Senior Data Engineer/ETL Engineer
Xpect Solutions
Full-time
On-site
Huntsville, Alabama, United States
Company Overview:
XPECT Solutions, Inc. has built a strong reputation by supporting our clients in meeting their strategic goals and mission objectives. We provide high quality resources for a wide range of IT and security solutions at best-value pricing. Our success is built on a solid foundation of well-vetted, highly technical personnel, a disciplined project management approach, and an overarching commitment to customer service. We develop, test, deploy, and support exceptional solutions that enhance system functionality, while maximizing reliability and availability, and ensure the tightest security.
Position Overview:
Xpect Solutions is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills and career. Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.
Core Responsibilities
Requirements:
Preferred Qualifications:
Xpect Solutions, Inc. is a one-of-a-kind employer with a talented team that is cleared at various levels and is certified in dozens of industry-recognized certifications. Our talented staff are the key to our success. They bring the knowledge, experience and technical skills to deliver the best solutions to our customers.
We support our team by providing open communication, win-win partnerships with clients and vendors, a team-oriented culture that supports employee diversity, and a focus on professional development and growth for a long-lasting and happy career.
We offer a benefits package that is designed to keep our most important assets – our employees – healthy, happy, energized and moving forward. Our philosophy is simple – empower our employees with the benefits, resources and the financial incentives they need to be successful.
Below is an overview of our amazing benefits and perks:
XPECT Solutions, Inc. has built a strong reputation by supporting our clients in meeting their strategic goals and mission objectives. We provide high quality resources for a wide range of IT and security solutions at best-value pricing. Our success is built on a solid foundation of well-vetted, highly technical personnel, a disciplined project management approach, and an overarching commitment to customer service. We develop, test, deploy, and support exceptional solutions that enhance system functionality, while maximizing reliability and availability, and ensure the tightest security.
Position Overview:
Xpect Solutions is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills and career. Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.
Core Responsibilities
- Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.
- Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
- Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.
- Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
- Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.
Requirements:
-
Active Top-Secret Clearance with the ability to obtain an SCI
- A Counter Intelligence Polygraph is required after start.
- Bachelor’s degree in Engineering, Computer Science, or other related analytical, scientific, or technical discipline.
- At least 6 years experience with ETL.
- Database ETL engineers should have experience with Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments.
- Strong proficiency in programming languages such as Scala, or Java.
- Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
- In-depth knowledge of ETL best practices, data integration techniques, and data quality management.
- Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.
- MUST have strong UNIX/LINUX experience
Preferred Qualifications:
- Understanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.
- Experience using software repository tools such as GIT or SVN.
Benefits
Company Culture and Benefits:Xpect Solutions, Inc. is a one-of-a-kind employer with a talented team that is cleared at various levels and is certified in dozens of industry-recognized certifications. Our talented staff are the key to our success. They bring the knowledge, experience and technical skills to deliver the best solutions to our customers.
We support our team by providing open communication, win-win partnerships with clients and vendors, a team-oriented culture that supports employee diversity, and a focus on professional development and growth for a long-lasting and happy career.
We offer a benefits package that is designed to keep our most important assets – our employees – healthy, happy, energized and moving forward. Our philosophy is simple – empower our employees with the benefits, resources and the financial incentives they need to be successful.
Below is an overview of our amazing benefits and perks:
- A competitive Medical, Dental, and Vision plan.
- Retirement Savings Plan (with company match)
- Life Insurance
- AD&D Insurance
- Short Term and Long Term Disability Insurance
- 3 weeks of annual PTO
- 11 days of Holiday PTO
- Performance Awards
- Referral Bonus Plan (of up to $2,500/year)
- Education Reimbursement/Training (of up to $2,500/year)