D

AWS– Spark –Python Data Engineer

Digital Alpha Technologies
Full-time
On-site
Virginia, Virginia, United States
Digital Alpha is looking for passionate data engineers to join our team. As an experienced member we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge, attention to detail and expertise to all aspects of the software development lifecycle.  We embrace a culture of experimentation and constantly strive for improvement and learning. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.

Requirements

  • Strong hands on experience building data pipelines using Apache Spark in AWS.
  • Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
  • Proficient in python programming language.
  • Proficient in PySpark.
  • Knowledge of application development lifecycles, & continuous integration/deployment practices
  • Experience with development on AWS and cloud native applications
  • Kafka and event driven architectures exposure is a plus
  • Experience with Developing Data Platforms on AWS
  • Proficient in Agile Software Development methodology, processes, and practices.

 

Qualifications:

- Bachelor’s degree in related field

- Strong, analytical, focused, self-driven with excellent problem-solving skills

- Minimum 2+ years of hands on in-depth experience of AWS Data Pipelines development and implementation is required

- AWS Architect Associate or Professional level certifications is a plus