As an Egen Cloud Data Engineer, you will be responsible for building and implementing distributed data pipelines and workflows to enable the processing of huge data sets, solving ingestion and data modeling challenges at scale, and continuously improving data processing turnaround and usability.
The ideal candidate is very resourceful and has strong production experience working with Python, complex SQL procedures, relational databases, distributed data warehouses, data mapping, data transformations, and data integration.
Must be knowledgeable of infrastructure disciplines, including network design, system administration, storage management, security policy implementation, virtualization, and process automation.
This position requires a candidate local to the Dallas, TX area with a strong personal presence, in a client facing environment.
RESPONSIBILITIES:
-Work directly with client technical and business teams
-Provide both consultative and hands-on technical guidance and support
-Use GCP services to deploy highly available, scalable, and secure pipelines and applications
-Implement workflows to automate the release and upgrade process for applications in Development, Test and
production environments.
-Implement secure integrations using Google security and networking technologies (IAP, VPC, and PSC). Administration and engineering of IAM user Role-Based Access Controls and processes
-Create and update support documentation and standards
-Develop automated methodologies for deployment activities, configuration management, supporting systems and business processes.
-Investigate and contribute to solving various issues in production environments.
NTTA- Cloud Data Engineer
- Required Experience:
- 4+ years GCP with focus on BQ and including networking and access control/security management
- 4+ years in software development, preferably with Python
- 4+ SQL and complex stored procedures
- Experience with CI/CD Pipelines and Workflows
- Azure Devops/GIT
- Good understanding of ETL/ELT principals
- LAMDA and Shell Scripting and Cloud Functions
- Excellent debugging and testing skills
- Qlik Change Data Capture
- Windows operating system and scripting
- VPN and Partner Interconnect
**Must be commutable to the Dallas, TX area**