Job Title: GCP Lead Data Engineer
Location: Atlanta GA
Duration: / Term: 08 months
Job Description:
Experience Desired: 10 Years.
Key required skills
- Design architect and implement scalable and secure data pipelines on GCP utilizing services like Dataflow Pub/Sub and Cloud Storage.
- Develop and maintain data models ensuring data quality consistency and accessibility for various internal stakeholders.
- Automate data processes and workflows using scripting languages like Python leveraging technologies like Spark and Airflow.
- Monitor and troubleshoot data pipelines identifying and resolving performance issues
- proactively.
- Stay up to date with the latest trends and advancements in GCP and related technologies actively proposing and evaluating new solutions.
- Implement data governance best practices including data security access control and lineage tracking.
- Lead security initiatives design and implement security architecture.
- Lead data quality initiatives design and implement monitoring dashboards.
- Mentor and guide junior data engineers sharing knowledge and best practices to foster a high-performing team.
- Role requires a solid educational foundation and the ability to develop a strategic vision and roadmap for D&As transition to the cloud while balancing delivery of near-term results that are aligned with execution.
What experience you need
- 8 years of experience as a data engineer or related role with experience demonstrating leadership capabilities
- Cloud certification strongly preferred
- Expert level skills using programming languages such as Python or SQL and advanced level experience with scripting languages.
- Demonstrated proficiency in all Google Cloud Services
- Experience building and maintaining complex data pipelines troubleshooting complex issues transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects; Proficiency in Airflow strongly desired
- Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance
- Experience leading a team with Git expertise strongly preferred
Key Skills:
GCP Python SQL Dataflow Spark Airflow.