DataOps Cloud Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Our Client is currently hiring a Senior DataOps / Cloud Data Engineer for a long term public sector engagement
The ideal candidate will have strong experience building cloud based data pipelines modern lakehouse architectures ETL frameworks and enterprise scale data transformation solutions.
Key Responsibilities
Design develop test implement and troubleshoot enterprise data pipelines
Build scalable ETL/ELT workflows using cloud native technologies
Develop complex data transformation logic and orchestration processes
Design data warehouse and lakehouse models for analytics and reporting
Work with structured and unstructured datasets across cloud environments
Support full SDLC including requirements gathering deployment testing and production support
Collaborate with cross functional teams in agile delivery environments
Required Technical Skills
Python SQL Linux Shell PowerShell
pandas and PySpark
AWS Glue Lambda Step Functions S3
Databricks and Delta Lake
Azure Data Factory
Informatica IDMC
AWS and/or Azure cloud services
Redshift and cloud data warehouse solutions
Relational and dimensional data modeling
Data warehouse and lakehouse architecture
Additional Skills
Agile/Scrum and Waterfall delivery experience
Change and Incident Management
Strong communication and stakeholder management skills
Consulting analytical and problem solving capabilities
Must Have Experience
Data engineering using pandas and PySpark
Databricks and Delta Lake
AWS Services: Glue Lambda Step Functions S3
Informatica IDMC
Handling XLSX CSV JSON relational databases cloud storage
Building ETL pipelines and orchestration workflows
