- Develop and maintain scalable data pipelines using Python and PySpark.
- Work extensively with MS SQL to design optimize and manage database structures and queries.
- Build and deploy solutions in Azure and Databricks environments.
- Perform data transformations cleaning validation and performance tuning.
- Collaborate with Data Engineers Cloud Architects and Business Teams to deliver data solutions.
- Ensure code quality through best practices reviews testing and documentation.
- Troubleshoot complex data issues and optimize workflows for performance and reliability.
- Assist in guiding or mentoring junior developers when required
Requirements
- Minimum 5 years of total IT experience.
- Minimum 4 years of hands-on experience Python (Advanced / Hardcore development) PySpark MS SQL (queries stored procedures optimization) Azure cloud Databricks
- Strong understanding of relational databases and data engineering concepts.
- Experience building end-to-end data pipelines and working with large datasets.
- Ability to write clean efficient and scalable code.
Required Skills:
Minimum 5 years of total IT experience. Minimum 4 years of hands-on experience Python (Advanced / Hardcore development) PySpark MS SQL (queries stored procedures optimization) Azure cloud Databricks Strong understanding of relational databases and data engineering concepts. Experience building end-to-end data pipelines and working with large datasets. Ability to write clean efficient and scalable code.
Develop and maintain scalable data pipelines using Python and PySpark.Work extensively with MS SQL to design optimize and manage database structures and queries.Build and deploy solutions in Azure and Databricks environments.Perform data transformations cleaning validation and performance tuning.Col...
- Develop and maintain scalable data pipelines using Python and PySpark.
- Work extensively with MS SQL to design optimize and manage database structures and queries.
- Build and deploy solutions in Azure and Databricks environments.
- Perform data transformations cleaning validation and performance tuning.
- Collaborate with Data Engineers Cloud Architects and Business Teams to deliver data solutions.
- Ensure code quality through best practices reviews testing and documentation.
- Troubleshoot complex data issues and optimize workflows for performance and reliability.
- Assist in guiding or mentoring junior developers when required
Requirements
- Minimum 5 years of total IT experience.
- Minimum 4 years of hands-on experience Python (Advanced / Hardcore development) PySpark MS SQL (queries stored procedures optimization) Azure cloud Databricks
- Strong understanding of relational databases and data engineering concepts.
- Experience building end-to-end data pipelines and working with large datasets.
- Ability to write clean efficient and scalable code.
Required Skills:
Minimum 5 years of total IT experience. Minimum 4 years of hands-on experience Python (Advanced / Hardcore development) PySpark MS SQL (queries stored procedures optimization) Azure cloud Databricks Strong understanding of relational databases and data engineering concepts. Experience building end-to-end data pipelines and working with large datasets. Ability to write clean efficient and scalable code.
View more
View less