Senior Data Engineer (Data Bricks)
Primary Skills
- ETL Fundamentals SQL SQL (Basic Advanced) Python Data Warehousing PLSQL T-SQL Stored Procedures
- Modern Data Platform Fundamentals Data Modelling Fundamentals Data Ware Housing
- Databricks
- Cloud
Specialization
- Databricks Engineering: Senior Data Engineer
Job requirements
- Role Overview:
- We are seeking a highly skilled Databricks Engineer to design develop and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks PySpark and SQL with experience in building scalable data solutions across cloud platforms.
- Key Responsibilities:
- Design and implement data pipelines and ETL processes using Databricks and PySpark.
- Develop and optimize SQL queries for data transformation and analytics.
- Collaborate with data architects analysts and business stakeholders to deliver high-quality data solutions.
- Ensure data quality governance and compliance across all processes.
- Integrate data from multiple sources and manage large-scale datasets efficiently.
- Troubleshoot and optimize performance for data workflows and queries.
- Primary Skills (Must-Have):
- Databricks (including Delta Lake and ML capabilities)
- PySpark for distributed data processing
- SQL for data manipulation and analytics
- Good-to-Have Skills:
- Azure Services: ADF Synapse Purview Fabric
- AWS Services: Glue Lambda Step Functions
- Workflow Orchestration: Airflow
- Data Transformation & Integration: DBT Fivetran Informatica
- Streaming & Messaging: Kafka
- BI & Visualization: Power BI
- Data Governance Tools: Collibra Alation
- GCP: BigQuery
- Qualifications:
- Bachelors or Masters degree in Computer Science Data Engineering or related field.
- Proven experience in building and managing data pipelines in cloud environments.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Nice to Have:
- Experience with multi-cloud environments (Azure AWS GCP).
- Familiarity with modern data stack and data governance frameworks.
- Promoting Women Professionals
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
Senior Data Engineer (Data Bricks)Primary SkillsETL Fundamentals SQL SQL (Basic Advanced) Python Data Warehousing PLSQL T-SQL Stored Procedures Modern Data Platform Fundamentals Data Modelling Fundamentals Data Ware HousingDatabricksCloudSpecializationDatabricks Engineering: Senior Data Engineer Jo...
Senior Data Engineer (Data Bricks)
Primary Skills
- ETL Fundamentals SQL SQL (Basic Advanced) Python Data Warehousing PLSQL T-SQL Stored Procedures
- Modern Data Platform Fundamentals Data Modelling Fundamentals Data Ware Housing
- Databricks
- Cloud
Specialization
- Databricks Engineering: Senior Data Engineer
Job requirements
- Role Overview:
- We are seeking a highly skilled Databricks Engineer to design develop and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks PySpark and SQL with experience in building scalable data solutions across cloud platforms.
- Key Responsibilities:
- Design and implement data pipelines and ETL processes using Databricks and PySpark.
- Develop and optimize SQL queries for data transformation and analytics.
- Collaborate with data architects analysts and business stakeholders to deliver high-quality data solutions.
- Ensure data quality governance and compliance across all processes.
- Integrate data from multiple sources and manage large-scale datasets efficiently.
- Troubleshoot and optimize performance for data workflows and queries.
- Primary Skills (Must-Have):
- Databricks (including Delta Lake and ML capabilities)
- PySpark for distributed data processing
- SQL for data manipulation and analytics
- Good-to-Have Skills:
- Azure Services: ADF Synapse Purview Fabric
- AWS Services: Glue Lambda Step Functions
- Workflow Orchestration: Airflow
- Data Transformation & Integration: DBT Fivetran Informatica
- Streaming & Messaging: Kafka
- BI & Visualization: Power BI
- Data Governance Tools: Collibra Alation
- GCP: BigQuery
- Qualifications:
- Bachelors or Masters degree in Computer Science Data Engineering or related field.
- Proven experience in building and managing data pipelines in cloud environments.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Nice to Have:
- Experience with multi-cloud environments (Azure AWS GCP).
- Familiarity with modern data stack and data governance frameworks.
- Promoting Women Professionals
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
View more
View less