Senior Data Engineer
Senior Data Engineer
Posted on :
06-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Role Overview
We are looking for a Senior Data Engineer who will play a key role in designing building and maintaining data ingestion frameworks and scalable data pipelines. The ideal candidate should have strong expertise in platform architecture data modeling and cloudbased data solutions to support realtime and batch processing needs.
What youll be doing:
- Design develop and optimiseDBT modelsto support scalable data transformations.
- Architect and implementmodern ELT pipelinesusingDBTand orchestration tools likeApache Airflow and Prefect.
- Leadperformance tuning and query optimizationfor DBT models running onSnowflake Redshift or Databricks
- IntegrateDBT workflows & pipelineswithAWS services(S3 Lambda Step Functions RDS Glue) and eventdriven architectures
- Implement robust data ingestion processes from multiple sources including manufacturing systems (MES) Manufacturing stations and web applications.
- Manage and monitororchestration tools(Airflow Prefect) for automated DBT model .
- ImplementCI/CD best practicesfor DBT ensuringversion control automated testing and deployment workflows.
- Troubleshootdata pipeline issuesand provide solutions for optimizingcost and performance.
What youll have:
- 5 years of handson experience with DBT includingmodel design testing and performance tuning.
- 5 years of Strong SQL expertise with experience inanalytical query optimizationanddatabase performance tuning.
- 5 years of programming experience especially inbuilding custom DBT macros scripts APIs working with AWS services using boto3.
- 3 years of Experience withorchestration toolslikeApache Airflow Prefectfor scheduling DBT jobs.
- Handson experience inmodern cloud data platformslikeSnowflake Redshift Databricks or Big Query
- Experience withAWS data services(S3 Lambda Step Functions RDS SQS CloudWatch).
- Familiarity with serverless architectures and infrastructure as code (CloudFormation/Terraform).
- Ability to effectively communicate timelines and deliver MVPs set for the sprint.
- Strong analytical and problemsolving skills with the ability to work across crossfunctional teams.
Nice to haves:
- Experience in hardware manufacturing data processing.
- Contributions to opensource data engineering tools.
- Knowledge of Tableau or other BI tools for data visualization.
- Understanding of frontend development (React JavaScript or similar) to collaborate effectively with UI teams or build internal tools for data visualization
Required Experience:
Senior IC
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
