Data Platform Eng4yrs+Kol
Job Location:
Monthly Salary:
Posted on:
10 hours ago
Posted on:
Vacancies:
1 Vacancy
Vacancies:
Job Summary
Data Platform Engineer (Pipeline) 4 8 years AWS Snowflake Python Airflow
Responsibilities
Build and maintain ELT pipelines on Snowflake and AWS (S3 Lambda Glue) following a medallion lakehouse architecture (Bronze Silver Gold)
Write and manage Apache Airflow DAGs on AWS MWAA for ingestion workflows covering SFTP/FTP S3 database and API-based sources
Work within a Spec-Driven Development (SDD) approach - translating data requirements and mapping documents into pipeline specs with AI-assisted tooling
Monitor pipeline health respond to incidents on rotation and document findings clearly
Follow GitLab CI/CD and Terraform standards for code deployment and infrastructure changes
Skills
Solid Python skills: data pipelines scripting and basic Lambda handlers
Hands-on Snowflake: Streams Tasks Stored Procedures and query writing
Working knowledge of AWS: S3 Lambda Glue MWAA and IAM basics
Good SQL: comfortable with complex queries and transformation logic
Familiarity with Terraform and GitLab CI/CD workflows
Exposure to dbt or similar tools is a plus
Willingness to work with AI-assisted development tools like Cursor AI
Responsibilities
Build and maintain ELT pipelines on Snowflake and AWS (S3 Lambda Glue) following a medallion lakehouse architecture (Bronze Silver Gold)
Write and manage Apache Airflow DAGs on AWS MWAA for ingestion workflows covering SFTP/FTP S3 database and API-based sources
Work within a Spec-Driven Development (SDD) approach - translating data requirements and mapping documents into pipeline specs with AI-assisted tooling
Monitor pipeline health respond to incidents on rotation and document findings clearly
Follow GitLab CI/CD and Terraform standards for code deployment and infrastructure changes
Skills
Solid Python skills: data pipelines scripting and basic Lambda handlers
Hands-on Snowflake: Streams Tasks Stored Procedures and query writing
Working knowledge of AWS: S3 Lambda Glue MWAA and IAM basics
Good SQL: comfortable with complex queries and transformation logic
Familiarity with Terraform and GitLab CI/CD workflows
Exposure to dbt or similar tools is a plus
Willingness to work with AI-assisted development tools like Cursor AI
