DATA ENGINEER
Share
Job Location:
Overland, MO - USA
Monthly Salary:
Not Disclosed
Posted on:
17 hours ago
Vacancies:
1 Vacancy
Job Summary
Role: Data Engineer
Location: Overland Park KS(Onsite)
Can do Only W2 No C2C
Job Description:
We are looking for a skilled Data Engineer with strong experience in Azure Databricks and Snowflake. The candidate will be responsible for building and maintaining scalable data pipelines optimizing data processing and ensuring data quality and governance across enterprise platforms.
Key Responsibilities:
- Design develop and maintain large-scale data pipelines using Azure and Databricks.
- Work with Snowflake for data warehousing and data modeling.
- Develop and optimize PySpark and Spark-based data processing solutions.
- Ensure pipeline reliability through validation deduplication backfills and idempotency handling.
- Implement data governance PII handling data lineage and Unity Catalog standards.
- Perform performance tuning troubleshooting and optimization for Spark workloads.
- Collaborate with cross-functional teams to support scalable and secure data solutions.
- Monitor and improve data quality compliance and operational efficiency.
Required Skills:
- Strong experience with Azure services such as ADF and ADLS.
- Hands-on experience with Databricks PySpark and Spark optimization.
- Strong Snowflake experience including data modeling and warehousing.
- Excellent SQL coding and query optimization skills.
- Experience building scalable and governed enterprise data pipelines.
- Knowledge of data governance and pipeline monitoring.
