DATA ENGINEER
Share
Job Location:
Overland Park, KS - USA
Monthly Salary:
Not Disclosed
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Job Summary
Role: Data Engineer
Location: Overland Park KS(Onsite)
Can do Only W2 No C2C
Job Description:
Experience Required: 10 Years
- We are looking for a skilled Data Engineer with strong experience in Azure Databricks and Snowflake.
- The candidate will be responsible for building and maintaining scalable data pipelines optimizing data processing and ensuring data quality and governance across enterprise platforms.
Key Responsibilities:
- Design develop and maintain large-scale data pipelines using Azure and Databricks.
- Work with Snowflake for data warehousing and data modeling.
- Develop and optimize PySpark and Spark-based data processing solutions.
- Ensure pipeline reliability through validation deduplication backfills and idempotency handling.
- Implement data governance PII handling data lineage and Unity Catalog standards.
- Perform performance tuning troubleshooting and optimization for Spark workloads.
- Collaborate with cross-functional teams to support scalable and secure data solutions.
- Monitor and improve data quality compliance and operational efficiency.
Required Skills:
- Strong experience with Azure services such as ADF and ADLS.
- Hands-on experience with Databricks PySpark and Spark optimization.
- Strong Snowflake experience including data modeling and warehousing.
- Excellent SQL coding and query optimization skills.
- Experience building scalable and governed enterprise data pipelines.
- Knowledge of data governance and pipeline monitoring.
Best Regards:
