Lead Data Engineer
Share
Job Location:
Chicago, IL - USA
Monthly Salary:
Not Disclosed
Posted on:
10 hours ago
Vacancies:
1 Vacancy
Job Summary
Role: Lead Data Engineer
Location: Chicago IL (Locals Only)
Experience: 12 Years
Job Type: Contract/W2
Duration: Long Term
Interview: Video Final In-Person Interview
What We Do NOT Want:
- Candidates without real-time Data Vault implementation experience
- Profiles with only support/maintenance work and no hands-on development
- No strong experience in Snowflake SQL Python/PySpark
- No experience with Kafka/EventHub streaming
- Candidates lacking Azure data platform experience (ADF ADLS Databricks)
- No experience in query optimization/performance tuning
- Only theoretical knowledge of DBT Snowpipe Tasks/Triggers
- Non-local candidates or candidates unwilling to attend in-person final interview in Chicago
- Less hands-on coding more managerial/coordination profiles
- Candidates without CI/CD automation exposure
- Weak understanding of Snowflake architecture concepts (Virtual Warehouse vs Serverless Compute)
Required Skills:
- Strong experience with:
- Snowflake / Snowpipe
- SQL
- Python / PySpark
- Hands-on experience in:
- Data Engineering
- Data Modeling techniques
- Data Vault implementation (real project experience required)
- Experience with:
- Kafka streaming
- Azure Event Hub
- Streaming data pipelines
- Strong Azure stack knowledge:
- ADLS
- ADF
- Databricks
- CI/CD automation
- Knowledge of:
- Snowflake Triggers & Tasks
- Virtual Warehouse vs Serverless Compute
- Query Optimization
- DBT and its advantages over other tools
Responsibilities:
- Lead development of Azure-based data platforms
- Build and optimize scalable data pipelines
- Work on real-time/streaming data solutions
- Improve performance and query efficiency
