Data Engineer
Share
Job Location:
Chicago, IL - USA
Monthly Salary:
Not Disclosed
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Job Title: Data Engineer
Primary Location: Hybrid in Chicagos Northwest Suburbs- 2 Days In-Office 3 Days WFH
Position Type: Direct Hire
Overview
TalentFish is casting a line for a Data Engineer! This is a new Direct Hire role in the Northwest Suburbs of Chicago.
The Data Engineer will be responsible for designing developing and maintaining scalable data pipelines and integrations that support data analytics and business intelligence across the organization. This role is essential to ensuring high-quality data delivery optimizing performance and enabling effective decision-making through reliable data solutions.
What You Bring to the Role (Ideal Experience)
- Bachelors degree in Computer Science Information Technology or a related field (or equivalent work experience).
- 5 years of experience as a Data Engineer.
- 3 years of experience with the following:
- Building and supporting data lakehouse architectures using Delta Lake and change data feeds.
- Working with PySpark and Python with strong Object-Oriented Programming (OOP) experience to extend existing frameworks.
- Designing data warehouse table architecture such as star schema or Kimball method.
- Writing and maintaining versioned Python wheel packages to manage dependencies and distribute code.
- Creating and managing CI/CD pipelines especially using Azure DevOps for Microsoft Fabric-related assets.
- Experience establishing scalable and maintainable data integrations and pipelines in Databricks environments.
Nice to Haves
- Hands-on experience implementing data solutions using Microsoft Fabric.
- Experience with machine learning/ML and data science tools.
- Knowledge of data governance and security best practices.
- Experience in a larger IT environment with 3000 users and multiple domains.
- Current industry certifications from Microsoft cloud/data platforms or equivalent certifications. One or more of the following is preferred:
- Microsoft Certified: Fabric Data Engineer Associate
- Microsoft Certified: Azure Data Scientist Associate
- Microsoft Certified: Azure Data Fundamentals
- Google Professional Data Engineer
- Certified Data Management Professional (CDMP)
- IBM Certified Data Architect Big Data
What Youll Do (Skills Used in this Position)
- Design and develop scalable data pipelines to collect process and store large volumes of structured and unstructured data.
- Extend and enhance existing OOP-based frameworks developed in Python and PySpark.
- Partner with data scientists and analysts to define requirements and design robust data analytics solutions.
- Ensure data quality and integrity through data cleansing validation and automated testing procedures.
- Develop and maintain technical documentation including requirements design specifications and test plans.
- Implement and manage data integrations from multiple internal and external sources.
- Optimize data workflows to improve performance reliability and reduce cloud consumption.
- Monitor troubleshoot and resolve data pipeline issues to ensure consistent data delivery.
- Establish and manage CI/CD pipelines and release processes particularly using Azure DevOps for Microsoft Fabric.
- Provide technical leadership and coordination for global development and support teams.
- Participate in creating a safe and healthy workplace by adhering to organizational safety protocols.
- Support additional projects and initiatives as assigned by management.
Compensation Information
The expected salary range for this position is $110000 - $147000 per year depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance 401(k) and paid time off. TalentFish is committed to pay transparency and equal opportunity. The salary range provided is in compliance with applicable state and federal regulations.
This role requires authorization to work in the U.S. without current or future visa sponsorship.
All offers are contingent upon the completion of a background check which may include but is not limited to reference checks education verification employment verification drug testing criminal records checks and any required certifications or compliance requirements based on the end clients background check policies and applicable laws.
TalentFish is an employee-owned company pioneering a new realm in talent acquisition. We are redefining IT staffing by evolving AI video screening and our unique platform. TalentFish focuses on providing the best employee consultant and client experience possible.
At TalentFish we are an Equal Opportunity Employer; we embrace and encourage diversity!
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
