Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
$ 132000 - 165000
1 Vacancy
Job Description
Position Summary
The Lead Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst Data Analyst IT Teams and key stake holders. This role will lead projects and coach junior staff on build and optimize data pipelines integrating data from various sources ETL (Extract Transform Load) processes and ensuring data quality and consistency. The Lead will ensure that our data engineering practices are aligned with the latest technologies and industry best practices focusing on performance reliability and efficiency. This person will need to be in Chicago and go into the corporate office 2 days per week.What will your job entail
Job Responsibilities:
Provide technical leadership in data architecture and engineering collaborating with solution stakeholders to align data solutions with business objectives.
Mentor less experienced data engineers and team members fostering a collaborative and innovative work environment.
Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure.
Manage and enhance complex SSIS packages for data integration and ETL processes along with SSRS reports for business intelligence.
Design build and maintain scalable and efficient data pipelines using Azure Data Factory implementing both batch and realtime data integration processes.
Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments.
Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage optimizing for query performance and costefficiency.
Integrate and configure Profisee Master Data Management tools within Azure focusing on data governance and quality.
Set up and manage Change Data Capture processes for realtime data synchronization in Azure data platforms.
Implement data cataloging classification and lineage using Azure Purview developing data governance policies and ensuring compliance.
Enhance and support Tableau reporting solutions developing complex dashboards and integrating with Azure data services.
Drive automation and process optimization using Azure services and scripting and implement CI/CD pipelines using Azure DevOps.
Lead SQL Server database optimization and performance tuning efforts.
Lead Coach and Mentor junior staff on projects.
Work Experience and Education:
Bachelors degree required Masters degree preferred; Computer science Information Technology or Engineering is preferred. Any other related discipline or commensurate work experience considered.
12 years of experience in Data Engineering with a Bachelors degree or 8 years of experience with a Masters degree is preferred.
Subject Matter Expert in SQL Server Management Azure Data Factory Development Databricks Engineering Delta Parquet File Management and SQL Server Integration Services.
Proficiency in Profisee MDM Integration Change Data Capture implementation and data quality and governance with Azure Purview.
Proven experience in Tableau and BI Reporting and strong skills in Automation and Process
Licenses & Certifications:
Advanced Data Analytics Certifications (ADAC) SAS Statistical Business Analyst Professional Certification (SBAPC) or Cloudera Certified Professional (CCP) Data Engineer a plus.
Skills:
Technical/Functional Skills:
Big Data Analytics
Leadership
Data Governance
Data Modeling
Data Processing
Data Warehousing
Database Management
Knowledge of ETL processes
Machine Learning
Predictive Analysis
Programming Languages
Behavioral Skills:
Critical Thinker
Communication
Relationship Building
Effective Communication
Time Management
Problem Solving
Attention to Detail
Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race creed color religious beliefs physical or mental capabilities gender identity or expressionsexual orientation and many other characteristics bring together varied perspectives and add value to the service we provide our clients trading partnersand policy extends to all aspects of our employment practices including but not limited to recruiting hiring discipline firing promoting transferring compensation benefits training leaves of absence and other terms conditions and benefits of employment.
How We Support Our Teammates
Ryan Specialty seeks to offer our employees a comprehensive and bestinclass benefits package that helps them and their family members achieve their physical financial and emotional wellbeing goals. In addition to paid time off for company holidays vacation sick and personal days Ryan offers paid parental leave mental health services and more.
The target salary range for this position is $132000.00 $165000.00 annually.The wage range for this role considers many factors such as training transferable skills work experience licensure and certification business needs and market demands. The pay range is subject to change and may be modified in the future. Fulltime roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards visit our website provide individuals with disabilities reasonable accommodations to participate in the job application or interview process to perform essential job functions and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at
The above is intended to describe this jobs general requirements. It is not to be construed as an exhaustive statement of duties responsibilities or physical requirements. Nothing in this job description restricts managements right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Employment Type
Full-Time
