Data Engineer III
Data Engineer III
Employer Active
Job Alert
You will be updated with latest job alerts via email
Job Alert
You will be updated with latest job alerts via email
Job Description
Overview
As Manager of IT Data Services you will have responsibility and oversight for the design analysis development and operations of data pipelines and Data Warehouses that support Business Intelligence and Data Science (AI/ML) initiatives. This includes modeling building and populating Modern MPP Warehouse & Lakehouse architectures to resolve complex business problems.
Responsibilities
- Partner with the business document requirements and advise solutions from a data and architecture perspective.
- Define and lead the data lifecycle strategy across data acquisition data ingestion data cleansing normalization and linkage.
- Assess business rules; perform source to target data mapping; design review implement and optimize ETL processes.
- Provide data analysis and identify data-related issues within the Data Warehouse environment as well as source systems as needed.
- Create optimize and maintain logical and physical dimensional data models.
- Work in a fast-paced agile development environment.
- Participate in peer code reviews.
Qualifications
Skills and Key Competencies:
- 7 years of hands-on experience designing and implementing large-scale data warehouse solutions and complex data models.
- 3 years of experience in designing developing and tuning modern Azure data warehouses including in-depth knowledge. of slowly changing dimensions and advanced performance tuning techniques.
- 3 years of hands-on experience designing and implementing large-scale data pipelines including Change Data.
- Capture (CDC) solutions for structured semi-structured and unstructured data in batch and real-time environments.
- Strong knowledge of cloud native data platform architectures data engineering and data management.
- Experience with Data lake technologies including ADLS Gen. 2
- 2 years of experience with Azure Data Factory and PowerBI.
- 5 years of hands-on experience with TSQL Python and Pyspark (Spark SQL)
- Broad experience in Microsoft SQL technologies SSIS SSRS etc.
- Experience using Azure DevOps and CI/CD.
- Ability to work in a fast-paced collaborative team environment.
- Excellent written and verbal communication skills and ability to express ideas clearly and concisely.
Education and Experience
- Proven enterprise experience implementing and supporting large-scale data warehouse and data pipelines.
- Bachelors degree in information technology computer science or related field.
- Industry certifications are a plus in addition to work experience e.g. Certified Azure Data Engineer.
- 8 years of relevant experience with data pipelines data warehouses and business intelligence
- Experience working with methodologies and techniques such as Agile Scrum and Kanban.
What We Offer
AmTrust Financial Services offers a competitive compensation package and excellent career advancement opportunities. Our benefits include: Medical & Dental Plans Life Insurance including eligible spouses & children Health Care Flexible Spending Dependent Care 401k Savings Plans Paid Time Off.
AmTrust strives to create a diverse and inclusive culture where thoughts and ideas of all employees are appreciated and respected. This concept encompasses but is not limited to human differences with regard to race ethnicity gender sexual orientation culture religion or disabilities.
AmTrust values excellence and recognizes that by embracing the diverse backgrounds skills and perspectives of its workforce it will sustain a competitive advantage and remain an employer of choice. Diversity is a business imperative enabling us to attract retain and develop the best talent available. We see diversity as more than just policies and practices. It is an integral part of who we are as a company how we operate and how we see our future.
Employment Type
Full-Time