Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job description:
This list is intended to reflect the current job but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so observing of course any legal obligations including any collective bargaining obligations.
Work closely with source data application teams and product owners to design implement and support analytics solutions that provide insights to make better decisions
Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage Azure Data Factory Azure Functions Event Hub Azure Stream Analytics Azure Databricks etc.) and traditional data warehouse tools
Perform multiple aspects involved in the development lifecycle design cloud engineering (Infrastructure network security and administration) ingestion preparation data modeling testing CICD pipelines performance tuning deployments consumption BI alerting prod support
Provide technical leadership and collaborate within a team environment as well as work independently
Be a part of a DevOps team that completely owns and supports their product
Implement batch and streaming data pipelines using cloud technologies
Leads development of coding standards best practices and privacy and security guidelines
Mentors others on technical and domain skills to create multi-functional teams
All youll need for success
Minimum Qualifications- Education & Prior Job Experience
1. Bachelors degree in Computer Science Computer Engineering Technology Information Systems (CIS/MIS) Engineering or related technical discipline or equivalent experience/training
2. 3 years software solution development using agile DevOps operating in a product model that includes designing developing and implementing large-scale applications or data engineering solutions
3. 3 years Data Engineering experience using SQL
4. 2 years of cloud development (prefer Microsoft Azure) including Azure EventHub Azure Data Factory Azure Databricks Azure DevOps Azure Blob Storage Azure Power Apps and Power BI.
5. Combination of Development Administration & Support experience in several of the following tools/platforms required:
a. Scripting: Python PySpark Unix SQL
b. Data Platforms: Teradata SQL Server
c. Azure Data Explorer. Administration skills are a plus
d. Azure Cloud Technologies: Azure Data Factory Azure Databricks Azure Blob Storage Azure Power Apps and Azure Functions
e. CI/CD: GitHub Azure DevOps Terraform
f. BI Analytics Tool Stack - Cognos Power BI
Preferred Qualifications- Education & Prior Job Experience
1. 5 years of software solution development using agile dev ops product model that includes designing developing and implementing large-scale applications or data engineering solutions.
2. 3 years of Data Analytics experience using SQL
3. 3 years full-stack development experience preferably in Azure
4. 3 years of cloud development (prefer Microsoft Azure) including Azure EventHub Azure Data Factory Azure Functions ADX ASA Azure Databricks Azure DevOps Azure Blob Storage Azure Power Apps and Power BI.
5. 1 years of FAST API experience is a plus
6. Airline Industry Experience
7. Skills Licenses & Certifications
8. Expertise with the Azure Technology stack for data management data ingestion capture processing curation and creating consumption layers.
9. Azure Development Track Certification (preferred)
10. Spark Certification (preferred)
Employment Type
Full-time
