Data Engineer

Job Title: Data Engineer
Location: Downtown Chicago IL - Willis Tower
Duration: 10 Months
Work Arrangement: Onsite - 3 to 4 days per week
Interview Process: 2 Rounds (Video Interview followed by In-Person Interview)
C2C: Not preferred by the client manager

• Design develop and support large-scale data pipelines in distributed and scalable environments.
• Enable and optimize AWS production environments for data infrastructure and frameworks.
• Develop reusable Terraform modules to automate infrastructure deployments.
• Work with Databricks and data lake technologies.
• Design and develop batch and streaming data applications using AWS technologies.
• Collaborate with development teams business stakeholders and department leaders to deliver innovative technical solutions.
• Provide technical leadership architectural guidance and troubleshooting support to the team.
• Perform root cause analysis and resolve complex data and infrastructure issues.
• Coordinate cross-functional projects involving internal teams vendors and external partners.
• Manage multiple deliverables while adapting to changing business priorities.
• Collaborate with project managers product owners and development leads to support Agile development and delivery.

• Bachelors degree in Statistics Software Engineering Business Analytics Information Systems Aviation Management or a related field.
• Minimum 5 years of experience in Data Engineering or ETL Development.
• Strong experience with AWS cloud services including:
  • Amazon Redshift
  • Amazon S3
  • Amazon Athena
  • AWS Glue
  • AWS Lambda
• Strong hands-on experience with Python Bash scripting and PySpark.
• Experience with Terraform and infrastructure automation.
• Strong understanding of DevOps practices and CI/CD pipelines.
• Experience with SQL and database tools such as:
  • SQL Server
  • SSMS
  • Oracle SQL Developer
  • BigQuery
• Knowledge of Apache Airflow and Databricks.
• Experience working with structured semi-structured and unstructured datasets.
• Strong analytical troubleshooting and problem-solving skills.
• Experience performing root cause analysis on data and business processes.
• Ability to develop data models and data-driven solutions.
• Excellent communication presentation and stakeholder management skills.
• Proficiency in Microsoft Excel and PowerPoint.
• Ability to work under pressure and manage multiple priorities.
• Fluent in written and spoken English.
  
  Preferred Qualifications
• Masters degree in a relevant field.
• AWS Certification.
• Experience with Blue-Green deployments.
• Knowledge of Kubernetes and Ansible Playbooks.
• Experience with Quantum Metric and Akamai.
• Programming experience in Python and R.
• Strong experience with Continuous Integration and Continuous Delivery (CI/CD).
• Experience working in Agile development environments.
• Data Engineering experience in the airline or transportation industry.
• Interview Process
• Round 1: Video Interview
• Round 2: In-Person Interview
• Important Work Location Requirement

  This is an onsite position in Downtown Chicago at Willis Tower.

  Candidates are expected to work onsite 3-4 days per week. Candidates must be comfortable with the hybrid onsite schedule and attending in-person interviews in Chicago.

Required Skills:

AwSPythonDevOpsTerraformCICD