Apache Airflow Technical SME

Jacksonville, FL - USA

Monthly Salary: Not Disclosed

Posted on: 6 hours ago

Vacancies: 1 Vacancy

Job Summary

For over 16 years Trilyon has been a leader in global workforce solutions specializing in Cloud Technology AI/ML Software Development Technical Writing and Digital Transformation. We partner with top companies to deliver high-quality talent in engineering IT and emerging technologies. For additional information or to view all of our job opportunities please visit our website

We are seeking a Apache Airflow Technical SME to join our team. This role will involve owning and delivering high-quality workflow orchestration data pipeline development and platform support using Airflow in a cloud environment. The ideal candidate will have experience in Python SQL workflow orchestration (Airflow) ETL/ELT cloud services CI/CD containerization/orchestration (Docker Kubernetes) and a passion for data engineering and automation.

Job Title: Apache Airflow Technical SME
Location: Raleigh NC / Phoenix AZ (On-site)
Duration: 6 months (contract)
Rate/Salary: Enter Pay Rate/Salary Range

Job Description:

Design develop and maintain complex modular reusable DAGs in Airflow to orchestrate data pipelines.
Provide technical SME-level support for Airflow architecture including schedulers executors (Celery/Kubernetes) and plugin development.
Integrate Airflow pipelines with cloud services (e.g. Azure Data Factory Databricks storage etc.) and manage end-to-end ETL/ELT workflows.
Build and maintain CI/CD pipelines for Airflow DAG deployment version control (e.g. via Git) testing and release automation.
Monitor log and alert Airflow jobs - handle incident response and troubleshooting for production issues.
Optimize performance of Airflow environments: identify bottlenecks and implement best practices for orchestration and scheduling.
Use containerization and orchestration (Docker Kubernetes) to deploy and manage Airflow instances in cloud environments.
Write and maintain documentation for Airflow configuration deployment procedures operational processes and share knowledge with team members.
Support and mentor other engineers on best practices tooling and architectural decisions related to Airflow and data pipelines.

Why Join Us
Trilyon Inc. offers a comprehensive benefits package.
Opportunities for growth and professional development.
Collaborative and inclusive company culture.

Equal Employment Opportunity (EEO) Statement:
Trilyon Inc. is an Equal Opportunity Employer committed to diversity equity and inclusion. We do not discriminate based on race color religion gender gender identity sexual orientation national origin age disability veteran status or any other protected status under applicable laws. Our diverse team drives innovation competitiveness and creativity enhancing our ability to effectively serve our clients and communities. This commitment to diversity makes us stronger and more adaptable.