Solution Architect (Astronomer Airflow Architect)
Solution Architect (Astronomer Airflow Architect)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Hiring: Sr. Solution Architect (Astronomer Airflow Architect)
Location: Iselin NJ (USA) / Mississauga Canada
The Role:
Sr. Solution Architect specializing in Cloud Orchestration to join our team. The successful candidate will work with a small group of technologists and serve as a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform.
In this role you will:
-
Engineer a wide range of use cases with Apache Airflow at the core of the solution.
-
Guide technologists in their Airflow journey including identifying new use cases and onboarding new domain teams.
-
Review optimize and tune data ingestion/extraction pipelines orchestrated by Airflow.
-
Develop frameworks to manage and scale large numbers of pipelines across the domain.
-
Build architecture data flow and operational diagrams and documentation (physical and logical layers).
-
Provide reference implementations (e.g. building Airflow pipelines implementing features integrations with third-party tools).
-
Stay updated on Astronomer and Airflow features to advise on impactful improvements.
-
Collaborate to build reusable assets automation tools and documented best practices.
-
Partner with domain and engineering teams to provide feedback and refine requirements.
-
Ensure technology teams realize value in their Airflow and Astronomer adoption.
-
Strong experience with Apache Airflow in production environments.
-
Proven ability in designing and implementing ETL Data Warehousing and ML/AI use cases.
-
Proficiency in Python.
-
Knowledge of Azure cloud-native data architecture.
-
Demonstrated technical leadership in team projects.
-
Strong oral and written communication skills.
-
Willingness to learn new technologies and provide reference implementations.
-
Experience migrating workflows from legacy schedulers (Tidal) to Airflow.
-
Integration experience with Azure Data Factory pipelines.
-
Snowflake and Databricks.
-
Containers and Kubernetes (on-prem or cloud).
-
Strong SQL expertise.
-
Enterprise data experience in regulated environments.
Employment Type
Full-time
