Python Airflow
Python Airflow
Posted on :
05-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Lead Systems EngineerPrimary SkillsAirflowAutosysPythonGood to haveFinance domain expJD1. Design implement and maintain Airflow DAGs (Directed Acyclic Graphs) to automate ETL (Extract Transform Load) processes and other data workflows.2. Configure and manage task dependencies scheduling retries and error handling in Airflow.3. Integrate Apache Airflow with different data sources processing systems and storage solutions (e.g. databases cloud services data lakes). Responsibility 7 years of experience in managing workflow automation and job scheduling with at least 3 year focused on Apache Airflow.Strong background in Autosys (preferably 3 years) including job scheduling dependency management and error handling.Experience migrating jobs from Autosys to Airflow and automating complex workflows.Familiarity with Airflows components such as operators sensors and hooks.Strong knowledge of Python for writing Airflow tasks and custom operators. Experience working with cloud environments (AWS GCP Azure).Solid understanding of SQL databases and data engineering concepts.Familiarity with containerization technologies (Docker Kubernetes) is a plus.Experience with monitoring alerting and logging systems (e.g. Prometheus Grafana).
Employment Type
Full-Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
