Airflow Data Engineer
Airflow Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
$ 85000 - 150000
1 Vacancy
Job Description
You Lead the Way. Weve Got Your Back.
With the right backing people and businesses have the power to progress in incredible ways. When you join Team Amex you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers communities and each other. Here youll learn and grow as we help you create a career journey thats unique and meaningful to you with benefits programs and flexibility that support you personally and professionally.
At American Express youll be recognized for your contributions leadership and impactevery colleague has the opportunity to share in the companys success. Together well win as a team striving to uphold our company values and powerful backing promise to provide the worlds best customer experience every day. And well do it with the utmost integrity and in an environment where everyone is seen heard and feels like they belong.
Join Team Amex and lets lead the way together.
As part of our diverse tech team you can architect code and ship software that makes us an essential part of our customers digital lives. Here you can work alongside versatile engineers in an open supportive inclusive environment where your voice is valued and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills current and relevant we give you dedicated time to invest in your professional development. Find your place in technology on #TeamAmex.
About American Express Cloud Engineering:
Cloud Engineering provides a comprehensive platform that enables business critical applications to have Faster TimetoMarket for American Express. Cloud Engineering offers dynamic rapid codetodevelopment models and services such as PlatformasaService InfrastructureasaService DBasaService AnalyticsasaService MessagingasaService CICD Pipelines etc. for application developers in a hybrid cloud environment.
American Express is building an exciting Hybrid Cloud platform and is in search of innovative and critical thinking engineers to build our Hybrid Cloud Platform environment. This position will report into the xPaaS Services Enterprise Cloud Engineering team within the Enterprise Cloud Engineering organization. In this Engineer role you will be part of a versatile team responsible for building scalable secure and highly available Enterprise Astronomer Airflow in Private and Public cloud providers.
How will you make an impact in this role
- With your core understanding of Airflow Kubernetes and real time data streaming you will have an emphasis on ensuring all services are highly available and scalable using both Open Sourced and vendor provided products.
- Become a domain expert in two or more of the following: Airflow Kubernetes and their public cloud service equivalents
- Gain a solid understanding of Cloud Principles and containerbased platforms like Docker Kubernetes and Redhat OpenShift to support our customers use of Cloud Services
- Build scripts using Python and configuration languages like YAML/JSON
- Combine your expertise and detailed and rational root cause analysis skills to find opportunities to build things faster and better
- Provide engineering advanced support as needed to back up our operational support teams including resolving performance issues with Airflow and containerized environments
Design and implement scalable data pipelines using Apache Airflow.
Optimize Airflow DAGs for performance and resource efficiency.
Collaborate with data scientists to integrate machine learning models into workflows.
Develop custom Airflow operators and plugins to extend functionality.
Monitor and troubleshoot Airflow jobs to ensure reliability and uptime.
Participate in agile sprints to deliver iterative improvements to data infrastructure.
Mentor junior engineers on best practices in Airflow and data engineering.
Implement CI/CD pipelines for automated deployment of Airflow configurations.
Stay updated with the latest Airflow features and industry trends.
Collaborate with crossfunctional teams to align data workflows with business goals.
Are you up for the challenge
- Overall 5 years of Technology relevant experience with 23 Years of relevant engineering experience
- Strong experience in Advanced Apache Airflow orchestration and optimization
- Data pipeline design and implementation
- Python programming and scripting expertise
- SQL and NoSQL database management
- Data modeling and ETL processes
- Continuous integration and deployment (CI/CD)
- Realtime data streaming and processing
- A knowledge of integration with public cloud managed services in AWS/GCP/Azure
- Demonstrated working knowledge of high availability and Disaster Recovery implementations
- Bachelors degree in computer science Computer Engineering or equivalent work experience
- Strong Passion for learning new technologies particularly in the cloud computing infrastructure area
Desirable experience
- Private or Public Cloud management and administration
- Validated diagnostic and service restoration skills.
- Excellent interpersonal and customer service skills
- Strong English communication skills with the ability to work with customers in critical outage situations.
- Good written and verbal communication and presentation skills
Salary Range: $85000.00 to $150000.00 annually bonus benefits
The above represents the expected salary range for this job requisition. Ultimately in determining your pay well consider your location experience and other jobrelated factors.
We back our colleagues and their loved ones with benefits and programs that support their holistic wellbeing. That means we prioritize their physical financial and mental health through each stage of life. Benefits include:
- Competitive base salaries
- Bonus incentives
- 6% Company Match on retirement savings plan
- Free financial coaching and financial wellbeing support
- Comprehensive medical dental vision life insurance and disability benefits
- Flexible working model with hybrid onsite or virtual arrangements depending on role and business need
- 20 weeks paid parental leave for all parents regardless of gender offered for pregnancy adoption or surrogacy
- Free access to global onsite wellness centers staffed with nurses and doctors (depending on location)
- Free and confidential counseling support through our Healthy Minds program
- Career development and training opportunities
For a full list of Team Amex benefits visit our Colleague Benefits Site.
American Express is an equal opportunity employer and makes employment decisions without regard to race color religion sex sexual orientation gender identity national origin veteran status disability status age or any other status protected by law. American Express will consider for employment all qualified applicants including those with arrest or conviction records in accordance with the requirements of applicable state and local laws including but not limited to the California Fair Chance Act the Los Angeles County Fair Chance Ordinance for Employers and the City of Los Angeles Fair Chance Initiative for Hiring Ordinance. For positions covered by federal and/or state banking regulations American Express will comply with such regulations as it relates to the consideration of applicants with criminal convictions.
We back our colleagues with the support they need to thrive professionally and personally. Thats why we have Amex Flex our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique inperson culture. Depending on role and business needs colleagues will either work onsite in a hybrid model (combination of inoffice and virtual days) or fully virtually.
US Job Seekers Click to view the Know Your Rights poster. If the link does not work you may access the poster by copying and pasting the following URL in a new browser window: eligibility to work with American Express in the United States is required as the company will not pursue visa sponsorship for these positions.
Employment Type
Full-Time
