Sr. AWS Pyspark Developer
Sr. AWS Pyspark Developer
Posted on :
24-07-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
JD of Senior AWS PySpark Engineer
Role Summary:
This role is responsible for building and orchestrating cloud-native ETL pipelines using AWS Glue Airflow (MWAA) PySpark and S3 to support the modernization of legacy Informatica workloads. The engineer will help design the cloud execution layer for migrated PySpark-based pipelines.
Key Responsibilities:
- Build serverless ETL pipelines using AWS Glue integrated with S3 and PySpark.
- Design and implement workflow orchestration using Airflow (MWAA).
- Support cloud-native data ingestion transformation and data lake integration.
- Monitor troubleshoot and enhance performance of data pipelines in AWS.
- Collaborate with developers and architects to integrate migrated pipelines into production.
Required Skills:
- Strong hands-on experience with PySpark and distributed data transformation.
- Proficiency in SQL for complex joins filters and data validations.
- Exposure to AWS data stack including S3 and Glue is preferred.
- Strong experience with AWS Glue Airflow (MWAA) and S3.
- Knowledge of PySpark and Python-based data engineering.
- Familiarity with legacy ETL modernization and migration best practices.
- Understanding of infrastructure-as-code and deployment automation is a plus.
- Experience integrating metadata-driven frameworks is preferred.
Employment Type
Full-time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
