AWS Data Engineer San Francisco, CA
AWS Data Engineer San Francisco, CA
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
AWS Data Engineer (10737-1) San Francisco CA
AWS Data Engineer Python Spark AWS Services ETL Glue EMR S3 Redshift Airflow Data Quality CI/CD
If you post this job on a job board please do not use company name or salary.
Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No
Job Description:
7 years of experience in Amazon Web Services (AWS) Cloud Computing
Strong background in designing developing and maintaining scalable data pipelines for ingestion and processing using Python Spark and AWS services
Key Skills & Expertise
ETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data
Data Storage Solutions: Design and maintain storage solutions using Medallion Architecture in S3 and Redshift
Workflow Orchestration: Monitor and optimize data workflows using Airflow or other orchestration tools
Data Quality: Ensure accuracy consistency and integrity throughout the data lifecycle
CI/CD: Implement and understand CI/CD practices for automated data pipeline deployment
System Monitoring: Utilize CloudWatch and Datadog for performance monitoring and reliability
Collaboration: Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions
Communication: Strong ability to communicate project updates and technical details to stakeholders.
Additional Notes:
Please submit the candidates resume in PDF format.
Please remove the candidates LinkedIn URL from the resume; otherwise the profile will not be considered.
Employment Type
Full Time
