Data Engineer AWS Glue and PySpark
Data Engineer AWS Glue and PySpark
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Summary
Synechron is seeking a skilled Data Engineer with expertise in AWS Glue and PySpark to join our dynamic data team. As a Data Engineer you will be instrumental in designing developing and managing data pipelines that ensure data accessibility reliability and timeliness for our analytics and business intelligence needs. Your contributions will directly support Synechrons commitment to leveraging data for strategic decisionmaking and operational efficiency.
Software Requirements
Required:
- Proficiency in AWS Glue and PySpark
- Experience with ETL processes and tools
- Knowledge of data ingestion strategies and data quality assurance
Preferred:
- Familiarity with additional AWS services
- Experience with other data processing frameworks
Overall Responsibilities
- Design develop and maintain scalable ETL processes using AWS Glue and PySpark
- Collaborate with data architects and data scientists to understand data requirements and deliver solutions that meet business needs
- Implement data ingestion strategies for various data sources ensuring data quality and integrity
- Optimize and monitor data pipelines for performance scalability and cost efficiency
- Troubleshoot and resolve data issues ensuring data accuracy and timeliness
- Document data pipelines processes and architecture to enable knowledge sharing within the team
- Stay updated with industry trends and best practices in data engineering and cloud technologies
Technical Skills (By Category)
Programming Languages:
- Essential: Proficiency in PySpark
- Preferred: Knowledge of Python
Databases/Data Management:
- Essential: Experience with ETL processes and data quality management
Cloud Technologies:
- Essential: AWS Glue
- Preferred: Familiarity with other AWS services
Frameworks and Libraries:
- Essential: PySpark
Development Tools and Methodologies:
- Essential: Experience with data pipeline optimization and monitoring
Experience Requirements
- Minimum of X years of experience in data engineering or a related role
- Proven experience with AWS Glue PySpark and ETL processes
- Experience in designing and managing data pipelines for analytics and business intelligence
DaytoDay Activities
- Develop and manage scalable data pipelines using AWS Glue and PySpark
- Collaborate with data architects and scientists to deliver data solutions
- Implement and optimize data ingestion strategies for performance and cost efficiency
- Troubleshoot data issues and ensure data integrity
- Document data processes and architecture for team knowledge sharing
- Engage in regular meetings to align on project objectives and progress
Qualifications
Educational Requirements:
- Bachelors degree in Computer Science Information Technology or a related field
- Equivalent experience may be considered
Certifications:
- Relevant certifications in AWS or data engineering are a plus
Professional Competencies
- Strong critical thinking and problemsolving capabilities
- Excellent communication and stakeholder management skills
- Ability to work effectively in a team environment
- Adaptability and proactive learning orientation
- Innovation mindset with attention to detail
- Strong time and priority management skills
SYNECHRONS DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.
All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law.
Employment Type
Full-Time
