Let's begin! Sr Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
11 hours ago
Vacancies:
1 Vacancy
Job Summary
At Moodys we unite the brightest minds to turn todays risks into tomorrows opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they arewith the freedom to exchange ideas think innovatively and listen to each other and customers in meaningful ways. Moodys is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment were advancing AI to move from insight to actionenabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity helping our clients navigate uncertainty with clarity speed and confidence.
If you are excited about this opportunity but do not meet every single requirement please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship lead with curiosity champion diverse perspectives turn inputs into actions and uphold trust through integrity.
Skills And Competencies
- Proficiency in designing and implementing scalable fault-tolerant data infrastructure on AWS using services such as AWS Redshift RDS Glue EMR and other related tools.
- Advanced skills in Python PySpark and SQL for efficient data manipulation and processing.
- Familiarity with big data technologies (e.g. Apache Spark Hadoop) and real-time data processing solutions.
- Experience with data modelling and database design (SQL and NoSQL).
- Understanding of data governance data quality and security best practices.
- Knowledge of data streaming technologies such as Kafka AWS Kinesis or equivalent.
- Ability to work directly with data scientists analysts and cross-functional teams to understand business requirements and translate them into technical solutions.
- Excellent communication leadership and problem-solving skills.
- 5 years of experience in developing and managing large-scale data infrastructure and AI applications.
Education
- Bachelors degree (Mandatory): Computer Science Software Engineering Data Science or a related field.
- Masters degree (Preferred): In a related field contributing added knowledge.
- Certifications: AWS-related certifications (e.g. AWS Certified Data Analytics) or equivalent cloud platform credentials are highly desirable.
Roles And Responsibilities
- As a Senior Data Engineer you will play a pivotal role in designing building and maintaining reliable data infrastructure including pipelines and workflows that support business functions and advanced analytics. This role is crucial in ensuring the seamless integration and operation of our AI and data infrastructure.
- Design implement and maintain robust scalable and fault-tolerant ETL/ELT processes leveraging AWS services (e.g. Redshift RDS Glue EMR).
- Develop and optimize data workflows using Python PySpark and SQL ensuring top closely with data scientists analysts and stakeholders to gather data requirements while delivering effective solutions.
- Ensure adherence to best practices related to data governance quality and security across all data pipelines.
- Automate and optimize data processing tasks to improve reliability and reduce manual intervention.
- Drive adoption of emerging big data technologies cloud engineering and automation practices.
- Provide technical mentoring and guidance to junior team members as required.
- Foster a culture of teamwork openness and innovation within and across teams.
About The Team
Moodys Ratings AI Analytics group develops advanced machine learning (ML) and generative AI solutions for high-profile data science initiatives. The successful candidate will guide teams in building robust scalable and secure solutions on successful candidate will strive to meet Moodys values: openness diversity inclusivity respect and a willingness to learn.
Moodys is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability protected veteran status sexual orientation gender expression gender identity or any other characteristic protected by law.
Candidates for Moodys Corporation may be asked to disclose securities holdings pursuant to Moodys Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy including remediation of positions in those holdings as necessary.
For more information on the Securities Trading Program please refer to the STP Quick Reference guide on ComplianceNet
Please note: STP categories are assigned by the hiring teams and are subject to change over the course of an employees tenure with Moodys.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Moody's CreditView is our flagship solution for global capital markets that incorporates credit ratings, research and data from Moody's Investors Service plus research, data and content from Moody's Analytics.
