Sr Data engineer
Sr Data engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Your Team Responsibilities
We are looking for a Senior Data Engineer with deep hands-on expertise in PySpark Databricks and distributed data architecture. This individual will play a lead role in designing developing and optimizing data pipelines critical to our Ratings Modernization Corrections and Regulatory implementation programs under PDB 2.0. The ideal candidate will thrive in fast-paced ambiguous environments and collaborate closely with engineering product and governance teams.
Your Key Responsibilities
Design develop and maintain robust ETL/ELT pipelines using PySpark and Databricks.
Own pipeline architecture and drive performance improvements through partitioning indexing and Spark optimization.
Collaborate with product owners analysts and other engineers to gather requirements and resolve complex data issues.
Perform deep analysis and optimization of SQL queries functions and procedures for performance and scalability.
Ensure high standards of data quality and reliability via robust validation and cleansing processes.
Lead efforts in Delta Lake and cloud data warehouse architecture including best practices for data lineage and schema management.
Troubleshoot and resolve production incidents and pipeline failures quickly and thoroughly.
Mentor junior team members and guide best practices across the team.
Your skills and experience that will help you excel
Bachelors degree in Computer Science Engineering or a related technical field.
6 years of experience in data engineering or related roles.
Advanced proficiency in Python PySpark and SQL.
Strong experience with Databricks BigQuery and modern data lakehouse design.
Hands-on knowledge of Azure or GCP data services.
Proven experience in performance tuning and large-scale data processing.
Strong communication skills and the ability to work independently in uncertain or evolving contexts
About MSCI
What we offer you
- Transparent compensation schemes and comprehensive employee benefits tailored to your location ensuring your financial security health and overall wellbeing.
- Flexible working arrangements advanced technology and collaborative workspaces.
- A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
- A global network of talented colleagues who inspire support and share their expertise to innovate and deliver for our clients.
- Global Orientation program to kickstart your journey followed by access to our platform LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.
- Multi-directional career paths that offer professional growth and development through new challenges internal mobility and expanded roles.
- We actively nurture an environment that builds a sense of inclusion belonging and connection including eight Employee Resource Groups. All Abilities Asian Support Network Black Leadership Network Climate Action Network Hola! MSCI Pride & Allies Women in Tech and Womens Leadership Forum.
At MSCI we are passionate about what we do and we are inspired by our purpose to power better investment decisions. Youll be part of an industry-leading network of creative curious and entrepreneurial pioneers. This is a space where you can challenge yourself set new standards and perform beyond expectations for yourself our clients and our industry.
MSCI is a leading provider of critical decision support tools and services for the global investment community. With over 50 years of expertise in research data and technology we power better investment decisions by enabling clients to understand and analyze key drivers of risk and return and confidently build more effective portfolios. We create industry-leading research-enhanced solutions that clients use to gain insight into and improve transparency across the investment process.
MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race color religion creed age sex gender gender identity sexual orientation national origin citizenship disability marital and civil partnership/union status pregnancy (including unlawful discrimination on the basis of a legally protected parental leave) veteran status or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for any part of the application process please email and indicate the specifics of the assistance needed. Please note this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.
To all recruitment agencies
MSCI does not accept unsolicited CVs/Resumes. Please do not forward CVs/Resumes to any MSCI employee location or website. MSCI is not responsible for any fees related to unsolicited CVs/Resumes.
Note on recruitment scams
We are aware of recruitment scams where fraudsters impersonating MSCI personnel may try and elicit personal information from job seekers. Read our full note on
Required Experience:
Senior IC
Employment Type
Full-Time
