Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailOliver Wyman is a global leader in management consulting. With offices in 60 cities across 29 countries Oliver Wyman combines deep industry knowledge with specialized expertise in strategy operations risk management and organization transformation. Our 5000 professionals help clients optimize their business improve their operations and risk profile and accelerate their organizational performance to seize the most attractive opportunities. Oliver Wymans thought leadership is evident in our agendasetting books white papers research reports and articles in the business press. Our clients are the CEOs and executive teams of the top Global 1000 companies.
Visit our website for more details about Oliver Wyman:
Job specification
Job title:Senior Data Engineer
Department:
OWG Tech
Office/region:
India
Reports to:
Director of Data Engineering
Job Overview:
The OWG Technology department is seeking a highly skilled and motivated Senior Data Engineer to play a critical role in our data transformation program. In this position you will lead major projects and workstreams collaborating closely with stakeholders to ensure the successful implementation of data solutions. You will also mentor and coach junior team members providing guidance during sprints as a technical lead. Your expertise in cloud data platforms particularly the Databricks Lakehouse will be essential in driving innovation and best practices within the team.
Key Responsibilities:
Lead the design and implementation of processes to ingest data from various sources into the Databricks Lakehouse platform ensuring alignment with architectural and engineering standards.
Oversee the development maintenance and optimization of data models and ETL pipelines that support the Medallion Architecture (Bronze Silver Gold layers) to enhance data processing efficiency and facilitate data transformation.
Utilize Databricks to integrate consolidate and cleanse data ensuring accuracy and readiness for analysis while leveraging Delta Lake for versioned data management.
Implement and manage Unity Catalog for centralized data governance ensuring proper data access security and compliance with organizational policies and regulations.
Collaborate with business analysts data scientists and stakeholders to understand their data requirements and deliver tailored solutions that leverage the capabilities of the Databricks Lakehouse platform.
Promote available data and analytics capabilities to business stakeholders educating them on how to effectively leverage these tools and the Medallion Architecture for their analytical needs.
Experience:
Bachelors or Masters degree in Computer Science Data Science Engineering or a related field.
Minimum of 7 years of experience in data engineering or a related data role with a proven track record of leading projects and initiatives.
Expertisein designing and implementing productiongrade Sparkbased solutions.
Expertisein query tuning performance tuning troubleshooting and debugging Spark or other big data solutions.
Proficientin big data technologies such as Spark/Delta Hadoop NoSQL MPP and OLAP.
Proficientin cloud architecture systems and principles particularly in AWS.
Proficientin programming languages such as Python R Scala or Java.
Expertisein scaling ETL pipelines for performance and costeffectiveness.
Experiencein building and scaling streaming data pipelines.
Strong understandingof DevOps tools and best practices for data engineering including CI/CD unit and integration testing automation and orchestration.
Cloud or Databricks certification is highly desirable.
Skills and Attributes:
Full professional proficiency in both written and spoken English.
Strong problemsolving and troubleshooting skills.
Excellent communication skills both verbal and written with the ability to articulate complex concepts clearly and engage effectively with diverse audiences.
Proven ability to lead and mentor junior team members fostering a collaborative and highperforming team environment.
Neutral toward technology vendor and product choices prioritizing results over personal preferences.
Resilient and composed in the face of opposition to ideas demonstrating a collaborative spirit.
Lead the migration of existing ETL processes from Informatica IICS and SSIS to cloudbased data pipelines within the Databricks environment ensuring minimal disruption and maximum efficiency.
Act as a technical lead during sprints providing guidance and support to team members and ensuring adherence to best practices in data engineering.
Engage with clients and stakeholders to support architectural designs address technical queries and provide strategic guidance on utilizing the Databricks Lakehouse platform effectively.
Stay updated on industry trends and emerging technologies in data engineering particularly those related to Databricks cloud data solutions and ETL migration strategies continuously enhancing your skills and knowledge.
Demonstrate excellent problemsolving skills with an ability to see and solve issues before they affect business productivity.
Demonstrate thought leadership by contributing to the development of best practices standards and documentation for data engineering processes within the organization.
Why join our team:
We help you be your best through professional development opportunities interesting work and supportive leaders.
We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues clients and communities.
Our scale enables us to provide a range of career opportunities as well as benefits and rewards to enhance your wellbeing.
Marsh McLennan(NYSE: MMC) is a global leader in risk strategy and people advising clients in 130 countries across four businesses: Marsh Guy Carpenter Mercer and Oliver Wyman. With annual revenue of $23 billion and more than 85000 colleagues Marsh McLennan helps build the confidence to thrive through the power of perspective. For more information visit marshmclennan or follow on LinkedIn and X.
Marsh McLennan is committed to embracing a diverse inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age background caste disability ethnic origin family duties gender orientation or expression gender reassignment marital status nationality parental status personal or social status political affiliation race religion and beliefs sex/gender sexual orientation or expression skin color or any other characteristic protected by applicable law.
Marsh McLennan is committed to hybrid work which includes the flexibility of working remotely and the collaboration connections and professional development benefits of working together in the office. All Marsh McLennan colleagues are expected to be in their local office or working onsite with clients at least three days per week. Officebased teams will identify at least one anchor day per week on which their full team will be together in person.
Marsh McLennan (NYSE: MMC) is a global leader in risk strategy and people advising clients in 130 countries across four businesses: Marsh Guy Carpenter Mercer and Oliver Wyman. With annual revenue of $24 billion and more than 90000 colleagues Marsh McLennan helps build the confidence to thrive through the power of perspective. For more information visit marshmclennan or follow on LinkedIn and X.Marsh McLennan is committed to embracing a diverse inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age background caste disability ethnic origin family duties gender orientation or expression gender reassignment marital status nationality parental status personal or social status political affiliation race religion and beliefs sex/gender sexual orientation or expression skin color or any other characteristic protected by applicable law.Marsh McLennan is committed to hybrid work which includes the flexibility of working remotely and the collaboration connections and professional development benefits of working together in the office. All Marsh McLennan colleagues are expected to be in their local office or working onsite with clients at least three days per week. Officebased teams will identify at least one anchor day per week on which their full team will be together in person.Required Experience:
Senior Manager
Full-Time