Data Engineer Senior Associate - operate

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Managed Services

Management Level

Senior Associate

Job Description & Summary

At PwC our people in managed services focus on a variety of outsourced solutions and support clients across numerous functions. These individuals help organisations streamline their operations reduce costs and improve efficiency by managing key processes and functions on their behalf. They are skilled in project management technology and process optimization to deliver highquality services to clients.

Those in managed service management and strategy at PwC will focus on transitioning and running services along with managing delivery teams programmes commercials performance and delivery risk. Your work will involve the process of continuous improvement and optimising of the managed services process tools and services.

Job Title:Data Engineer Offshore

KEY SKILLS Tera Data data stage AWS Data Bricks SQL Delta Live tables Delta tables Spark Kafka Spark Streaming MQ ETL

Summary: We are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in a variety of data technologies including Teradata DataStage AWS Databricks SQL and more. As a Data Engineer you will be responsible for designing implementing and maintaining scalable data pipelines and systems that support our datadriven initiatives.

Minimum Degree Required: Bachelors degree in computer science/IT or relevant field

Degree Preferred: Masters degree in computer science/IT or relevant field

Minimum Years of Experience: 6 9 year(s)

Certifications Required: NA

Key Responsibilities:

• Design develop and maintain scalable ETL pipelines using DataStage and other ETL tools.
• Leverage AWS cloud services for data storage processing and analytics.
• Utilize Databricks to analyze process and transform data ensuring high performance and reliability.
• Implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying.
• Work with Apache Spark to process large datasets ensuring optimal performance and scalability.
• Integrate Kafka and Spark Streaming to build realtime data processing applications.
• Collaborate with crossfunctional teams to gather requirements and deliver data solutions that meet business needs.
• Ensure data quality integrity and security across all data systems and pipelines.
• Monitor and troubleshoot data workflows to ensure smooth operations.
• Document data processes architecture designs and technical specifications.

Qualifications:

• Bachelors degree in Computer Science Information Technology or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with relational databases such as Teradata.
• Handson experience with AWS services such as S3 EMR Redshift and Lambda.
• Proficiency in using Databricks for data engineering tasks.
• Experience with Delta Live Tables and Delta Tables in a data engineering context.
• Solid understanding of Apache Spark Kafka and Spark Streaming.
• Experience with messaging systems like MQ is a plus.
• Strong problemsolving skills and attention to detail.
• Excellent communication and collaboration skills.

Preferred Skills:

• Experience with data warehousing and big data technologies.
• Familiarity with data governance and data security best practices.
• Certification in AWS or Databricks is a plus.

Role: Senior Associate

Tower: Data Analytics & Specialist Managed Service

Experience: 5.5 10 years

Educational Qualification: BE / B Tech / ME / M Tech / MBA

Work Location: Bangalore

Job Description

As a Senior Associate you will work as part of a team of problem solvers helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to:

• Use feedback and reflection to develop selfawareness personal strengths and address development areas.
• Flexible to work in stretch opportunities/assignments.
• Demonstrate critical thinking and the ability to bring order to unstructured problems.
• Ticket Quality and deliverables review Status Reporting for the project.
• Adherence to SLAs experience in incident management change management and problem management.
• Seek and embrace opportunities which give exposure to different situations environments and perspectives.
• Use straightforward communication in a structured way when influencing and connecting with others.
• Able to read situations and modify behavior to build quality relationships.
• Uphold the firms code of ethics and business conduct.
• Demonstrate leadership capabilities by working with clients directly and leading the engagement.
• Work in a team environment that includes client interactions workstream management and crossteam collaboration.
• Good team player take up cross competency work and contribute to COE activities.
• Escalation/Risk management.

Position Requirements:

Required Skills:

AWS Cloud Engineer:

Job description:

Candidate is expected todemonstrateextensive knowledge and/or a proven record of success in the following areas:

• Should have minimum 6years hand on experience building advanced Data warehousing solutions on leading cloud platforms.
• Should have minimum 35yearsof Operate/Managed Services/Production Support Experience
• Should have extensive experience in developing scalable repeatable and secure data structures and pipelines to ingest store collect standardize and integrate data that for downstream consumption like Business Intelligence systems Analytics modeling Data scientists etc.
• Designing and implementing data pipelines to extract transform and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes.
• Should have experience in building efficient ETL/ELT processes using industry leading tools like AWS AWS GLUE AWS Lambda AWS DMS PySpark SQL Python DBT Prefect Snowflake etc.
• Design implement and maintain data pipelines for data ingestion processing and transformation in AWS.
• Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
• Implementing data validation and cleansing procedures will ensure the quality integrity and dependability of the data.
• Improve the scalability efficiency and costeffectiveness of data pipelines.
• Monitoring and troubleshooting data pipelines and resolving issues related to data processing transformation or storage.
• Implementing andmaintainingdata security and privacy measures including access controls and encryption to protect sensitive data
• Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) as well as working familiarity with a variety of databases
• Should have experience in Building andmaintainingData Governance solutions (Data Quality Metadata management Lineage Master Data Management and Data security) using industry leading tools
• Scaling andoptimizingschema and performance tuning SQL and ETL pipelines in data lake and data warehouse environments.
• Should have Handson experience with Data analytics tools like Informatica Collibra Hadoop Spark Snowflake etc.
• Should have Experience of ITIL processes like Incident management Problem Management Knowledge management Release management Data DevOps etc.
• Should have Strong communication problem solving quantitative and analytical abilities.

Nice to have:

• AWS certification

Managed Services Data Analytics & Insights Managed Service

At PwC we relentlessly focus on working with our clients to bring the power of technology and humans together and create simple yet powerful solutions. We imagine a day when our clients can simply focus on their business knowing that they have a trusted partner for their IT needs. Every day we are motivated and passionate about making our clients better.

Within our Managed Services platform PwC delivers integrated services and solutions that are grounded in deep industry experience and powered by the talent that you would expect from the PwC brand. The PwC Managed Services platform delivers scalable solutions that add greater value to our clients enterprise through technology and humanenabled experiences. Our team of highly skilled and trained global professionals combined with the use of the latest advancements in technology and process allows us to provide effective and efficient outcomes. With PwCs Managed Services our clients are able to focus on accelerating their priorities including optimizing operations and accelerating outcomes. PwC brings a consultative first approach to operations leveraging our deep industry insights combined with world class talent and assets to enable transformational journeys that drive sustained client outcomes. Our clients need flexible access to world class business and technology capabilities that keep pace with todays dynamic business environment.

Within our global Managed Services platform we provide Data Analytics & Insights where we focus more so on the evolution of our clients Data and Analytics ecosystem. Our focus is to empower our clients to navigate and capture the value of their Data & Analytics portfolio while costeffectively operating and protecting their solutions. We do this so that our clients can focus on what matters most to your business: accelerating growth that is dynamic efficient and costeffective.

As a member of our Data Analytics & Insights Managed Service team we are looking for candidates who thrive working in a highpaced work environment capable of working on a mix of critical Data Analytics & Insights offerings and engagement including help desk support enhancement and optimization work as well as strategic roadmap and advisory level work. It will also be key to lend experience and effort in helping win and support customer engagements from not only a technical perspective but also a relationship perspective.

Education (if blank degree and/or field of study not specified)

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank certifications not specified)

Required Skills

Optional Skills

Accepting Feedback Accepting Feedback Active Listening Analytical Thinking Automation Automation Framework Design and Development Automation Solutions Budgetary Management Business Process Automation (BPA) Business Process Improvement Business Process Outsourcing Business Transformation Communication Continuous Process Improvement Creativity Data Quality Automation Deliverable Planning Delivery Excellence Design Automation Digital Transformation Embracing Change Emotional Regulation Empathy Inclusion Intellectual Curiosity 24 more

Desired Languages (If blank desired languages not specified)

Travel Requirements

0%

Available for Work Visa Sponsorship

No

Government Clearance Required

No

Job Posting End Date

May 31 2025