IN-Manager Data Engineer (DatabricksPyspark) Data and AnalyticsAdvisoryGurgaon
IN-Manager Data Engineer (DatabricksPyspark) Data and AnalyticsAdvisoryGurgaon
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
Data Analytics & AIManagement Level
ManagerJob Description & Summary
At PwC our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights enabling informed decision-making and driving business growth.In data engineering at PwC you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines data integration and data transformation solutions.
Job Description & Summary: A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities including business intelligence data management and data assurance that help our clients drive innovation growth and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data understand and navigate risk and help our clients gain a competitive edge.
Responsibilities: Design and develop data pipelines using Databricks and PySpark to ingest process and transform large volumes of data. Implement ETL/ELT workflows to move data from source systems to Data Warehouses Data Lakes and Lake Houses using cloud-native tools. Work with structured and unstructured data stored in AWS or Azure Data Lakes. Apply strong SQL and Python skills to manipulate and analyze data efficiently. Collaborate with cross-functional teams to deliver cloud-based serverless data solutions. Design innovative data solutions that address complex business requirements and support data-driven decision-making. Maintain documentation and enforce best practices for data architecture governance and performance optimization.
Mandatory skill sets:
Databricks PySpark and SQL on any cloud platform (AWS or Azure).
Preferred skill sets:
ETLPyspark
Years of experience required: 4 to 10 Years
Education qualification:
Bachelors degree in computer science data science or any other Engineering discipline. Masters degree is a plus.
Education (if blank degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor Degree Master DegreeDegrees/Field of Study preferred:Certifications (if blank certifications not specified)
Required Skills
PySparkOptional Skills
Accepting Feedback Accepting Feedback Active Listening Agile Scalability Amazon Web Services (AWS) Analytical Thinking Apache Airflow Apache Hadoop Azure Data Factory Coaching and Feedback Communication Creativity Data Anonymization Data Architecture Database Administration Database Management System (DBMS) Database Optimization Database Security Best Practices Databricks Unified Data Analytics Platform Data Engineering Data Engineering Platforms Data Infrastructure Data Integration Data Lake Data Modeling 32 moreDesired Languages (If blank desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship
NoGovernment Clearance Required
NoJob Posting End Date
Required Experience:
Manager
Employment Type
Full-Time
