IN-AssociateSparkData & AnalyticsAdvisoryGurugram

Line of Service

Industry/Sector

Specialism

Management Level

Job Description & Summary

*Why PWC

At PwC you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes forour clients and communities. This purpose-led and values-driven work powered by technology in an environment that drives innovation will enable you to make a tangible impact in the real world. We reward your contributions support your wellbeing and offer inclusive benefits flexibility programmes and mentorship that will help you thrive in work and life. Together we grow learn care collaborate and create a future of infinite experiences foreach other. Learn more about us.

At PwC we believe in providing equal employment opportunities without any discrimination on the grounds of gender ethnic background age disability marital status sexual orientation pregnancy gender identity or expression religion or other beliefs perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firms growth. To enable this we have zero tolerance for any discrimination and harassment based on the above

Responsibilities:

AWS Service Implementation: Design develop and maintain data solutions using AWS services with a particular focus on S3 Athena Glue EMR and Redshift. Implement and optimize data lakes and data warehouses on AWS platforms. 2. Data Pipeline Development: Create and maintain efficient ETL processes using PySpark and other relevant tools. Develop scalable and performant data pipelines to process large volumes of data. Implement data quality checks and monitoring systems to ensure data integrity. 3. Database Management: Proficient with SQL and NoSQL databases optimizing queries and database structures for performance. Design and implement database schemas that align with business requirements and data models. 4. Performance Optimization: Continuously monitor and optimize the performance of data processing jobs and queries. Implement best practices for cost optimization in AWS environments. Troubleshoot and resolve performance bottlenecks in data pipelines and analytics processes. 5. Collaboration and Documentation: Work closely with data scientists analysts and other stakeholders to understand data requirements and deliver solutions. Develop and maintain comprehensive documentation for data architectures processes and best practices. Participate in code reviews and contribute to the teams knowledge base. Required Qualifications: Bachelors or Masters degree in Computer Science Information Technology or a related field. 2-7 years of experience in data engineering with a focus on AWS technologies.

Strong hands-on experience with AWS services particularly S3 Athena Glue EMR and Redshift. Proficiency in Python and PySpark for data processing and analysis. Extremely good with SQL/PL SQL Demonstrated ability to optimize data pipelines and queries for performance. Strong problem-solving skills and attention to detail. Preferred Skills: AWS certifications (e.g. AWS Certified Data Analytics - Specialty AWS Certified Solutions Architect). Familiarity with data visualization tools (e.g. Tableau Power BI). Experience with data modeling and data warehouse concepts. Innovation thinking and creativity in solution delivery

Mandatory skill sets:

AWS

Preferred skill sets:

AWS

Years of experience required:

2

Education qualification:

BE/BTech/MBA/MCA

Education (if blank degree and/or field of study not specified)

Certifications (if blank certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship

Government Clearance Required

Job Posting End Date