AWS Databricks Senior Associate
AWS Databricks Senior Associate
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
Advisory OtherManagement Level
Senior AssociateJob Description & Summary
At PwC our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights enabling informed decisionmaking and driving business growth.In data engineering at PwC you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines data integration and data transformation solutions.
Focused on relationships you are building meaningful client connections and learning how to manage and inspire others. Navigating increasingly complex situations you are growing your personal brand deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients and to deliver quality. Embracing increased ambiguity you are comfortable when the path forward isnt clear you ask questions and you use these moments as opportunities to grow.
Examples of the skills knowledge and experiences you need to lead and deliver value at this level include but are not limited to:
- Respond effectively to the diverse perspectives needs and feelings of others.
- Use a broad range of tools methodologies and techniques to generate new ideas and solve problems.
- Use critical thinking to break down complex concepts.
- Understand the broader objectives of your project or role and how your work fits into the overall strategy.
- Develop a deeper understanding of the business context and how it is changing.
- Use reflection to develop self awareness enhance strengths and address development areas.
- Interpret data to inform insights and recommendations.
- Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance) the Firms code of conduct and independence requirements.
BRIEF COMPANY DESCRIPTION
At PwC we connect people with diverse backgrounds and skill sets to solve important problems together and lead with purposefor our clients our communities and for the world at large. It is no surprise therefore that 429 of 500 Fortune global companies engage with PwC.
Acceleration Centers (ACs) are PwCs diverse global talent hubs focused on enabling growth for the organization and value creation for our clients. The PwC Advisory Acceleration Center in Bangalore is part of our Advisory business in the US. The team is focused on developing a broader portfolio with solutions for Risk Consulting Management Consulting Technology Consulting Strategy Consulting Forensics as well as vertical specific solutions.
PwCs highperformance culture is based on passion for excellence with focus on diversity and inclusion. You will collaborate with and receive support from a network of people to achieve your goals. We will also provide you with global leadership development frameworks and the latest in digital technologies to learn and excel in your career. At the core of our firms philosophy is a simple construct: We care for our people.
Globally PwC is ranked as the 3rd most attractive employer according to Universum. Our commitment to Responsible Business Leadership Diversity & Inclusion worklife flexibility career coaching and learning & development makes our firm one of the best places to work learn and excel.
Apply to us if you believe PwC is the place to be. Now and in the future!
JOB OVERVIEW
At PwC AC as an AWSDatabricks Senior Developer the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for endtoend implementation of Cloud data engineering solutions like Enterprise Data lake Data hub in AWS. The candidate should have strong experience in AWS cloud technology. Ability to work as cloud developer and provide automated cloud solutions.
Years of Experience: Candidates with 48 years of experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.
Position Requirements:
Must Have:
- Build and maintain scalable data pipelines using Databricks and Apache Spark.
- Develop and optimize ETL/ELT processes for structured and unstructured data.
- Knowledge of Lakehouse architecture for efficient data storage processing and analytics.
- Orchestrating ETL/ELT Pipelines: Design and manage data workflows using Databricks Workflows Jobs API.
- Worked with AWS Data Services S3 Lambda CloudWatch for seamless integration.
- Performance Optimization: Optimize queries using pushdown capabilities and indexing strategies.
- Worked on data governance with Unity Catalog security policies and access controls.
- Monitor troubleshoot and improve Databricks jobs and clusters.
- Exposure to endtoend implementation of migration projects to AWS Cloud
- AWS & Python Expertise with handson cloud development.
- Orchestration: Airflow
- Code Repositories: Git GitHub.
- Strong in writing SQL
- Cloud Data Migration: Deep understanding of processes.
- Strong Analytical ProblemSolving & Communication Skills.
Good to have Knowledge / Skills:
- Experience in Teradata DataStage SSIS
- Knowledge of Databricks Delta Live Table.
- Knowledge of Delta Lake.
- Streaming: Kafka Spark Streaming.
- CICD: Jenkins
- IaC & Automation: Terraform for Databricks deployment.
Professional and Educational Background:
- BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA
Certification:
Amazon Web Services (AWS) certifications (AWS certified Data Engineer is recommended).
Databricks Certified Associate Developer for Apache Spark
Additional Information:
- Travel Requirements: Travel to client locations may be required as per project requirements.
- Line of Service: Advisory
- Horizontal: Technology Consulting
- Designation: Senior Associate
- Location: Bangalore India
2020 PwC. All rights reserved. PwC refers to the PwC network and/or one or more of its member firms each of which is a separate legal entity. Please see www.pwc/structure for further details. This content is for general information purposes only and should not be used as a substitute for consultation with professional advisors.
Legal disclaimer Legal notices Privacy statement
Education (if blank degree and/or field of study not specified)
Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications (if blank certifications not specified)
Required Skills
Optional Skills
Accepting Feedback Accepting Feedback Active Listening Agile Scalability Amazon Web Services (AWS) Analytical Thinking Apache Hadoop Azure Data Factory Communication Creativity Data Anonymization Database Administration Database Management System (DBMS) Database Optimization Database Security Best Practices Data Engineering Data Engineering Platforms Data Infrastructure Data Integration Data Lake Data Modeling Data Pipeline Data Quality Data Transformation Data Validation 18 moreDesired Languages (If blank desired languages not specified)
Travel Requirements
Available for Work Visa Sponsorship
Government Clearance Required
Job Posting End Date
Required Experience:
Senior IC
Employment Type
Full-Time
