AWS Databricks Senior Associate
AWS Databricks Senior Associate
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
Advisory OtherManagement Level
Senior AssociateJob Description & Summary
At PwC our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights enabling informed decisionmaking and driving business growth.In data engineering at PwC you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines data integration and data transformation solutions.
Years of Experience: Candidates with 4 years of experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.
Position Requirements:
Must Have:
- Build and maintain scalable data pipelines using Databricks and Apache Spark.
- Develop and optimize ETL/ELT processes for structured and unstructured data.
- Knowledge of Lakehouse architecture for efficient data storage processing and analytics.
- Orchestrating ETL/ELT Pipelines: Design and manage data workflows using Databricks Workflows Jobs API.
- Worked with AWS Data Services S3 Lambda CloudWatch for seamless integration.
- Performance Optimization: Optimize queries using pushdown capabilities and indexing strategies.
- Worked on data governance with Unity Catalog security policies and access controls.
- Monitor troubleshoot and improve Databricks jobs and clusters.
- Exposure to endtoend implementation of migration projects to AWS Cloud
- AWS & Python Expertise with handson cloud development.
- Orchestration: Airflow
- Code Repositories: Git GitHub.
- Strong in writing SQL
- Cloud Data Migration: Deep understanding of processes.
- Strong Analytical ProblemSolving & Communication Skills.
Good to have Knowledge / Skills:
- Experience in Teradata DataStage SSIS
- Knowledge of Databricks Delta Live Table.
- Knowledge of Delta Lake.
- Streaming: Kafka Spark Streaming.
- CICD: Jenkins
- IaC & Automation: Terraform for Databricks deployment.
Professional and Educational Background:
BE / / MCA / / M.E / / MBA
Education (if blank degree and/or field of study not specified)
Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications (if blank certifications not specified)
Required Skills
Optional Skills
Accepting Feedback Accepting Feedback Active Listening Agile Scalability Amazon Web Services (AWS) Analytical Thinking Apache Hadoop Azure Data Factory Communication Creativity Data Anonymization Database Administration Database Management System (DBMS) Database Optimization Database Security Best Practices Data Engineering Data Engineering Platforms Data Infrastructure Data Integration Data Lake Data Modeling Data Pipeline Data Quality Data Transformation Data Validation 18 moreDesired Languages (If blank desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship
NoGovernment Clearance Required
YesJob Posting End Date
Required Experience:
Senior IC
Employment Type
Full-Time
