Line of Service
Advisory
Industry/Sector
Not Applicable
Specialism
Data Analytics & AI
Management Level
Senior Associate
Job Description & Summary
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities including business intelligence data management and data assurance that help our clients drive innovation growth and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data understand and navigate risk and help our clients gain a competitive edge.
Creating business intelligence from data requires an understanding of the business the data and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions data visualisation and integrated reporting dashboards we can deliver agile highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.
*Why PWC
At PwC you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes forour clients and communities. This purposeled and valuesdriven work powered by technology in an environment that drives innovation will enable you to make a tangible impact in the real world. We reward your contributions support your wellbeing and offer inclusive benefits flexibility programmes and mentorship that will help you thrive in work and life. Together we grow learn care collaborate and create a future of infinite experiences foreach other. Learn moreabout us. At PwC we believe in providing equal employment opportunities without any discrimination on the grounds of gender ethnic background age disability marital status sexual orientation pregnancy gender identity or expression religion or other beliefs perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firms growth. To enable this we have zero tolerance for any discrimination and harassment based on the above considerations.
Job Description & Summary: ETL Databricks
Responsibilities:
Years of Experience: 4 10 Yrs
- Databricks Engineers with 23 years of handon experience in Pyspark Cloud Platform and SQL.
- Proven experience in implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster working in Databricks modules data pipelines for ingesting and transforming data from various sources into Databricks.
- Sparkbased ETL workflows and data pipelines for data preparation and transformation within Databricks.
- Bachelors or Masters degree with 46 years of professional experience.
- Proven experience in implementing data solutions on the Databricks platform.
- Solid understanding of Databricks fundamentals and have hands on experience in setting up Databricks cluster working in Databricks modules (Data Engineering ML and SQL warehouse).
- Configure set up and manage Databricks clusters workspaces and notebooks to ensure optimal performance scalability and resource allocation.
- Implement data pipelines for ingesting cleansing and transforming data from various sources into Databricks ensuring data quality consistency and reliability. Develop ETL (Extract Transform Load) processes as needed.
- Develop optimize and maintain Sparkbased ETL workflows and data pipelines for data preparation and transformation within Databricks.
- Knowledge of Performance Optimization Monitoring and Automation would be a plus.
- Understanding of data governance compliance and security best practices.
- Strong Proficiency in Pyspark Databricks Notebooks SQL Python Scala or Java.
- Proficiency in SQL for data querying and manipulation.
- Experience with data modeling ETL processes and data warehousing concepts.
- Strong problemsolving and troubleshooting skills.
Mandatory skill sets:
ETL Databricks
Preferred skill sets:
ETL Databricks
Years of experience required:
4
Education qualification:
BTech/MBA/MCA
Education (if blank degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of Engineering Master of Business Administration
Degrees/Field of Study preferred:
Certifications (if blank certifications not specified)
Required Skills
Extract Transform Load (ETL)
Optional Skills
Desired Languages (If blank desired languages not specified)
Travel Requirements
Available for Work Visa Sponsorship
Government Clearance Required
Job Posting End Date
Required Experience:
Senior IC