IN-Senior Associate Azure DE Databricks DeveloperData Analytics Advisory PAN India
IN-Senior Associate Azure DE Databricks DeveloperData Analytics Advisory PAN India
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Line of Service
AdvisoryIndustry/Sector
Not ApplicableSpecialism
OperationsManagement Level
Senior AssociateJob Description & Summary
At PwC our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.In business intelligence at PwC you will focus on leveraging data and analytics to provide strategic insights and drive informed decisionmaking for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.
*Why PWC
At PwC we believe in providing equal employment opportunities without any discrimination on the grounds of gender ethnic background age disability marital status sexual orientation pregnancy gender identity or expression religion or other beliefs perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firms growth. To enable this we have zero tolerance for any discrimination and harassment based on the above considerations.
Responsibilities:
1. Data Lake and Lakehouse Implementation:
o Design implement and manage Data Lake and Lakehouse architectures. (Must have)
o Develop and maintain scalable data pipelines and workflows. (Must have)
o Utilize Azure Data Lake Services (ADLS) for data storage and management. (Must have)
o Knowledge on Medalion Architecture Delta Format. (Must have)
2. Data Processing and Transformation:
o Use PySpark for data processing and transformations. (Must have)
o Implement Delta Live Tables for realtime data processing and analytics. (Good to have)
o Ensure data quality and consistency across all stages of the data lifecycle. (Must have)
3. Data Management and Governance:
o Employ Unity Catalog for data governance and metadata management. (Good to have)
o Ensure robust data security and compliance with industry standards. (Must have)
4. Data Integration:
o Extract transform and load (ETL) data from multiple sources (Must have) including SAP (Good to have) Dynamics 365 (Good to have) and other systems.
o Utilize Azure Data Factory (ADF) and Synapse Analytics for data integration and orchestration. (Must have)
o Performance Optimization of the Jobs. (Must have)
5. Data Storage and Access:
o Implement and manage Azure Data Lake Storage (ADLS) for largescale data storage. (Must have)
o Optimize data storage and retrieval processes for performance and costefficiency. (Must have)
6. Collaboration and Communication:
o Work closely with data scientists analysts and other stakeholders to understand data requirements. (Must have)
o Provide technical guidance and mentorship to junior team members. (Good to have)
7. Continuous Improvement:
o Stay updated with the latest industry trends and technologies in data engineering and cloud computing. (Good to have)
o Continuously improve data processes and infrastructure for efficiency and scalability. (Must have)
Required Skills and Qualifications:
Technical Skills:
o Proficient in PySpark and Python for data processing and analysis.
o Strong experience with Azure Data Lake Services (ADLS) and Data Lake architecture.
o Handson experience with Databricks for data engineering and analytics.
o Knowledge of Unity Catalog for data governance.
o Expertise in Delta Live Tables for realtime data processing.
o Familiarity with Azure Fabric for data integration and orchestration.
o Proficient in Azure Data Factory (ADF) and Synapse Analytics for ETL and data warehousing.
o Experience in pulling data from multiple sources like SAP Dynamics 365 and others.
Soft Skills:
o Excellent problemsolving and analytical skills.
o Strong communication and collaboration abilities.
o Ability to work independently and as part of a team.
o Attention to detail and commitment to data accuracy and quality.
Certifications required:
Certification in Azure Data Engineering or relevant Azure certifications.
o DP203 (Must have)
Certification in Databricks.
o Databricks certified Data Engineer Associate (Must have)
o Databricks certified Data Engineer Professional (Good Have)
Mandatory skill sets:
Azure DE Pyspark Databricks
Preferred skill sets:
Azure DE Pyspark Databricks
Years of experience required:
510 Years
Education Qualification
BE B.Tech MCA M.Tech
Education (if blank degree and/or field of study not specified)
Degrees/Field of Study required: Master of Engineering Bachelor of EngineeringDegrees/Field of Study preferred:Certifications (if blank certifications not specified)
Required Skills
Microsoft AzureOptional Skills
Accepting Feedback Accepting Feedback Active Listening Analytical Thinking Business Case Development Business Data Analytics Business Intelligence and Reporting Tools (BIRT) Business Intelligence Development Studio Communication Competitive Advantage Continuous Process Improvement Creativity Data Analysis and Interpretation Data Architecture Database Management System (DBMS) Data Collection Data Pipeline Data Quality Data Science Data Visualization Embracing Change Emotional Regulation Empathy Inclusion Industry Trend Analysis 12 moreDesired Languages (If blank desired languages not specified)
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship
NoGovernment Clearance Required
NoJob Posting End Date
Required Experience:
Senior IC
Employment Type
Full-Time
