EY - GDS Consulting - AI And DATA - Pyspark - Senior
EY - GDS Consulting - AI And DATA - Pyspark - Senior
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
At EY youll have the chance to build a career as unique as you are with the global scale support inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better too. Join us and build an exceptional experience for yourself and a better working world for all.
EY GDS Data and Analytics (D&A) PYSPARK - Senior
As part of our EY-GDS D&A (Data and Analytics) team we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking Insurance Manufacturing Healthcare Retail Manufacturing and Auto Supply Chain and Finance.
The opportunity
We are currently seeking a seasoned Azure Data Engineer with proven experience in Databricks PySpark to join our team of professionals. The successful candidate will play a key role in our Metadata Management team providing cutting-edge data management strategies and leveraging their strong analytical skills to solve complex problems.
Responsibilities
- Create Spark jobs for data transformation and aggregation
- Produce unit tests for Spark transformations and helper methods
- Design data processing pipelines
- 3-4 years of exposure to big data stack
Skills
- Py (with a focus on the functional programming paradigm)
- Apache Spark 2.x
- Apache Spark RDD API
- Apache Spark SQL DataFrame API
- Apache Spark GraphX API
- Apache Spark Streaming API
- Spark query tuning and performance optimization
- Bachelors degree in computer science Information Technology or related field.
- Minimum 4-6 years of experience in designing implementing and managing Data engineering practices that includes all aspect of data warehousing data quality master data management.
- Minimum 3 years experience in Spark with either pyspark or scala and building data pipelines using any orchestration tools.
- Expertise in writing automations frameworks using any scripting language preferably python/shell.
- Strong knowledge on SQL PL/SQL is must.
- Optimizing spark sql code and job performance using spark configurations is strongly desirable/
- Understanding & knowledge of Data warehouse concepts and infrastructures.
- Hands-on experience with cloud platforms such as AWS Azure.
- In-depth knowledge of CI/CD process
- Knowledge in Data acquisition real time systems is desirable.
What working at EY offers
At EY were dedicated to helping our clients from startups to Fortune 500 companies and the work we do with them is as varied as they are.
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus we offer:
- Support coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way thats right for you
EY Building a better working world
EY exists to build a better working world helping to create long-term value for clients people and society and build trust in the capital markets.
Enabled by data and technology diverse EY teams in over 150 countries provide trust through assurance and help clients grow transform and operate.
Working across assurance consulting law strategy tax and transactions EY teams ask better questions to find new answers for the complex issues facing our world today.
Employment Type
Full Time
