Apache Pyspark

Greetings From Maneva!

Job Description

Job Title Apache Pyspark

Location Chennai

Experience 4 10 Years

Notice 15 30 Days

Job Requirements:

Mandatory: Primary skill: Pyspark

Education: B. Tech/M. Tech/MCA

46 years of experience in the design and implementation of Big Data systems using PySpark database migration transformation and integration solutions for any Data warehousing project.

Must have excellent knowledge in Apache Spark and Python programming experience

Deep experience in developing data processing tasks using PySpark such as reading data from external sources merging data performing data enrichment and loading into target data destinations.

Experience in deployment and operationalizing the code knowledge of scheduling tools

Working experience on Cloud technology architecture like AWS ecosystem Google Cloud BigQuery etc. is an added advantage

Understanding of Unix/Linux Shell Scripting

Good knowledge of Hadoop Hive and Cloudera/ Hortonworks Data Platform

Experience handling CDC operations for huge volumes of data

Should understand and have operating experience with Agile delivery methodologies

Should have handson experience in the following: data validation writing unit test cases

Should have experience in integrating PySpark with downstream and upstream applications through a batch/realtime interface

Should have experience in finetuning process and troubleshooting performance issues

If you are excited to grab this opportunity please apply directly or share your CV at and

Pyspark