Data Engineer (PySpark)

Bengaluru - India

Monthly Salary: Not Disclosed

Posted on: 6 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Description:

Utilize Hive for data warehousing and querying.
Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
Ensure data quality and integrity throughout the data lifecycle.
Monitor and troubleshoot data workflows to ensure optimal performance.

Mandatory Skill Sets

Proficiency in Python: Strong programming skills in Python for data manipulation and analysis.
SQL Expertise: Advanced knowledge of SQL for querying and managing databases.
PySpark: Experience with PySpark for big data processing.
Hadoop: Hands-on experience with Hadoop ecosystem components.
Hive Basics: Understanding of Hive for data warehousing and querying.
HDFS: Proficiency in HDFS for data storage and management.

Job Description: Utilize Hive for data warehousing and querying. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Ensure data quality and integrity throughout the data lifecycle. Monitor and troubleshoot data workflows to ensure optimal...