Python & PySpark Developer
Job Summary
*Python & PySpark Developer – Hiring*
*Experience:* 5–7 Years
*Openings:* 2
*Location:* Bangalore
*CTC:* 15–18 LPA
We are looking for an experienced *Python & PySpark Developer* to design develop optimize and maintain scalable data processing applications and ETL pipelines.
*Key Responsibilities:*
• Develop and maintain scalable data pipelines and ETL processes using Python and PySpark.
• Optimize PySpark applications and workflows for performance and efficiency.
• Work with big data technologies such as Hadoop Hive Kafka AWS and Databricks Lakehouse.
• Ensure data quality validation reconciliation and integrity.
• Monitor and troubleshoot production data processing jobs.
• Collaborate with Data Engineers Data Scientists and cross-functional teams.
*Required Skills:*
• Strong proficiency in Python and PySpark.
• Expertise in Apache Spark Spark SQL and DataFrames.
• Strong SQL and database knowledge.
• Good understanding of ETL Data Warehousing Data Pipelines Quality Gates and Reconciliation.
• Experience handling large-scale datasets.
• Strong analytical debugging and problem-solving skills.
• Excellent communication and collaboration skills.