Senior Data Engineer (Python PySpark Big Data) Bangalore,Chennai,Gurgoan Hybrid

Not Interested
Bookmark
Report This Job

profile Job Location:

Bengaluru - India

profile Monthly Salary: Not Disclosed
Posted on: 7 hours ago
Vacancies: 1 Vacancy

Job Summary

Roles & Responsibilities
  • Design build and optimize large-scale data processing pipelines using Spark and PySpark.

  • Develop high-quality maintainable code using Python and object-oriented programming principles.

  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

  • Troubleshoot and resolve complex data engineering and software issues.

  • Implement best practices for data quality performance tuning and scalability.

  • Deliver solutions in alignment with enterprise architectural standards and guidelines.

  • Mentor junior team members and contribute to continuous process improvement.

Experience Requirements
  • Overall Experience: 7 years

  • Relevant Experience: Minimum 5 years in Spark Python and Big Data technologies.

  • Proven track record as a Senior Data Engineer or in a similar capacity.

  • Strong analytical and problem-solving skills with the ability to handle complex technical challenges.

  • Excellent verbal and written communication skills.

  • Ability to work independently with minimal supervision.

Mandatory Skills
  • Spark

  • Python

  • Big Data

Desired Skills
  • Spark

  • Python

  • Big Data

Domain
  • Cards and Payments

Location
  • Bangalore

  • Chennai

  • Gurgaon

Work Model
  • Hybrid: 3 days per week from office

Roles & Responsibilities Design build and optimize large-scale data processing pipelines using Spark and PySpark. Develop high-quality maintainable code using Python and object-oriented programming principles. Collaborate with cross-functional teams to understand business requirements and tran...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala