Required Skills & Qualifications:
o 5 years of experience working with Apache Spark (including Structured Streaming).
o Strong proficiency in Scala with ability to write clean performant code.
o 3 years of experience with Apache Kafka for real-time streaming and messaging.
o Solid understanding of data modeling ETL and data pipeline orchestration.
o Familiarity with Hadoop ecosystem Hive Parquet or similar.
o Experience with CI/CD Docker and Kubernetes is a plus.
o Exposure to cloud platforms like AWS (EMR MSK) Azure or GCP is preferred.
o Excellent problem-solving communication and analytical skills.