We are looking for an experienced Data Engineer (Big Data exp) to join our team in Bangalore on an immediate basis. The ideal candidate will have strong expertise in big data technologies data processing frameworks and cloud platforms.
Key Responsibilities
*Design develop and maintain big data solutions using Hadoop Hive and Spark.
*Develop data processing pipelines with Spark (Scala/Java) and implement real-time streaming solutions using Kafka.
*Work with PostgresSQL for data management and integration.
*Collaborate with teams to deliver scalable and robust data solutions.
*Use Git for version control and Jenkins for CI/CD pipeline automation.
*Deploy and manage workloads on AWS and/or Azure cloud platforms.
*Leverage Databricks for advanced Spark analytics (Databricks Spark certification is preferred).
*Troubleshoot data and performance issues; optimize processes for efficiency.
BigData, Hadoop, Hive, Spark, Scala, Java, Kafka, PostgresSQL, Git, Jenkins, AWS/Azure