Sr Spark and Kafka Developer

Who we are

Artmac Soft is a technology consulting and serviceoriented IT company dedicated to providing innovative technology solutions and services to customers.

Job Description:

Job Title : Sr Spark and Kafka Developer

Job Type : W2 / C2C

Experience : 10 Years

Work Location : Onsite

Location : RichmondVA / Washington D.C (Hybrid)

We are looking for a senior Spark and Kafka developer who will be responsible for designing implementing and optimizing data pipelines leveraging Spark and Kafka technologies. The candidate will have a strong background in developing and maintaining Spark and Kafkabased solutions.

Responsibilities:

• Experience in developing and maintaining Spark and Kafka applications.
• Experience with streaming data processing frameworks like Spark Streaming or Kafka Streams.
• Handson experience with Spark SQL Spark Streaming Kafka Streams and related technologies.
• Experience with stream processing frameworks such as Apache Flink is a plus.
• Familiarity with cloud platforms (e.g. AWS Azure GCP) and their managed Spark and Kafka services.
• Design develop and maintain Spark and Kafkabased data pipelines to support realtime data processing requirements.
• Collaborate with crossfunctional teams to understand business requirements and translate them into technical solutions.
• Optimize Spark jobs for performance and scalability considering factors such as data partitioning caching and resource allocation.
• Develop and implement monitoring and alerting solutions to ensure the health and performance of Spark and Kafka clusters.
• Troubleshoot and resolve issues related to Spark and Kafka applications in production environments.
• Stay uptodate with the latest advancements in Spark and Kafka technologies and incorporate them into the existing infrastructure when appropriate.
• Document designs implementations and best practices for Spark and Kafkabased solutions.

Qualification:

• Bachelors degree or equivalent combination of education and experience