Hadoop Developer

Dear Supplier Partner

Looking for Hadoop Developer for our client.

Location: Charlotte NC (Onsite)

Must Have Technical/Functional Skills

Primary Skill: Hadoop ecosystem (HDFS Hive Spark) PySpark Python Apache Kafka

Experience: Minimum 10 years

Roles & Responsibilities

Architectural Leadership:

Define end-to-end architecture for data platforms streaming systems and web applications.

Ensure alignment with enterprise standards security and compliance requirements.

Evaluate emerging technologies and recommend adoption strategies.

Data Engineering:

Design and implement data ingestion transformation and processing pipelines using Hadoop PySpark and related tools.

Optimize ETL workflows for large-scale datasets and real-time streaming.

Integrate Apache Kafka for event-driven architectures and messaging.

Collaboration & Leadership:

Work closely with product owners business analysts and DevOps teams.

Mentor junior developers and data engineers.

Participate in agile ceremonies code reviews and design discussions.

Required Skills & Qualifications:

Technical Expertise:

Strong experience with Hadoop ecosystem (HDFS Hive Spark).

Proficiency in PySpark for distributed data processing.

Advanced programming skills in Python.

Hands-on experience with Apache Kafka for real-time streaming.

Architectural Skills:

Expertise in designing scalable secure and high-performance systems.

Familiarity with microservices API design and cloud-native architectures.

Additional Skills:

Knowledge of CI/CD pipelines containerization (Docker/Kubernetes).

Exposure to cloud platforms (AWS Azure GCP). Soft Skills: Strong analytical and problem-solving abilities.

Excellent communication and leadership skills.

Ability to thrive in a fast-paced agile environment.