Big Data Engineer

New York City, NY - USA

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Skills: Coding expert in Java/Python Hadoop Ecosystem(HDFS) Spark Hive

Strong work experience -Agile environment preferred
Data Engineer (Big Data - Hadoop Green Plum etc. Data Owner)
Designsand builds scalable data pipelines integrates diverse sourcesand optimizes storage/processing using Hadoop ecosystemand Greenplum.

Ensures data quality securityand compliance through governance frameworks.

Implements orchestration monitoringand performance tuning for reliable cost-efficient operations.
Expertise in Hadoop ecosystem (HDFS Hive Spark Kafka)and MPP databases like Greenplum for large-scale data processingand optimization.
Collaborates with Data Ownersand stakeholders to translate business rules into technical solutions.
Delivers curated datasets lineageand documentationaligned with SLAsand regulatory standards.
Subject matter expert having experiance of interacting with client understanding the requirementand guiding the team.
Documenting the requirements crlearly with defined scopeand must playaanchor role in setting the reight expectationsand deliveringas per the schedule

Skills: Coding expert in Java/Python Hadoop Ecosystem(HDFS) Spark Hive Strong work experience -Agile environment preferredData Engineer (Big Data - Hadoop Green Plum etc. Data Owner)Designsand builds scalable data pipelines integrates diverse sourcesand optimizes storage/processing using Hadoop ec...