Big Data Engineer
Share
Job Location:
New York City, NY - USA
Monthly Salary:
Not Disclosed
Posted on:
5 days ago
Vacancies:
1 Vacancy
Job Summary
Position: Big Data Engineer (Only 12 Years Exp).
Location: NYC NY
Location: NYC NY
Skills: Coding expert in Java/Python Hadoop Ecosystem(HDFS) Spark Hive
Strong work experience - Agile environment preferred
Data Engineer (Big Data Hadoop Green Plum etc. Data Owner)
Designs and builds scalable data pipelines integrates diverse sources and optimizes storage/processing using Hadoop ecosystem and Greenplum.
Ensures data quality security and compliance through governance frameworks.
Implements orchestration monitoring and performance tuning for reliable cost-efficient operations.
Expertise in Hadoop ecosystem (HDFS Hive Spark Kafka) and MPP databases like Greenplum for large-scale data processing and optimization.
Collaborates with Data Owners and stakeholders to translate business rules into technical solutions.
Delivers curated datasets lineage and documentation aligned with SLAs and regulatory standards.
Subject matter expert having experiance of interacting with client understanding the requirement and guiding the team.
Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Data Engineer (Big Data Hadoop Green Plum etc. Data Owner)
Designs and builds scalable data pipelines integrates diverse sources and optimizes storage/processing using Hadoop ecosystem and Greenplum.
Ensures data quality security and compliance through governance frameworks.
Implements orchestration monitoring and performance tuning for reliable cost-efficient operations.
Expertise in Hadoop ecosystem (HDFS Hive Spark Kafka) and MPP databases like Greenplum for large-scale data processing and optimization.
Collaborates with Data Owners and stakeholders to translate business rules into technical solutions.
Delivers curated datasets lineage and documentation aligned with SLAs and regulatory standards.
Subject matter expert having experiance of interacting with client understanding the requirement and guiding the team.
Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
