Senior Data Engineer Big Data

Wilmington, DE - USA

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Strong work experience - Agile environment preferred Data Engineer (Big Data Hadoop Green Plum etc. Data Owner) Designs and builds scalable data pipelines integrates diverse sources and optimizes storage/processing using Hadoop ecosystem and Greenplum. Ensures data quality security and compliance through governance frameworks. Implements orchestration monitoring and performance tuning for reliable cost-efficient operations. Expertise in Hadoop ecosystem (HDFS Hive Spark Kafka) and MPP databases like Greenplum for large-scale data processing and optimization. Collaborates with Data Owners and stakeholders to translate business rules into technical solutions. Delivers curated datasets lineage and documentation aligned with SLAs and regulatory standards. Subject mater expert having experiance of interacting with client understanding the requirement and guiding the team. Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule. Design and develop scalable data pipelines using Hadoop ecosystem and Greenplum for ingestion transformation and storage of large datasets. Optimize data models and queries for performance and reliability ensuring compliance with security and governance standards. Implement data quality checks monitoring and orchestration workflows for timely and accurate data delivery. Collaborate with Data Owners and business teams to translate requirements into technical solutions and maintain documentation and lineage.