Big Data Engineer

Malvern, PA - USA

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

Hello There

My name is Himanshu Sharma and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at .

Job Description

Position : Big Data Engineer

Location : Malvern PA Hybrid

Duration : Initial 12 months options to extend - Long term contract role

Responsibilities

Collaborate on the Smartstream cash reconciliation platform known as TLM to support data integration and transformation workflows.
Design and implement ETL processes using tools like AWS Glue Spark or Python to transform raw data into structured formats compatible with Smartstreams ingestion requirements.
Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S3 buckets ensuring consistency and accuracy across systems.
Ensure data quality and lineage through validation checks anomaly detection and documentation of data assumptions
Integrate data sources into cloud platforms such as AWS leveraging services like S3 Glue Lambda
Work closely with product owner and business to understand data requirements translate them into technical specifications
Implement data governance principles including version control access management and compliance with Vanguard and GIFS standards

Qualification: (8 minimum experience)

AWS Skills - Glue Lambda S3 KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)

Hello There My name is Himanshu Sharma and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at . Job Description Posi...