Data Engineer

Malvern, PA - USA

Monthly Salary: Not Disclosed

Posted on: 30+ days ago

Vacancies: 1 Vacancy

Job Summary

There will be a code assessment first so make sure your consultants are aware. A resume should not be More than 2 pages

Data Engineer

Malvern PA (Hybrid)

Responsibilities

Analyze complex business problems track down required information document requirements and develop technical solutions.

Strong analytical and problem-solving skills and the tenacity to overcome technical challenges.

Troubleshoot and optimize new and existing ETL packages.

Experience with AWS Glue AWS Athena Lambda AWS Cloudformation AWS IAM & S3 AWS SNS Oracle Hive.

Experience with CI/CD pipeline tools like Bamboo Bitbucket GitHub.

Experience with Test Driven Development.

Experience with building AWS cloud formation templates.

Experience with building server level architecture framework in AWS.

Experience with Unix scripting/Linux configuration preferred.

Experience building Spark data processing applications (Python PySpark)

Experience with SQL development.

Qualifications

Pyspark SQL AWS Glue AWS Athena Lambda AWS Cloudformation AWS IAM & S3 AWS SNS Oracle

building pipelines with EMR/glue which is essential for us

Feel free to reach me at

There will be a code assessment first so make sure your consultants are aware. A resume should not be More than 2 pages Data Engineer Malvern PA (Hybrid) Responsibilities Analyze complex business problems track down required information document requirements and develop technical solutions. Stron...