Big Data Engineer

Harrisburg, PA - USA

Monthly Salary: Not Disclosed

Posted on: 3 hours ago

Vacancies: 1 Vacancy

Job Summary

Hiring: W2 Candidates Only
Visa: Open to any visa type with valid work authorization in the USA

Responsibilities

Develop and maintain data pipelines using ETL processes
Take responsibility for Apache Hadoop development and implementation
Work closely with data science team to implement data analytics pipelines
Help define data governance policies and support data-versioning processes
Maintain security and data privacy working closely with data protection officer
Analyze vast number of data stores to uncover insights

Required skills and qualifications

Experience with Python Spark and Hive
Understanding of data-warehousing and data-modeling techniques
Knowledge of industry-wide visualization and analytics tools (ex: Tableau R)
Strong data engineering skills with Azure cloud platform
Experience with streaming frameworks such as Kafka
Knowledge of Core Java Linux SQL and any scripting language
Good interpersonal skills and positive attitude

Preferred skills and qualifications

Degree in computer science mathematics or engineering
Expertise in ETL methodology for corporate-wide solution design using DataStage

Hiring: W2 Candidates OnlyVisa: Open to any visa type with valid work authorization in the USA Responsibilities Develop and maintain data pipelines using ETL processesTake responsibility for Apache Hadoop development and implementationWork closely with data science team to implement data analytics p...