Big Data Engineer
Share
Job Location:
Alpharetta, GA - USA
Monthly Salary:
$ 50 - 55
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Responsibilities
* Design & Develop new automation framework for ETL processing
* Support existing framework and become technical point of contact for all related teams
* Enhance existing ETL automation framework as per user requirements
* Performance tuning of spark snowflake ETL jobs
* New technology POC and suitability analysis for Cloud migration
* Process optimization with the help of automation and new utility development
* Work in collaboration for any issues and new features
* Support any batch issue
* Support application team teams with any queries
Required Skills
* 7 years of Data engineering experience
* Must be strong in UNIX Shell Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github DevOps CICD/ Enterprise code management tools
* Strong collaboration and communication skills
* Must possess strong team-player skills and should have excellent written and verbal communication skills
* Ability to create and maintain a positive environment of shared success
* Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
* Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
Primary skills: Python Big Data & Apache Spark
Desired skills
* Snowflake/Azure/AWS any cloud
* IDMC/any ETL tool
Rate range - $50-$55
* Design & Develop new automation framework for ETL processing
* Support existing framework and become technical point of contact for all related teams
* Enhance existing ETL automation framework as per user requirements
* Performance tuning of spark snowflake ETL jobs
* New technology POC and suitability analysis for Cloud migration
* Process optimization with the help of automation and new utility development
* Work in collaboration for any issues and new features
* Support any batch issue
* Support application team teams with any queries
Required Skills
* 7 years of Data engineering experience
* Must be strong in UNIX Shell Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github DevOps CICD/ Enterprise code management tools
* Strong collaboration and communication skills
* Must possess strong team-player skills and should have excellent written and verbal communication skills
* Ability to create and maintain a positive environment of shared success
* Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
* Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
Primary skills: Python Big Data & Apache Spark
Desired skills
* Snowflake/Azure/AWS any cloud
* IDMC/any ETL tool
Rate range - $50-$55
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Digital transformation and Engineering services company working with Fortune 500 customers across Industries for a Sustainable Tomorrow.
