Senior DataETL Engineer
Job Summary
Mandatory Skills
Informatica Snowflake Cloud DBPythonSpark ScalaPySparkAWS service
Experience
Responsibilities
Informatica Snowflake Cloud DBPythonSpark ScalaPySparkAWS service
Experience
- BS Degree in Engineering or Masters Computer Science or equivalent experience
- 6-8 years of experience in database development programming design and analysis
- 2 years of experience in coding and scripting languages - Java Python JavaScript bash batch files Korn.
- 1 years of experience with Spark ScalaPySpark
- 6-8 years of experience with data and ETL programming (Informatica)
- 4-6 years of experience in SQL and a variety of database technologies Snowflake Teradata and Oracle.
- 1 years of experience in No Sql db (dynanmo db Cassandra)
- Good technical analysis & troubleshooting skills
- Experience in designing and architecting medium to complex systems well versed with design standards & framework
- General knowledge in Linux Unix Administration and Windows Administration
- Knowledge of Dimensional Modelling
- 1 year of experience with streaming services Flink Kafka
- Experience with automation configuration management orchestration enterprise schedulers
- 1 years of experience with AWS services (EKS S3 EC2 Kinesis DynamoDB Glue Deequ etc)
Responsibilities
- Engineer data pipelines and provide automated solutions for DE teams
- Work proactively to address project requirements and articulate issues challenges with enough lead time to address project delivery risk
- Ensure code is fully scalable maintainable and performant Verifies program logic by overseeing the preparation of test data testing and debugging of programs
- Work with Project Managers and TPM to ensure the timely delivery of project deliverables that meet requirements
- Requires ability to work in a global and multi-cultural environment. Team members are in multiple geographies resulting in time constraints due to time zones differences and a requirement for occasional travel
- Participate in the agile development process
- Develops new documentation departmental technical procedures and user guid