Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
- Senior Data Engineer is responsible for design develop and support ETL data pipelines solutions primary in AWS environment
- Design develop and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
- Work as part of a team to build out and support data warehouse implement solutions using PySpark to process structured and unstructured data.
- Play key role in building out a semantic layer through development of ETLs and virtualized views.
- Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
- Support existing ETL processes written in SQL or leveraging third party APIs with Python troubleshoot and resolve production issues.
- Strong SQL and data to understand and troubleshoot existing complex SQL.
- Handson experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
- Create and maintain report specifications and process documentations as part of the required data deliverables.
- Serve as liaison with business and technical teams to achieve project objectives delivering cross functional reporting solutions.
- Troubleshoot and resolve data system and performance issues
- Communicating with business partners other technical teams and management to collect requirements articulate data deliverables and provide technical designs.
Qualifications :
- you have completed graduation from BE/Btech
- 6 to 9 years of experience in Data Engineering development
- 5 years of experience in Python scripting
- You should have 8 years experience in SQL 5years in Datawarehouse 5yrs in Agile and 3yrs with Cloud
- 3 years of experience with AWS ecosystem (Redshift EMR S3 MWAA)
- 5 years of experience in Agile development methodology
- You will work with the team to create solutions
- Proficiency in CI/CD tools (Jenkins GitLab etc.
Additional Information :
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is awardwinning; Worlds Best Workplaces 2024 (Fortune Top 25 Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
#LIOnsite
Benefits
Experian care for employees work life balance health safety and wellbeing.
1 In support of this endeavor we offer the best family wellbeing benefits
2 Enhanced medical benefits and paid time off.
Experian Careers Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
