Senior Product Engineer (Data Engineer)
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Department:
Job Summary
Job description
Job Summary:
We are seeking a skilled and motivated Data Engineer to design develop and maintain scalable data pipelines and backend services using cutting-edge technologies. You will work with AWS services PySpark Python and Java to implement efficient data processing solutions and APIs. Collaborating with cross-functional teams you will gather requirements optimize data workflows troubleshoot performance issues and ensure data quality across platforms. As a mentor to junior engineers you will provide technical guidance and contribute to the teams success.
Key Responsibilities:
- Design develop and maintain scalable data pipelines and systems using AWS services.
- Implement data processing solutions using PySpark and Python.
- Develop and maintain backend services and APIs using Java.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions.
- Optimize and troubleshoot data workflows and performance issues.
- Ensure data quality and integrity across various data sources and platforms.
- Mentor junior engineers and provide technical guidance.
Required Skills:
- Extensive experience with AWS services such as EC2 S3 Lambda Glue and EMR.
- Proficiency in PySpark for large-scale data processing.
- Strong programming skills in Python.
- At least 2 years of experience in Java.
- Experience with data warehousing solutions and ETL processes.
- Knowledge of both relational and NoSQL databases.
- Familiarity with CI/CD pipelines and version control systems like Git.
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork abilities.
Preferred Qualifications:
- Experience with machine learning frameworks and tools.
- Knowledge of data security and compliance best practices.
- Certification in AWS or related technologies.
Qualifications :
Qualifications
- AWS: EC2 S3 Lambda Glue EMR. Proficiency in PySpark & Python for large-scale data processing 2years of Java experience
- Familiarity with ETL processes and data warehousing concepts Understanding of relational databases and NoSQL databases
- Familiarity with CI/CD pipelines and version control systems like Git.
Additional Information :
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
