Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
We are looking for an experienced Senior Data Engineer with expertise in AIpowered tools workflow automation and modern data platform engineering. You will develop data software applications data platforms and data products. It partners with application engineers data engineers data scientists and CRM teams to develop scalable solutions. The Engineer will contribute both independently and collaboratively. The Engineers responsibilities will include defining engineering standards performing data analysis and modeling writing highquality code conducting testing and code reviews preparing deployments ensuring operational readiness and supporting Agile development practices. Additionally the Engineer will keep Security first in mind. You will report to the Development and Operations Manager.
- Lead the implementation of AI and LLMbased tooling to automate data engineering workflows (e.g. code generation data quality monitoring schema drift detection).
- Build automated frameworks for data ingestion transformation orchestration and deployment using AIpowered accelerators.
- Integrate AI/ML capabilities into pipelines including anomaly detection metadata enrichment and pattern recognition.
- Develop automated data validation frameworks and implement AIassisted data quality checks.
- Take technical ownership of all stages and iterations of assigned software components.
- Design technology solutions meet all functional and nonfunctional our requirements.
- Provide ongoing production support by overseeing critical data pipelines resolving incidents ensuring system stability and driving rootcause analysis for continuous improvement.
- Produce clear documentation of designs architectural decisions and code artifacts; participate in knowledge sharing.
- Provide regular updates and communications to project partners.
- Ensure solution adoption through training documentation and readiness planning.
- Work across multiple projects and departments supporting engineering tasks and crossfunctional programs.
- Apply industry best practices engineering standards and governance principles.
- Be a important contributor to deliver highvalue ontime onbudget complex projects.
Qualifications :
- Bachelors degree in Computer Science or equivalent experience.
- 5 years in commercial software development environments.
- 5 years of handson experience in data engineering or similar roles.
- Demonstrated experience using AI/LLM tools for code generation testing monitoring and automation.
- Handson experience with:
- PySpark Python SQL (expertlevel)
- Data engineering pipelines frameworks and automation
- Knowledge of data platform paradigms and modern software architecture.
- Cloud experience with AWS including services such as API Gateway Lambda EC2 ECS SQS SNS DynamoDB Redshift and Aurora.
- Understand detailed technical specifications and adapt quickly to new technologies Experience making any architectural tradeoffs required to provide software solutions.
- Experience building scalable resilient and observable distributed systems and problemsolving skills across a range of complexities.
- Experience troubleshooting issues with users.
- Familiarity with MLOps ML orchestration and model deployment workflows.
Additional Information :
This is a permanent remote home-based role in Costa Rica. No relocation available.
Our benefits include: Medical life and dental insurance treceavo salario International Share Save Plan Flex Work/Work from home Paid time off Annual Performance Bonus Education Reimbursement Family Bonding Bereavement Leave Referral Program and more.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
#LI-ML2 #LI-Remote
This is a remote position.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
