Staff Data Engineer
Share
Job Location:
Heredia - Costa Rica
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
We are looking for an Engineer who succeed in solving complex large-scale data challenges and bring creative practical solutions shaped by their unique perspectives. Your work will directly allow Experians next generation of data-driven marketing solutions.
Were open-minded about new technologies passionate about what we do and make time for everyone to grow as the industry changes. The teams 20 engineers have an openness mindset thinking outside the box and solving big problems together.
Are you up for the challenge
- Design and build a petabyte-scale data platform on AWS (Spark Athena Iceberg Airflow) driving performance and reliability.
- Build scalable data pipelines using Spark and ensure code is optimized for performance and resiliency.
- Be able to navigate through complex data challenges and provide cohesive and creative solutions.
You will report to the Senior Manager Software Engineering.
A day in the life as an Engineer:
- Build advanced software systems while processing several petabytes of data.
- Use software engineering best practices and metrics.
- Deliver quality software collaboratively in value stream teams using Scrum methodology.
- Contribute to production projects that constitute our core offering.
- Work with cross-functional teams to provide production-ready data solutions that move business and product improvement. Always provide collaboration mutual assistance mutual respect courtesy and reliability.
- Ensure that the software you create is testable and tested.
- Peer review code and participate in proper code stewardship.
- Work with the Product Owner and Service Delivery Lead to explore detailed requirements acceptance tests and edge cases.
- Comply with corresponding protocols and procedures such as coding conventions use of version control proper code testing and alert/monitoring systems. Focus groups and leads will produce and share these protocols/procedures.
- Participate in code releases following pre-defined standards.
- Help us adapt our GraphQL interfaces to modern Model Context Protocol services.
- Experience using modern artificial intelligence (AI) large language model (LLM) techniques to enhance software development quality assurance and data access.
Qualifications :
- 8 years of experience making contributions in the form of tested production code in a big data platform environment.
- 5 years working with big data processing technologies like Python / Spark or Scala
- 5 years of working with Cloud Ecosystems and Tools. AWS experience is desired but Azure or GCP are accepted.
- Experience working with high-scale systems with expertise around parallelized workloads special emphasis on:
- Query optimization
- Data partitioning
- Proper usage of stored procedures
- Passionate about helping your teammates grow by providing insightful code reviews and feedback
- Experience planning and executing complex technical projects using the Agile framework.
- Collaborate against multiple code bases using git GitHub or Bitbucket.
Bonus Experience
- Experience with DBT or other data transformation tools
- Experience with AWS Services like Glue / S3 and Managed Airflow / AWS RDS.
- Understanding of concurrent and parallel programming
- Experience with AWS Database Migration Services or other Migration tools
- Experience with Angular and TypeScript is a bonus
- Experience using vector databases or using modern database technology vector search capabilities (pgvector redis vectorfields ) to accelerate large language model or retrieval augmented generation applications.
- Experience using modern artificial intelligence (AI) large language model (LLM) techniques to enhance software development quality assurance and data access.
Additional Information :
Our benefits include: Medical life and dental insurance Asociación Solidarista International Share Save Plan Flex Work/Work from home Paid time off Annual Performance Bonus Education Reimbursement Family Bonding Bereavement Leave Referral Program and more.
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward and recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
#LI-Hybrid
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Computer Science
- Docker
- Kubernetes
- Python
- VMware
- C/C++
- Go
- System Architecture
- gRPC
- OS Kernels
- Perl
- Distributed Systems
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
