Important Information
Experience: 6 years
Job Mode: Full-time
Work Mode: Work from home
Job Summary
We are looking for a Data Engineer who has experience with data pipelines real-time APIs and scalable cloud this role you will work with technologies like Kotlin Kafka/Pulsar Azure and Kubernetes to build reliable high-throughput systems for data movement and access.
Responsibilities and Duties
- Design build and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar.
- Develop and maintain high-performance APIs to serve real-time data from databases services and caches.
- Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data.
- Architect and implement scalable solutions to handle growing traffic and data volume across services.
- Work with Azure cloud services including Databricks for data processing and analytics.
- Manage containerized workloads using Kubernetes with a focus on high availability and auto-scaling.
- Participate in CI/CD observability and performance tuning across the platform.
Qualifications and Skills
- 4 years of experience building ELT or streaming data pipelines.
- Strong Kotlin Python development skills (or experience with JVM languages and willingness to learn Kotlin).
- Deep understanding of distributed systems and real-time data processing.
- Proven experience with microservices architecture and API development.
- Solid understanding of Kubernetes concepts: pods services autoscaling Helm charts etc.
- Cloud deployment experience ideally on Azure with exposure to Databricks or similar platforms.
- Excellent communication skills and user-first mindset.
Tech Stack
- Languages: Kotlin Python SQL/Oracle
- Data Pipelines: Kafka Pulsar
- APIs: REST
- Cloud: Azure (preferred) Databricks
- Deployment: Kubernetes Helm Docker
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services Product Engineering & Application Modernization Data & Analytics Digital Experience & Design Services DevSecOps Cybersecurity Quality Engineering AI & LLM Engineering among others.
At Encora we hire professionals based solely on their skills and do not discriminate based on age disability religion gender sexual orientation socioeconomic status or nationality.