Data Engineer

We are seeking a Data Engineer with strong experience in Apache Kafka Apache Spark Python DBT Airflow and SQL to build and maintain batch and streaming data pipelines across private cloud and on-premise environments. The role involves data ingestion ETL transformations data quality validation CDC/event streaming and near real-time processing from multiple data sources. Experience in Payments or Banking domains is preferred along with hands-on expertise in modern data engineering and pipeline development. Knowledge of technologies such as Apache Flink Trino Oracle SQL/PLSQL IBM MQ and Qlik Replicate is a plus.

Qualifications :

Must Have Skills

• Apache Kafka  Apache Spark Python DBT Airflow SQL SDK
• Domain : Work experience in  Payments industry(Preferred) or Banking / regermination
• Hands on experience building data pipelines

Nice to have: Apache Flink Trino superset Oracle SQLPL/SQL Qlik Replicate IBM MQ
Private Cloud/ on Prem*

Responsibilities

• Create data Ingestion/Acquisition and processing pipelines from different sources and environment     
• Batch Engineering: Batch ingestion of sources (Oracle PostgreSQL files) ETL transformations data quality checks and unit testing.
• Streaming Engineering:   -CDC and business event ingestion - near real-time  streaming - Schema management and fault tolerance.               

Soft skills

• Good communication skills (both written/verbal) mandatory 
• Oriented towards customer needs and problem solving;
• Willingness to understand and master very complex business applications
• Ability to work quickly and accurately within a team or on an individual basis under pressure with tight deadlines
• Excellent communication skills

Additional Information :

Why Join Us

• Competitive compensation and benefits.
• A collaborative tech-driven team culture.

Remote Work :

No

Employment Type :

Full-time