Senior Consultant, Data Engineering

Hyderabad - India

Monthly Salary: Not Disclosed

Posted on: 12 hours ago

Vacancies: 1 Vacancy

Job Summary

Overview:

TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations enabling them to transform their digital futures

Position: Senior Consultant Data Engineering

Location: Hyderabad

Duration: 24 Months

Job Type: Contract

Work Type: Hybrid

Job Description:

Database Expertise:

Strong hands-on experience with Greenplum Teradata MongoDB and Oracle for data modelling querying and performance optimization.

Streaming & Real-Time Data:

Proficient in Apache Kafka for building and managing real-time data streaming pipelines.

Data Integration & ETL Tools:

Informatica: Experience with HTTP Transformation for REST APIs XML Transformation and OAuth-based authentication.
StreamSets: Skilled in using components like HTTP Client Processor with OAuth2 authentication for API integration.

Big Data & Lakehouse Technologies:

Strong development experience with PySpark for distributed data processing.
Familiarity with Apache Iceberg for managing large-scale transactional datasets in Lakehouse architectures.

Scripting & Automation:

Advanced scripting skills in Python and Unix/Linux shell for automation data manipulation and workflow management.
Proven ability to debug and promote fixes under high-priority scenarios.

Data Replication:

Basic working knowledge/Understanding of Oracle Goldengate and CDC frameworks for data replication across heterogeneous systems.

Workflow Orchestration:

Experience with Control-M and Apache Airflow for scheduling monitoring and managing complex/custom data workflows.

Cloud & DevOps:

Familiarity with CI/CD tools and AWS ECS for containerized deployments and continuous integration.

Soft Skills:

Strong problem-solving and debugging capabilities.
Flexible and dependable in supporting teams during critical issue resolution and extended hours when needed.

Mandatory Skills:

Database Expertise: Primary (Greenplum & Teradata)
Data Integration & ETL Tools: Primary
Streaming & Real-Time Data: Primary
Scripting & Automation: Primary
Workflow Orchestration: Secondary
Cloud & DevOps: Secondary
Big Data & Lakehouse Technologies: Secondary
Data Replication: good to have
Soft Skills: good to have

Experience:

Total Exp: 15 years
Rel Exp: 15 years

TekWissen Group is an equal opportunity employer supporting workforce diversity.

Overview: TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations enabling them to transform their digital futures Po...