Senior Data Engineer

Hyderabad - India

Monthly Salary: INR 55000 - 85000

Posted on: 7 days ago

Vacancies: 1 Vacancy

Job Summary

Deep Sync is the industry leader in deterministic identity and AI-powered data solutions. Leveraging our 35-year foundation of compiling direct mail-grade datasets Deep Sync develops data-first technologies that power marketing measurement AI and business intelligence for agencies and brands with our fully deterministic identity graph privacy-first audiences comprehensive data solutions and integrations with leading platforms and cloud providers.

Position Overview: We are seeking a Senior Data Engineer with a robust background in data engineering to join our team. The ideal candidate will be pivotal in designing developing and maintaining our data infrastructure. This role emphasizes on building machine learning models but on integrating and deploying these models into our data pipelines to enhance our capabilities in advanced analytics and machine learning processes. The successful candidate will contribute expertise to improve and scale our data engineering practices ensuring the seamless incorporation of machine learning models into our operational workflows.

Key Responsibilities:

Data Pipeline Development:

Design implement and maintain scalable data pipelines to collect process and store data from various sources.
Ensure data quality accuracy and consistency throughout the pipeline.

Data Modeling Integration:

Design and implement existing data models for predictive analytics machine learning and data exploration.
Optimize data structures and storage to support predictive analytics/machine learning processes.

Data Integration:

Work closely with cross-functional teams to integrate data from diverse sources including databases APIs and external data providers.
Develop and maintain ETL processes to transform and enrich raw data into actionable insights.

Performance Tuning:

Monitor and optimize the performance of data pipelines and databases to meet business requirements.
Identify and resolve bottlenecks and performance issues.

Continuous Learning and mentoring:

Stay up-to-date with the latest advancements in data engineering and data science technologies.
Share knowledge and mentor junior team members.

Requirements

Bachelors or Masters degree in Computer Science Engineering or a related field.
5 years of software engineering experience.
Proven experience in developing and delivering large-scale software products.
Strong experience in AI/ML technologies and building AI-powered applications.
Strong programming skills in languages such as Python Java or C.
Experience with cloud platforms (e.g. AWS Azure GCP) and containerization technologies (e.g. Docker Kubernetes).
Excellent problem-solving skills and a passion for innovation.
Tech Stack:
- Cloud Provider Experience: AWS
- Data Storage and Warehousing Analytics Engine
  - Snowflake
- Amazon Services
  - AWS Glue
  - AWS Elastic MapReduce (EMR)
  - AWS Lambda
- Data Processing and Computation
  - Apache Spark
- Workflow & DataOps
  - Apache Airflow DAGs (Directed Acyclic Graph) for orchestration

Benefits: We are proud to offer a best-in-class benefits package designed to support the well-being and professional growth of our team members. Our comprehensive benefits are highly competitive and considered to be among the best offered by companies in India ensuring you are well-cared for as part of the Deep Sync family.

Required Experience:

Senior IC