Data Engineer

Hoshangabad - India

Monthly Salary: INR 3500000 - 3500000

Experience Required: 4-5years

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 3-7 years of prior experience in data engineering with a strong background in working on modern data platforms. This role offers an exciting opportunity to work on diverse projects collaborating with cross-functional teams to design build and optimize data pipelines and infrastructure.

Responsibilities:

Designing building and operating scalable on-premises or cloud data architecture

Analyzing business requirements and translating them into technical specifications

Design develop and implement data engineering solutions using DBT on cloud platforms (Snowflake Databricks)

Design develop and maintain scalable data pipelines and ETL processes

Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.

Optimize data storage and retrieval mechanisms to ensure performance reliability and cost-effectiveness

Implement data governance and security best practices to ensure compliance and data integrity

Troubleshoot and debug data pipeline issues providing timely resolution and proactive monitoring

Stay abreast of emerging technologies and industry trends recommending innovative solutions to enhance data engineering capabilities.

Requirements

Bachelors or Masters degree in Computer Science Engineering or a related field.

Overall 3 years of prior experience in data engineering with a focus on designing and building data pipelines

Experience of working with DBT to implement end-to-end data engineering processes on Snowflake and Databricks

Comprehensive understanding of the Snowflake and Databricks ecosystem

Strong programming skills in languages like SQL and Python or PySpark.

Experience with data modeling ETL processes and data warehousing concepts.

Familiarity with implementing CI/CD processes or other orchestration tools is a plus.

Required Skills:

Bachelors degree in Computer Science Engineering or related field; or equivalent work experience. Proven experience as a DevOps Engineer or similar role with hands-on expertise in AWS and Azure cloud environments. Strong proficiency in Azure DevOps Git GitHub Jenkins and CI/CD pipeline automation. Experience deploying and managing Kubernetes clusters (EKS AKS) and container orchestration platforms. Deep understanding of cloud-native architectures microservices and serverless computing. Familiarity with Azure Synapse ADF ADLS and AWS data services (EMR Redshift Glue) for data integration and analytics. Solid grasp of infrastructure as code (IaC) tools like Terraform CloudFormation or ARM templates. Experience with monitoring tools (e.g. Prometheus Grafana) and logging solutions for cloud-based applications. Excellent troubleshooting skills and ability to resolve complex technical issues in production environments.