Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
8years
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.
Requirements
Requirements
We are seeking an experienced SQL & Python Data Engineer with a strong background in SQL development performance tuning and Python programming for data engineering. The ideal candidate will have expertise in advanced SQL queries stored procedures and query optimization along with experience in Apache Airflow for workflow automation. The role involves working on largescale data platforms ensuring efficient data processing and ETL workflows.
Key Responsibilities:
- Develop optimize and maintain complex SQL queries functions and stored procedures to support data processing and analytics workflows.
- Analyze and optimize SQL performance by improving indexing partitioning and query plans.
- Develop scalable and efficient data pipelines using Python for data engineering and transformation.
- Implement and manage workflow automation using Apache Airflow ensuring smooth of data pipelines.
- Monitor and troubleshoot SQL and Python scripts to ensure high performance and reliability.
- Collaborate with crossfunctional teams to gather requirements and design efficient database solutions.
- Work on ETL processing data ingestion and transformation pipelines for structured and semistructured data.
- Ensure data integrity and consistency by implementing best practices in SQL and Python development.
- Stay updated with industry trends and recommend improvements to optimize data infrastructure and performance.
MustHave Skills:
GoodtoHave Skills (Preferred but Not Mandatory):
Benefits
8+ years of experience in SQL and Python programming Expertise in writing advanced SQL queries and creating complex functions and stored procedures. Skilled at optimizing complex SQL statements and performance tuning Strong Python programming expertise for data engineering use cases Experience with Apache Airflow. Good to have : Working knowledge on Greenplum platforms. Excellent communication, interpersonal skills, and motivation to work in high performance and rewarding work environments
Education
B.E/B.Tech/MCA/MSC/MS
Employment Type
Full Time
