Senior Azure Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
Role : Senior Azure Data Engineer
Experience : 6- 9 Years
Mandatory skills ( need to check ) : Python Pyspark SQL Data warehousing Concept Azure Cloud (ADF ADLS Azure Databricks )
Please note : Before sharing please cross validate Stability and Valid reason of change LinkedIn profiles and Company that candidate is working( past/ present ) Communication skills should be good since it is a client facing role
Interview Rounds: AI Screening Round Internal Panel Round Client Round HR discussion
Job description
KPI Partners is seeking a talented and experienced Senior Data Engineer with a strong background in Azure technologies to join our dynamic team. As a Senior Data Engineer you will be responsible for designing building and maintaining data pipelines and infrastructure that support our data analytics and business intelligence initiatives. You will work closely with data scientists analysts and other engineering teams to ensure the efficient processing and storage of data in the Azure cloud environment.
Key Responsibilities:
- Design and implement scalable data pipelines using Azure data services such as Azure Data Factory Azure Databricks and Azure Synapse Analytics.
- Collaborate with data architects and stakeholders to define data requirements and ensure alignment with business objectives.
- Optimize data storage and processing workflows to enhance performance and reduce costs.
- Monitor and troubleshoot data pipelines ensuring high availability and reliability of data processes.
- Conduct data quality assessments and implement monitoring solutions to ensure data integrity.
- Mentor and provide guidance to junior data engineers on best practices and design patterns.
- Stay up to date with the latest trends and technologies in the data engineering and Azure ecosystems.
Qualifications:
- Bachelor’s degree in computer science Engineering or a related field.
- 6 years of experience in data engineering with a strong focus on Azure-based solutions.
- Proficiency in programming languages such as Python SQL
- Experience with data warehousing concepts and tools specifically in an Azure context.
- Familiarity with big data technologies such as Azure HDInsight or Apache Spark.
- Strong understanding of ETL processes and data modeling techniques.
- Excellent analytical and problem-solving skills along with attention to detail.
- Strong communication and collaboration skills with the ability to work effectively in a team environment.
What We Offer:
- Competitive salary and benefits package.
- Opportunities for professional growth and development.
- A vibrant and inclusive workplace culture.
- The chance to work on innovative projects within a forward-thinking company.
Required Skills:
pyhton pyspark sQL
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
