Data Enginner
Share
Job Location:
Monthly Salary:
Posted on:
9 days ago
Vacancies:
1 Vacancy
Job Summary
Company Name: Willware Technologies
Role: Data Engineer
Experience:4 Years
Location: Bangalore
WorkMode: Hybrid
Job Summary
We are seeking a highly skilled Data Engineer with strong expertise in building scalable data pipelines and working with cloud-based data platforms. The ideal candidate should have hands-on experience in SQL ETL processes Python and Azure data services.
Key Responsibilities
- Design build and maintain scalable ETL/ELT pipelines
- Develop and optimize complex SQL queries for data processing and reporting
- Work with Azure Data Factory for orchestration and pipeline automation
- Process large datasets using Databricks (PySpark)
- Build and manage data solutions on Azure Data Lake & Blob Storage
- Perform data transformation cleansing and validation
- Handle structured and semi-structured data (JSON XML)
- Integrate data from multiple sources (APIs databases files)
- Ensure data quality reliability and performance
- Collaborate with data analysts and business teams
Required Skills (Core Focus)
- Strong expertise in SQL (mandatory)
- Hands-on experience in ETL/ELT pipeline development
- Proficiency in Python (Pandas / PySpark)
- Experience with Azure Data Factory
- Strong working knowledge of Databricks / Apache Spark
- Experience with Azure Data Lake & Blob Storage
- Good understanding of data warehousing concepts
- Experience working with Oracle / SQL databases
Good to Have
- Exposure to Microsoft Fabric
- Knowledge of Oracle OTM (Transportation Management)
- Experience with CI/CD pipelines
- Understanding of data governance and security
Required Skills:
SQLETLPythonpysparkAWSGCPAzureELT
