DescriptionWe are looking for an experienced Azure Data Engineer to be part of our data & analytics team. You will develop solutions leveraging Azure cloud platform to create a Modern Enterprise data platform. You will work with crossfunctional teams to ensure data is collected stored processed and analyzed in a timely efficient and accurate manner.
You will support digital transformation journey of data and analytics team at Rheem. This exciting transformation will enable new cloud technologies that will transform the way we derive value from our data assets.
This position will serve our Enterprise Division located in Atlanta GA (Hybrid)
Responsibilities- Design develop and deploy data solutions using Microsoft Azure cloud platform
- Develop and maintain automated data ingestion transformation and validation processes to ensure data accuracy and consistency
- Data Ingestion: Ingesting data from various sources such as onpremises systems cloudbased systems and thirdparty services into
- Data Transformation: Transforming data into the appropriate format schema and structure to meet business requirements
- Data Loading: Loading transformed data into Azure Synapse SQL Warehouse/ Azure Data Lake Storage
- Error Handling and Monitoring: Implementing error handling and monitoring processes to ensure data integration solutions operate smoothly and provide reliable data.
- Performance Optimization: Optimizing data integration processes for performance and cost by tuning queries caching data and managing resources.
- Collaboration: Collaborating with other teams such as architects developers and business analysts to ensure data solutions meet their requirements.
Qualifications- Bachelors degree in Computer Science or Data Analytics/engineering related streams
- 5 yearsof experience in developing Data warehouse/Lakehouse/Data platform on Azure Synapse Analytics/Azure Databricks/Azure Cloud Platform
- Strong experience in creating data ingestion and transformation pipelines using Synapse Pipeline/Azure Data Factory(ADF) and Azure Databricks.
- Should have experience in ETL/ELT. Handson experience using ADF/Synapse configuration parameters variables Integration services runtime.
- Strong understanding of Azure services such as Azure Synapse Azure Synapse Pipeline Azure Synapse Spark Notebooks Azure Synapse Dedicated SQL Pool Warehouse Azure Databricks Azure Functions and Azure Data Lake storage
- Knowledge of Dimensional data modeling and familiarity with concepts like start schema snowflake schema and normalization.
- Proficiency in DevOps tools and practices including CI/CD using Git automation and monitoring.
- Understanding of MDM concepts and technologies.
- Knowledge of Power BI Semantic data modeling and reporting.
- Understanding of with various data formats like relational json parquet streaming and others
- Proficiency in SQLTSQL and Python/PySpark
- Excellent problemsolving and analytical skills. Aptitude to adapt to new technologies
- Excellent business facing and internal communication skills
Preferred Qualifications:
- Microsoft Azure Data Engineer Associate Certificate
- Certification on Data Science/ML.
- Manufacturing industry experience.
#LIPM1
#LIHybrid