Data Platform Engine....
Data Platform Engineer with Azure Databricks
Posted on :
13-03-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
13-03-2024
Job Description
Req ID : 2621724
Data Platform Engineer with Azure Databricks and Unity Catalog.
Seattle based client
1012 months
Remote
Remote
Core skills needed
Data Platform Engineer with Databricks and Unity Catalog.
Experience 9 years
Design and implement data architecture leveraging technologies such as Azure Databricks.
Set up Unity Catalog Should have specific experience setting up Unity Catalog
Good to have Privacera and Collibra.
Develop optimize and manage data pipelines for ETL processes using azure Databricks with a focus on data integrity and quality.
Design and maintain data models and schemas incorporating Unity Catalog and Collibra data governance practices.
Ensure data security and compliance with regulations using Databricks.
Establish a robust data governance strategy defining standards metadata management lineage and quality practices.
Operationalize Machine Learning models in Batch and Real Time Data Pipelines leveraging relevant governance setups.
Collaborate with crossfunctional teams including data scientists engineers and analysts to translate business requirements into scalable solutions.
Regards
Tarun Shrivastava
Talent acquisition specialist
Employment Type
Full Time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
