drjobs
Senior Databricks Platform Engineer
drjobs Senior Databricks Platform Engineer English

Senior Databricks Platform Engineer

صاحب العمل نشط

1 وظيفة شاغرة
هذا المنشور غير متاح الآن! ربما يكون قد تم شغل الوظيفة.
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني
Valid email field required
أرسل الوظائف
drjobs drjobs drjobs
drjobs drjobs
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني

Valid email field required
أرسل الوظائف

الراتب الشهري

drjobs

لم يكشف

drjobs

لم يتم الكشف عن الراتب

عدد الوظائف الشاغرة

1 وظيفة شاغرة

الوصف الوظيفي

Role: Senior Databricks Platform Engineer

Location: Remote

Full time Role

Job Description::

Mandatory Skills: Terraform, Databricks, Unity Catalog, Governance and Security for the databricks platform, Azure (platform), Integration/configuration experience of databricks with Github, Jenkins and reporting tools such as Tableau

As a Senior Databricks Platform Engineer, you will have the opportunity to build Databricks platform from the ground up. You'll be putting your Databricks knowledge and experience to work as you collaborate with teams of Data Engineers, Data Scientists, and Analysts to build a world-class data platform. You will lead the Databricks platform to deliver services for projects and users, including tracking Databricks roadmap for new features and evaluating public/private preview offerings for future use.

What you'll do as a Senior Databricks Platform Engineer

Automate and manage provisioning needs, such as Databricks Cluster Policies, Unity Catalog, Secrets Management, Role Based Access Control model and permissions.

Tune Databricks for performance and utilization optimization.

Provide infrastructure guidance of Databricks capabilities to accommodate business/technical use cases.

Leverage your strong communication skills to keep users informed and provide excellent quality of service.

Monitor and manage data and processes to control cost and optimize compute spend.

Configure and manage monitoring/alerting around latency performance on the Databricks platform including Delta Live Tables and Databricks Workflows.

Coordinate and collaborate with dependent infrastructure and Azure services to implement Databricks integration with services, such as ADLS, Access Management, SSO.

Support CICD processes including Jenkins/GITHUB.

Plan, implement and test disaster recovery protocols.

Define standards and practices for platform use, with a focus on Data Engineering use cases.

Provide technical expertise and troubleshooting as well as support for change management, governance. compliance, internal audits and remediations.

What you'll bring

A proven track record of administration, engineering, and operationalizing the Databricks platform in a production mode at scale for Data Engineering, Data Science or MLOps use cases.

Experience working in Azure.

Strong experience with infrastructure as code technologies (eg Terraform).

Strong experience with Python.

Experience with integrating other platforms like Snowflake, Tableau, MongoDB with Databricks.

Experience with streaming use cases and Databricks streaming technologies including Delta Live Tables.

The ability to leverage new technologies to test, build, and optimize data platform processes, pipelines, transformations, architectures, and data sets.

Expert level SQL knowledge in a variety of data engines (for example, Snowflake, MySQL, CosmosDB, SQL Server) is a big plus.

Excellent communications skills and interpersonal skills to effectively communicate and collaborate with both business and technical teams.

Experience with data logging/monitoring tools (e.g., Datadog, Splunk) is preferred.

Experience with MLFlow is a plus.

نوع التوظيف

عن بُعد

المهارات المطلوبة

  • APIs
  • C/C++
  • Computer Graphics
  • Go
  • React
  • Redux
  • Node.js
  • AWS
  • Library Services
  • Assembly
  • GraphQL
  • High Voltage

نبذة عن الشركة

الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل. نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا