drjobs Senior Data Engineer Databricks Optimization Specialist fmdiv

Senior Data Engineer Databricks Optimization Specialist fmdiv

Employer Active

1 Vacancy
The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Portugal

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

We are a dynamic team responsible for managing the central cloud infrastructure including the Databricks platform. Our mission is to empower teams ensuring highperformance costeffective solutions that optimize workloads and improve efficiency. We are looking for a Senior Data Engineer with a strong focus on Databricks optimization to help users finetune their workloads and contribute to cloud infrastructure enhancements.

As a Senior Data Engineer Databricks Optimization Specialist you will play a crucial role in optimizing Databricks workloads ensuring high performance while minimizing costs and resource usage. You will work closely with users to enhance Spark query performance finetune resource allocation and implement best practices in Databricks. Proficiency in PySpark Spark optimization and query tuning is essential. Knowledge of Azure cloud services is a plus.

Key Responsibilities

  • Optimize Databricks workloads to improve efficiency and reduce costs.

  • Analyze and finetune Spark queries for optimal performance.

  • Provide best practices for Databricks resource allocation and cluster management.

  • Troubleshoot and resolve performance bottlenecks.

  • Implement costsaving measures and automate workload management.

  • Develop and document performance optimization strategies.

  • Stay updated with the latest Databricks and Spark advancements and recommend improvements.

  • Support cloud infrastructure projects and advise on DatabricksAzure integrations.

  • Assist in cloud infrastructure implementation and support various use cases.


Qualifications :

Education:

  • Degree in Computer Science Data Engineering or a related field (or equivalent experience).

Experience:

  • Proven experience as a Data Engineer with a strong focus on Databricks optimization.

  • Handson expertise in PySpark and Spark performance tuning.

  • Experience in query performance tuning and workload optimization.

  • Knowledge of costsaving techniques within Databricks.

Knowhow:

  • Deep understanding of distributed computing and big data processing.

  • Expertise in Databricks resource allocation cluster management and automation.

  • Familiarity with Azure cloud services is a plus.

Languages:

  • Fluency in English (written and spoken) is required.

  • Additional languages are a plus.

Working Style and Methods:

  • Strong problemsolving skills and ability to troubleshoot performance bottlenecks.

  • Ability to work independently while collaborating with teams.

  • Proactive in staying updated with Databricks and Spark advancements.

Personality:

  • High level of initiative ownership and autonomy.

  • Excellent communication and collaboration skills to support users effectively.

  • Passion for efficiency optimization and continuous improvement.

Why Join Us

Work in a fastpaced innovative environment.
Opportunity to influence and optimize a critical data platform.
Collaborate with a passionate team focused on data and technology.
Enjoy a competitive salary and benefits package.
Access continuous learning and professional growth opportunities.


Additional Information :

Work #LikeABosch includes: 

Flexible work conditions

Hybrid work system

Exchange with colleagues around the world

Health insurance and medical office on site (general clinic)

Training opportunities (p.e. technical training foreign languages training) & certifications

Opportunities for career progression and continuous professional development

Access to great discounts in partnerships and Bosch

Sports and health related activities (gym)

Great access to public transports

Free parking lot

Canteen

 

Success stories dont just happen. They are made...

Make it happen. We are looking forward to your application!


Remote Work :

Yes


Employment Type :

Fulltime

Employment Type

Remote

Company Industry

Key Skills

  • GIS
  • Computer Data Entry
  • Facilities Management
  • ADMA
  • Fleet
  • Key Account

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.