drjobs Senior Data Engineer

Senior Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Bengaluru - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

As a Data engineer in our team you work with large scale manufacturing data coming from our globally distributed plants. You will focus on building efficient scalable & data-driven applications.

The data sets produced by these applications whether data streams or data at rest need to be highly available reliable consistent and quality-assured so that they can serve as input to wide range of other use cases and downstream applications.

We run these applications on Azure databricks you will be building applications you will also contribute to scaling the platform including topics such as automation and observability.

Finally you are expected to interact with customers and other technical teams e.g. for requirements clarification & definition of data models.

Primary responsibilities:                                                   

  • Be a key contributor to the Bosch hybrid cloud data platform (on-prem & cloud)

  • Designing & building data pipelines on a global scale ranging from small to huge datasets

  • Design applications and data models based on deep business understanding and customer requirements

  • Directly work with architects and technical leadership to design & implement applications and / or architectural components

  • Architectural proposal and estimation for the application technical leadership to the team
  • Coordination/Collaboration with central teams for tasks and standards
  • Develop data integration workflow in Azure
  • Developing streaming application using scala.
  • Integrating the end-to-end Azure Databricks pipeline to take data from source systems to target system ensuring the quality and consistency of data.
  • Defining data quality and validation checks.
  • Configuring data processing and transformation.
  • Writing unit test cases for data pipelines.
  • Defining and implementing data quality and validation check.
  • Tuning pipeline configurations for optimal performance.
  • Participate in Peer review and PR review for the code written by team members

Qualifications :

  • Bachelors degree in computer science Computer Engineering relevant technical field or equivalent; Masters degree preferred.


Additional Information :

Skills

Based on deep technical expertise capable of working directly with architects and technical leadership

Able to guide junior team members in technical questions related to architecture or software & system design

Self-starter and empowered professional with strong execution and communication capabilities

Proactive mindset: identify and start work independently challenges status quo accepts being challenged

Outstanding written and verbal communication skills.

Key Competencies:

  • 6 years experience in data engineering ETL tools and working with large data sets.
  • Minimum 5 years of working experience of distributed cluster.
  • At least 5 years of experience in Scala software development.
  • At least 2-3 years of Azure Databricks Cloud experience in Data Engineering
  • Experience of Delta table ADLS DBFS ADF.
  • Deep level of understanding in distributed systems for data storage and processing (e.g. Kafka Spark Azure Cloud)
  • Experience with Cloud based SQL Database: Azure SQL Editor
  • Excellent software engineering skills (i.e. data structures algorithms software design).
  • Excellent problem-solving investigative and troubleshooting skills
  • Experience with CI/CD tools such as Jenkins and Github
  • Ability to work independently.

Soft Skills:

  • Good Communication Skills
  • Ability to coach and Guide young Data Engineers
  • Decent Level in English as Business Language


Remote Work :

No


Employment Type :

Full-time

Employment Type

Full-time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.