drjobs Databricks Engineer

Databricks Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Boston - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Title: Databricks Engineer
Location: Boston MA (Day One Onsite)
Duration: 6 months
Implementation Partner: Infosys
End Client: State Street Corporation

JD:

  • Mandatory Skills: Databricks Hadoop Python Spark Spark SQL PySpark AirFlow and IBM StreamSet

Key Responsibilities:

  • Develop Data Engineering and ML pipelines in Databricks and different AWS services including S3 EC2 API RDS Kinesis/Kafka and Lambda to build serverless applications.
  • Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster working in Databricks modules (Data Engineering ML and SQL warehouse).
  • Knowledge on medallion architecture DLT and unity catalog within Databricks.
  • Experience in migrating data from on-prem Hadoop to Databricks/AWS.
  • Understanding of core AWS services uses and AWS architecture best practices.
  • Hands-on experience in different domains like database architecture business intelligence machine learning advanced analytics big data etc.
  • Solid knowledge on Airflow.
  • Solid knowledge on CI/CD pipeline in AWS technologies.
  • Application migration of RDBMS java/python applications model code elastic etc.
  • Solid programming background on scala python SQL.

Employment Type

Full-time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.