drjobs Senior Data Engineer

Senior Data Engineer

Employer Active

1 Vacancy
The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Maryland, MD - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Job Title: Senior Data Engineer

Location: Remote

Job Description:

We are seeking a highly skilled Senior Data Engineer to join our remote team. As a Senior Data Engineer you will be responsible for designing building and maintaining scalable data pipelines and analytics solutions. This is a remote position offering the flexibility to work from anywhere.

Responsibilities:

  1. Design and implement robust data pipelines using Apache Airflow for orchestration.
  2. Develop data processing jobs using Apache Spark for largescale data analysis and transformation.
  3. Utilize BigQuery for data warehousing and querying large datasets.
  4. Collaborate with crossfunctional teams to gather requirements and design data solutions that meet business needs.
  5. Implement and manage infrastructure on Google Cloud Platform (GCP) using Terraform.
  6. Write clean efficient and maintainable code in Scala.
  7. Optimize data pipelines for performance and scalability.
  8. Monitor pipeline health and troubleshoot issues as they arise.
  9. Stay updated on industry best practices and emerging technologies in data engineering.

Requirements:

  1. Bachelors degree in Computer Science Engineering or a related field.
  2. Proven experience as a Data Engineer or similar role.
  3. Strong expertise in Google Cloud Platform (GCP) services and infrastructure.
  4. Experience in designing and implementing data pipelines for ecommerce platforms.
  5. Proficiency in Apache Spark using Scala for data processing and analysis.
  6. Handson experience with Apache Airflow for workflow orchestration.
  7. Familiarity with BigQuery for data warehousing and analytics.
  8. Experience with infrastructure as code using Terraform.
  9. Excellent problemsolving and analytical skills.
  10. Strong communication and collaboration skills.
  11. Ability to work independently and efficiently in a remote environment.

Required Skills:

  • Strong experience with Google Cloud Platform (GCP)
  • Experience in ecommerce data pipelines
  • Proficiency in Apache Spark using Scala

Must Have:

  • Apache Airflow
  • Apache Spark
  • BigQuery
  • GCP/Google Cloud/Terraform
  • Scala

Employment Type

Full Time

Company Industry

Accounting & Auditing

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.