drjobs Senior Data Engineer

Senior Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Ashburn, IL - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Senior Data Engineer
Location: Ashburn VA
Long Term Project
Note:Must hold or be able to obtain CBP Public Trust Clearance.
10 years ETL Spark/Databricks AWS Data Engineering
Key Responsibilities:
  • Design develop and maintain scalable ETL pipelines using Databricks and Apache Spark
  • Migrate and optimize big data workflows in AWS.
  • Implement data governance quality assurance and performance enhancements
  • Work with large datasets (80 TB) performing analysis and producing regular/ad hoc reports
  • Support cloud/on prem migrations and source code control via Git/GitLab
  • Mentor junior data engineers and help establish best practices
Required Experience & Skills:
  • 10 years in ETL with Spark and Databricks.
  • Proven AWS Data Engineering experience.
  • Strong SQL Python/Scala skills.
  • Experience with Unix/Linux shell scripting CRON.
  • Familiarity with data warehousing (e.g. Oracle Redshift).
  • Comfortable working with big data volumes (80 TB)
  • Excellent problem-solving and stakeholder collaboration.

Employment Type

Full-time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.