drjobs
Data Engineer
drjobs
Data Engineer
ATD Technology LLC
drjobs Data Engineer العربية

Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Job Location

drjobs

- USA

Monthly Salary

drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Req ID : 2634046
Job details/description:
Design develop and implement data pipelines for the new internal application
Leverage GCP services like Cloud Storage Cloud Functions Pub/Sub Cloud Scheduler Cloud Run BigQuery and Cloud SQL
Utilize Python scripting and libraries (NumPy Pandas SciPy) for data manipulation and analysis
Collaborate with crossfunctional teams to ensure data quality and accessibility
Troubleshoot and resolve complex data engineering challenges
Continuously improve data pipelines for efficiency and performance

Cloud: (required)

  • Experience with cloud computing platforms such as Amazon Web Services (AWS) Microsoft Azure or Google Cloud Platform (GCP)
  • Familiarity with cloud computing concepts such as virtual machines storage and networking
  • Experience with cloudbased data engineering tools and services
  • GCP: (required)

  • Experience with Google Cloud Platform (GCP)
  • Familiarity with GCP services such as Google Cloud Storage Cloud Functions Pub/Sub Cloud Scheduler Cloud Run BigQuery and Cloud SQL
  • Experience with GCP APIs and SDKs
  • Other required skills: (required)

  • Experience with data engineering tools and technologies such as Apache Spark Hadoop and Hive
  • Familiarity with data modeling and database design
  • Strong problemsolving and analytical skills
  • Excellent communication and teamwork skills
  • Python scripting:

  • Experience writing Python scripts for data engineering tasks
  • Familiarity with Python libraries for data manipulation and analysis such as NumPy Pandas and SciPy
  • Experience with Python frameworks for web development such as Django or Flask
  • Other preferred skills: (preferred)

  • r/rshiny for front end development preferred

ATD Technology LLC is a certified minority woman owned business that creates opportunities to match qualified individuals with client programs while meeting all parties financial and technical goals. ATD is a full service provider with offerings in Contract Permanent and TemptoPerm staffing solutions. We serve Fortune 1000 mid cap and small cap companies in the Commercial Public and Government sectors.

Employment Type

Full Time

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.