drjobs
Data Ingestion Engineer
drjobs
Data Ingestion Engin....
Vision It US
drjobs Data Ingestion Engineer العربية

Data Ingestion Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Job Location

drjobs

- USA

Monthly Salary

drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Req ID : 2675351

Data Ingestion Engineer/Analyst

Position Purpose: Implements simple to complex data ingestion processes on Google Cloud Platform using industrystandard best practices. Designs develops configures tests debugs and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion processes and data.

Responsibilities:

  • Design and implement Data ingestion workflows as per business needs and technical specifications.
  • Works independently and collaboratively with team; keeping the project team and leaders in the loop.
  • Prepares detailed specifications from which data ingestion processes are developed.
  • Develops and implements technical solutions by code development and tool configuration.
  • Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
  • Responsible for the development and execution of testing and implementation plans. Can perform unit system integration and user acceptance testing. Documents results.
  • Participates in project planning and development or assumes responsibility for a project of limited scope.
  • Provides options for and estimates of possible coding.
  • May be responsible for the completion of a phase of a project or small projects depending on complexity.
  • Estimates and tracks time required to complete work for project budgeting and financial tracking.
  • Conducts and participates in reviews of solution designs configurations and code.
  • Provides technical expertise for project and baseline support teams.
  • Adheres to security standards to comply in the handling/processing/storing of sensitive data.
  • Adheres to development standards and provides development standards recommendations.

Education Level: 4Year Bachelors Degree

Years of Experience: 3 years of professional experience

Technical Skills and Qualifications:

  • Must have:
    • Cloud Data fusion
    • Google Pub/Sub
    • BigQuery
    • Google Cloud Storage
    • Cloud Composer
    • GitHub
    • SQL
  • Good to have:
    • DBMS connectivity and interaction experience (SQL Server DB2 Oracle)
    • Experience calling RESTful APIs and SOAP Webservices
    • Experience integrating with other Google resources databases and services
    • Google Dataform
    • Jira
    • Confluence

While working remotely. Your candidates should have reliable highspeed internet and L.L.Bean will provide a VDI. The L.L.Bean Developer Virtual Desktop Infrastructure allows for entitled users to access a virtual computer asset to complete tasks and processes relative to their role and responsibilities. Your employee needs to have a Windows laptop/desktop to log into their assigned L.L.Bean VDI. Your employee will install a VMware Horizon 7 compatible Client for Windows on their personal PC or one you provide once they are onboarded. This PC must have a currently supported operating system which is regularly patched and has updated commercial antimalware software. To efficiently do the work an additional monitor and a headset are required


Required Skills : Google Cloud Platform (GCP)
Additional Skills : Cloud Engineer

Employment Type

Full Time

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.