drjobs
Architect
drjobs Architect العربية

Architect

Employer Active

1 Vacancy
The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Job Location

drjobs

others - USA

Monthly Salary

drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Req ID : 2280612

DataLake Architect

The DataLake Architect will be an integral part of the Innovation team. Core responsibilities will involve operating, managing, and monitoring the datalake infrastructure to enable efficient data storage, processing, and analysis.

The DataLake Architect will determine core data storage and replication needs, build Extract Transform Load process and pipelines to applicable data stores.

The DataLake Architect will utilize various on-prem and cloud systems to populate and manage the growing Azure & AWS Infrastructures. DataBricks will be used for analytical processing within the DataLake.

The DataLake Architect will be responsible for ensuring that data is available to support self-service analytics, and data automations from source systems to DataLake as programmed.

The DataLake Architect will be responsible for the following items:

  • Operate and maintain the data lake infrastructure, ensuring its reliability, scalability, and security.
  • DOA Collaboration on Data Ingestion/ Storage Needs (Data from APIs, On Prem, Cloud, Legacy Systems).
  • Design and develop data ingestion pipelines to efficiently collect and integrate data from various sources into the data lake.
  • Monitor data lake performance metrics and identify opportunities for optimization.
  • Optimize data processing workflows to enable efficient data retrieval and analysis.
  • Design Initial Wireframes, Proof of Concepts, and Ideation of Data Lake Architecture and ETL Processes.
  • Research methods and best practices in creating secure, monitored and reliable "source of truth".
  • Provide updates on work as accomplished.
  • Ensure data policy adherence, row-level security, and ensure data privacy in produced data models and pipelines.
  • Test for proper operation of newly deployed pipelines and data distributions.
  • Assist in end-user training as determined.
  • Document data lake infrastructure, processes, and workflows.

The DataLake Architect will assist with new data pipeline initiatives that need direct design, creation, and deployment to production for divisional consumption.

Job Duties consist of the following but are not limited to:

  • Utilize Azure, AWS Data Storage, with DataBricks Analytical Platform
  • 3 years or more experience with Azure, AWS data warehousing
  • Must be able to discuss the requirements effectively with internal/external stakeholders.
  • Understanding of Data Storage and Design Process of AIS.
  • Able to create a "story" of business challenges, and how the Data Lake can solve.
  • Able to create User Stories, and Divisional Personas of DOA.
  • Able to research and recommend best practices for at scale digital data deployments and integrations.

The contractor must be able to manage multiple tasks concurrently. Must be a self-starter & be able to use own judgment/initiative to undertake activities with minimal supervision. The Candidate must also have excellent oral & written communications skills as well as the ability to work alone or within a team environment.

The candidate must be able to work collaboratively with others to achieve team & organizational goals; prioritize projects and/or tasks; provide constructive input to achieve team goals; deliver a customer-focused, responsive service to customers; support efforts to enhance business efficiency & effectiveness; demonstrate a positive, "can-do" attitude; respond constructively to new information, changing conditions, & unexpected obstacles.

Comment Files Company Origin Viewable Created By Created On
Budget Information

Critical Hire Code (Assigned by Approver)

Background Verification (Suppliers shall use Info Cubic (IC) for background verifications.)
Instructions

The completed Background Verification will be attached (via an automated feed) to the candidates user profile under the Attachments Section.

Please make sure to always include the applicable proposal ID, contract ID, or requisition ID in the reference field when ordering. It is also very important to double check that the name on the order being requested matches the candidate's name in the Covendis system. Otherwise, the completed report will not be successfully uploaded to the candidates profile.

Additional Background Verification Services (City of Atlanta)

To be completed upon candidate selection:

Global Monitor Check

State Criminal Record verification (past 7 years covering each State in which the candidate has resided)

Social Security Number Verification

Federal Criminal Records Verification (past 7 years)

Any additional requirements stated by the Agency on the requisition

Education Verification Employment Verification Drug Screening

MVR

(Suppliers Only)
To order, click on the link to the right:

Order Additional Background Verification services

Instructions (If Applicable)

The completed Background Verification will be attached (via an automated feed) to the candidates user profile under the Attachments Section.

Please make sure to always include the applicable proposal ID, contract ID, or requisition ID in the reference field when ordering. It is also very important to double check that the name on the order being requested matches the candidate's name in the Covendis system. Otherwise, the completed report will not be successfully uploaded to the candidates profile.

Agency Certification(s)
Please read and understand the following statement carefully: I understand that a person who enters into an agreement in restraint of trade or in restraint of free and open competition in any transaction with the state may, upon conviction thereof, be punished by imprisonment for not less than one nor more than five years pursuant to OCGA. I further agree that when there is a prior agreement or understanding between a vendor and a state agency or state employee regarding the acceptance of any offer, such conduct is collusive, fraudulent and in restraint of trade and in restraint of free and open competition on the part of both the vendor and the state agency or state employee. Do you agree with the above statement? I Agree

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.