NCDPI Data Engineer Senior

Raleigh, WV - USA

Monthly Salary: Not Disclosed

Posted on: 7 days ago

Vacancies: 1 Vacancy

Job Summary

Typical Experience: 60-84 months

***The max rate for this position is $$$/hour.
***The manager would like the candidate to be onsite regularly throughout the position. The amount of onsite time per week will be negotiable. However weekly onsite time will be required.

Job Summary - Data Engineer:

We are seeking a skilled mid-level Data Engineer to join our team and focus on quality assurance quality checking and ETL processes. The successful candidate will be responsible for ensuring the integrity and accuracy of data transferred from a shared file transfer service to an S3 bucket and subsequently into and through our Snowflake data platform. This data will be utilized by downstream applications and reporting systems. These applications and the corresponding consumed data are critical to business process execution.

Key Responsibilities:

Quality Assurance & Quality Checking: Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process.
ETL Processes: Design develop and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
Data Integration: Ensure seamless data integration into data platform enabling efficient consumption by downstream applications and reporting tools.
Data Quality Management: Address data quality challenges including inconsistencies in source data that do not meet ingestion requirements which can lead to load failures or data backouts.
Collaboration: Work closely with business owners data analysts business intelligence teams and other stakeholders to understand data requirements and deliver high-quality data solutions.
Monitoring & Troubleshooting: To preserve data flow and integrity monitor pipelines identify issues and implement solutions.

Qualifications (Knowledge/Skills/Abilities):

Demonstrated mid-level experience in data engineering with a emphasis on data quality assurance and ETL processes.
Expertise in Python PyPI and SQL
Expert analytical and problem-solving skills.
Demonstrate a strong understanding of cybersecurity principles related to code development DevOps data access and fundamental cybersecurity.
Understanding of fundamental public-cloud capabilities.
Proven capacity to comprehend business needs and convert them into technical requirements.
Demonstrated excellence in communication and collaboration abilities.
Proven capacity to define success deliver and operate in an agile setting.

Required/Desired Skills

Skill	Required /Desired	Amount	of Experience
Demonstrated mid-level experience in data engineering with an emphasis on data quality assurance and ETL processes.	Required	5	Years
Expertise in Python PyPI and SQL	Required	5	Years
Demonstrate a strong understanding of cybersecurity principles related to code development DevOps data access and fundamental cybersecurity.	Required	5	Years
Understanding of fundamental public-cloud capabilities.	Required	5	Years
Proven capacity to comprehend business needs and convert them into technical requirements.	Required	5	Years

Questions

No.	Question
Question1	Absences greater than two weeks MUST be approved by CAI management in advance and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement
Question2	This is a hybrid position. The manager and candidate will discuss how often the candidate needs to be onsite. However the candidate will be expected onsite weekly. Do you agree to this requirement
Question3	What is your candidates email address
Question4	How soon can your candidate start if selected for this opportunity
Question5	Vendors are encouraged to submit candidates that are available for the duration of the assignment. Do you anticipate your candidate being able to work until the proposed end date listed on this VectorVMS req
Question6	Vendors must disclose to the agency if the candidate will be subcontracted at the time of submission. Is your candidate an employee of your company or a subcontractor Please be sure to notify a CAI Account Manager if your candidates employee status changes.
Question7	Vendors must notify the agency if any portion of the requirements listed in this task order will be outsourced to other countries. Do you anticipate outsourcing any work being done for this assignment to another country
Question8	Candidates submitted above the hourly Vendor Rate of $$$ may not be considered for this assignment. Do you agree to this requirement
Question9	Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the Vendor to adhere to any applicable compensation laws including payment for overtime hours. Do you agree to this requirement
Question10	Have you thoroughly validated and attest to the accuracy of the credentials listed throughout your candidate s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440

Typical Experience: 60-84 months***The max rate for this position is $$$/hour.***The manager would like the candidate to be onsite regularly throughout the position. The amount of onsite time per week will be negotiable. However weekly onsite time will be required.Job Summary - Data Engineer: We are...

Job Summary - Data Engineer:

Key Responsibilities:

Quality Assurance & Quality Checking: Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process.
ETL Processes: Design develop and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
Data Integration: Ensure seamless data integration into data platform enabling efficient consumption by downstream applications and reporting tools.
Data Quality Management: Address data quality challenges including inconsistencies in source data that do not meet ingestion requirements which can lead to load failures or data backouts.
Collaboration: Work closely with business owners data analysts business intelligence teams and other stakeholders to understand data requirements and deliver high-quality data solutions.
Monitoring & Troubleshooting: To preserve data flow and integrity monitor pipelines identify issues and implement solutions.

Qualifications (Knowledge/Skills/Abilities):

Demonstrated mid-level experience in data engineering with a emphasis on data quality assurance and ETL processes.
Expertise in Python PyPI and SQL
Expert analytical and problem-solving skills.
Demonstrate a strong understanding of cybersecurity principles related to code development DevOps data access and fundamental cybersecurity.
Understanding of fundamental public-cloud capabilities.
Proven capacity to comprehend business needs and convert them into technical requirements.
Demonstrated excellence in communication and collaboration abilities.
Proven capacity to define success deliver and operate in an agile setting.

Required/Desired Skills

Skill	Required /Desired	Amount	of Experience
Demonstrated mid-level experience in data engineering with an emphasis on data quality assurance and ETL processes.	Required	5	Years
Expertise in Python PyPI and SQL	Required	5	Years
Demonstrate a strong understanding of cybersecurity principles related to code development DevOps data access and fundamental cybersecurity.	Required	5	Years
Understanding of fundamental public-cloud capabilities.	Required	5	Years
Proven capacity to comprehend business needs and convert them into technical requirements.	Required	5	Years

Questions

No.	Question
Question1	Absences greater than two weeks MUST be approved by CAI management in advance and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement
Question2	This is a hybrid position. The manager and candidate will discuss how often the candidate needs to be onsite. However the candidate will be expected onsite weekly. Do you agree to this requirement
Question3	What is your candidates email address
Question4	How soon can your candidate start if selected for this opportunity
Question5	Vendors are encouraged to submit candidates that are available for the duration of the assignment. Do you anticipate your candidate being able to work until the proposed end date listed on this VectorVMS req
Question6	Vendors must disclose to the agency if the candidate will be subcontracted at the time of submission. Is your candidate an employee of your company or a subcontractor Please be sure to notify a CAI Account Manager if your candidates employee status changes.
Question7	Vendors must notify the agency if any portion of the requirements listed in this task order will be outsourced to other countries. Do you anticipate outsourcing any work being done for this assignment to another country
Question8	Candidates submitted above the hourly Vendor Rate of $$$ may not be considered for this assignment. Do you agree to this requirement
Question9	Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the Vendor to adhere to any applicable compensation laws including payment for overtime hours. Do you agree to this requirement
Question10	Have you thoroughly validated and attest to the accuracy of the credentials listed throughout your candidate s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440