Typical Experience: 6084 months
***This is an onsite position.
Job Title:Data Engineer Azure Platform
Overview:
We are looking for an experienced Data Engineer tojoin our team. You will use various methods to import raw data into AzureCloud. You will analyze data and create rules for the ETL process. The importprocess will also include identifying the business rules and apply them to thefiles stored in staging area before moving the files to processed area.
The ideal candidate will have a strong background indata engineering along with expertise in cloud computing. This role offers anexciting opportunity to play a key role in modernizing our technology stack anddriving our organizations digital transformation journey.
Responsibilities:
Collaborate with crossfunctional business teams tounderstand requirements analyze and organize raw data import by identifyingthe ETL rules.
Identify and apply transformation rules for legacydata migration from mainframe systems to the Azure cloud platform.
Develop and implement data pipelines ETL processesand data integration solutions to facilitate the conversion of data.
Develop and maintain documentation best practicesand standards for data engineering processes and procedures.
Provide technical leadership and mentorship to teammembers guiding them in best practices for data engineering and cloudmigration projects.
Explore ways to enhance data quality and reliability.
Requirements and Skills
1. **DataModeling and Database Design:**
Proficiency in designing and implementing relational and nonrelationaldatabases.
Knowledge of data modeling techniques and tools.
2.**Azure Data Services:**
Deep understanding and handson experience with Azure data servicessuch as Azure SQL Database Azure Cosmos DB Azure Data Lake Storage AzureBlob Storage etc.
3. **ETL(Extract Transform Load) Processes:**
Expertise in designing and implementing ETL processes using tools likeAzure Data Factory or Azure Databricks.
Knowledge of data integration and transformation techniques.
4. **SQLand TSQL:**
Proficient in writing complex SQL queries and stored procedures.
Familiarity with TransactSQL (TSQL) for managing and querying SQLServer databases.
5. **DataSecurity and Compliance:**
Knowledge of data security best practices and experience implementingsecurity measures for data storage and processing on Azure.
Awareness of compliance requirements and ability to implement solutionsthat adhere to NC DPI and DIT regulations.
6. **DataMonitoring and Optimization:**
Ability to set up monitoring and logging for data pipelines anddatabases.
Skills in optimizing data storage and processing for performance andcosteffectiveness.
7.**Scripting and Automation:**
Proficiency in scripting languages like Python or PowerShell forautomating data engineering tasks.
Knowledge of Azure Resource Manager (ARM) templates for infrastructureas code.
Additionally obtaining relevant certifications such as theMicrosoft Certified: Azure Data Engineer Associate can further validate andenhance these skills.
Qualifications:
Bachelor s degree in computer science Engineering ora related field
Proven experience as a data engineer with a strongfocus on data migration ETL and data integration.
Handson experience with data warehousing conceptsdatabase technologies (SQL on Azure)
Strong problemsolving skills attention to detailand the ability to work effectively in a fastpaced environment.
Excellent communication and interpersonal skills withthe ability to collaborate effectively with crossfunctional teams andstakeholders.
Required/Desired Skills
Skill | Required /Desired | Amount | of Experience |
---|
Proficiency in designing and implementing relational and nonrelational databases. | Required | 5 | Years |
Knowledge of data modeling techniques and tools. | Required | 5 | Years |
Handson experience with Azure data services such as Azure SQL Database Azure Cosmos DB Azure Data Lake Storage Azure Blob Storage etc. | Required | 5 | Years |
Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks. | Required | 5 | Years |
Knowledge of data integration and transformation techniques. | Required | 5 | Years |
Proficient in writing complex SQL queries and stored procedures | Required | 5 | Years |
Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure. | Required | 5 | Years |
Ability to set up monitoring and logging for data pipelines and databases. | Required | 5 | Years |
Skills in optimizing data storage and processing for performance and costeffectiveness | Required | 5 | Years |
Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks | Required | 5 | Years |
Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code | Required | 5 | Years |
Questions
No. | Question |
---|
Question1 | Absences greater than two weeks MUST be approved by CAI management in advance and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you accept this requirement |
Question2 | All work must be completed onsite. Do you accept this requirement |
Question3 | Candidate must be able to attend an inperson interview. Do you accept this requirement |
Question4 | Please list candidate s email address. |
Question5 | Please indicate how soon this candidate is available to start work. Vendors are encouraged to submit candidates that are available for the duration of the assignment. |
Question6 | Vendor must disclose to the agency if the candidate will be subcontracted at the time of submission. Do you accept this requirement |
Question7 | Vendor must notify the agency if any portion of the requirements listed in this task order is to be outsourced to other countries. Do you accept this requirement |
Question8 | Candidates submitted above the rate of $$$ will not be considered. Do you accept this requirement |
Question9 | Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the supplier to adhere to any applicable compensation laws including payment for overtime hours. Do you accept this requirement |
Question10 | Please confirm you have thoroughly validated and attest to the accuracy of the credentials listed throughout this candidate s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS009440. Do you confirm |
Employment Type
Full Time
Key Skills
- APIs
- SOAP
- Software Architecture
- .NET
- Design Patterns
- Enterprise Software
- AWS
- Solution Architecture
- Cloud Architecture
- Java
- SSO
- Oracle
Disclaimer:
Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via
contact us page.
We Value Your Privacy
We use cookies to enhance your browsing experience, serve personalied ads or content, and analyze our traffic. By clicking "Accept All", you consent to our use of cookiesCookie Policy
We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.
The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site.
We also use third-party cookies that help us analyze how you use this website, store your preferences, and provide the content and advertisements that are relevant to you. These cookies will only be stored in your browser with your prior consent.
You can choose to enable or disable some or all of these cookies but disabling some of them may affect your browsing experience.
For more information on how Google's third-party cookies operate and handle your data, see: Google Privacy Policy