Azure Big Data Specialist
Azure Big Data Specialist
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
CEdge has an opportunity for aAzure Big Data Specialist. This role is located at Bangalore Karnataka India..If you are ready to work alongside World Renowned Technology experts and carry the skills below this is the opportunity that will inevitably take your career to unbelievable levels!
Responsibilities:
- We are looking for a Data Engineer to join our growing team of analytics experts.
- The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams.
- The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
- Should have good hands on implementing Incremental/Delta loads.
- Develop and Support activities of development in Projects and Automation solutions for customers
Deliverables Expected:
The following shall be the deliverables
a. Updated requirements document / Detailed Bug Analysis report
b. Concept document (wherever applicable)
c. Design document (for all features)
d. Test specification document
e. Source code
f. Review report
g. Test report
h. Filled review checklists
i. Traceability matrix
j. User manuals and related artifacts
k. Filled predelivery checklist (PDC)
l. Release Note & release mails
Skillset:
Skills: AzureSQL/TSQL Azure Data Factory Azure Function apps Azure Blob Azure Databricks Unity Catalog Microsoft Purview
Responsibilities:
- Overall 7 8 years of experience with a minimum 5 years of relevant professional work experience
- Design implement and maintain data pipelines for data ingestion processing and transformation in Azure.
- Work together with data analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database Azure Data Lake
- Utilizing Azure Data Factory to create and maintain ETL (Extract Transform Load) operations using ADF pipelines.
- HandsOn Experience working on Data Bricks for implementing Transformations and Delta Lake
- HandsOn Experience working on Serverless SQL Pool Dedicated SQL Pool(Synapse analytic).
- Use ADF pipelines to orchestrate the endtoend data transformation including the of Data Bricks notebooks.
- Should have experience working on Medallion Architecture
- Experience working on CI/CD pipelines using Azure DevOps
- Attaching both ADF and ADB to DevOps
- Creating and managing Azure infrastructure across the landscape using Bicep
- Implementing data validation and cleansing procedures will ensure the quality integrity and dependability of the data.
- Improve the scalability efficiency and costeffectiveness of data pipelines.
- Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
- Good to have exposure on Power BI Power Automate
- Good to have knowledge on Azure fundamentals
Desirable skills:
- Good ability to anticipate issues and formulate remedial actions
- Sound interpersonal and team working skills
- Sound Knowledge of unit testing methodologies and frameworks
- Should be able to work independently
- Good communication skills
WHATS IN IT FOR YOU
- Insurance
- Paid Holidays
WHO ARE WE
CEdge Software Consultants is an innovative IT consulting firm and a strategic business partner. We offer IT solutions to Federal and State government as well as Commercial Enterprises throughout the United States & India. Our main objective is to create an integritybased culture that takes pride in working as a collaborative team that focuses on growth and is driven by the desire to provide purely ethical services for both our clients and teammates.
Required Experience:
Unclear Seniority
Employment Type
Full Time
