Sr Azure Data Engineer

Location: Remote

Mid to senior level with 3 to 5 years of min.
Experience needed on Data Engineering skills on Azure Cloud

Responsibilities
Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark
SPARK Performancetuningoptimization
Identify and optimize long running Databricks SPARK jobs.
Monitor resource utilization and costs associated with Databricks usage identifying opportunities for optimization and cost reduction.
Analyze cluster performance metrics and implement tuning strategies to ensure optimal query execution times and resource utilization.
Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
HandOn Experience in creating ADF Pipelines and Orchestrate various notebooks in Azure Data Factory
Work closely with data engineers to ensure that our Databricks platform is optimized for performance scalability and reliability.
Ensure the quality of deliverables by developing automated controls and performing unit integration and user acceptance testing.
Perform other duties as assigned.
Skills Needed:
Significant experience building Data Warehouses (Azure Synapse Analytics or similar) Data Lakes (Azure Data Lake or similar) ETL/ELT pipelines (Databricks or similar) and nice to have skills on data streaming (Azure Event Hub Kafka Cosmos MongoDB or similar)
Expert knowledge of SQL
Experience in data engineering programming languages. (Azure Databricks PySpark Python)
Expertise on Azure Cloud platform

4 Reasons to Join Volitiion IIT Inc.: 1. Our Commitment to You We offer competitive pay multiyear projects and a list of exciting clients. 2. WorkLife Balance We work hard; we work smart and have quality time for family and life. 3. Our Mantra We treat our consultants the way we want to be treated: with integrity professionalism and trust. 4. Career Development We help you meet your career goals and continuously support your efforts to build your skillset. Check out our Referral Program! Volitiion IIT Inc will pay you up to $1000 for every qualified professional that you refer and we place. If you see a position posted by Volitiion IIT Inc. and know the perfect person for the job please send us your referral. Volitiion IIT Inc. is an Equal Opportunity/Affirmative Action Employer.