Managing Technical Consultant – Azure Data Lake Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Houston, MS - USA

profile Monthly Salary: Not Disclosed
Posted on: 9 hours ago
Vacancies: 1 Vacancy

Job Summary

MatchPoint Solutions is a fast-growing young energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber Robinhood Netflix Airbnb Google Sephora and more! More recently we have expanded to working internationally in Canada China Ireland UK Brazil and India. Through our culture of innovation we inspire build and deliver business results from idea to outcome. We keep our clients on the cutting edge of the latest technologies and provide solutions by using industry-specific best practices and expertise.

We are excited to be continuously expanding our team. If you are interested in this position please send over your updated resume. We look forward to hearing from you!

Job Title: Managing Technical Consultant Azure Data Lake Engineer

Location: Remote

Duration: 12 Months

Employment Type: Contract

Pay Range: $80 to $82

Position Overview

We are seeking a Managing Technical Consultant Azure Data Lake Engineer to design build and maintain scalable data ingestion storage and processing solutions within the Microsoft Azure ecosystem.

This role focuses on enterprise-grade Azure Data Lake implementations ETL/ELT pipeline development SAP data integration and advanced analytics enablement. The ideal candidate will bring deep expertise across Azure Data & Analytics services and strong experience delivering cloud-based data engineering solutions in large-scale environments.

Top 3 Required Skills

  1. Hands-on experience building scalable ETL/ELT pipelines using Azure Data Factory (ADF) (mapping data flows pipelines triggers) and Azure Synapse pipelines
  2. Experience developing data ingestion frameworks data validation workflows and orchestration logic
  3. Experience integrating SAP ECC/S4 data into Azure Data Lake using ADF/Synapse pipelines (batch and delta loads)

Key Responsibilities

Azure Data Engineering & Architecture

  • Design and implement scalable data solutions using:
    • Azure Data Lake Storage (ADLS)
    • Azure Data Factory (ADF)
    • Azure Synapse Analytics
    • Azure Databricks
    • Azure SQL
  • Develop enterprise-grade data warehousing and big data solutions.
  • Build high-performance data analytics solutions leveraging Azure Databricks.

ETL/ELT & Data Integration

  • Build and optimize ETL/ELT pipelines using ADF and Synapse.
  • Design ingestion frameworks supporting batch and delta loads.
  • Integrate SAP ECC/S4 data into Azure Data Lake.
  • Develop orchestration logic and data validation workflows.

Data Modeling & Processing

  • Conduct data profiling cataloging and mapping for technical design.
  • Implement data flows aligned to Lambda and Kappa architecture patterns.
  • Translate business use cases into scalable technical solutions.
  • Support data exposure through Power BI and Azure API Apps.

Programming & Development

  • Develop solutions using:
    • Python or Scala
    • Advanced SQL
  • Utilize Azure Databricks for distributed data processing.
  • Work with various database technologies (SQL and NoSQL such as Hadoop MongoDB Redis).

DevOps & Governance

  • Use Git for source control.
  • Implement CI/CD pipelines using Azure DevOps.
  • Leverage ARM templates and PowerShell for infrastructure automation.
  • Apply best practices in data governance and solution architecture.

Collaboration & Consulting

  • Participate in Agile delivery methodologies.
  • Support proof of concepts (POCs) and prototyping efforts.
  • Drive knowledge transfer and training initiatives.
  • Provide technical leadership and consulting guidance.

Required Qualifications

  • Strong expertise in:
    • Azure Data Lake
    • Azure Data Factory
    • Azure Databricks
    • Azure SQL
    • Azure Synapse Analytics
  • Experience as a Data Engineer in Azure Big Data environments.
  • Programming proficiency in Python or Scala and strong SQL mastery.
  • Experience with:
    • Azure Data & Analytics PaaS services
    • Azure Stream Analytics
    • Azure Cosmos DB
    • Azure HDInsight Spark
  • Proficiency with Git and CI/CD pipelines.
  • Experience with DBT (preferred hands-on knowledge).
  • Strong communication and stakeholder engagement skills.
  • Experience translating business requirements into technical solutions.

Preferred / Nice-to-Have Skills

  • Knowledge of Master Data Management (MDM) and Data Quality tools.
  • Experience preparing data for Data Science and Machine Learning use cases.
  • Experience with Azure Machine Learning and AI solutions.
  • Experience managing teams or acting as a technical coach.
  • Background in practice development consulting or cloud architecture.

MatchPoint Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race color religion age sex national origin disability status genetics protected veteran status sexual orientation gender identity or expression or any other characteristic protected by federal state or local laws.

This policy applies to all terms and conditions of employment including recruiting hiring placement promotion termination layoff recall transfer leaves of absence compensation and training.

MatchPoint Solutions is a fast-growing young energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber Robinhood Netflix Airbnb Google Sephora and more! More recently we have expanded to working internationally in Canada...
View more view more

Key Skills

  • Business Development
  • ISO 27001
  • Pegasystems
  • SAAS
  • Financial Services
  • TOGAF
  • COBIT
  • Customer relationship management
  • Cataloging
  • Internal Audits
  • Pre-sales
  • Word Processing