Azure Databricks Architect

Data Architect Databricks ETL ML AI BI Data Modelli

Location USA Raleigh North Carolina

Mandatory Onsite

Rate: Contract- Market

Must Have Skills

• Databricks Lakehouse architecture
• Delta Lake
• Dimensional data modelling
• ETL data pipeline design

Primary Skill

• Databricks Architecture Lakehouse Design Databricks Lakehouse architecture Bronze Silver Gold layers Delta Lake
• Data Engineering Pipelines ETL ELT architecture batch and near realtime data pipeline design
• Processing Analytics Apache Spark PySpark Spark SQL for largescale data processing
• Analytical Data Modelling Dimensional Modelling Star Snowflake schemas for reporting and analytics
• Data Warehousing Concepts Data quality consistency scalability and performance best practices
• Cloud Data Platforms Azure based data platforms with handson experience in ADLS or equivalent
• Platform Optimization Cloud storage performance tuning and cost optimization strategies
• BI Consumption Enablement Curated analytics ready datasets for BI tools Power BI Tableau or similar
• AIML Enablement Feature ready data preparation and pipeline support for AIML workloads on Databricks
• Metadata Architecture Standards Metadata management data cataloguing and architectural documentation
• Technical Leadership Architecture design and implementation oversight across data solutions
• Data governance security and compliance frameworks
• Databricks CICD pipelines and Git based development practices
• Secondary Nice to Have Skills NOT MANDATORY
• ML flow or similar model tracking and lifecycle management tools
• Familiarity with Agile Scrum delivery methodologies
• Domain experience in Insurance or Financial Services

Soft Skills

• As this is an onsite role must have strong written and oral communication skills
• Insurance Domain Knowledge
• Strong ability to work with client stakeholders
• Requirement Review and Work Effort Estimation

3 Qualifying Questions

• Databricks Basics
• Have you used Databricks for data processing or ETL work
• Briefly explain the type of data you worked with and your role in the implementation
• Data Modelling Fundamentals What types of data models have you worked with for reporting or analytics eg fact dimension tables reporting tables aggregations
• Analytics BI Enablement How have you made data available for reporting or dashboards using tools like Power BI or similar platforms

Skills

Mandatory Skills : Data Architecture Databricks Dimensional Data Modeling

Good to Have Skills : ETL Concepts