drjobs Senior Data Architect (Azure Databricks/Python)

Senior Data Architect (Azure Databricks/Python)

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Plano, TX - USA

Yearly Salary drjobs

$ 186000 - 210000

Vacancy

1 Vacancy

Job Description

Description

Position at loanDepot

Position Summary:

The Senior Data Architect is responsible for designing developing and maintaining robust scalable and high-performance enterprise data architectures within a modern cloud environment. This role requires deep expertise in Big Data solutions (Delta Lake architecture) modern data warehouse practices and operations semantic layering dimensional modeling (star schemas) transactional OLTP databases (3NF modeling) and advanced data modeling techniques. The ideal candidate will have at least 15 years of data modeling experience specifically within Business Intelligence and Analytics contexts extensive hands-on experience with batch and streaming data processing and strong expertise with Apache Spark Databricks and Spark Structured Streaming. Required skills include proficiency in Python programming Azure cloud technologies semantic modeling and modern CI/CD deployment practices. Experience in ML engineering is highly desirable. The candidate must be able to collaborate quickly and effectively with data and engineering teams clearly document source-to-target mappings and reverse engineer existing database objects such as stored procedures views and complex SQL queries.

Responsibilities:
  • Lead architecture design and implementation of enterprise-scale data platforms leveraging Databricks Delta Lake Azure cloud and modern Big Data technologies.
  • Design build and maintain modern data warehouse solutions using dimensional modeling (star schema) and semantic layering to optimize analytics and reporting capabilities.
  • Define and enforce data modeling standards guidelines and best practices within analytics and BI contexts.
  • Architect robust batch processing and real-time streaming solutions using Apache Spark Databricks Kafka Kinesis and Spark Structured Streaming.
  • Effectively collaborate with engineering teams to rapidly deliver data architecture solutions and support agile development practices.
  • Provide clear comprehensive source-to-target documentation data lineage mappings and semantic layer definitions.
  • Reverse engineer existing database structures including stored procedures views and complex SQL logic to document existing data processes and support modernization initiatives.
  • Provide technical leadership mentoring and guidance to data engineering teams ensuring alignment with architectural standards and best practices.
  • Evaluate and continuously improve existing data architectures optimize performance and recommend enhancements for efficiency and scalability.
  • Collaborate closely with stakeholders to define long-term data strategies and clearly communicate architectural decisions.
  • Ensure compliance with industry standards data governance practices regulatory requirements and security guidelines.
  • Champion modern DevOps and CI/CD practices for data and analytics pipelines.
Requirements:

  • Expert working knowledge of the data platform landscape along with best practices with respect to Relational databases NoSQL databases and Big Data architectures
  • Minimum of 15 years of hands-on data modeling experience specifically in Business Intelligence (BI) and Analytics contexts.
  • Extensive experience designing and implementing modern data architectures including Big Data solutions (Delta Lake) modern data warehouses (star schema/dimensional modeling) semantic layering and transactional OLTP (3NF) data modeling.
  • Prior experience designing and building a Delta Lake using Medallion Architecture
  • Deep understanding of relational and dimensional modeling normalization (3NF) semantic modeling and transactional database design principles.
  • Proven ability to produce detailed source-to-target mappings data lineage documentation semantic definitions and reverse engineer existing stored procedures views and SQL logic.
  • Demonstrated expertise in Apache Spark Databricks and Spark Structured Streaming for batch and real-time data processing.
  • Proficiency in Python programming required.
  • Strong experience with Azure cloud technologies including Azure Data Factory Azure Storage Azure Databricks and related data services.
  • Solid experience designing streaming data solutions using Kafka Kinesis or similar streaming technologies.
  • Knowledge and hands-on experience implementing modern CI/CD practices for data engineering and analytics solutions.
  • Strong analytical organizational and communication skills with the ability to clearly articulate complex technical concepts to diverse stakeholders.
  • Proven ability to collaborate effectively and efficiently with engineering teams and business stakeholders.

Preferred Qualifications:

  • ML Engineering experience or exposure to ML pipelines and model deployment processes highly desirable.
  • Experience in the mortgage or financial services industry preferred but not required.
  • Exposure to FiveTran and Dynamics CRM
Why work for #teamloanDepot:
loanDepot (NYSE: LDI) is a digital commerce company committed to serving its customers throughout the home ownership journey. Since its launch in 2010 loanDepot has revolutionized the mortgage industry with a digital-first approach that makes it easier faster and less stressful to purchase or refinance a home. Today as the nations second largest non-bank retail mortgage lender loanDepot enables customers to achieve the American dream of homeownership through a broad suite of lending and real estate services that simplify one of lifes most complex transactions. With headquarters in Southern California and offices nationwide loanDepot is committed to serving the communities in which its team lives and works through a variety of local regional and national philanthropic efforts.
Base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay for this roles is between $186000 and $210000 per year. Your base pay will depend on multiple individualized factors including your job-related knowledge/skills qualifications experience and market location.
We are an equal opportunity employer and value diversity in our company. We do not discriminate based on race religion color national origin gender sexual orientation age marital status veteran status or disability status.


Required Experience:

Senior IC

Employment Type

Full-Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.