Description
Position at loanDepot
Position Summary:
The Data Engineer will serve as a key resource in building out our enterprise Delta Lake-based Data Warehouse partnering closely with the Senior Data Architect. This role is boots on the ground actively involved in constructing and optimizing a modernized scalable single source of truth data solution in accord with modern Data Engineering operations and practices. Primary responsibilities include migrating and retiring legacy SQL Server objects reverse-engineering existing business logic embedded in SQL Server views stored procedures and other database artifacts and implementing optimized data pipelines using Databricks Delta Lake and Azure Data Factory. Strong Python and PySpark skills are essential along with the ability to tune and optimize Spark-based data flows and transformations. Prior experience with Databricks is highly desirable.
Responsibilities:
- Work directly with the Senior Data Architect to design build and operationalize a robust Delta Lake/Data Warehouse solution with heavy emphasis on Medallion Architecture.
- Reverse-engineer legacy SQL Server objects (views stored procedures functions) to clearly document and transition existing business logic and data transformations.
- Design and implement optimized data pipelines leveraging Azure Data Factory (ADF) SSIS and Databricks Delta Lake.
- Develop efficient Spark jobs (PySpark) and data transformations to enable high-performance analytics and reporting capabilities.
- Perform performance tuning and optimization of Spark-based data workflows and Delta Lake implementations.
- Ensure adherence to best practices in data modeling pipeline construction and data warehouse architecture.
- Collaborate closely with stakeholders to understand and translate business requirements into technical solutions.
- Champion engineering excellence through regular code reviews automated testing and continuous integration/deployment practices.
- Proactively identify opportunities for improvement and optimization of data processes and infrastructure.
Requirements:
- Bachelors Degree required with at least five (5) years of relevant work experience in data engineering and modern data warehouse build-outs.
- 1 years of experience building Medallion Architecture in a Big Data platform (Hadoop MPP etc)
- Demonstrated expertise implementing Delta Lake data warehouse and data mart solutions.
- Strong proficiency in Python specifically PySpark including streaming experience and experience optimizing Spark jobs and data transformations.
- Extensive hands-on experience reverse engineering business logic from SQL Server database objects (views stored procedures functions).
- Proven experience building and optimizing ETL/ELT workflows using tools such as Azure Data Factory (ADF) SSIS Databricks and Delta Lake.
- Expert-level SQL skills with a strong understanding of query optimization and data modeling principles.
- Familiarity with Azure Data Lake Storage (ADLS) and cloud-native technologies is highly desirable.
- Working knowledge of Git including branching and merging strategies.
- Demonstrated ability to deliver scalable maintainable and reusable code in a fast-paced environment.
- Prior hands-on experience with Databricks platforms highly desired. (preferred)
- Prior experience in Azure highly desired (preferred)
Why work for #teamloanDepot:
- Compensation package based on experience and skill set.
- An inclusive diverse and collaborative culture where people from all backgrounds can thrive.
- Work with other passionate purposeful and customer-centric people.
- Extensive internal growth and professional development opportunities including tuition reimbursement.
- Comprehensive benefits package including Medical/Dental/Vision.
- Wellness program to support both mental and physical health.
- Generous paid time off for both exempt and non-exempt positions.
About loanDepot:
loanDepot (NYSE: LDI) is a digital commerce company committed to serving its customers throughout the home ownership journey. Since its launch in 2010 loanDepot has revolutionized the mortgage industry with a digital-first approach that makes it easier faster and less stressful to purchase or refinance a home. Today as the nations second largest non-bank retail mortgage lender loanDepot enables customers to achieve the American dream of homeownership through a broad suite of lending and real estate services that simplify one of lifes most complex transactions. With headquarters in Southern California and offices nationwide loanDepot is committed to serving the communities in which its team lives and works through a variety of local regional and national philanthropic efforts.
Base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay for this roles is between $111000 and $136500. Your base pay will depend on multiple individualized factors including your job-related knowledge/skills qualifications experience and market location.
We are an equal opportunity employer and value diversity in our company. We do not discriminate based on race religion color national origin gender sexual orientation age marital status veteran status or disability status.