Data Platform Engineer, Data Capture
Share
Job Location:
San Mateo, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
About Upstart
Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstarts AI marketplace Upstart-powered banks and credit unions can have higher approval rates and lower loss rates across races ages and genders while simultaneously delivering the exceptional digital-first lending experience their customers demand. More than 80% of borrowers are approved instantly with zero documentation to upload.
Upstart is a digital-first company which means that most Upstarters live and work anywhere in the United States. However we also have offices in San Mateo California; Columbus Ohio; Austin Texas; and New York City NY (opening Summer 2026).
Most Upstarters join us because they connect with our mission of enabling access to effortless credit based on true risk. If you are energized by the impact you can make at Upstart wed love to hear from you!
The Team
The Data Engineering team (Part of Upstarts core platform vertical) provides developer tools frameworks and scalable data infrastructure as shared services across Upstart. The teams primary objective is to provide Data Analysts Software Engineers and ML scientists access to high-quality data and developer tools to create business metrics for respective product verticals
You will join the subdivision focusing on Data Capture.
As the Data Platform Engineer joining this team you will get the opportunity to contribute to 3 areas:
- Expand the Developer tools that capture business events operational data and third party data into the Lakehouse.
- Expand the self-serve and orchestration framework that developers use to build pipelines.
- Improve the observability and SLAs for the above services and raw layer data in the Lakehouse.
We would love to hear from you if you are passionate about building data products!
Position Location - This role is available in the following locations: Remote
Time Zone Requirements - This team operates on the East/West Coast time zones.
Travel requirements As a digital first company the majority of your work can be accomplished remotely. The majority of our employees can live and work anywhere in the U.S but are encouraged to to still spend high quality time in-person collaborating via regular onsites. The in-person sessions cadence varies depending on the team and role; most teams meet once or twice per quarter for 2-4 consecutive days at a time.
How youll make an impact
- Build and Improve the tools owned by the Capture team
- Own the service/raw layer data observability and SLAs
- Participate in planning and prioritization by collaborating with stakeholders across the various product verticals and functions (ML Analytics Finance) to ensure our architecture aligns with the overall business objectives.
- Collaborate with stakeholders such as Software Engineering Machine Learning Machine Learning Platform and Analytics teams to ingest data into the Lakehouse and adopt the developer tools
- Participate in code reviews and architecture discussions to exchange actionable feedback with peers.
- Contribute to engineering best practices and mentor junior team members.
- Help break down complex projects and requirements into sprints.
- Continuously monitor and improve data platform performance reliability and security.
- Stay up-to-date with emerging technologies and industry best practices in data engineering.
Minimum Qualifications
- A bachelors degree in Computer Science Data Science Engineering or a related field.
- 3 years of experience in data engineering or related fields with a strong focus on data quality governance and data infrastructure.
- Proficiency in data engineering tech stack; Databricks / PostgreSQL / Python / Spark / Kafka/ Streaming / SQL / AWS / Airflow/ Airbyte/ Fivetran / DBT / EKS/ containers and orchestration (Docker Kubernetes) and others.
- Ability to approach problems with first principles thinking embrace ambiguity and enjoy collaborative work on complex solutions.
Preferred Qualifications
- Strong foundation in algorithms and data structures and their real-world use cases.
- Experience and understanding of distributed systems data architecture design and big data technologies (e.g. Spark Streaming / Batch Kafka Streaming Lakehouse Databricks Redshift Airbyte Fivetran EKS).
- Experience with AWS technologies ( e.g. AWS RDS S3 Redshift IAM etc.).
- Knowledge of data ingestion software engineering and data security best practices.
- Good knowledge of DevOps engineering using Continuous Integration/Delivery tools like Kubernetes Jenkins Terraform etc. thinking about automation alerting monitoring security and other declarative infrastructure.
- Ability to explain complex concepts in easy-to-understand ways and navigate environments where problems are not well-defined (and evolve quickly).
#LI-REMOTE
#LI-Associate
At Upstart your base pay is one part of your total compensation package. The anticipated base salary for this position is expected to be within the below range. Your actual base pay will depend on your geographic locationwith our digital first philosophy Upstart uses compensation regions that vary depending on location. Individual pay is also determined by job-related skills experience and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
In addition Upstart provides employees with target bonuses equity compensation and generous benefits packages (including medical dental vision and 401k).
Upstart is a proud Equal Opportunity Employer. Just as we are dedicated to improving access to affordable credit for all we are committed to inclusive and fair hiring practices.
If you require reasonable accommodation in completing an application interviewing completing any pre-employment testing or otherwise participating in the employee selection process please email
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Through Upstart, apply online for a fast personal loan, auto refinancing, or debt consolidation. Try our quick rate check today with no impact to your credit!
