Software Engineer, Data Lake

Who we are

About Stripe

Stripe is a financial infrastructure platform for businesses. Millions of companiesfrom the worlds largest enterprises to the most ambitious startupsuse Stripe to accept payments grow their revenue and accelerate new business opportunities. Our mission is to increase the GDP of the internet and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyones reach while doing the most important work of your career.

About the team

The Data Lake team builds and operates Stripes Data Lake enabling high-scale data ingestion unified storage and data governance across services for all of Stripe. We operate globally distributed systems at high levels of reliability to support Stripes growing scalability reliability and product requirements. We enable other teams at Stripe by creating simple abstractions and providing self-service tooling and dashboards to enable users to easily operate services on our infrastructure. We minimize operational toil for the team through regular investment in automation of maintenance operations.

Were looking for people with a strong background (or interest!) in Data Lake architectures and who are excited about solving challenging distributed systems problems.

What youll do

Youll work with other infrastructure engineers as well as the product engineers who use the systems we build. Were looking for people interested in data. Wed love to hear from you whether youre a seasoned software engineer or whether youve just learned you might like working with data lakes .

Responsibilities

• Design build and maintain Data Lake infrastructure leveraging popular systems such as Hadoop Spark Iceberg Temporal and Amazon S3 used by all of Stripes engineering teams.
• Work with various stakeholders at Stripe to understand their specific requirements and identify opportunities to better leverage our streaming infrastructure

Who you are

Were looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements you are encouraged to apply. The preferred qualifications are a bonus not a requirement.

Minimum requirements

• 5 years of professional hands-on software development experience
• Experience designing building maintaining and debugging distributed systems
• Experience with scaling distributed systems in a rapidly moving environment
• Experience building infrastructure as a product centered around users needs

Preferred qualifications

• Experience with Data Lake architecture
• Experience working with open source technology such Hadoop Spark Iceberg or Amazon S3
• Experience with orchestration platforms such as Cadence Temporal or AWS Step Functions