Staff Software Engineer, Stream Processing Platform

Were seeking a software engineer to help Pinterest build and lead the next generation of stream processing platform and infrastructure. Youll be working on some of the most exciting big data open source technologies (Flink Kafka RocksDB and more) at the scale of tens of millions of messages per second with terabytes of data to help Pinners discover and do what they love.

What youll do:

• Lead the strategy and technical direction of Pinterests Streaming platform
• Improve and customize the internals of open source Flink to meet our challenges at scale and actively participate in open source community
• Build and scale stream processing frameworks and infrastructure to process millions of messages per second with terabytes of state
• Work with internal customers on critical business use cases that rely on low latency stream processing
• Provide thought leadership to the entire company on how real-time data should be processed and stored more reliably quickly and efficiently at scale
• Contribute to the teams technical vision and long-term roadmap

What were looking for:

• 8years of industry experience with a proven track record of technical excellence
• 5 years of experience of building and support large scalable big data infrastructure/platform
• 4 years of experiences in contributing to open-source Flink or streaming technologies
• Deep knowledge of big data technologies ( Spark Hadoop Parquet/ORC Flink)
• Experience in leading cross-team engineering efforts
• Proficiency in one or more programming languages (Java Scala Python)
• Experiences in Kubernetes and AWS technologies
• BS degree in a relevant field such as Computer Science OR equivalent experience

In-Office Requirement Statement:

• We let the type of work you do guide the collaboration style. That means were not always working in an office but we continue to gather for key moments of collaboration and connection.
• This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country.

Relocation Statement:

• This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.

#LI-HYBRID

#LI-AH2

Required Experience:

Staff IC