Staff Software Engineer

The Staff Software Engineer on the Data Platforms Data Mesh team will help set technical direction to deliver scalable data pipelines retrieval processes and analytics jobs which process data at an enterprise scale. They will serve as an expert and owner for the Data Platforms Data Mesh participate in architectural discussions and contribute significant handson implementation to successfully deliver new capabilities from conception to release. In addition to handson development they will work closely with the product management team mentor engineers and help drive roadmap planning. The Staff Software Engineers role is responsible for providing technical leadership and does not have peoplemanagement responsibilities.

About the Team

The Rapid7 Data Platform team builds and maintains a unified system of services and pipelines to ingest store and access data at an enterprise scale.

We focus on scalability performance and resilience to ensure our centralized Data Platform delivers reliable seamless access to data to power critical customer experiences.

About the Role

We are seeking an innovative selfmotivated Staff Software Engineer with strong data engineering experience. The ideal candidate will act as technical leader for the Data Platforms Data Mesh engineering team building and supporting scalable data pipelines retrieval processes and analytics jobs. The Staff Software Engineer on the data mesh team will work widely across product teams and collaborate within the Data Platform to deliver product adoption and pipeline scalability. They will also take ownership of monitoring/testing strategies to ensure performance resilience and cost optimisation.

You will both help set technical direction and directly contribute with significant handson development. The Staff Software Engineers role is responsible for providing technical leadership and does not have peoplemanagement responsibilities.

In this role you will:

• Build maintain and release our well architected services and infrastructure by writing correct and clean code consistently and following best practices and conventions. You will understand and make wellreasoned design decisions and tradeoffs.

• Work cross functionally with internal product tech teams and product managers.

• Take a lead role in the design and implementation of solutions to ensure pipeline performance resilience and cost optimisation.

• Help set technical direction defining and implementing data models access controls data governance and data retention strategies.

The skills youll bring include:

• A minimum of 8 years experience in software development. Preferably 5 years actively building solutions with common Data Engineering technologies e.g. Spark SQL Airflow etc.

• Strong handson experience building and supporting analytics/ transformation workloads in Spark ideally in Scala.

• Experience working with technologies to support storage and high performant access of huge analytic data sets. Preferably Apache Iceberg and Parquet.

• Hands on expertise building high performance data pipelines using kafka.

• Experience implementing systems that use Change Data Capture(CDC) tools and patterns to replicate data to other systems preferably Debezium.

• Experience in continuously monitoring and optimising data pipelines for performance and costeffectiveness.

• Familiarity with CI/CD pipelines such as Jenkins and proficiency with version control systems such as GitHub.

• Mentorship and guidance of junior engineers providing technical leadership and fostering a culture of continuous improvement and innovation.

• Excellent verbal and written communication skills.

• Strong creative problem solving ability.

We know that the best ideas and solutions come from multidimensional teams. Teams reflecting a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact please dont be shy apply today.

About Rapid7

At Rapid7 we are on a mission to create a secure digital world for our customers our industry and our communities. We do this by embracing tenacity passion and collaboration to challenge whats possible and drive extraordinary impact.

Here were building a dynamic workplace where everyone can have the career experience of a lifetime. We challenge ourselves to grow to our full potential. We learn from our missteps and celebrate our victories. We come to work every day to push boundaries in cybersecurity and keep our 10000 global customers ahead of whatevers next.

Join us and bring your unique experiences and perspectives to tackle some of the worlds biggest security challenges.

#LICG1