Principal Data Engineer, (APIsmicroservicesPythonKafkaElasticsearch)

With 1000 intelligence professionals over $300M in sales and serving over 1900 clients worldwide Recorded Future is the worlds most advanced and largest intelligence company!

Were looking for a Principal DataEngineer to help design build and scale the systems that power our Attack Surface Intelligence module. Youll be taking ownership of critical data pipelines responsible for the ingestion and distribution of critical intelligence signals both internally and directly to customers via the product. The Attack Surface Intelligence Data Engineering team is responsible for two key datasets: our holistic global internet inventory and the technical artifacts of our customers attack surface.

This role reports directly to the Engineering Owner for Attack Surface Intelligence Data and is ideal for someone who enjoys writing clean maintainable code and thrives in distributed systems environments. Youll work closely with product management and other engineering teams to drive technical strategy and ensure our systems are reliable performant and insightful.

What Youll Do:

• Lead the design and implementation of backend services and APIs in Python
• Architect and evolve microservice-based systems for scalability and resilience
• Collaborate with product managers and cross-functional partners to align technical work with business goals
• Proactively identify and resolve data and integration issues by diving deep into our pipelines and systems
• Drive observability and operational excellence across services
• Mentor other engineers through code reviews and design discussions
• Coordinate with internal stakeholders outside of the Attack Surface Intelligence team to inform solutions for data transfers around the greater Recorded Future ecosystem
• Contribute to technical roadmaps and long-term platform strategy

What Youll Bring:

• Proven experience designing & maintaining scalable APIs and microservices in Python leveraging tools like Kafka Clickhouse and Elasticsearch.
• Deep understanding of distributed systems and service-oriented architecture
• Comfortable exploring data to debug validate assumptions and drive better system behavior
• Excellent communication skills and the ability to work across teams to align on goals and priorities
• Track record of operating independently and driving complex projects especially with a geographically distributed team
• Experience with informing and driving coding and design standards within a team

The base salary range for this full-time position is $152000-$228000. Our salary ranges are determined by role level and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range individual pay is determined by state work location and additional factors including job-related skills experience and relevant education or training. This position may be eligible for incentive compensation equity and medical dental vision life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

Why should you join Recorded Future
Recorded Future employees (or Futurists) represent over 40 nationalities and embody our core values of having high standards practicing inclusion and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

Want more info
Blog & Podcast: Learn everything you want to know (and maybe some things youd rather not know) about the world of cyber threat intelligence
Linkedin Instagram&Twitter: Whats happening at Recorded Future
The Record: The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field
Timeline: History of Recorded Future
Recognition: Check out our awards and announcements

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work Recorded Future is made a better place every day.

If you need any accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to our recruiting team at

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race religion color national origin gender including pregnancy sexual orientation gender identity age marital status veteran status disability or any other characteristic protected by law.

Recorded Future will not discharge discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about discussed or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts and in alignment with our hiring practices across all jurisdictions.

Notice to Agency and Search Firm Representatives:
Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future including those sent to our employees or through our website will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

Agencies must have a valid written agreement in place with Recorded Futures recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

Note: Our interview process for all final-round candidates requires a mandatoryin-person interviewor a live scheduledvideo conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.