Senior Software Engineer Secure AI service
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Hi there we are Edgeless Systems
We are a fast-growing cybersecurity startup. Join us in developing the next generation of secure AI and cloud software explore cutting-edge technologies like confidential computing and grow in and alongside a world-class team
Our product
Privatemode AI is our secure alternative to ChatGPT. It enables AI workflows with sensitive data by keeping all data encryptedeven during processingusing confidential computing. You can access it via a user-friendly app or a fully OpenAI-compatible API.
See for yourself: Most of our code is available on GitHub.
Our tech stack
Our product
Privatemode AI is our secure alternative to ChatGPT. It enables AI workflows with sensitive data by keeping all data encryptedeven during processingusing confidential computing. You can access it via a user-friendly app or a fully OpenAI-compatible API.
See for yourself: Most of our code is available on GitHub.
Our tech stack
- API: Go Kubernetes
- RAG: Python Qdrant
- Model hosting: Python vLLM
- Scaling: pipeline/tensor parallelism optimization for Nvidia H100 and B200
Your mission
As part of our team youll work on the Privatemode platform across frontend backend and model hosting. Tasks include:
- Extending our OpenAI-compatible API and confidential processing stack
- Building RAG features embedding pipelines and agent functionality
- Hosting and optimizing the performance of cutting-edge open-source LLMs
- Scaling models using parallelism and efficient GPU orchestration
- CI/CD automation and documentation
- Prototyping and iterating on new features
Your profile
We are looking for team members who
- have outstanding technical capabilities
- are experienced in a relevant subset of the technologies outlined above
- are excited about the challenges of a fast-paced innovative startup environment
- are experienced in professional agile software-development practices
- are inherently motivated to deliver high-quality work
Why us
- Competitive compensation (salary and stock options)
- Opportunity to learn and grow within an outstanding team
- Flexible working arrangementsremote or in our offices in Bochum and Berlin
- Exciting tasks in a dynamic environment
Required Experience:
Senior IC
Key Skills
- Spring
- .NET
- C/C++
- Go
- React
- OOP
- C#
- AWS
- Data Structures
- Software Development
- Java
- Distributed Systems
About Company
Industry-leading solutions for confidential AI and confidential cloud. Protect anything from AI prompts to containers with runtime encryption.
