Principal Software Engineer – Applied AI & Agentic Systems
Frankfurt am Main - Germany
Job Summary
Join us as our Principal AI Software Engineer and help turn Matrix42sAI Your Wayvision into secure reliable and useful product capabilities.
This is a principal-level hands-on software engineering role. You will spend most of your time designing coding testing and operating production software. You will also be a technical multiplier: working alongside developers when the problems are difficult turning working experiments into reusable components and helping product squads make sound architectural decisions.
You will connect real customer and product needs with the right combination of software data and AI. Sometimes that means a deterministic workflow; sometimes retrieval tool calling or an agentic system. Your job is to choose pragmatically prove value early and build a path from the first working vertical slice to a scalable product capability.
Your key responsibilities would be:
- Own selected AI capabilities end to endfrom problem discovery and technical design through implementation evaluation release production monitoring and continuous improvement.
- Write and review production code across AI servicesAI harnessesAPIs connectors background services MCP-compatible tools data pipelines and the product surfaces needed to deliver a complete workflow.
- Design agentic systems using the simplest architecture that works including retrieval and grounding structured outputs tool execution state and context model routing approval flows fallbacks and graceful degradation.
- Translate each use case into concrete data and platform requirements. Work with APIs event streams ingestion and transformation data quality and alignment metadata storage observability and governance so that AI results are trustworthy.
- Create results early: build focused end-to-end prototypes with small teams validate them against real workflows and evolve successful patterns into secure maintainable multi-tenant product capabilities.
- Make evaluation part of engineering. Build representative datasets automated and human-reviewed evaluations trace analysis regression gates and telemetry for quality task completion latency safety and cost.
- Engineer for enterprise trust through tenant isolation least-privilege tool access identity and authorization auditability data minimization prompt-injection defenses human approval for consequential actions feature flags and safe rollback.
- Collaborate closely with Product Design Architecture Security Support Customer Success and engineering teams. Turn customer problems into measurable outcomes unblock developers contribute reusable libraries and reference implementations and raise applied-AI engineering practices across Matrix42.
Must haves
- 7 years of professional software engineering experience or equivalent evidence of senior/principal-level impact in production product development.
- A strong record of shipping and operating customer-facing softwarenot only notebooks proofs of concept demos or advisory work.
- Professional proficiency in Python and strong ability in at least one product engineering language such as C# TypeScript or Java.
- Hands-on experience building production LLM or agentic applications including several of the following: retrieval and grounding embeddings or hybrid search structured outputs tool or function calling context and state management model selection or routing and human approval or escalation.
- Experience with data-intensive systems: APIs and integrations event or streaming data ingestion and transformation data quality metadata storage and operational observability.
- Strong system-design fundamentals for API-first distributed cloud-native multi-tenant SaaS products including identity authorization reliability performance and secure integration with enterprise systems.
- Practical experience evaluating and diagnosing AI systems through datasets traces qualitative review quantitative metrics automated tests CI/CD and production telemetry.
- Pragmatic architectural judgment. You know when conventional software is sufficient when AI adds real value and how to balance fast validation with a credible path to production.
- Clear communication and product thinking. You can work directly with developers and customers translate ambiguous needs into a testable technical plan explain trade-offs and drive an end-to-end result across team boundaries.
- A degree in computer science software engineering AI/ML or a related fieldor equivalent practical experience.
Nice to have
- Experience with observability telemetry operational intelligence or other high-volume event-data platforms.
- Knowledge of IT Service Management Enterprise Service Management endpoint management knowledge management service automation or employee self-service.
- Experience with Microsoft Azure Azure OpenAI/Microsoft Foundry Semantic Kernel or comparable enterprise AI platforms.
- Practical knowledge of MCP or comparable tool-integration protocols agent orchestration frameworks vector or hybrid search and OpenTelemetry-based tracing.
- Experience with hosted and open-source models provider-agnostic or bring-your-own-model architectures and hybrid or on-premises deployments.
- Experience evolving a substantial installed enterprise product base toward a new architecturenot only building greenfield products.
- Familiarity with European data-sovereignty privacy security and responsible-AI requirements.
- Experience mentoring engineers creating reusable technical patterns and using agentic development tools such as GitHub Copilot Claude Code Gemini CLI or OpenAI Codex.
At Matrix42 you will work on AI that operates inside real service-management workflowshelping employees service agents administrators and AI leaders resolve work faster and move from reactive support toward proactive service delivery.
You will have the scope to build new AI-native capabilities while solving the harder engineering challenge: integrating them securely into a mature multi-product enterprise platform and creating a credible migration path for existing customers.
We already embrace agentic AI tools as a core part of how we build this role you will go further: shaping how we engineer evaluate secure and operate AI-powered product capabilities across Matrix42. This is technical influence through working software sound judgment and shared engineering patternsnot formal people management.
We could tell you about flexible hours and that hybrid and remote work are part of the deal. But honestly Thats just standard.
What you can expect at Matrix42 includes:
- A flexible work model that combines office and home.
- Personalized learning journeys mentorship and clear opportunities for professional growth.
- Time and support to learn experiment and improve how we build.
- A paid Social Day to give back to your community or support a cause you care about.
- Regular opportunities to connect share knowledge and build relationships across our European teams.
- A competitive location-specific benefits package.
We ask for your understanding that MATRIX42 can only accept applications online via the applicant portal in connection with our applicant management system due to the currently valid EU data protection regulations.
At Matrix42 we empower organizations to digitalize and automate their everyday work. With our platform customers manage IT and business processes assets endpoints and identities seamlesslydriving productivity agility security and a better employee experience. Through integrated solutions and automation we enable modern digital workplaces and true self-service.
Join a diverse team of over 600 professionals across Europe who are shaping the future of service management every day.
Our culture is built on a strong value-based performance mindsetbecause success is not just about what we achieve but how we achieve it. Guided by our four core values we bring our vision to life every day:
- We love customers we put customer success at the heart of everything we do
- Make it happen we take ownership act with speed and turn ideas into impact
- Better every day we continuously learn improve and push boundaries
- With respect we collaborate with trust openness and appreciation for each other
We are committed to building an inclusive and diverse workplace where everyone feels valued and empowered. We welcome applications from all individuals regardless of gender age disability ethnic or social origin religion or belief sexual orientation or identity.
Required Experience:
Staff IC
About Company
We are the European choice in intelligent service management – built on trust, powered by people! At Matrix42, we empower organizations to digitalize and automate their everyday work. With our platform, customers manage IT and business processes, assets, endpoints, and identities seam ... View more