AIML Customer Engineer

The AI/ML Engineer / Senior AI/ML Engineer is a highly technical hands-on role at the intersection of Enterprise AI and client-facing architecture. As part of our Customer Engineering function you will write production-grade solution blueprints alongside strategic customers and technology partners. Your mission is to solve immediate high-stakes operational bottlenecks in the APAC region by delivering repeatable extensible and open-sourced AI Quickstarts that show the industry how to solve complex challenges.

In this team career growth and seniority are defined purely by your technical competence architectural depth and ability to deliver end-to-end solutions autonomously in highly ambiguous environments. There is no expectation of team management project coordination or formal talent mentorship; your progression is driven entirely by engineering impact.

• Enterprise-Minded Blueprinting: Design and build comprehensive production-ready architecture blueprints and reference codebases. These blueprints must naturally take into account critical enterprise requirementsincluding systems-level hardening infrastructure scalability and network isolation boundarieswithout you needing to perform the last-mile hands-on production deployment yourself.

• Open-Source AI Quickstarts: Package repeatable extensible technical architectures as open-sourced AI Quickstarts to solve complex real-world industry problems and accelerate ecosystem adoption.

• Co-Development & Integration: Collaborate with external engineering teams (such as semiconductor partners regional AI programs and software vendors) to validate joint-architecture blueprints ensuring stable integrations across the system stack.

• Benchmarking & Evaluation: Design and integrate automated testing evaluation harnesses and system-level telemetry into blueprints to monitor and measure performance metrics like latency throughput cost and model quality.

• Regulated & Secure Design: Proactively incorporate robust data privacy standards secure network perimeters and localized hosting considerations into all solution blueprints to satisfy compliance and risk management requirements in highly regulated environments.

To be considered for this role all candidates must meet the following baseline requirements:

• Education: Bachelors or Masters degree in Computer Science Computer Engineering or a related quantitative field.

• Software Engineering Foundations: Excellent understanding of software engineering fundamentals including clean code principles test-driven development (TDD) CI/CD automation pipelines and version control (Git) workflows.

• Communication: Clear verbal and written communication skills in English with the ability to articulate complex technical architectures to other engineers and technical stakeholders.

• Programming Languages: Exceptional hands-on proficiency in Python (specifically for machine learning and systems programming). Solid familiarity with lower-level system languages such as Go or C/C is highly preferred.

• Deep Learning & ML Libraries: Strong familiarity with PyTorch and core NLP/vision ecosystems (e.g. Hugging Face Transformers datasets and tokenizers).

• Cloud-Native Frameworks: Strong practical experience deploying containerized applications on Kubernetes or production-grade enterprise container orchestration platforms.

• Base MLOps Knowledge: Conceptual and hands-on understanding of model serving lifecycles data ingestion steps and automated packaging.

We are building a multi-disciplinary engineering squad. Candidates are expected to bring experience in some of the following domains and will have the opportunity to continuously develop their skills across all of them as they grow in seniority:

• Platform & Pipeline Engineering: Experience with distributed computing frameworks and cluster schedulers (such as Ray) workflow orchestration (such as MLflow or Kubeflow) distributed unstructured data parsing tools (such as Docling) and vector database structures.

• Generative AI & Agentic Architectures: Familiarity with LLM orchestration engines (such as LangChain LlamaIndex or LangGraph) agentic workflows (AgentOps) tool-calling protocols (such as Model Context Protocol) and model fine-tuning (PEFT/SFT).

• Hardware Heterogeneity & Runtime Optimization: Understanding of model serving runtimes (such as vLLM) optimizing engines for latency and throughput (e.g. KV cache offloading chunked prefill) and running benchmarks across diverse hardware setups including CUDA ROCm and emerging GPU/NPU architectures.

• Regulated Deployments: Designing isolated air-gapped container networks secure registry services and local inference environments to meet strict data residency privacy and compliance policies.

While not strictly required experience applying AI/ML architectures to solve challenges in the following regulated industries is a strong advantage:

• Financial Services (FSI): Familiarity with risk-assessment models fraud detection patterns or compliance requirements under regulatory frameworks.

• Public Sector & Healthcare: Experience handling highly sensitive or anonymized datasets building secure data boundaries or deploying solutions under strict government compliance protocols.

• Telecommunications & Manufacturing: Experience with edge AI deployments high-throughput streaming pipelines or low-latency remote architectures.

• Pioneering Ecosystem Impact: Work in a highly strategic center of gravity where your contributions directly shape open-source solution blueprints and AI Quickstarts used by the wider community.

• Pure Engineering Focus: Grow along a dedicated technical track where career progression is tied directly to your architectural depth and software contribution free from administrative management or project coordination overhead.

• State-of-the-Art Technologies: Gain hands-on exposure to emerging global hardware platforms next-generation agentic runtimes and localized enterprise software stacks.

#LI-SH4

About Red Hat

Red Hat is the worlds leading provider of enterprise open source software solutions using a community-powered approach to deliver high-performing Linux cloud container and Kubernetes technologies. Spread across 40 countries our associates work flexibly across work environments from in-office to office-flex to fully remote depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas no matter their title or tenure. Were a leader in open source because of our open and inclusive environment. We hire creative passionate people ready to contribute their ideas help solve complex problems and make an impact.

Inclusion at Red Hat
Red Hats culture is built on the open source principles of transparency collaboration and inclusion where the best ideas can come from anywhere and anyone. When this is realized it empowers people from different backgrounds perspectives and experiences to come together to share ideas challenge the status quo and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access and that all voices are not only heard but also celebrated. We hope you will join our celebration and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Equal Opportunity Policy (EEO)
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race color religion sex sexual orientation gender identity national origin ancestry citizenship age veteran status genetic information physical or mental disability medical condition marital status or any other basis prohibited by law.