Associate Director, Software Engineering (AI Guardrail)
Job Summary
Some careers have more impact than others.
If youre looking for a career where you can make a real impression join HSBC and discover how valued youll be.
We are currently seeking an experienced professional to join our team in the role ofAssociate Director Software Engineering (AI Guardrail).
Business: CTO Platforms (AI Platforms)
Location: Shenzhen / Guangzhou
Req ID: 45007
Principal responsibilities
- Build high-concurrency async services in Python (asyncio) and/or Go for AI/LLM guardrail runtimes.
- Design scalable sync/async execution pipelines including batching routing and inference orchestration.
- Implement queueing and flow-control (backpressure retries timeouts cancellation overload protection rate limiting).
- Deliver streaming and real-time processing via WebSocket SSE gRPC streaming and event-driven patterns.
- Build distributed messaging architectures using Kafka/PubSub to support chunked/streaming inference and detection.
- Instrument end-to-end observability (metrics tracing telemetry) with OpenTelemetry/OpenInference and actionable dashboards/alerts.
- Lead reliability and performance engineering: profiling concurrency tuning bottleneck/latency/overload remediation SLO/SLA practices.
- Enable governance-ready controls: config-driven policies/detectors (versioning/rollout/rollback) multi-tenancy (isolation/quotas) audit trails and traceable runtime signals.
Requirements
- Bachelors degree or above in CS/Software Engineering (or equivalent experience) with 8 years engineering experience including 5 years building and running distributed cloud-native backend systems in production.
- Strong hands-on Python (asyncio/FastAPI) and/or Go with deep knowledge of non-blocking I/O async programming and high-concurrency service design.
- Proven runtime control and performance engineering: queueing/backpressure rate limiting/overload protection retries/timeouts/cancellation latency and throughput optimisation under load.
- Experience with event-driven and streaming systems plus API platforms: WebSocket/SSE/message streaming REST/gRPC and API gateway/platform components; strong observability (metrics/logs/traces OpenTelemetry) and production troubleshooting (profiling RCA).
- Cloud and platform operations: Kubernetes/Docker on AWS/GCP/Azure; operational controls such as RBAC/authN/authZ configuration management and audit logging; AI-native mindset and effective use of coding assistants.
Youll achieve more when you join HSBC.
HSBC is an equal opportunity employer committed to building a culture where all employees are valued respected and opinions count. We take pride in providing a workplace that fosters continuous professional development flexible working and opportunities to grow within an inclusive and diverse environment. We encourage applications from all suitably qualified persons irrespective of but not limited to their gender or genetic information sexual orientation ethnicity religion social status medical care leave requirements political affiliation people with disabilities color national origin veteran status etc. We consider all applications based on merit and suitability to the role. /WX
Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement which is available on our website.
***Issued By HSBC Software Development (GuangDong) Limited***
Required Experience:
Director
About Company
HSBC Holdings plc is a British multinational investment bank and financial services holding company. It was the 7th largest bank in the world by 2018, and the largest in Europe, with total assets of US$2.558 trillion.