Senior AI Governance Java Engineer
Job Location:
Monthly Salary:
Experience Required:
Posted on:
Vacancies:
Job Summary
About the Role:
We are seeking strong Senior Java AI Platform Engineers to work on strategic enterprise initiatives focused on building scalable AI Governance observability and Compliance platforms.
The ideal candidate will have strong expertise in Java backend engineering distributed systems AI integrations telemetry pipelines and cloud-native architectures. This role involves designing scalable enterprise-grade platforms capable of monitoring governing and securing AI interactions across large-scale enterprise environments.
Key Responsibilities:
- Design and build pluggable evaluator services using Java and Spring Boot
- Develop scalable SaaS/cloud-native backend services and microservices
- Integrate with AI platforms including AWS Bedrock Azure AI Foundry Google Vertex AI OpenAI and Anthropic APIs
- Build orchestration frameworks and schedulers for evaluation execution workflows
- Develop AI risk scoring systems and evaluation pipelines
- Design and implement telemetry monitoring and observability solutions
- Build dashboards and reporting systems for evaluation results and governance insights
- Develop integrations/connectors for cloud-native event streams and event-driven architectures
- Collaborate with cross-functional engineering teams in an Agile sprint environment
- Participate in code reviews CI/CD setup and quality engineering practices
- Ensure adherence to software development lifecycle and engineering best practices
Requirements
Required Skills & Qualifications
- 47 years of strong backend engineering experience using Java and Spring Boot
- Proven expertise in SaaS application development and cloud-native architecture
- Strong understanding of REST APIs and microservices architecture
- Hands-on experience with at least one AI platform:
- AWS Bedrock
- Azure OpenAI
- Google Vertex AI
-OpenAI APIs - Experience with cloud SDKs such as AWS SDK for Java Azure SDK or Google Cloud Java libraries
- Strong knowledge of CI/CD tools like GitHub Actions Jenkins or similar
- Experience with testing frameworks including unit integration and contract testing
- Understanding of orchestration/scheduler frameworks such as Quartz or Spring Batch
- Experience with event streaming platforms such as Kafka AWS Kinesis Azure Event Hub or GCP Pub/Sub
- Knowledge of ETL/ELT pipelines and stream processing technologies like Flink or Spark Streaming
- Experience designing schemas and data models for high-volume telemetry/time-series data
- Strong understanding of event-driven architecture and connector development
Preferred Skills
- Familiarity with LLM evaluation frameworks such as:
-RAGAS
-TruLens
-DeepEval - Knowledge of AI governance standards and EU AI Act requirements
- Experience with workflow orchestration frameworks
- Cloud certifications in AWS Azure or GCP
- Exposure to AI risk assessment and governance tooling
Must-Have Skills (Non-Negotiable)
- Strong production-grade experience in Java Spring Boot
- Experience building multi-tenant SaaS/cloud-ntive applications
- Strong software development lifecycle discipline
- Hands-on exposure to at least one AI platform
- REST API and Microservices architecture expertise
- Experience with AI evaluation/testing frameworks
- Telemetry and observability engineering expertise
Benefits
Employee Benefits
Culture:
- Open Door Policy: Encourages open communication and accessibility to management.
- Open Office Floor Plan: Fosters a collaborative and interactive work environment.
- Flexible Working Hours: Allows employees to have flexibility in their work schedules.
- Employee Referral Bonus: Rewards employees for referring qualified candidates.
- Appraisal Process Twice a Year: Provides regular performance evaluations and feedback.
Inclusivity and Diversity:
- Hiring practices that promote diversity: Ensures a diverse and inclusive workforce.
- Mandatory POSH training: Promotes a safe and respectful work environment.
Health Insurance and Wellness Benefits:
- GMC and Term Insurance: Offers medical coverage and financial protection.
- Health Insurance: Provides coverage for medical expenses.
- Disability Insurance: Offers financial support in case of disability.
Child Care & Parental Leave Benefits:
- Company-sponsored family events: Creates opportunities for employees and their families to bond.
- Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child.
- Family Medical Leave: Offers leave for employees to take care of family members medical needs.
Perks and Time-Off Benefits:
- Company-sponsored outings: Organizes recreational activities for employees.
- Gratuity: Provides a monetary benefit as a token of appreciation.
- Provident Fund: Helps employees save for retirement.
- Generous PTO: Offers more than the industry standard for paid time off.
- Paid sick days: Allows employees to take paid time off when they are unwell.
- Paid holidays: Gives employees paid time off for designated holidays.
- Bereavement Leave: Provides time off for employees to grieve the loss of a loved one.
Professional Development Benefits:
- L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development.
- Mentorship Program: Offers guidance and support from experienced professionals.
- Job Training: Provides training to enhance job-related skills.
- Professional Certification Reimbursements: Assists employees in obtaining professional certifications.
Required Skills:
Key Responsibilities: Lead the design and development of AI-driven applications particularly focusing on RAG-based chatbot solutions. Architect robust solutions leveraging Python and Java to ensure scalability reliability and maintainability. Deploy manage and scale AI applications using AWS cloud infrastructure optimizing performance and resource utilization. Collaborate closely with cross-functional teams to understand requirements define project scopes and deliver solutions effectively. Mentor team members providing guidance on best practices in software development AI methodologies and cloud deployments. Ensure solutions meet quality standards including thorough testing debugging performance tuning and documentation. Continuously research emerging AI technologies and methodologies to incorporate best practices and innovation into our products. --- Required Qualifications: Bachelors or Masters degree in Computer Science Engineering Data Science Mathematics Statistics or related fields. At least 5 years of professional experience in AI/Machine Learning engineering. Strong programming skills in Python and Java. Demonstrated hands-on experience building Retrieval-Augmented Generation (RAG)-based chatbots or similar generative AI applications. Proficiency in cloud platforms particularly AWS including experience with EC2 Lambda SageMaker DynamoDB CloudWatch and API Gateway. Solid understanding of AI methodologies including natural language processing (NLP) vector databases embedding models and large language model integrations. Experience with leading projects or teams managing technical deliverables and ensuring high-quality outcomes. AWS certifications (e.g. AWS Solutions Architect AWS Machine Learning Specialty). Familiarity with popular AI/ML frameworks and libraries such as Hugging Face Transformers TensorFlow PyTorch LangChain or similar. Experience in Agile development methodologies. Excellent communication skills capable of conveying complex technical concepts clearly and effectively. Strong analytical and problem-solving capabilities with the ability to navigate ambiguous technical challenges.
