Artificial Intelligence & Agentic Solutions Specialist

Requisition ID: 266247

Thanks for your interest in ScotiaTech Scotiabanks new and innovative Technology hub in Bogota.

Join a purpose driven winning team that promotes creativity and innovation in a fast-paced environment where were always committed to results in an inclusive diverse and high-performing culture.

Purpose

This position is responsible for acting as the organizations deep technical authority for enterprise Artificial Intelligence initiativesparticularly agentic and LLM-enabled solutionsensuring they exceed intended business outcomes and comply with Responsible AI and Model Risk requirements. This role is designed for an expert individual contributor who leads through technical influence: defining patterns guiding architecture decisions strengthening evaluation discipline (including prompting) and elevating delivery quality across hybrid environments (cloud and on-prem).

The Specialist is accountable for taking over complex AI initiatives already in motion identifying critical gaps and improving them through rigorous prompt/evaluation practices governance-by-design and production-grade engineering. The role serves as a key escalation point for complex technical decisions enabling multiple teams (including Level 6 engineers) to deliver safe reliable measurable and supportable AI capabilities.

Accountabilities

.1. Technical Authority & Architecture Leadership (IC Leadership)
- Lead architecture decisions for agentic/LLM solutions including integration patterns (APIs/event-driven) retrieval/grounding approaches guardrails evaluation design and operational monitoring.
- Establish reusable reference architectures and golden paths that reduce rework and accelerate safe delivery across teams.
- Act as escalation point for high-impact technical risks and guide root-cause analysis to drive sustainable fixesnot short-term patches.

2. Prompting Excellence (MUST Prompt Engineering)
- Own prompt engineering standards for production systems: prompt templates system instructions structured outputs and context strategies that improve reliability and reduce failures.
- Design and execute controlled experiments to compare prompt variants and measure impact on quality safety and cost (token usage/latency).
- Define evaluation metrics and datasets for prompt/agent behavior (relevance groundedness safety robustness) and implement regression testing for prompt and model changes.
- Implement prompt lifecycle management (documentation version control A/B testing/rollbacks) and integrate it into delivery workflows.
- Identify and mitigate failure modes such as hallucinations prompt injection risk unsafe outputs and brittle behavior under edge cases.

3. Responsible AI / Model Risk Governance (MUST)
- Implement Responsible AI controls as non-negotiable standards: privacy safeguards auditability traceability and risk-based validation for prompts responses logs and tool usage.
- Partner with Security Risk and Compliance stakeholders to ensure approvals documentation and controls are met before production releases.

4. Full-Stack Delivery Enablement (MUST / TypeScript / React)
- Provide technical leadership to ensure end-to-end AI-enabled products (UI API AI integration) meet enterprise standards for maintainability security and performance.
- Review and guide backend services and React/TypeScript frontend implementation approaches to ensure consistency and scalability across solutions.

5. LLMOps / Operational Excellence (Production Readiness)
- Establish evaluation and monitoring practices for LLM/agentic systems (tracing evaluation harnesses prompt management governed model access production monitoring) to detect regressions early and improve reliability at scale.
- Define and monitor operational KPIs (quality safety signals latency cost per task adoption) and recommend optimization strategies.

6. Cross-Functional Influence & Advisory
- Translate complex technical risks and trade-offs into executive-ready recommendations for Product Architecture and Risk stakeholders.
- Provide enablement to engineers (including Level 6) via technical reviews standards playbooks and knowledge transfer sessionswithout direct people management accountability.

7. Continuous Improvement & Innovation
- Drive continuous improvement of AI delivery practices: evaluation maturity observability testing automation cost optimization and reusable components.
- Evaluate emerging tools and practices for agentic systems (tool use orchestration memory evaluation) and recommend adoption aligned with governance expectations.

Education / Experience / Other Information

Bachelors degree in Computer Science Engineering or related field.
3-5 years of software engineering experience including 2 years in an engineering leadership/people management role (direct reports).
Demonstrated experience delivering AI-enabled solutions in production (LLM applications agentic workflows or applied ML) including scaling and improving existing initiatives to meet defined outcomes.
Responsible AI / Model Risk (MUST): proven experience implementing privacy auditability traceability and validation controls aligned with enterprise governance.
Prompt Engineering (MUST): hands-on experience designing testing and maintaining prompts/system instructions including controlled experimentation evaluation metrics and prompt versioning/documentation in production settings
Full-Stack Engineering (MUST): strong working knowledge of backend services and React/TypeScript frontend delivery sufficient to guide architecture decisions and mentor senior-equivalent ICs.
Strong knowledge of SDLC and Agile methodologies; experience leading delivery across multiple streams and dependencies.
Strong stakeholder communication skills including executive-ready reporting of risks progress and trade-offs.
English level: B2 (recommended for global stakeholder management).

#LI-HYBRID

Location(s): Colombia : Bogota : Bogota

ScotiaTech is a business unit within ScotiaGBS a Scotiabank Group company located in Bogota Colombia. The ScotiaTech hub was created to support different technology systems and processes of the Bank. We offer an inclusive positive work environment and competitive benefits.

At ScotiaTech we value the unique skills and experiences each individual brings and are committed to creating and maintaining an inclusive and accessible environment for everyone. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at ScotiaTech; however only those candidates who are selected for an interview will be contacted.

Note: All postings in will remain live for a minimum of 5 days.