FLEX AI Software Engineer, Software Development Engineer in Test

This is a temporary position.

The assignment duration is through September 11 2027.

Marriott International is a global hospitality company with a portfolio of 31 brands and more than 8500 properties across 138 countries and territories. Diversity inclusion and the well-being of associates are fundamental to Marriotts values and business goals. The FLEX Software Engineer Software Development Engineer in Test AI leads quality engineering for production conversational AI and intelligent search experiences. This role combines software development in test browser and API automation AI evaluation performance engineering accessibility validation and production reliability to establish measurable quality standards and release-readiness gates for accurate grounded secure reliable and consistent customer experiences.

• Bachelors degree in Computer Science Software Engineering Information Technology or a related field or equivalent professional experience.
• 2 years of experience in quality engineering test automation or SDET roles.
• Strong programming experience in Python JavaScript TypeScript Java or a comparable language with hands-on experience in browser automation API testing automated test frameworks performance testing source control code review and CI/CD quality gates.
• Experience testing conversational AI generative AI retrieval-augmented generation intelligent search chatbot or agent-based applications including non-deterministic evaluation cloud-native systems containers Kubernetes observability accessibility and cross-functional delivery.

Preferred

• Experience with commercial or open-source LLM evaluation platforms and with designing LLM-as-judge deterministic human-evaluation prompt-testing model-comparison and retrieval-ranking workflows.
• Experience with responsible-AI validation red teaming adversarial datasets contract testing service virtualization workflow orchestration asynchronous systems canary deployments and production smoke testing.
• Experience with localization accessibility responsive and cross-browser testing authentication and authorization testing CORS CSP sensitive-data security testing quality dashboards and executive release-readiness reporting.

• Defines and owns the automated quality strategy for conversational AI applications and intelligent search experiences.
• Builds and maintains browser API integration contract smoke regression and end-to-end automated test suites.
• Develops automated evaluations for response correctness relevance grounding hallucination risk retrieval quality ranking quality tool selection and tool-call accuracy.
• Validates multi-turn conversation consistency safety guardrails prompt-injection resistance responsible-AI requirements and sensitive-data handling.
• Converts business scenarios customer journeys and production defects into reusable regression datasets and automated tests.
• Develops performance load stress spike scalability and reliability tests for AI applications and supporting services.
• Establishes measurable quality baselines for latency throughput error rates concurrency resource utilization and release readiness.
• Integrates automated tests AI evaluations and quality thresholds into CI/CD pipelines and progressive-delivery workflows.
• Builds automated pre-deployment and post-deployment smoke tests that validate critical customer and system workflows.
• Manages test environments synthetic data fixtures service mocks test credentials and repeatable test execution capabilities.
• Analyzes failures and production issues using logs metrics distributed traces automation results and AI evaluation data.
• Produces quality dashboards defect insights evaluation summaries and release-readiness reports for engineering and business stakeholders.
• Collaborates with Engineering Product Platform Security Accessibility Quality Engineering and Responsible AI teams to improve testability and prevent defects earlier in development.
• Evaluates emerging AI quality-engineering tools and techniques and applies pragmatic approaches appropriate for production systems.

At Marriott International we are dedicated to being an equal opportunity employer welcoming all and providing access to opportunity. We actively foster an environment where the unique backgrounds of our associates are valued and greatest strength lies in the rich blend of culture talent and experiences of our are committed to non-discrimination on any protected basis including disability veteran status or other basis protected by applicable law.