GSS AIMLGen AI Associate 2

Industry/Sector

Specialism

Management Level

Job Description & Summary

Job Title: GSS AI/ML/Gen AI

Essential Skills:

• Proficiency in leveraging LLM APIs (such Open AI / Cohere)
• Experience level 2-5 years
• Expertise in embedding chunking and indexing for Retrieval-Augmented Generation (RAG)
• Experience with frameworks such as Langchain / Haystack / LlamaIndex/Pydantic/CrewAI for building LLM applications
• Ability to implement strategies to identify and mitigate biases in generative models
• Knowledge of cost-effective token consumption techniques
• Proficiency in debugging and logging frameworks for monitoring GenAI app performance
• Ability to monitor key performance metrics and establish performance monitoring frameworks like LangSmith
• Strong collaboration skills with domain experts architects data scientists ML engineers UI/UX designers and business stakeholders
• Proficiency in python and prompt engineering techniques such as Few-shot Chain-of-Thought (COT) ReAct and CART

Job Duties:

• Design develop and maintain LLM-based applications ensuring high performance and scalability.
• Collaborate with business stakeholders to gather and understand requirements aligning LLM applications with business goals and user needs.
• Create and maintain comprehensive technical design documents to guide the development and implementation of LLM applications.
• Conduct research and stay up-to-date with the latest advancements in AI and Gen AI technologies
• Develop adapt and maintain effective prompts for various use cases ensuring reusability and consistency.
• Implement and maintain debugging and logging frameworks to monitor and improve the performance of GenAI applications
• Develop metrics and benchmarks to evaluate model performance.
• Support testing activities and ensure resolution of defects reported.
• Provide support and guidance to users and team members on the use of generative models / LLM based applications.
• Develop training materials and conduct workshops or training / knowledge transfer sessions.

The Opportunity

When you join PwC Acceleration Centers (ACs) you step into a pivotal role focused on actively supporting various Acceleration Center services from Advisory to Assurance Tax and Business our innovative hubs youll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. Youll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.

As part of the Business Application Consulting team you design develop and maintain LLM-based applications focusing on performance and scalability. As an Associate you support senior staff engage in research and participate in project tasks while building meaningful client connections and enhancing your technical knowledge.

Responsibilities

- Collaborate on AI/ML or Gen AI projects with the team

- Assist in the development and implementation of solutions

- Support the analysis of data to inform project decisions

- Engage in learning opportunities to enhance technical knowledge

- Contribute to project documentation and knowledge sharing

- Participate in team meetings to discuss project progress

- Help maintain productive communication with clients

- Uphold the firms ethical standards and professional conduct

What You Must Have

- Bachelors Degree

- 2 years of experience in Generative AI development

- Oral and written proficiency in English required

What Sets You Apart

- Proficiency in leveraging LLM APIs

- Experience in embedding chunking and indexing for RAG

- Familiarity with frameworks like Langchain Haystack and LlamaIndex

- Implementing strategies to mitigate biases in generative models

- Knowledge of cost-effective token consumption techniques

- Proficiency in debugging and logging frameworks

- Monitoring key performance metrics and establishing performance frameworks

- Collaborating with domain specialists and stakeholders

- Proficiency in Python and prompt engineering techniques

Travel Requirements

Job Posting End Date