Principal Applied Scientist (OCI-GEN AI)
Principal Applied Scientist (OCI-GEN AI)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
The Senior Applied Scientist will play a key role in the development and evaluation of LLM and vLLM models with a focus on creating innovative solutions to real-world problems. This role requires a deep understanding of machine learning techniques including foundation model evaluation traditional NLP/CV metrics LLMaaJ techniques human evaluation confidence estimation agentive application evaluation and RAG application evaluation. The successful candidate will have experience in conducting in-depth research producing production-ready code and collaborating with cross-functional teams to integrate evaluation capabilities into various applications and products. A strong background in programming languages such as Python and experience with machine learning frameworks such as TensorFlow or PyTorch is also required.
The successful candidate will be responsible for conducting in-depth research on foundation model evaluation producing production-ready code for handoff to engineering counterparts and helping to build and mentor a high-performing team of scientists and engineers. They will work closely with cross-functional teams to integrate evaluation capabilities into various applications and products identify new opportunities for evaluation and explore emerging technologies. The candidate will also be responsible for staying up-to-date with industry trends and advancements in evaluation and for applying this knowledge to drive innovation and improvement in the teams work. This will involve designing and executing experiments researching new algorithms and finding new ways of optimizing risk profitability and customer experience. A PhD in Computer Science Mathematics Statistics Physics Linguistics or a related field with a dissertation or thesis centered on machine learning techniques is preferred although a Masters or Bachelors degree with relevant experience will also be considered.
Career Level - IC4
Responsibilities
Responsibilities:
Research and Development: Conduct in-depth research on foundation model evaluation including traditional NLP/CV metrics LLMaaJ techniques human evaluation confidence estimation agentive application evaluation and RAG application evaluation. Produce production-ready code for handoff of POC applications to counterparts in Engineering.
Collaboration: Work closely with cross-functional teams to integrate evaluation capabilities into various applications and products.
Team Leadership: Help lead and mentor a high-performing team of scientists and engineers.
Innovation: Identify new opportunities for evaluation and explore emerging technologies.
Stay Updated: Maintain a deep understanding of industry trends and advancements in evaluation.
Qualifications and Experience:
PhD Computer Science Mathematics Statistics Physics Linguistics or a related field (with a dissertation thesis or final project centered in Machine Learning/Deep Learning/Generative AI/Computational Linguistics) and a minimum of 4 years work experience. Candidates without a PhD but with 5 additional years experience will be considered.
Strong publication record including as a lead author or reviewer in top-tier journals or conferences.
Extensive experience in generative AI and model/application evaluation.
Strong understanding of machine learning algorithms and architectures
Excellent problem-solving and analytical skills
Strong leadership and communication abilities
Qualifications
Disclaimer:
Certain US customer or client-facing roles may be required to comply with applicable requirements such as immunization and occupational health mandates.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $120100 to $251600 per annum. May be eligible for bonus equity and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge skills experience market conditions and locations as well as reflect Oracles differing products industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical dental and vision insurance including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
Required Experience:
Staff IC
Employment Type
Full-Time
