drjobs Research Scientist Large Scale Pre-training Model

Research Scientist Large Scale Pre-training Model

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

London - UK

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Snapshot

At Google DeepMind weve built a unique culture and work environment where longterm ambitious research can flourish. We are seeking a highly motivated Research Scientist to join our team and contribute to groundbreaking fundamental research and deployment in large scale pretraining.

About Us

Artificial Intelligence could be one of humanitys most useful inventions. At Google DeepMind were a team of scientists engineers machine learning experts and more working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery and collaborate with others on critical challenges ensuring safety and ethics are the highest priority.

The Role

Were looking for a Research Scientist with a strong empirical and theoretical understanding of deep learning (architecture optimisation data LLMs) as well as strong engineering skills and understanding of distributed systems.

Key responsibilities:

  • Develop strong intuitions grounded in scaling laws and theoretical insights that can lead to research breakthroughs and new model capabilities.
  • Understand and measure effects of scaling on training dynamics and model performance via scaling laws and other analysis tools.
  • Conduct modelling research: Use empirical and theoretical insights to derive novel research ideas that improve Gemini models.
  • Dive deep into specific aspects of pretraining (modelling optimisation data) to understand and improve model dynamics.
  • Collaborate with the wider Gemini team engaging closely with the Data Infrastructure and the PostTraining teams.

About You

In order to set you up for success as a Research Scientist at Google DeepMind we look for the following skills and experience:

  • A PhD in machine learning or closely related field or similar experience.
  • A proven track record of large scale deep learning with handson experience with Python and neural network training (publications opensource projects relevant work experience .
  • An indepth knowledge of Transformer models and LLM training dynamics.
  • Ability to communicate technical ideas effectively e.g. through discussions whiteboard sessions written documentation.

In addition the following would be an advantage:

  • Experience with GPU/TPU kernel development (Triton Pallas).
  • Experience with distributed systems and large scale deep learning performance optimisation.
  • Experience with running large scale data processing pipelines.

At Google DeepMind we value diversity of experience knowledge backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex race religion or belief ethnic or national origin disability age citizenship marital domestic or civil partnership status sexual orientation gender identity pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation please do not hesitate to let us know.

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.