Team Overview:
LinkedIns Core AI organization is dedicated to transforming the professional world through innovative solutions including advanced models agents and AI systems.
Our HALO Evaluation Engineering team builds core technology that powers LinkedIns model and agent evaluation ecosystem. This is a horizontal and deeply cross-functional team empowering product linguists and operations partners to evaluate new AI solutions quickly efficiently and at scale.
Were building a next-generation AI evaluation and optimization platform that makes AI systems measurable reliable and continuously improving in production. As AI systems become more autonomous and agentic evaluation cant rely on manual labeling and disconnected tools. Our team is creating a unified intelligence layer that connects human feedback AI judges synthetic data training pipelines and real-time monitoring into a closed-loop improvement engine defining how AI agents are validated shipped and improved at scale.
Team Scope & Future Work
Golden Dataset Generation Tools Automate creation labeling quality control and versioning of high-quality evaluation datasets from specs and production data.
LLM-as-a-Judge Infrastructure Build and align large model evaluators to reliably score outputs reasoning traces and agent behavior.
Distilled In-House Evaluator Models Convert large judges into efficient internal models for scalable low-latency evaluation.
Synthetic Data Generation Generate controlled edge-case and stress-test datasets to expand coverage and robustness.
Observability for AI Agents Measure hallucinations tool-use accuracy reasoning quality and convergence in real time.
End-to-End Agent Evaluation Framework Standardize offline benchmarking regression testing and production quality monitoring.
Training Signal Pipeline (SFT & RLHF) Turn evaluation signals and datasets into structured training data for continuous model improvement.
Location:
At LinkedIn our approach to flexible work is centered on trust and optimized for culture connection clarity and the evolving needs of our business. The work location of this role is hybrid meaning it will be performed both from home and from a LinkedIn office on select days as determined by the business needs of the team.
This role will be based in Sunnyvale CA.
Responsibilities:
Provide direct leadership for a team of 5-7 engineers.
Work closely with various other teams across LinkedIn to align on initiatives leveraging existing solutions and ensure optimal collaboration.
Participate in and facilitate technical and design discussions
Contribute to the hands-on execution of technical solutions (coding design etc.).
Leverage best practices & processes to ensure productivity of the team and drive faster iterations
Attract world class talent and provide technical guidance career development and mentoring to team members.
Qualifications :
Basic Qualifications:
5 years of related industry experience in software/platform design development and related solutions
1 year(s) of management experience or 1 year(s) of staff level engineering experience with management training
BA/BS in Computer Science or other technical discipline or related practical technical experience
Preferred Qualifications:
2 years of experience as a Technical Lead (Staff or Manager)
7 years of overall experience including prior work with AI operations or related solutions.
Experience building enterprise grade data platforms
MS or PhD in Computer Science Machine Learning Statistics or related fields
Suggested Skills:
Technical Leadership
AI Infrastructure
Platform Engineering
You will Benefit from our Culture:
We strongly believe in the well-being of our employees and their families. That is why we offer generous health and wellness programs and time away for employees of all levels.
Compensation:
LinkedIn is committed to fair and equitable compensation practices. The pay range for this role is $170000 - $277000. Actual compensation packages are based on a wide array of factors unique to each candidate including but not limited to skill set years & depth of experience certifications and specific office location. This may differ in other locations due to cost of labor considerations. The total compensation package for this position may also include annual performance bonus stock benefits and/or other applicable incentive compensation plans. For additional information visit: Information :
Equal Opportunity Statement
We seek candidates with a wide range of perspectives and backgrounds and we are proud to be an equal opportunity employer. LinkedIn considers qualified applicants without regard to race color religion creed gender national origin age disability veteran status marital status pregnancy sex gender expression or identity sexual orientation citizenship or any other legally protected class.
LinkedIn is committed to offering an inclusive and accessible experience for all job seekers including individuals with disabilities. Our goal is to foster an inclusive and accessible workplace where everyone has the opportunity to be successful.
If you need a reasonable accommodation to search for a job opening apply for a position or participate in the interview process connect with us at and describe the specific accommodation requested for a disability-related limitation.
Reasonable accommodations are modifications or adjustments to the application or hiring process that would enable you to fully participate in that process. Examples of reasonable accommodations include but are not limited to:
A request for an accommodation will be responded to within three business days. However non-disability related requests such as following up on an application will not receive a response.
LinkedIn will not discharge or in any other manner discriminate against employees or applicants because they have inquired about discussed or disclosed their own pay or the pay of another employee or applicant. However employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information unless the disclosure is (a) in response to a formal complaint or charge (b) in furtherance of an investigation proceeding hearing or action including an investigation conducted by LinkedIn or (c) consistent with LinkedIns legal duty to furnish information.
San Francisco Fair Chance Ordinance
Pursuant to the San Francisco Fair Chance Ordinance LinkedIn will consider for employment qualified applicants with arrest and conviction records.
Pay Transparency Policy Statement
As a federal contractor LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: Data Privacy Notice for Job Candidates
Please follow this link to access the document that provides transparency around the way in which LinkedIn handles personal data of employees and job applicants: Work :
No
Employment Type :
Full-time
LinkedIn is the world’s largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We’re ... View more