Talent.com

Program evaluation serp_jobs.h1.location_city

serp_jobs.job_alerts.create_a_job

Program evaluation • san francisco ca

serp_jobs.last_updated.last_updated_1_day
ML Engineer LLM Evaluation

ML Engineer LLM Evaluation

Dynamo AiSan Francisco, California, United States
serp_jobs.job_card.full_time
LLMs must be developed with safety, privacy, and real-world responsibility in mind.Our ML team comes from a culture of academic research driven to democratize AI advancements responsibly.By operati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Sr. Manager, Digital Health Technologies Search & Evaluation

Sr. Manager, Digital Health Technologies Search & Evaluation

AbbVieSouth San Francisco, California, United States
serp_jobs.job_card.full_time
AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Program Coordinator

Program Coordinator

Institute on AgingSan Francisco, California, USA
serp_jobs.job_card.full_time
IOA is on the forefront of revolutionary healthcare models reshaping the way people can age in place.Our innovative models transform lives enhance communities and save healthcare systems millions o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Sr. Manager, Digital Health Technologies Search & Evaluation

Sr. Manager, Digital Health Technologies Search & Evaluation

BioSpace, Inc.South San Francisco, CA, United States
serp_jobs.job_card.full_time
AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Psychologist - ADHD and Adult ASD Evaluation

Psychologist - ADHD and Adult ASD Evaluation

Kaiser PermanenteDaly City, US
serp_jobs.job_card.full_time
Provides mental health assessment, diagnosis, treatment and crisis intervention services for adult and / or child members who present themselves from psychiatric evaluation with a broad range of ment...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Program Monitor

Program Monitor

Salvation Army Western TerritorySan Francisco, CA, US
serp_jobs.job_card.full_time
Job Category : Childcare / Day Care / Day Camp.Requisition Number : PROGR020972.San Fran Harbor Light, San Francisco, CA 941034405, USA. Observe all persons entering and exiting the building.Document, inf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Data Scientist, Evaluation & Insights

AI Data Scientist, Evaluation & Insights

IroncladSan Francisco, CA, US
serp_jobs.job_card.full_time
Ironclad is the leading AI-powered contract lifecycle management platform, processing billions of contracts every year.Every business is powered by contracts, but managing them can slow companies d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Manager

Program Manager

Tech DigitalSan Francisco, CA, US
serp_jobs.job_card.full_time
Program / Project Manager For Mergers & Acquisitions.Strong Program / Project Manager specializing in Mergers & Acquisitions (M&A) with a proven track record in successfully managing projects using Agi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Head of AI Evaluation Science

Head of AI Evaluation Science

VirtualVocationsSan Francisco, California, United States
serp_jobs.job_card.full_time
A company is looking for a Head of AI Evaluation Science.Key Responsibilities Lead the AI Evaluation Science team, defining evaluation strategy for robot models Develop metrics and benchmarks fo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Staff Software Engineer, Evaluation Applications

Staff Software Engineer, Evaluation Applications

WaymoSan Francisco, CA, United States
serp_jobs.job_card.full_time
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Analyst / Senior Program Analyst

Program Analyst / Senior Program Analyst

Government JobsSan Francisco, CA, US
serp_jobs.job_card.full_time
Program Analyst / Senior Program Analyst.The Office of Research and Statistics (ORS) is the State Bar's data and research hub. We produce the research and analytics that guide policy, planning, and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Software Engineer - Evaluation Platform

AI Software Engineer - Evaluation Platform

Perplexity AISan Francisco, CA, US
serp_jobs.job_card.full_time
Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world's leading AI platforms. Perplexity has raised over $1B in venture investment from some ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Psychologist - ADHD and Adult ASD Evaluation

Psychologist - ADHD and Adult ASD Evaluation

KaiserDALY CITY, California, United States
serp_jobs.job_card.full_time
Provides mental health assessment, diagnosis, treatment and crisis intervention services for adult and / or child members who present themselves from psychiatric evaluation with a broad range of ment...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Program Manager / Senior Program Manager

Program Manager / Senior Program Manager

SonoTheraSouth San Francisco, California, United States
serp_jobs.job_card.full_time
SonoThera is a venture capital-backed early-stage biopharmaceutical company developing ultra-sound-guided non-viral targeted gene therapies to treat multiple diseases of high unmet need.The Gene Th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Program Director

Program Director

The William and Flora Hewlett FoundationSan Francisco, CA, US
serp_jobs.job_card.full_time
Performing Arts Program Director.The Hewlett Foundation invests in creative thinkers and problem solvers with different perspectives, all working to build an inclusive society where everyone has a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Program Manager

Program Manager

Match Point SolutionsOakland, California, USA
serp_jobs.job_card.full_time
MatchPoint Solutions is a fast-growing young energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber Robinhood Netfl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Software Engineer Evaluation Platform

AI Software Engineer Evaluation Platform

AbridgeSan Francisco, CA, United States
serp_jobs.job_card.full_time
Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare.Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation eff...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
On-Call Research and Evaluation Assistant

On-Call Research and Evaluation Assistant

ExploratoriumSan Francisco, CA, US
serp_jobs.job_card.full_time
This position is responsible for assisting with visitor learning and evaluation of museum exhibits and programs at the Exploratorium or partner sites. Responsibilities include conducting interviews ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Program Manager

Program Manager

OpenAISan Francisco, California, USA
serp_jobs.job_card.full_time
Youll run fast decision-oriented research and talent programs that change what OpenAI builds how its organized and where it places bets. Work spans conceptual research empirical analysis tightly sco...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
Program Coordinator

Program Coordinator

Golden Gate UniversitySan Francisco, California, USA
serp_jobs.job_card.full_time
San Francisco - San Francisco CA.Associate Director of Administration and Partner Support GGU WW.The Universitys comprehensive benefits program. The standard work schedule is 9 : 00 am to 5 : 30 pm mayb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
ML Engineer LLM Evaluation

ML Engineer LLM Evaluation

Dynamo AiSan Francisco, California, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

At  Dynamo AI , we believe that LLMs must be developed with safety, privacy, and real-world responsibility in mind. Our ML team comes from a culture of academic research driven to democratize AI advancements responsibly. By operating at the intersection of ML research and industry applications, our team empowers Fortune 500 companies’ adoption of frontier research for their next generation of LLM products. Join us if you :

  • Wish to work on the premier platform for private and personalized LLMs. We provide the fastest end to end solution to deploy research in the real world with our fast-paced team of ML Ph.D.’s and builders, free of Big Tech / academic bureaucracy and constraints.
  • Are excited at the idea of democratizing state-of-the-art research on safe and responsible AI.
  • Are motivated to work at a  2023 CB Insights Top 100 AI Startup  and see your impact on end customers in the timeframe of weeks not years.
  • Care about building a platform to empower fair, unbiased, and responsible development of LLMs and don’t accept the status quo of sacrificing user privacy for the sake of ML advancement.

Responsibilities

  • Own LLM evaluation processes and methods with a focus on generating benchmarks representative of real-world usage and safety vulnerabilities.
  • Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking.
  • Deliver robust, scalable, and reproducible production code.
  • Push the envelope by developing methods for benchmarking that revamps how we assess the best LLMs for harmlessness and helpfulness. Your research will directly empower our customers to more feasibly deploy safe and responsible LLMs.
  • Co-author papers, patents, and presentations with our research team by integrating other members’ work with your vertical.
  • Qualifications

  • Domain knowledge in LLM evaluation and data curation techniques.
  • Extensive experience in designing and implementing LLM benchmarking, extending previous methods. Comfortability with leading end-to-end projects.
  • Adaptability and flexibility. In both the academic and startup world, a new finding in the community may necessitate an abrupt shift in focus. You must be able to learn, implement, and extend state-of-the-art research.
  • Preferred : past research or projects in benchmarking LLMs.
  • Dynamo AI is committed to maintaining compliance with all applicable local and state laws regarding job listings and salary transparency. This includes adhering to specific regulations that mandate the disclosure of salary ranges in job postings or upon request during the hiring process. We strive to ensure our practices promote fairness, equity, and transparency for all candidates.

    Salary for this position may vary based on several factors, including the candidate's experience, expertise, and the geographic location of the role. Compensation is determined to ensure competitiveness and equity, reflecting the cost of living in different regions and the specific skills and qualifications of the candidate.