Talent.com

Program evaluation serp_jobs.h1.location_city

serp_jobs.job_alerts.create_a_job

Program evaluation • berkeley ca

serp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
ML Engineer LLM Evaluation

ML Engineer LLM Evaluation

Dynamo AiSan Francisco, California, United States
serp_jobs.job_card.full_time
LLMs must be developed with safety, privacy, and real-world responsibility in mind.Our ML team comes from a culture of academic research driven to democratize AI advancements responsibly.By operati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Program Manager

Program Manager

LHHSan Francisco, CA, United States
serp_jobs.job_card.full_time
This is an onsite position in San Francisco, CA.As a key leader, you’ll manage the Drop-in Center and Domestic Violence Response Team, supervise staff across various locations, and ensure high-qual...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Software Engineer Evaluation Platform

AI Software Engineer Evaluation Platform

AbridgeSan Francisco, CA, US
serp_jobs.job_card.full_time
Our generative AI-powered products are making a huge impact in the Healthcare industry.As a full stack engineer you will be partnering with AI engineers to build out platforms for Agentic Orchestra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Manager

Program Manager

VirtualVocationsSan Francisco, California, United States
serp_jobs.job_card.full_time
A company is looking for a Program Manager.Key Responsibilities Lead all aspects of the program lifecycle, ensuring successful service solution implementation and ongoing support Drive completio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Program Assistant

Program Assistant

Salvation Army Western TerritorySan Francisco, CA, US
serp_jobs.job_card.full_time
Job Category : Administrative & Clerical.Requisition Number : PROGR021227.Location : Joseph McFee Center, San Francisco, CA 94110, USA. Perform all duties according to policy and procedure and our phil...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Metrics Engineer-Maps Evaluation

Metrics Engineer-Maps Evaluation

AppleSan Francisco, California, USA
serp_jobs.job_card.full_time
Metrics Engineers love to deep dive into data understand data quality measures discover patterns and insights propose changes to our data ecosystem and build tools for data scientists and data engi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Director

Program Director

HomewordBerkeley, CA, US
serp_jobs.job_card.full_time
Are you passionate about outdoor Jewish education and Earth-based Judaism?.Do you love organizational development, facilitation, and building relationships with Jewish organizations?.Can you suppor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Metrics Engineer-Maps Evaluation

Metrics Engineer-Maps Evaluation

Apple Inc.San Francisco, CA, United States
serp_jobs.job_card.full_time
San Francisco Bay Area, California, United States Software and Services.Metrics Engineers love to deep dive into data, understand data quality measures, discover patterns and insights, propose chan...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Assistant

Program Assistant

Southeast Asian Development CenterSan Francisco, CA, United States
serp_jobs.job_card.part_time
The objective is to prepare youth in kindergarten through 12th grade to be college and career ready.Project activities include daily out-of-school time, during the school year and summer with the f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Program Specialist

Program Specialist

Summit Public SchoolsEl Cerrito, CA, US
serp_jobs.job_card.full_time +1
Diverse Learner Program Specialist.The Diverse Learner Program Specialist plays a critical role in empowering special education teachers and site administrators to ensure that all Summit Public Sch...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Assistant

Program Assistant

University of California - San Francisco Campus and HealthSan Francisco, CA, United States
serp_jobs.job_card.full_time
In consultation with the PROPEL Program Administrator, the PROPEL Program Assistant uses professional concepts to coordinate, track and report postbaccalaureate scholar progress, national programma...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Software Engineer, Behaviors Evaluation

Senior Software Engineer, Behaviors Evaluation

WaymoSan Francisco, CA, United States
serp_jobs.job_card.full_time
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Director

Program Director

Youth Advocate ProgramsOakland, CA, US
serp_jobs.job_card.full_time
Requisition Number : PROGR002537.Summary of Position : Program Director is responsible for the overall administration of the Oakland / Alameda County Program. This includes the provision of client servi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Food Program Coordinator

Food Program Coordinator

The Salvation Army Golden State DivisionSan Francisco, CA, US
serp_jobs.job_card.full_time
Manage programs that address food insecurity, nutrition education, and cooking.Maintain food inventory, manage budget, monthly statistics, and menu creation for Kroc Center programs that involve fo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Program Monitor

Program Monitor

The Salvation Army ARC San FranciscoSan Francisco, CA, US
serp_jobs.job_card.full_time
Observe all persons entering and exiting the building.Document, inform, and report all incidents and daily activities that occur during the shift. Answer the main facility telephone, take messages, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Program Coordinator

Program Coordinator

University of California - San FranciscoSan Francisco, CA, United States
serp_jobs.job_card.full_time
This is a (2 year) contracted position and will end in two-years from the date of hire.The Program Coordinator will work under the direction of the Amend Manager of Impact & Evaluation to provide c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
On-Call Research and Evaluation Assistant

On-Call Research and Evaluation Assistant

ExploratoriumSan Francisco, CA
serp_jobs.job_card.part_time
This position is responsible for assisting with visitor learning and evaluation of museum exhibits and programs at the Exploratorium or partner sites. Responsibilities include conducting interviews ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Software Engineer - Evaluation Platform

AI Software Engineer - Evaluation Platform

Perplexity AISan Francisco, CA, US
serp_jobs.job_card.full_time
Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world's leading AI platforms. Perplexity has raised over $1B in venture investment from some ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Associate Director, Search & Evaluation

Associate Director, Search & Evaluation

AbbVieSan Francisco, CA, US
serp_jobs.job_card.full_time +2
Associate Director, Search & Evaluation.Associate Director, Search & Evaluation.Get AI-powered advice on this job and more exclusive features. AbbVie's mission is to discover and deliver inn...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Program Manager

Program Manager

PSG Global SolutionsSan Francisco, CA, US
serp_jobs.job_card.full_time
This is for US Bank in San Francisco and the candidate will be working directly on-site with US Bank.Ideal candidate will have worked for a bank / finance and done deployment rollouts.PM who has done...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
ML Engineer LLM Evaluation

ML Engineer LLM Evaluation

Dynamo AiSan Francisco, California, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

At  Dynamo AI , we believe that LLMs must be developed with safety, privacy, and real-world responsibility in mind. Our ML team comes from a culture of academic research driven to democratize AI advancements responsibly. By operating at the intersection of ML research and industry applications, our team empowers Fortune 500 companies’ adoption of frontier research for their next generation of LLM products. Join us if you :

  • Wish to work on the premier platform for private and personalized LLMs. We provide the fastest end to end solution to deploy research in the real world with our fast-paced team of ML Ph.D.’s and builders, free of Big Tech / academic bureaucracy and constraints.
  • Are excited at the idea of democratizing state-of-the-art research on safe and responsible AI.
  • Are motivated to work at a  2023 CB Insights Top 100 AI Startup  and see your impact on end customers in the timeframe of weeks not years.
  • Care about building a platform to empower fair, unbiased, and responsible development of LLMs and don’t accept the status quo of sacrificing user privacy for the sake of ML advancement.

Responsibilities

  • Own LLM evaluation processes and methods with a focus on generating benchmarks representative of real-world usage and safety vulnerabilities.
  • Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking.
  • Deliver robust, scalable, and reproducible production code.
  • Push the envelope by developing methods for benchmarking that revamps how we assess the best LLMs for harmlessness and helpfulness. Your research will directly empower our customers to more feasibly deploy safe and responsible LLMs.
  • Co-author papers, patents, and presentations with our research team by integrating other members’ work with your vertical.
  • Qualifications

  • Domain knowledge in LLM evaluation and data curation techniques.
  • Extensive experience in designing and implementing LLM benchmarking, extending previous methods. Comfortability with leading end-to-end projects.
  • Adaptability and flexibility. In both the academic and startup world, a new finding in the community may necessitate an abrupt shift in focus. You must be able to learn, implement, and extend state-of-the-art research.
  • Preferred : past research or projects in benchmarking LLMs.
  • Dynamo AI is committed to maintaining compliance with all applicable local and state laws regarding job listings and salary transparency. This includes adhering to specific regulations that mandate the disclosure of salary ranges in job postings or upon request during the hiring process. We strive to ensure our practices promote fairness, equity, and transparency for all candidates.

    Salary for this position may vary based on several factors, including the candidate's experience, expertise, and the geographic location of the role. Compensation is determined to ensure competitiveness and equity, reflecting the cost of living in different regions and the specific skills and qualifications of the candidate.