Talent.com
Simulation and Test Engineer (Conversational AI) - US Based
Simulation and Test Engineer (Conversational AI) - US BasedAndromeda Robotics • San Francisco, California, United States
Simulation and Test Engineer (Conversational AI) - US Based

Simulation and Test Engineer (Conversational AI) - US Based

Andromeda Robotics • San Francisco, California, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

About Us

Andromeda Robotics is an ambitious social robotics company with offices in Melbourne and San Francisco, dedicated to creating robots that seamlessly and intelligently interact with the human world. Our first robot, Abi, is a testament to this vision—a custom-built platform designed from the ground up to be a helpful aid and intuitive partner in aged care homes. We are a passionate, collaborative team of engineers who solve some of the most challenging problems in AI and robotics. To accelerate our development and ensure Abi's reliability, we are seeking a foundational member to build out our capabilities to train and test our robot in simulation.

Our Values

Deeply empathetic - Kindness and compassion are at the heart of everything we do.

Purposely playful - Play sharpens focus. It keeps us curious, fast and obsessed with the craft.

Relentlessly striving - With relentless ambition, an action bias and constant curiosity, we don’t settle.

Strong when it counts - Tenacious under pressure, we expect problems and stay in motion to adapt and progress.

United in action - Different minds. Shared mission. No passengers.

The Role

We are looking for a creative and driven Simulation and Test Engineer to build Andromeda's testing infrastructure for our conversational AI systems and embodied character behaviours. Your immediate focus will be creating robust test systems for Abi's voice-to-voice chatbot, social awareness perception, and gesture motor control. As this infrastructure matures, you'll extend it into simulation environments for generating synthetic training data for character animation and gesture models.

The Team

You'll work at the intersection of our character software, robotics, perception, conversational AI, controls, and audio engineering teams. We bring deep expertise from autonomous vehicles and robotics, including simulation backgrounds. You'll collaborate with product owners and technical specialists to define requirements, integrate systems, and ensure quality across our AI / ML stack.

Phase 1 : Build The Test Foundation

  • Define and stand up synthetic test environments for our AI / ML conversational stack
  • Conversational AI testing : voice-to-voice chat quality, response appropriateness, tool calling accuracy
  • Memory system testing : context retention, recall accuracy, conversation coherence
  • Audio modelling and testing : multi-speaker scenarios, room acoustics, voice activity detection
  • Perception system testing : social awareness (face detection, gaze tracking, person tracking)
  • Gesture appropriateness testing : Working with our Controls / ML team, create test infrastructure to validate that Abi's body gestures
  • CI / CD and automated regression testing for all AI / ML subsystems
  • Custodian of quality metrics : if they don't exist, work with stakeholders to elicit use cases, derive requirements, and establish measurable quality metrics
  • Requirements formalisation : you're skilled at gathering, documenting, and tracing requirements back to test cases

Phase 2 : Scale To ML Training Infrastructure

Our approach to gesture generation requires high-fidelity synthetic interaction data at scale. You'll investigate and build the infrastructure to generate this data, working closely with our character software team to define requirements and validate approaches.

  • Extend test environments into training data generation pipelines
  • Investigate and stand up simulation tools (e.g. Unity, Unreal Engine, Isaac Sim) to support our machine learning pipeline with synthetic data and validation infrastructure
  • Build infrastructure for fine-tuning character animation models on simulated multi-actor scenarios
  • Enable ML-generated gesture development to augment hand-crafted animation workflows
  • Create virtual environments with diverse social interaction scenarios for training and evaluation
  • Success In This Role Looks Like

    Months 1-3, stabilise our conversational system with automated regression tests and measurable quality benchmarks. By month 6, deliver an integrated simulation environment enabling rapid testing and iteration across our AI / ML stack.

    You'll design tests that push our systems beyond their limits and find what's brittle. Through trade studies and make-vs-buy decisions, you'll establish the infrastructure, set up automatic regression tests, and trace test cases back to high-level requirements. You'll be the final guardian, verifying that our AI and machine learning systems work as intended before integration with Abi's physical platform. Your work will directly impact the speed and quality of our development, ensuring that every software build is robust, reliable, and safe.

    Key Responsibilities

  • Architect and Build : Design, develop, and maintain scalable test infrastructure for conversational AI, perception, and gesture control systems
  • Own Testing Pipeline : Develop a robust CI / CD pipeline for automated regression testing, enabling rapid iteration and guaranteeing quality before deployment
  • Develop Test Scenarios : Create diverse audio environments, multi-actor social scenarios, and edge cases to rigorously test Abi's conversational and social capabilities
  • Model with Fidelity : Implement accurate models of Abi's hardware stack (cameras, microphone array, upper body motion) as needed for test and simulation scenarios
  • Enable Future ML Training : Design test infrastructure with an eye towards evolution into a simulation platform for generating synthetic training data for character animation and gesture models
  • Integrate and Collaborate : Work closely with the robotics, AI, and software teams to seamlessly integrate their stacks into the test infrastructure and define testing requirements
  • Analyse and Improve : Develop metrics, tools, and dashboards to analyse test data, identify bugs, track performance, and provide actionable feedback to the engineering teams
  • Ideally You Have

  • Bachelor or Masters in Computer Science, Robotics, Engineering, or a related field
  • 5+ years of professional experience testing complex AI / ML systems (conversational AI, perception systems, or embodied AI)
  • Strong programming proficiency in Python (essential); C++ experience valuable
  • Hands-on experience with LLM testing, voice AI systems, or chatbot evaluation frameworks
  • Understanding of audio processing, speech recognition, and / or computer vision fundamentals
  • Experience with testing frameworks and CI / CD tools (pytest, Jenkins, GitHub Actions, etc.)
  • Familiarity with ML evaluation metrics and experimental design
  • A proactive, first-principles thinker who is excited by the prospect of owning a critical system at an early-stage startup
  • Bonus Points

  • Experience with simulation platforms (e.g. Unity, Unreal Engine, NVIDIA Isaac Sim, Gazebo) and physics engines
  • Experience with character animation systems, motion capture data, or gesture generation
  • Knowledge of reinforcement learning, imitation learning, or synthetic data generation for training ML models
  • Experience with 3D modelling tools and game engine content creation
  • Understanding of ROS2 for robotics integration
  • Knowledge of sensor modelling techniques for cameras and audio
  • Experience building and managing large-scale, cloud-based simulation infrastructure
  • PhD in a relevant field
  • The expected base salary range for this role, when performed in our San Francisco office, is $150,000 - $250,000 USD, depending on skills and experience. The salary for this position may vary depending on factors such as job-related knowledge, skills, and experience. The total compensation package may also include additional benefits or components based on the specific role. Details will be provided if an employment offer is made.

    If you’re excited about this role but don’t meet every requirement, that’s okay—we encourage you to apply. At Andromeda Robotics, we celebrate diversity and are committed to creating an inclusive environment for all employees. Let’s build the future together.

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

    serp_jobs.job_alerts.create_a_job

    Simulation Engineer • San Francisco, California, United States

    Job_description.internal_linking.related_jobs
    AI Engineer, Evaluation and Reliability

    AI Engineer, Evaluation and Reliability

    Mice Groups • Redwood City, CA, US
    serp_jobs.job_card.permanent
    Senior Engineer, AI Evaluation and Reliability / Contract-to-Hire or Direct Hire / Redwood City / Hybrid, onsite 3 days per week / This position pays $70-80 / hr. W2 for Contract, $140-190K annually u...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software QA Engineer

    Software QA Engineer

    OSI Engineering • Menlo Park, CA, US
    serp_jobs.job_card.full_time
    We’re looking for a Software Quality Assurance Engineer with experience in web and mobile testing to join our team! In this role, you will work alongside Product, Engineering, and other members of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Hardware Support Engineer

    Hardware Support Engineer

    Cognizant • Emerald Hills, CA, US
    serp_jobs.job_card.full_time
    Cognizant is a leading provider IT and BPO services, providing critical initiatives to a variety of global clients.The Hardware Operations team is a part of a high profile client project that provi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

    Remote Machine Learning Engineer - AI Trainer ($80-$120 per hour)

    Mercor • Berkeley, California, US
    serp_jobs.filters.remote
    serp_jobs.job_card.part_time
    At Mercor, we’re building the talent engine that helps leading labs and research orgs move AI forward.Our latest initiative focuses on benchmarking and improving model performance and training spee...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Director, Engineering Applied AI

    Sr. Director, Engineering Applied AI

    Zapier • San Francisco, California, USA
    serp_jobs.job_card.full_time
    So if youre using AI tools while applying here - thats great! We just ask that you use them.How to Collaborate with AI During Zapiers Hiring Process. AI tools like ChatGPT Claude Gemini or others du...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Simulation Framework Software Engineer

    Simulation Framework Software Engineer

    Boeing • Berkeley, California, USA
    serp_jobs.job_card.full_time +1
    Simulation Framework Software Engineer.Simulation Framework Software Engineer.Simulation Frameworks Services and Tools (SFST) deployment team. This position will focus on supporting the Software Fab...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Agentic AI Engineer (Cybersecurity)

    Senior Agentic AI Engineer (Cybersecurity)

    Anomali • Redwood City, California, USA
    serp_jobs.job_card.full_time
    Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations. At the center of it is an omnipresent intelligent and m...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Moveworks Conversational AI Engineer

    Moveworks Conversational AI Engineer

    Acunor Inc • San Francisco, California, USA
    serp_jobs.job_card.full_time
    Moveworks Conversational AI Engineer.Bay Area CA (Onsite preferred) - Remote considered.We are hiring a Moveworks Developer / Engineer for one of our premier consulting clients.This role focuses on b...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Vallejo, California
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

    Get Paid to Test Products at Home – Flexible Hours, Weekly Pay

    OCPA • Pinole, California, us
    serp_jobs.job_card.part_time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Remote Product Tester - $25-45 per hour

    Remote Product Tester - $25-45 per hour

    Online Consumer Panels America • Berkeley, California, US
    serp_jobs.filters.remote
    serp_jobs.job_card.part_time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Applied AI Engineer at Innovative AI simulation startup

    Applied AI Engineer at Innovative AI simulation startup

    Jack & Jill / External ATS • San Francisco, California, USA
    serp_jobs.job_card.full_time
    This is a job that we are recruiting for on behalf of one of our customers.Hes an AI agent that sends you unmissable jobs and then helps you ace the interview. Hell make sure you are considered for ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior AI Engineer

    Senior AI Engineer

    Oracle • Redwood City, California, USA
    serp_jobs.job_card.full_time
    Design develop troubleshoot and debug software programs for databases applications tools networks etc.As part of this team you will be designing and developing new applications that will serve as t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Simulation and Test Engineer (Conversational AI) - US Based

    Simulation and Test Engineer (Conversational AI) - US Based

    Dromeda • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    At Andromeda Robotics, we’re not just imagining the future of human-robot relationships; we’re building it.Abi is the first emotionally intelligent humanoid companion robot, designed to bring care,...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Forward Deployed AI Engineer, Enterprise

    Forward Deployed AI Engineer, Enterprise

    Scale AI, Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications.We partner with leading enterprises and government organizations to accelerate the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Applied AI Engineer

    Senior Applied AI Engineer

    Omada Health • South San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time.Omada Health is a digital care provider that empowers individuals to reach their health goals throug...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831

    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831

    InsideHigherEd • Berkeley, California, United States
    serp_jobs.job_card.full_time
    Mission Operations Ground Systems and Software Engineer (7115C), Space Sciences Laboratory - 82831.At the University of California, Berkeley, we are dedicated to fostering a community where everyon...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Simulation and Test Engineer (Conversational AI) - US Based

    Simulation and Test Engineer (Conversational AI) - US Based

    Andromeda • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Simulation and Test Engineer (Conversational AI) – US Based.Be among the first 25 applicants.This range is provided by Andromeda. Your actual pay will be based on your skills and experience — talk w...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted