Talent.com
RL Controls Scientist, Dynamic Systems and Control
RL Controls Scientist, Dynamic Systems and ControlAmazon • Sunnyvale, California, USA
RL Controls Scientist, Dynamic Systems and Control

RL Controls Scientist, Dynamic Systems and Control

Amazon • Sunnyvale, California, USA
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

As a Reinforcement Learning Controls Scientist you will be responsible for developing Reinforcement Learning models to control complex electromechanical systems. You will take responsibility for defining frameworks performing analysis and training models that guide and inform mechanical and electrical designs software implementation and other software modules that affect overall device safety and performance. You understand trade-offs between model-based and model-free approaches. You will demonstrate cross-functional collaboration and influence to accomplish your goals. You will play a role in defining processes and methods to improve the productivity of the entire team. You will interface with Amazon teams outside your immediate organization to collaborate and share knowledge. You will investigate applicable academic and industry research prototype and test solutions to support product features and design and validate production designs that deliver an exceptional user experience.

Key job responsibilities

  • Produce models and simulations of complex high degree-of-freedom dynamic electromechanical systems
  • Train Reinforcement Learning control policies that achieve performance targets within hardware and software constraints
  • Hands-on prototyping and testing of physical systems in the lab
  • Influence hardware and software design decisions owned by other teams to optimize system-level performance
  • Work with cross-functional teams (controls firmware perception planning sensors mechanical electrical etc.) to solve complex system integration issues
  • Define key performance indicators and allocate error budgets across hardware and software modules
  • Perform root cause analysis of system-level failures and distinguish between hardware / software failures and hardware / software mitigations
  • Translate business requirements to engineering requirements and identify trade-offs and sensitivities
  • Mentor junior engineers in good design practice; actively participate in hiring of new team members

About the team

The Dynamic Systems and Control team develops models algorithms and code to bridge hardware and software development teams and bring robotic products to life. We contributed to Amazon Astro ( and Echo Show 10 ( along with several new technology introductions and unannounced products currently in development.

  • PhD or Masters degree and 4 years of building machine learning models or developing algorithms for business application experience
  • Experience programming in Java C Python or related language
  • Experience applying theoretical models in an applied environment
  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • 4 years of robotics system components and controls experience
  • Experience with reinforcement learning control policies for high degree-of-freedom dynamic systems
  • Experience with domain randomization in physics-based simulation environments for dynamic systems and bridging the sim2real gap
  • Experience in professional software development
  • Experience with model-based controls and gait planning for high degree-of-freedom dynamic systems
  • Experience with robotic manipulation : impedance control admittance control operational space control joint space control etc.
  • Experience with the complete product lifecycle development from early concept to prototype to production
  • Experience with specification and selection of sensors actuators and electromechanicalsoftware architecture
  • Experience with Functional Safety including design implementation verification and validation of safety functions
  • Experience training fine-tuning deploying and validating robotic foundation models
  • Experience shipping control algorithms or models in high-volume or consumer systems
  • Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

    Los Angeles County applicants : Job duties for this position include : work safely and cooperatively with other employees supervisors and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees supervisors and staff to ensure exceptional customer service; and follow all federal state and local laws and Company policies. Criminal history may have a direct adverse and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above as well as the abilities to adhere to company policies exercise sound judgment effectively manage stress and work safely and respectfully with others exhibit trustworthiness and professionalism and safeguard business operations and the Companys reputation. Pursuant to the Los Angeles County Fair Chance Ordinance we will consider for employment qualified applicants with arrest and conviction records.

    Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country / region youre applying in isnt listed please contact your Recruiting Partner.

    Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $136000 / year in our lowest geographic market up to $223400 / year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge skills and experience. Amazon is a total compensation company. Dependent on the position offered equity sign-on payments and other forms of compensation may be provided as part of a total compensation package in addition to a full range of medical financial and / or other benefits. For more information please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

    Key Skills

    Feed,Apache Commons,Maintenance,Business Support,Clinical

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 136000 - 223400

    serp_jobs.job_alerts.create_a_job

    Rl Scientist Dynamic • Sunnyvale, California, USA

    Job_description.internal_linking.related_jobs
    Principal Controls Scientist - Aerospace Guidance & Precision Systems

    Principal Controls Scientist - Aerospace Guidance & Precision Systems

    Lockheed Martin • Palo Alto, CA, US
    serp_jobs.job_card.full_time
    A leading aerospace technology company in California seeks a Control Systems Engineer to design and analyze sophisticated systems for precision aerospace mechanisms. The ideal candidate will have a ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Sr. Systems Engineer

    Sr. Systems Engineer

    Archer • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Archer is an aerospace company based in San Jose, California building an all-electric vertical takeoff and landing aircraft with a mission to advance the benefits of sustainable air mobility.We are...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Control engineer

    Control engineer

    IntelliPro Group Inc. • Santa Clara, CA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Control engineer Position Type : Full time Location : Santa Clara, CA, USA Salary Range : $150,000 - $230, 000 (USD) Job ID# : 158283 Job Description : We are seeking talented Control Engineers to...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sr. Analog Mixed-Signal Design Engineer

    Sr. Analog Mixed-Signal Design Engineer

    Cypress HCM • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Analog / Mixed-Signal Design Engineer.This exciting role will be responsible for circuit design and implementation at the chip or block level, developing high-performance analog and mixed-signal comp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Analog / Mixed-Signal Circuit Design Engineer

    Sr. Analog / Mixed-Signal Circuit Design Engineer

    SK hynix America • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Analog / Mixed-Signal Circuit Design Engineer.At SK hynix America, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to d...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr Solutions Engineer (Analog Mixed Signal Circuit Design) - R49780

    Sr Solutions Engineer (Analog Mixed Signal Circuit Design) - R49780

    Cadence • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Sr Solutions Engineer (Analog Mixed Signal Circuit Design) - R49780.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. This range is provided by Cadence....serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    FPGA Design Verification Engineer / Technical Lead II - VLSI

    FPGA Design Verification Engineer / Technical Lead II - VLSI

    Axelon Services Corporation • Mountain View, CA, US
    serp_jobs.job_card.full_time
    Job Title : FPGA Design Verification Engineer / Technical Lead II - VLSI.We are seeking a highly motivated and skilled FPGA Verification Engineer to join our dynamic team, working on state of the ar...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Engineer, Optical Systems Modeling

    Sr. Engineer, Optical Systems Modeling

    Ayar Labs • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Location : San Jose, CA (on site).Ayar Labs is pioneering the next generation of optical interconnect technology.We’re seeking a highly motivated Modeling Engineer to join our System Modeling Team a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    ASIC Design Engineer - Cache Controller

    ASIC Design Engineer - Cache Controller

    Apple Inc. • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    Santa Clara, California, United States Hardware.Apple is building the world’s fastest highly parallel mobile processing systems. Our high-bandwidth multi-client memory subsystems are blazing new ter...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Control Systems Engineer / Architect / Data Center Rack Solution (26968)

    Control Systems Engineer / Architect / Data Center Rack Solution (26968)

    Supermicro • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    System Calibration Engineer

    System Calibration Engineer

    PsiQuantum • Palo Alto, CA, United States
    serp_jobs.job_card.full_time
    PsiQuantum'smission is to build the first useful quantum computers-machines capable of delivering the breakthroughs the field has long promised. Since our founding in 2016, our singular focus has be...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Control Systems Engineer

    Senior Control Systems Engineer

    Electric Hydrogen • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Electric Hydrogen’s mission is to make molecules to decarbonize our world! Our outstanding people are our most important asset and will allow us to deliver hydrogen from renewable electrolysis for ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    R&D Engineer II

    R&D Engineer II

    Synopsys • Mountain View, California, United States
    serp_jobs.job_card.full_time
    ANSYS is seeking a software engineer to enhance the graphics and post processing features in its industry-leading electromagnetic simulation products. The successful candidate will perform design, d...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Research Scientist, System Software and I / O Architecture

    Senior Research Scientist, System Software and I / O Architecture

    NVIDIA • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    We are now looking for a Research Scientist with a focus in System Software and I / O!.NVIDIA is seeking Research Scientists with a focus in System Software and System I / O Architecture to contribute ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Sr. Systems Engineer, PHY Standards (Wi-Fi / BT)

    Sr. Systems Engineer, PHY Standards (Wi-Fi / BT)

    Synaptics Inc. • San Jose, CA, US
    serp_jobs.job_card.full_time
    Synaptics is leading the charge in AI at the Edge, bringing AI closer to end users and transforming how we engage with intelligent connected devices, whether at home, at work, or on the move.As the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Site Reliability Engineer – Observability & Automation

    Site Reliability Engineer – Observability & Automation

    black.ai • Palo Alto, CA, United States
    serp_jobs.job_card.full_time
    A leading quantum computing company is seeking a Site Reliability Engineer to join their OS / Platform team in Palo Alto. This role involves maintaining the health and performance of services through ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior FPGA Design Engineer (RTL & Vivado)

    Senior FPGA Design Engineer (RTL & Vivado)

    Capgemini • San Jose, CA, United States
    serp_jobs.job_card.full_time
    A leading engineering and R&D services firm in San Jose is seeking a professional with expertise in RTL design and Vivado Flow. The role involves collaborating with cross-functional teams, developin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Director, Hardware Engineering – Tracker

    Director, Hardware Engineering – Tracker

    Nextracker Inc. • Fremont, California, United States
    serp_jobs.job_card.full_time
    Director, Hardware Engineering – Tracker Director of Hardware Engineering is responsible for leading the end‑to‑end development of Nextracker’s tracker controller hardware, including electrical des...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new