Software Development Manager, AGI Info - Web Information Systems

Software Development Manager

Want to help develop the next generation of search and intelligent assistant products? Join us! We are looking for a talented Software Development Manager to lead a team of SDEs and MLEs to help us develop state-of-the-art, next generation web search capabilities for Amazon AGI.

What will you do?

You will lead a multidisciplinary team to develop solutions across multiple programs (text search, image search, local information, etc.) to :

• Own web search evaluation : You will own the systems that support fast and reliable evaluation of the quality of our web search service.
• Build and automate training data generation : You will own the development of high-quality training data sets for our web information retrieval and ranking models, having direct and significant impact on our search quality. You will help improve the data quality, including mining for hard negatives, incorporating several dimensions of quality (e.g. relevance, content freshness, page trustworthiness, etc.), as well as scale the pipeline to billions of examples. You will work with stakeholders to address their specific modeling needs and develop and own metrics to communicate your progress on data quality and scale.
• Accelerate experimental velocity : You will be responsible for improving the team's ability to experiment quickly. This includes measuring the entire lifecycle of an experiment (from ideation, acquiring data, setting up infra to train, debugging model, running evaluations, deploying into production), identifying painpoints and developing solutions to address them.
• Improve system understandability : You will develop advanced analytics and automate failure space analysis processes to help the team debug and understand search quality issues. You will partner with the broader AGI analytics team to coordinate metrics for our information retrieval engine with user signals or downstream dependencies to debug across systems as well.
• Streamline deployment and optimize model performance : You will develop expertise, systems, and processes to streamline model deployments and improve model inference efficiency, enabling the team to reduce latency, cut costs, or run larger models in production.

Key job responsibilities as the SDM for the WIS Machine Learning Infrastructure team, you will :