Talent.com
Machine Learning Engineer-Model Serving Infrastructure
Machine Learning Engineer-Model Serving InfrastructureByteDance • Seattle, WA, United States
Machine Learning Engineer-Model Serving Infrastructure

Machine Learning Engineer-Model Serving Infrastructure

ByteDance • Seattle, WA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Machine Learning Engineer-Model Serving Infrastructure

Machine Learning Engineer-Model Serving Infrastructure

2 weeks ago Be among the first 25 applicants

Responsibilities

The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company. We also drive substantial impact on core businesses of the company. Currently, we are looking for Machine Learning Engineer - Model Serving Infrastructure to join our team to support and advance that mission.

Responsibilities :

  • Responsible for the design and implementation of distributed inference infrastructure for feeds, ads and search ranking models.
  • Responsible for building monitoring / managing tools to oversee the reliability and scalability of online inference servers
  • Responsible for triaging system inefficiency and bottlenecks and improving system performance
  • Responsible for building tools to analyze bottlenecks and sources of instability and then design and implement solutions
  • Responsible for collaboration with product teams and providing general solutions to meet their requirements

Qualifications

Minimum Qualifications :

  • At least 5 years of experience in developing and deploying large-scale systems.
  • Experience contributing to an open sourced machine learning framework (tensorflow / jax / pytorch / torchscript / mxnet / tensorrt).
  • Strong background in one of the following fields : Hardware-Software Co-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU / RDMA) or ML for Systems.
  • Preferred Qualifications :

  • Proficient in C / C++ / CUDA, and have solid programming skills.
  • Familiar with deep learning serving frameworks (TensorFlow Serving / TorchScript).
  • Experience in GPU performance optimization
  • Ability to work independently and complete projects from beginning to end and in a timely manner.
  • Good communication and teamwork skills to clearly communicate technical concepts with other teammates.
  • About Us

    Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

    Why Join ByteDance

    Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

    As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

    Diversity & Inclusion

    ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

    Reasonable Accommodation

    ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https : / / tinyurl.com / RA-request

    Job Information

    【For Pay Transparency】Compensation Description (Annually)

    The base salary range for this position in the selected city is $177688 - $416100 annually.

    Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses / incentives, and restricted stock units.

    Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

    The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

    For Los Angeles County (unincorporated) Candidates :

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment :

  • 1. Interacting and occasionally having unsupervised contact with internal / external clients and / or colleagues;
  • 2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

    3. Exercising sound judgment.

    Seniority level

    Seniority level

    Mid-Senior level

    Employment type

    Employment type

    Full-time

    Job function

    Job function

    Engineering and Information Technology

    Industries

    Technology, Information and Internet

    Referrals increase your chances of interviewing at ByteDance by 2x

    Get notified about new Machine Learning Engineer jobs in Seattle, WA .

    data scientist, Staffing- Data & Analytics (Seattle)

    Seattle, WA $110,600.00-$166,000.00 1 week ago

    Redmond, WA $100,600.00-$258,000.00 5 days ago

    Seattle, WA $99,500.00-$187,000.00 1 week ago

    Seattle, WA $125,000.00-$200,000.00 6 months ago

    Software Developer-Artificial Intelligent / Machine Learning

    Seattle, WA $158,200.00-$185,000.00 1 month ago

    Bellevue, WA $80,000.00-$90,000.00 1 week ago

    Bellevue, WA $130,000.00-$200,000.00 4 weeks ago

    Bellevue, WA $130,000.00-$170,000.00 2 months ago

    Seattle, WA $112,725.00-$177,840.00 6 days ago

    Machine Learning Engineer, Supportability

    Seattle, WA $180,000.00-$318,000.00 1 week ago

    Machine Learning Engineer, Monetization Engineering

    Software Engineer - AI / ML, Multiple Locations

    Redmond, WA $84,200.00-$180,400.00 1 day ago

    Bellevue, WA $145,000.00-$204,000.00 2 weeks ago

    Seattle, WA $170,500.00-$181,500.00 2 days ago

    Machine Learning Engineer, Core Engineering

    Seattle, WA $167,000.00-$185,500.00 1 month ago

    Seattle, WA $147,000.00-$259,000.00 2 weeks ago

    Redmond, WA $100,600.00-$215,400.00 1 week ago

    Bellevue, WA $114,000.00-$171,000.00 6 hours ago

    Machine Learning Engineer Graduate (TikTok E-Commerce - Conversational AI)-2025 Start (BS / MS)

    Seattle, WA $112,725.00-$177,840.00 6 days ago

    Seattle, WA $100,000.00-$720,000.00 1 week ago

    Machine Learning Engineer / Scientist I - Early Career 2025 University Grad

    Seattle, WA $99,445.00-$139,222.66 1 week ago

    We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Machine Learning Engineer-Model Serving Infrastructure • Seattle, WA, United States

    Job_description.internal_linking.related_jobs
    ML Research Engineer, ML Systems

    ML Research Engineer, ML Systems

    Scale AI, Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Scale's ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and opera...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer - CFA, Seattle

    Machine Learning Engineer - CFA, Seattle

    Qualtrics • Seattle, Washington, United States
    serp_jobs.job_card.full_time
    At Qualtrics, we create software the world’s best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platfo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Large Machine Learning Model Optimization Engineer

    Large Machine Learning Model Optimization Engineer

    Apple Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Large Machine Learning Model Optimization Engineer.Seattle, Washington, United States Software and Services.Our team is an applied research and engineering team responsible for developing real-time...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer III

    Machine Learning Engineer III

    Chewy • Bellevue, Washington, United States
    serp_jobs.job_card.full_time
    Advertising is a critical component of the ecommerce ecosystem and provides a critical revenue stream to the company.At Chewy, Sponsored Ads team is looking for a Senior Machine Learning Engineer t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AIML - Machine Learning Engineer, Foundation Model Services

    AIML - Machine Learning Engineer, Foundation Model Services

    Apple Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Work closely with product teams to build production-grade solutions to launch models serving millions of customers in real time. Work alongside Foundation Model Research team to prototype and develo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer II, Special Projects

    Machine Learning Engineer II, Special Projects

    Amazon • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that pushes the company’s Think Big leadership principle to its limits.If you ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    PitchBook Data • Seattle, Oregon, USA
    serp_jobs.job_card.full_time
    At PitchBook a Morningstar company we are always looking forward.We continue to innovate evolve and invest in ourselves to bring out the best in everyone. Were deeply collaborative and thrive on the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer, Features

    Machine Learning Engineer, Features

    Cognitiv • Bellevue, Washington, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Are you ready to revolutionize the advertising industry? At Cognitiv, we are not just another AdTech company—we are industry trailblazers redefining media buying with our Deep Learning Advertising ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    ML Engineer : Distributed Inference & Serving Systems

    ML Engineer : Distributed Inference & Serving Systems

    ByteDance • Seattle, WA, United States
    serp_jobs.job_card.full_time
    A leading technology company in Seattle is looking for a Machine Learning Engineer to design and implement distributed inference infrastructure. The ideal candidate will have a strong background in ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AIML- Software Engineer, Machine Learning Platform Technologies

    AIML- Software Engineer, Machine Learning Platform Technologies

    Apple • Seattle, WA, United States
    serp_jobs.job_card.full_time
    At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly.Bring passion and dedication to your job and there’s no telling what you could accomplis...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer - Model Serving Infrastructure - USDS

    Software Engineer - Model Serving Infrastructure - USDS

    Tik Tok • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Team Intro The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company.We also d...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer, Cloud Expansion, Retention

    Machine Learning Engineer, Cloud Expansion, Retention

    Google Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Google place Seattle, WA, USA ; Kirkland, WA, USA.X Note : By applying to this position you will have an opportunity to share your preferred working location from the following : .Seattle, WA, USA; Ki...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Continua • Seattle, Oregon, USA
    serp_jobs.job_card.full_time
    AI agent that users can invite into group conversations to make planning coordination and information retrieval effortless. Funded by Google and Bessemer Venture Partners Continua is developing the ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer, Foundation Model

    Machine Learning Engineer, Foundation Model

    Stripe • Seattle, WA, US
    serp_jobs.job_card.full_time
    Stripe's mission is to accelerate global economic and technological development.We offer financial infrastructure and a variety of services to serve the needs of a wide range of users, from startup...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Hive • Seattle, Washington, United States
    serp_jobs.job_card.full_time
    Hive is the leading provider of cloud-based AI solutions to understand, search, and generate content, and is trusted by hundreds of the world's largest and most innovative organizations.The company...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer - Model Training Infrastructure - USDS

    Software Engineer - Model Training Infrastructure - USDS

    Tik Tok • Seattle, WA, United States
    serp_jobs.job_card.full_time
    About the team The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & ecom ranking in our company.We al...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Chewy • Bellevue, Washington, United States
    serp_jobs.job_card.full_time
    Marketing is a critical component of the ecommerce ecosystem and provides the core of the customer’s first experience at Chewy. Staff Machine Learning Engineer.Marketing Science and Operations Techn...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Scribd, Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Our Machine Learning team builds platform and product applications powering personalized discovery, recommendations, and generative AI features across Scribd, Slideshare, and Everand.The Orion ML P...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted