Talent.com
Software Engineer III/Senior, AI Gateway
Software Engineer III/Senior, AI Gatewayalgojobs • San Francisco, CA, United States
Software Engineer III / Senior, AI Gateway

Software Engineer III / Senior, AI Gateway

algojobs • San Francisco, CA, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.permanent
job_description.job_card.job_description

Software Engineer III / Senior, AI Gateway

About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve given developers and engineers simple interfaces for getting traffic into their apps and APIs without forcing them to deal with legacy proxies, external load balancers, or VPNs, and we’re now part of the standard stack for more than 9 million developers at some of the world’s top technology brands, like GitHub, Okta, HashiCorp, and Twilio.

Over the last few years, we’ve completely changed how that interface looks and works to make it easier, more composable, and infinitely flexible. We now give anyone who needs a “front door” to their apps or APIs powerful tools to orchestrate traffic, secure public endpoints, accelerate their services on a global network, observe all traffic passing to / from their network, and much more. The ngrok that millions love and trust has been completely transformed for the better.

The Opportunity

As a Software Engineer on the AI Gateway Team, you’ll be shaping the foundation of how developers and enterprises securely connect their applications through ngrok. This role gives you the chance to design and implement distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities—all at global scale.

You’ll work on challenges that demand both technical depth and creativity : building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling the next generation of AI-driven applications. Every line of code you ship will directly influence how developers build, secure, and scale their most critical services on ngrok.

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

What You’ll Do

  • Build and evolve the gateway services that handle traffic routing, policy enforcement.
  • Implement new traffic policy objects (e.g., secrets, IP rules, mTLS / CA policies) to give customers fine-grained control over their applications.
  • Extend and optimize endpoint services that provide reliability and observability for developers.
  • Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.
  • Write clean, high-quality, well-tested code and participate in thoughtful design / code reviews.
  • Investigate and resolve production issues across distributed systems.
  • Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.
  • Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.

You Are a Good Fit If You…

  • Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.
  • Understand networking and distributed systems fundamentals (protocols, TLS / mTLS, proxies, load balancers, traffic shaping).
  • Have experience building AI gateways, reverse proxies, API gateways, or working with AI / ML service traffic.
  • Are motivated by building scalable, performant systems that developers love to use.
  • Enjoy working at the intersection of infrastructure, security, and developer tooling / experience.
  • Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.
  • Compensation

    Senior Software Engineer

  • Tier 1 (SF, LA, Seattle, NYC) : $180,000 – $225,000
  • Tier 2 (rest of US) : $165,600 – $207,000
  • Software Engineer III

  • Tier 1 (SF, LA, Seattle, NYC) : $160,000 – $200,000
  • Tier 2 (rest of US) : $147,200 – $184,000
  • Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Software Engineer Ai • San Francisco, CA, United States

    Job_description.internal_linking.related_jobs
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Peregrine • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, AI Products

    Senior Software Engineer, AI Products

    TruckSmarter • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Logistics is one of the single largest industries in the world.Globally, logistics is an $8–$12 trillion dollar industry and in the US alone, ~ $2 trillion, representing ~10% of GDP.A single percen...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Peregrine Technologies • San Francisco, California, United States
    serp_jobs.job_card.full_time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Magical • San Francisco, California, United States
    serp_jobs.job_card.full_time
    At Magical, we empower organizations to automate the complex, manual workflows that are essential to their operations.We’re building a brand new product, and this is your chance to join as a foundi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer II, NLU & Agentic AI

    Senior Software Engineer II, NLU & Agentic AI

    Moveworks • San Francisco, California, United States
    serp_jobs.job_card.full_time
    Are you a software engineer who has honed your craft, partnership, and execution over years building and improving production systems? Want to apply your skills at the cutting edge of AI copilots? ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Sentry • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Bad software is everywhere, and we’re tired of it.Sentry is on a mission to help developers write better software faster so we can get back to enjoying technology. With more than $217 million in fun...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer II, AI Box

    Software Engineer II, AI Box

    Box • Redwood City, California, United States
    serp_jobs.job_card.full_time
    Box (NYSE : BOX) is the leader in Intelligent Content Management.Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer — Data & AI OS, Kubernetes

    Senior Software Engineer — Data & AI OS, Kubernetes

    Shakudo • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Shakudo is looking for a Senior Software Engineer to join their San Francisco team.You will be instrumental in developing their innovative data and AI operating system, ensuring high code quality, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Applied AI

    Senior Software Engineer, Applied AI

    TestBox • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    TestBox was founded with a bold mission : to fundamentally transform how software is bought and sold.We’re building an innovative platform that empowers buyers with transparent, interactive software...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Senior Software Engineer, Data & AI / ML

    Senior Software Engineer, Data & AI / ML

    Verse • San Francisco, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    San Francisco, CA (Remote / Hybrid Available).Organizations today are under growing pressure to navigate the transition to clean energy — not just to meet sustainability goals, but to manage risk, co...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer - AI Freight Platform (Chicago)

    Senior Software Engineer - AI Freight Platform (Chicago)

    FleetWorks • San Francisco, CA, US
    serp_jobs.job_card.full_time
    A transformative freight technology company is seeking a skilled software engineer to join their core team in Chicago.You'll lead technical delivery and integrations, build workflows that match cus...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior Software Engineer - AI

    Senior Software Engineer - AI

    CorVel Corporation • Foster City, CA, United States
    serp_jobs.job_card.full_time
    As our business continues to grow, we are expanding our capabilities in harnessing cutting-edge AI advancements.We seek a highly motivated problem solver who thrives in addressing complex challenge...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer – Platform AI Infrastructure

    Senior Software Engineer – Platform AI Infrastructure

    Verticalmove, Inc • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    ATTN – PLEASE READ CAREFULLY : WE CAN NOT SPONSOR NEW VISAS OR TRANSFER EXISTING VISAS.AT THIS TIME WE’RE ONLY CONSIDERING US CITIZENS OR GC HOLDERS. REMOTE – HOWEVER WE REQUIRE OUR TEAM TO BE CO-LOC...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Applied AI

    Senior Software Engineer, Applied AI

    Chaos Industries • San Francisco, California, United States
    serp_jobs.job_card.full_time
    Founded in 2022 by a seasoned leadership team, CHAOS has quickly become the place where world-class multi-disciplinary engineers come to build mission-critical technologies.CHAOS has a mission-focu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer III Analytics

    Software Engineer III Analytics

    Guidewire • San Mateo, California, USA
    serp_jobs.job_card.full_time +1
    At Guidewire we offer a dynamic work environment that combines excellent career opportunities a rational and meritocratic company culture and high quality software products.Our commitment to innova...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Intelligence — AI Retrieval

    Senior Software Engineer, Intelligence — AI Retrieval

    AngelList • San Francisco, California, United States
    serp_jobs.job_card.full_time
    A growing tech company is seeking a Senior Software Engineer to design and implement systems that power data retrieval and search functionalities. The ideal candidate should have extensive experienc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior Software Engineer - AI Incubator

    Senior Software Engineer - AI Incubator

    Sprinter Health, Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    We're looking for a Senior Software Engineer with at least 5 years of experience who wants to make an impact.We want to make a difference in the lives of those falling between the cracks of the cur...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Applied AI

    Senior Software Engineer, Applied AI

    CHAOS Industries • San Francisco, California, USA
    serp_jobs.job_card.full_time
    Founded in 2022 by a seasoned leadership team CHAOS has quickly become the place where world-class multi-disciplinary engineers come to build mission-critical technologies.CHAOS has a mission-focus...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted