Talent.com
Software Engineer - AI Infrastructure
Software Engineer - AI InfrastructureAssembledHQ, Inc • New York, NY, United States
Software Engineer - AI Infrastructure

Software Engineer - AI Infrastructure

AssembledHQ, Inc • New York, NY, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

About Assembled

Great customer support requires human agents and AI in perfect balance, and Assembled is the only unified platform that orchestrates both at scale. Companies like Canva, Etsy, and Robinhood use Assembled to coordinate their entire support operation - in-house agents, BPOs, and AI - in a single operating system. With AI Agents that resolve cases end-to-end, AI Copilot for agent assistance, and AI-powered workforce management that optimizes both human and AI capacity, Assembled helps teams deliver faster, better service while making smarter decisions about how to staff and automate. Backed by $70M from NEA, Emergence Capital, and Stripe, we're building the platform that makes AI and human collaboration actually work.

The Role

We're looking for a software engineer to join our Infrastructure team-building and operating the core systems that power our rapidly growing AI agent platform for customer support. Our AI Agents automates support workflows across email, chat, and voice, and has grown from $0 to $1M in ARR in just 3 months. As adoption accelerates, we're investing deeply in scaling its infrastructure to meet increasing demand and security expectations from enterprise customers.

As part of the AI Infrastructure team, you'll be responsible for the systems that enable Assist to be fast, reliable, and secure. You'll work on foundational platform components that power real-time LLM usage at scale, while also exploring how AI can be leveraged internally to make our engineering team more productive. This team is highly cross-functional, working closely with the AI, security, and product engineering teams.

This is a high-ownership role for someone who's excited by 0-to-1 building and shaping the infrastructure backbone of our AI products.

Some projects owned by the Infrastructure team

  • Agent service reliability and scaling : We manage and scale the infrastructure that serves LLM-powered agents across chat, email, and voice. This includes selecting inference strategies, integrating with model providers (e.g. OpenAI, Anthropic), and dynamically routing traffic for performance and cost efficiency.
  • Prompt and embedding storage systems : Assist relies heavily on dynamically generated prompts and semantic search across support content. The team owns highly-available, fast-access storage and indexing layers optimized for real-time AI interactions.
  • Privacy and security : Enterprises expect strict guardrails around AI use. We're building systems like network-level intrusion detection (IDS / IPS), audit logging, and LLM usage policy enforcement to meet these expectations and unlock new sales channels.
  • Observability and usage analytics : We operate systems that surface key metrics-token usage, latency, cost per response, and quality signals-so the Assist team can continuously improve Assist's performance and accuracy.
  • AI-powered developer tools : We are beginning to explore and evangelize the use of AI to accelerate internal engineering workflows-through internal chat agents, pair programming tools, and intelligent automation for deployment, debugging, and on-call. Our goal is to empower engineers across the company to build faster and more confidently with AI.

You may be a good fit if you :

  • Have 6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure
  • Have experience with distributed systems and container orchestration (especially Kubernetes)
  • Have worked with AI / ML platforms or are excited to build foundational infrastructure for LLM-based applications
  • Thrive in fast-paced environments with shifting requirements and ambiguous problem spaces
  • Are motivated by impact, enjoy deep technical challenges, and want to work cross-functionally across security, AI, and product
  • Have strong familiarity with one or more parts of our tech stack :
  • Cloud provider : AWS

  • Orchestration : Kubernetes + Karpenter
  • LLM integration : Experience with OpenAI, Anthropic, or open-source model serving (e.g., vLLM, HuggingFace TGI, Ray Serve)
  • Prompt & embedding infrastructure : Vector databases (e.g., Pinecone, Weaviate, PGVector), semantic search, prompt templating systems
  • Datastores : Postgres + PgBouncer, Snowflake, Redis
  • Languages : Go and Python
  • Monitoring & CI / CD : Datadog, Mezmo, CloudWatch, Buildkite, CircleCI
  • Our U.S. benefits

  • Generous medical, dental, and vision benefits
  • Paid company holidays, sick time, and unlimited time off
  • Monthly credits to spend on each : professional development, general wellness, Assembled customers, and commuting
  • Paid parental leave
  • Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices
  • 401(k) plan enrollment
  • serp_jobs.job_alerts.create_a_job

    Software Engineer Infrastructure • New York, NY, United States

    Job_description.internal_linking.related_jobs
    AI Software Engineer

    AI Software Engineer

    Success Academy Charter Schools • New York, NY, United States
    serp_jobs.job_card.full_time
    Thanks for your interest in Success Academy! Running the largest, fastest-growing, and highest-performing network of public charter schools in New York City takes a village - families, children, te...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer Data / AI / Intelligent Systems I (Full Time) - United States

    Software Engineer Data / AI / Intelligent Systems I (Full Time) - United States

    Cisco • New York, NY, United States
    serp_jobs.job_card.full_time
    Please note this posting is to advertise potential job opportunities.This exact role may not be open today but could open in the near future. When you apply, a Cisco representative may contact you d...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Infrastructure Engineer, Model Serving Platform

    AI Infrastructure Engineer, Model Serving Platform

    Scale AI, Inc. • New York, NY, United States
    serp_jobs.job_card.full_time
    As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and product...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer III - AI

    Software Engineer III - AI

    McGraw-Hill Education • New York, NY, United States
    serp_jobs.job_card.full_time
    At McGraw Hill we create best-in-class, next-generation learning platforms that are used by millions of students and educators worldwide every day. We design intuitive and effective tools and experi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Software Engineer

    AI Software Engineer

    Alvarez & Marsal • New York, NY, United States
    serp_jobs.job_card.part_time
    Alvarez & Marsal (A&M) is a global consulting firm with over 10,000 entrepreneurial, action and results-oriented professionals in over 40 countries. We take a hands-on approach to solving our client...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Engineer / Software Engineer

    AI Engineer / Software Engineer

    Kaav Inc. • New York, NY, United States
    serp_jobs.job_card.full_time
    Developing the agentic backend on Google ADK.Building APIs for seamless communication between the web app and the backend. Analyzing & monitoring system performance.Agents & tasks have been defined....serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Infrastructure Engineer, Core Infrastructure

    AI Infrastructure Engineer, Core Infrastructure

    Scale AI • New York, NY, United States
    serp_jobs.job_card.full_time
    AI Infrastructure Engineer, Core Infrastructure.As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrast...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Software Engineer - AI Solutions

    Lead Software Engineer - AI Solutions

    Thomson Reuters • New York, NY, United States
    serp_jobs.job_card.full_time
    Are you eager to innovate with AI-driven software that revolutionizes professional practices? Join the talented team at Thomson Reuters, a global leader dedicated to advancing AI technologies in em...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Software Engineer NYC AI Data Science Labs Investment Management

    AI Software Engineer NYC AI Data Science Labs Investment Management

    J Harlan Group, LLC • New York, NY, United States
    serp_jobs.job_card.full_time
    NYC AI Data Science Labs – Investment Management.J Harlan Group is currently conducting a search for a AI Software Engineer at a prominent Investment Manager in their NYC AI Data Science Labs.This ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Software Engineer, AI Solutions

    Lead Software Engineer, AI Solutions

    Centari • Corona, NY, United States
    serp_jobs.job_card.full_time
    Join our dynamic product team as a Lead Software Engineer, AI Solutions, where you will play a vital role in shaping Centari's innovative AI technology. Collaborating with a passionate team of engin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer III-AI Platform Engineer

    Software Engineer III-AI Platform Engineer

    JPMorgan Chase Bank, N.A. • Jersey City, NJ, United States
    serp_jobs.job_card.full_time
    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Corporate Sector, Infrastruc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Distinguished AI Engineer (Agentic AI Platform Infrastructure)

    Capital One • New York, NY, United States
    serp_jobs.job_card.full_time +1
    Distinguished AI Engineer (Agentic AI Platform Infrastructure).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an indu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer, Applied AI

    Software Engineer, Applied AI

    Norm AI, Inc • New York, NY, United States
    serp_jobs.job_card.full_time
    Norm Ai, the leading Legal & Compliance AI company, has a client base with a combined $30 trillion in assets under management. By turning legal code into AI code, Norm enables enterprises to move fa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior AI Engineer - Cloud Engineering Focus (Hybrid)

    Senior AI Engineer - Cloud Engineering Focus (Hybrid)

    OneStream Software • New York, NY, United States
    serp_jobs.job_card.full_time
    Senior AI Engineer - Cloud Engineering Focus.Hybrid, USA (Birmingham, MI, Chicago, IL, New York, NY, Fort Lauderdale, FL). Range applies to US candidates only) + Benefits / Variable Comp / Equity - Rang...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Engineer

    AI Engineer

    Oscar • New York, NY, US
    serp_jobs.job_card.full_time
    AI Engineer - Healthcare Automation Platform.Healthcare AI | Hybrid (NYC preferred) or Remote.AI-powered automation platform. Our system processes complex, unstructured data to ensure time-sensitive...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Engineer / Software Engineer

    AI Engineer / Software Engineer

    h3 Technologies • New York, NY, United States
    serp_jobs.job_card.full_time
    Job Title : AI Engineer / Software Engineer.Primary Skills : Google Cloud Platform (GCP).Developing the agentic backend on Google ADK. Building APIs for seamless communication between the web app and th...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Peregrine Technologies • New York, New York, United States
    serp_jobs.job_card.full_time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AI Software Engineer

    AI Software Engineer

    Stylitics • New York, New York, United States
    serp_jobs.job_card.full_time
    Stylitics is the leading visual outfitting and styling solution for the world’s top retailers and brands.Our clients include Nike, Macy’s, Revolve, Puma, Crate & Barrel, Bloomingdale’s, and dozens ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted