LLM Training Frameworks and Optimization Engineer

LLM Training Frameworks and Optimization Engineer

Join to apply for the LLM Training Frameworks and Optimization Engineer role at Together AI

LLM Training Frameworks and Optimization Engineer

Join to apply for the LLM Training Frameworks and Optimization Engineer role at Together AI

Role

At Together.ai, we are building cutting-edge infrastructure to enable efficient and scalable training of large language models (LLMs). We focus on optimizing training frameworks, algorithms, and infrastructure to push the boundaries of AI performance, scalability, and cost-efficiency.

Role

At Together.ai, we are building cutting-edge infrastructure to enable efficient and scalable training of large language models (LLMs). We focus on optimizing training frameworks, algorithms, and infrastructure to push the boundaries of AI performance, scalability, and cost-efficiency.

We are seeking a LLM Training Frameworks and Optimization Engineer to drive innovations in the development and optimization of distributed training frameworks. In this role, you will ensure that our LLM training pipelines are robust, efficient, and capable of handling the complexities of large-scale distributed systems.

Responsibilities

• Framework Development and Optimization :
• Design, implement, and optimize distributed training frameworks tailored for large language models.
• Develop custom modules, plugins, and features to enhance framework scalability and performance.
• Algorithmic and Systems Optimization :
• Optimize communication patterns (e.g., gradient synchronization, all-reduce) in distributed training.
• Implement techniques like mixed precision, tensor parallelism, pipeline parallelism, and sharded training.
• Performance Tuning :
• Conduct in-depth profiling and debugging of training jobs to identify and resolve bottlenecks.
• Collaborate with hardware teams to optimize performance for GPUs, TPUs, and other accelerators.
• Scalability and Resilience :
• Ensure training systems scale efficiently to thousands of nodes and petabytes of data.
• Develop resilience mechanisms for fault-tolerant and checkpointed training pipelines.
• Collaboration and Support :
• Work closely with researchers, data engineers, and platform teams to ensure training frameworks meet model and workload requirements.
• Provide guidance and tools to improve the overall efficiency of the LLM development lifecycle.

Requirements

Must-Have :

Nice-to-Have

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is : $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https : / / www.together.ai / privacy

Seniority level

Seniority level

Mid-Senior level

Employment type

Employment type

Full-time

Job function

Job function

Engineering and Information Technology

Industries

Software Development

Referrals increase your chances of interviewing at Together AI by 2x

Sign in to set job alerts for “Optimization Engineer” roles.

San Francisco, CA $167,000.00-$185,500.00 6 days ago

San Francisco, CA $130,000.00-$145,000.00 2 weeks ago

Staff Optimization Engineer, Dynamic Pricing

San Francisco, CA $223,000.00-$248,000.00 13 hours ago

San Francisco, CA $120,000.00-$180,000.00 4 months ago

Machine Learning Engineer, Forecast Platform

San Francisco, CA $198,000.00-$220,000.00 5 days ago

Machine Learning Engineer II - Autonomous Mobility and Delivery

San Francisco, CA $167,000.00-$185,500.00 3 days ago

Oakland, CA $90,000.00-$122,000.00 12 hours ago

San Francisco, CA $120,000.00-$160,000.00 2 weeks ago

San Francisco, CA $217,400.00-$294,100.00 14 hours ago

San Francisco, CA $209,700.00-$283,800.00 14 hours ago

GenAI Staff Machine Learning Engineer, Performance Optimization

San Francisco, CA $149,998.00-$250,000.00 9 months ago

San Francisco, CA $117,000.00-$150,000.00 1 month ago

Process Engineer, application via RippleMatch

San Francisco, CA $75,000.00-$150,003.00 10 months ago

San Francisco, CA $117,000.00-$150,000.00 3 weeks ago

Software Engineer, Performance Optimization

Redwood City, CA $175,000.00-$220,000.00 1 month ago

Process Engineer, application via RippleMatch

Redwood City, CA $142,000.00-$158,000.00 3 weeks ago

Staff Deep Learning Engineer, Perception

San Francisco, CA $193,375.00-$227,500.00 5 months ago

San Mateo, CA $233,840.00-$283,780.00 3 days ago

San Francisco, CA $100,000.00-$150,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr