Talent.com
Machine Learning Engineer, LLM Fine-Tuning
Machine Learning Engineer, LLM Fine-TuningFirst Soft Solutions LLC • San Jose, CA, United States
Machine Learning Engineer, LLM Fine-Tuning

Machine Learning Engineer, LLM Fine-Tuning

First Soft Solutions LLC • San Jose, CA, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Machine Learning Engineer, LLM Fine‑Tuning

We are actively hiring for a Machine Learning Engineer focused on LLM fine‑tuning for Verilog / RTL applications.

Location : San Jose, CA (Onsite)

Skills : LLM fine‑tuning, Verilog / RTL, AWS, Bedrock, SageMaker

Responsibilities

  • Own the technical roadmap for Verilog / RTL‑focused LLM capabilities—from model selection and adaptation to evaluation, deployment, and continuous improvement.
  • Lead a hands‑on team of applied scientists / engineers : set direction, unblock technically, review designs / code, and raise the bar on experimentation velocity and reliability.

Fine‑tune and customize models using state‑of‑the‑art techniques (LoRA / QLoRA, PEFT, instruction tuning, preference optimization / RLAIF) with robust HDL‑specific evals :

  • Compile‑ / lint‑ / simulate‑based pass rates, pass@k for code generation, constrained decoding to enforce syntax, and “does‑it‑synthesize” checks.
  • Design privacy‑first ML pipelines on AWS :

  • Training / customization and hosting using Amazon Bedrock and SageMaker (or EKS + KServe / Triton / DJL) for bespoke training needs.
  • Artifacts in S3 with KMS CMKs; isolated VPC subnets & PrivateLink (including Bedrock VPC endpoints), IAM least‑privilege, CloudTrail auditing, and Secrets Manager for credentials.
  • Enforce encryption in transit / at rest, data minimization, no public egress for customer / RTL corpora.
  • Stand up dependable model serving : Bedrock model invocation where it fits, and / or low‑latency self‑hosted inference (vLLM / TensorRT‑LLM), autoscaling, and canary / blue‑green rollouts.
  • Build an evaluation culture : automatic regression suites that run HDL compilers / simulators, measure behavioral fidelity, and detect hallucinations / constraint violations; model cards and experiment tracking (MLflow / Weights & Biases).
  • Partner deeply with hardware design, CAD / EDA, Security, and Legal to source / prepare datasets (anonymization, redaction, licensing), define acceptance gates, and meet compliance requirements.
  • Drive productization : integrate LLMs with internal developer tools (IDEs / plug‑ins, code review bots, CI), retrieval (RAG) over internal HDL repos / specs, and safe tool‑use / function‑calling.
  • Mentor & uplevel : coach ICs on LLM best practices, reproducible training, critical paper reading, and building secure‑by‑default systems.
  • Qualifications

  • 10+ years total engineering experience with 5+ years in ML / AI or large‑scale distributed systems; 3+ years working directly with transformers / LLMs.
  • Proven track record shipping LLM‑powered features in production and leading ambiguous, cross‑functional initiatives at Staff level.
  • Deep hands‑on skill with PyTorch, Hugging Face Transformers / PEFT / TRL, distributed training (DeepSpeed / FSDP), quantization‑aware fine‑tuning (LoRA / QLoRA), and constrained / grammar‑guided decoding.
  • AWS expertise to design and defend secure enterprise deployments : Bedrock, SageMaker, S3, EC2 / EKS / ECR, VPC / Subnets / Security Groups, IAM, KMS, PrivateLink, CloudWatch / CloudTrail, Step Functions, Batch, Secrets Manager.
  • Strong software engineering fundamentals : testing, CI / CD, observability, performance tuning; Python a must (bonus for Go / Java / C++).
  • Demonstrated ability to set technical vision and influence across teams; excellent written and verbal communication for execs and engineers.
  • Seniority Level

    Mid‑Senior level

    Employment Type

    Full‑time

    Job Function

    Engineering and Information Technology

    Industries

    IT Services and IT Consulting

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Machine Learning Engineer • San Jose, CA, United States

    Job_description.internal_linking.related_jobs
    Machine Learning Engineer : LLM, VLM / VLA and reasoning models

    Machine Learning Engineer : LLM, VLM / VLA and reasoning models

    Tensor • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Machine Learning Engineer : LLM, VLM / VLA and reasoning models.Tensor is an agentic AI company dedicated to building agentic products that empower individual consumers. Our flagship product, the Tenso...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer - LLM, AI & Robotics

    Machine Learning Engineer - LLM, AI & Robotics

    XPENG & Volkswagen Group • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Staff Machine Learning Engineer, Dynamic Pricing

    Staff Machine Learning Engineer, Dynamic Pricing

    Uber • Sunnyvale, CA, United States
    serp_jobs.job_card.full_time
    The mission of the Surge team is to maintain overall marketplace reliability by balancing supply / demand in real-time through dynamic pricing. We build scalable real-time systems to understand the st...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AIML – Machine Learning Engineer – Special Projects

    AIML – Machine Learning Engineer – Special Projects

    NLP PEOPLE • Cupertino, CA, United States
    serp_jobs.job_card.full_time
    Apple is where individual imaginations gather together, committing to the values that lead to great work.Every new product we build, service we create, or experience we deliver is the result of us ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Machine Learning Engineer - CV / NLP / Multimodal LLM (TikTok Trust and Safety) - 2025 Start(Master[...]

    Machine Learning Engineer - CV / NLP / Multimodal LLM (TikTok Trust and Safety) - 2025 Start(Master[...]

    TikTok • San Jose, CA, United States
    serp_jobs.job_card.full_time
    Machine Learning Engineer - CV / NLP / Multimodal LLM (TikTok Trust and Safety) - 2025 Start(Master / Bachelor).The algorithm team is responsible for developing state-of-the-art computer vision, NLP and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer, Monetization Engineering

    Machine Learning Engineer, Monetization Engineering

    Pinterest • Palo Alto, CA, United States
    serp_jobs.job_card.full_time
    Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to br...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Staff Machine Learning Engineer (Applied ML)

    Staff Machine Learning Engineer (Applied ML)

    Earnin • Mountain View, California, United States
    serp_jobs.job_card.full_time
    As one of the first pioneers of earned wage access, our passion at EarnIn is building products that deliver real-time financial flexibility for those with the unique needs of living paycheck to pay...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Founding Machine Learning Engineer

    Founding Machine Learning Engineer

    Key Technology • Fremont, CA, United States
    serp_jobs.job_card.full_time
    You’ll design, build, and ship ranking and recommendation systems that make every match feel more personal and improve week after week. Train and fine-tune LLMs / encoders.Collaborate across ML, platf...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AIML - Software Engineer, Machine Learning Platform Technologies

    AIML - Software Engineer, Machine Learning Platform Technologies

    Apple • Cupertino, CA, United States
    serp_jobs.job_card.full_time
    Imagine what you could do here.At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there’s no t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer - LLM, AI & Robotics

    Machine Learning Engineer - LLM, AI & Robotics

    XPENG • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take‑off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer, ML Resources

    Machine Learning Engineer, ML Resources

    Waymo • Mountain View, California, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer - GenAI, LLM, Agentic AI

    Machine Learning Engineer - GenAI, LLM, Agentic AI

    Nutanix • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    We are building the next generation of our AI-powered talent platform, aiming to match the right career for everyone in the world. Our AI-native enterprise talent intelligence platform leverages Gen...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer, Recommendation

    Machine Learning Engineer, Recommendation

    Newsbreak • Mountain View, California, United States
    serp_jobs.job_card.full_time
    NewsBreak is redefining the way users interact with local news and their communities.By bridging local users, local content creators, and local businesses, our mission is to foster safer, more vibr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AIML- Machine Learning Engineer, Machine Learning Platform Technologies

    AIML- Machine Learning Engineer, Machine Learning Platform Technologies

    Apple Inc. • Santa Clara, CA, United States
    serp_jobs.job_card.full_time
    AIML- Machine Learning Engineer, Machine Learning Platform Technologies.Santa Clara, California, United States Machine Learning and AI. Imagine what you could do here.At Apple, great ideas have a wa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Machine Learning Engineer II - LLM

    Senior Machine Learning Engineer II - LLM

    Moveworks • Mountain View, California, United States
    serp_jobs.job_card.full_time
    We are looking for a Machine Learning Engineer to help build cutting edge ML infrastructure for building and serving LLM’s at Moveworks. This role will be critical in building, optimizing and scali...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer - MLR

    Machine Learning Engineer - MLR

    Apple Inc. • Cupertino, CA, United States
    serp_jobs.job_card.full_time
    Cupertino, California, United States Machine Learning and AI.Play a part in building the next revolution of machine learning technology. We're looking for passionate mid-level and junior researchers...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer 756

    Machine Learning Engineer 756

    Protegrity • Palo Alto, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    At Protegrity, we lead innovation by using AI and quantum-resistant cryptography to transform data protection across cloud-native, hybrid, on-premises, and open source environments.We leverage adva...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Gotion • Fremont, California, United States
    serp_jobs.job_card.full_time
    Silicon Valley, CA, currently building a Manufacturing facility in Manteno, IL and has R&D centers in Ohio, China, Japan and Europe. We innovate in the next generation electric vehicle and energy st...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted