Repository navigation
[DRAFT] Add how-to for training a VLA model - #5412
Draft
Eliza Farley (elizafarley) wants to merge 3 commits into
Draft
Eliza Farley (elizafarley) wants to merge 3 commits into
Eliza Farley (elizafarley) wants to merge 3 commits into
Conversation
New docs/train/train-a-vla.md: record teleoperated demonstrations as sequences, convert them with viam-sequence-to-lerobot, fine-tune SmolVLA in a custom training container, and run the policy with the viam-labs:vla module. Link it from the custom containers page. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
✅ Deploy Preview for viam-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
Cite LeRobot's ~50-episode recommendation, explain which demonstrations to delete, introduce viam-sequence-to-lerobot before its first use, reword the web UI submission path, explain why to monitor the job, and rename "Next steps" to "Learn more". Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Summary
Adds
docs/train/train-a-vla.md, a how-to for training a vision-language-action (VLA) model with Viam, so a docs search for "VLA" finds a real path to follow. It works with any arm and builds on the custom training containers from #5407.GetImagesand armJointPositionsat one rate.capture-control, taggedcmd:<instruction>.viam-sequence-to-lerobotto catch bad sequences before training.huggingface/lerobot-gpuand register it.lerobot-trainfromlerobot/smolvla_base, and save the checkpoint to--model_output_directory.--container-id.viam-labs:vlaregistry module (vla:policyandvla:controller), loading the checkpoint from${packages.ml_model.<name>}.Also adds a "Next steps" card to
custom-containers.mdlinking to the new page.Evidence and what's untested
Steps 1–3 and 7 match what the BoxBot team ran for the IROS 2026 demo: the datasets and models are under the
viamroboticsHugging Face org. BoxBot trained on Hugging Face Jobs, not Viam. The Viam training steps (4–6) haven't been run. Before merging, someone should run one job and check:pip, becauselerobot-gpu's uv-created venv has none. I haven't built the image.user_lerobot). Unknown whether Viam's job launcher cares.lerobot/smolvla_basefrom Hugging Face at runtime, so this needs outbound internet from training jobs. If jobs don't have it, bake the weights into the image./gcs/image paths resolve was checked in the converter's source, not by running it.The page relies on two
viam-labsrepos. Confirm the team is comfortable with docs pointing to them.Checks
scripts/frontmatter_rules.pymake build-prod🤖 Generated with Claude Code