Hi ROS Community,
Benji from Roboto here. At ROSCon in October last year, we previewed an early experiment: could an AI agent investigate robotics data and help find the cause of a failure? As it turns out, the answer was yes.
After extensive testing with several robotics teams, last month we released Roboto Agents. Describe what you need in plain language, and Agents can now work across bags, video, and source code to help with tasks like:
-
Triage: an Agent automatically reviews every new bag, checks it for failure modes, tags it, and can open a labeled, evidence-backed ticket in Linear, GitLab, or Jira.
-
Root cause analysis: trace robot failures into your codebase and draft a fix.
-
Data curation: “find stair traversals from the last two months” becomes a Collection of matching examples from across your bags, exportable to ML-ready formats like LeRobot.
-
Data analysis: ask “Why did this drone flight crash?” and the visualizer opens with the data behind the answer: relevant plots, imagery, and key moments highlighted as Events.
Most bags are write-once, read-never. They sit in storage (or get deleted) until something breaks in the field, and then teams go digging. With Roboto Agents, every log gets triaged, your questions get answered with clear evidence, failures get traced into code fixes, and the moments worth learning from become training data. Every robot run improves the next one.
Any feedback is welcome! We’ll be at ROSCon in Toronto next month - sponsoring for our 4th year in a row! Hope to see you there.