Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

7.3. Hypothesis 3: Fast Adaptation, Extension, and Combination of Behaviors

To support our third hypothesis, we’ll show measured sessions where existing behaviors were adapted, composed, or extended rather than rebuilt from scratch.

In Figure 7.25, we summarize three measured adaptation sessions on Alex. Each row shows normalized active adaptation time on a log-second axis with internal milestone structure recovered from screen recordings. The bottle carry-through session composes existing pickup and door behaviors into one long-horizon task. The break-room session adapts a lab right-pull traversal to a real left-pull door: door-specific mirroring was only the starting transfer, and most time went to retuning opening, fallbacks, traversal, and footsteps. The two-table sorting session extends the open-house ball-return behavior with locomotion, table-specific routing, and color-dependent branches; its total includes an off-robot pre-authoring pass. Checkmarks mark first autonomous success.

Figure 7.25. In-house real-robot adaptation durations on a log-second axis with internal milestone structure. Rows are grouped by robot era and ordered chronologically. The bottle session composes existing behaviors; the break-room session adapts a mirrored lab behavior to a real door; the two-table session extends an existing manipulation behavior with locomotion and routing logic. The cyan segment marks off-robot pre-authoring counted in the two-table total. Checkmarks mark first autonomous success. Times are normalized active adaptation.

The subsections below walk through each row in Figure 7.25 with a representative still, the authoring-time table, and a link to the screen recording.

7.3.1. Bottle Carry Through Composition (Alex, 2026-03-18)

On March 18, 2026, we composed an existing bottle pickup behavior with the left push door traversal so Alex could carry a bottle through the door in one autonomous run. Most of the session wired the two behaviors together, recovered from a tooling failure while loading the door subtree, and tuned grasp and traversal so the bottle stayed in hand. First fully autonomous success came at 1 hour, 13 minutes, and 49 seconds of measured active adaptation time. The result is shown in Figure 7.26. Authoring times are presented in Table 7.22.

Figure 7.26. Alex after the first fully autonomous bottle pickup, walk, and door traversal with the bottle in hand on March 18–19, 2026. A video is available at https://youtu.be/AH2dFMW-IbY.
Elapsed timeComposition milestone
0:00:00Start from existing bottle-pickup and left push door traversal behaviors; robot is at the table holding the bottle.
0:01:34Backup-from-table and face-door walk action added.
0:02:43Tooling issue while loading the large door subtree into the tree.
0:26:56Door subtree loaded by manual JSON edit and UI/autonomy relaunch.
0:42:55Retry grasp bottle fallback added with a near-hand point check.
0:58:41Right-hand finger and arm motions disabled in the push-door behavior so the bottle grasp is preserved through traversal.
0:59:44Door fully traversed with the bottle, but discontinuously.
1:13:49First fully autonomous run: approach, pickup, walk, traverse with bottle in hand.

Table 7.22. Cumulative adaptation timeline for the March 18, 2026 bottle carry-through composition session shown in Figure 7.26.

7.3.2. Break Room Door Adaptation (Alex, 2026-03-26)

On March 26, 2026, we adapted the lab right pull door traversal to the break room left pull door on Alex. Door mirroring was only the starting point. Most of the 1 hour, 54 minutes, and 3 seconds of measured active adaptation time went to retuning opening, fallbacks, traversal, and footsteps on the real door. The successful run is shown in Figure 7.27. Authoring times are presented in Table 7.23.

Figure 7.27. Alex opening the break room left pull door on March 26, 2026 after mirrored adaptation from the lab right pull behavior. A video is available at https://youtu.be/HcJPLoRfs3Q.
Elapsed timeAdaptation milestone
0:00:33Load DoorTraversal.json (mirrored left pull, untested on a real door).
0:01:56Door type and door-relative poses identified from scene objects.
0:23:51First real-door opening after retuning the lever-turn motion.
0:29:44Point-check fallback added to retry door opening when the pull is unreliable.
0:31:29Door fully opened.
0:54:49Spine yaw added after the lever turn for consistent opening.
1:17:13Traversal arm motions simplified under the no-spring-closer assumption.
1:48:00Traversal footsteps re-authored; shoulder-frame clearance checked in Preview Mode.
1:53:20Reset and run the behavior autonomously from the top.
1:54:03First successful break-room door traversal.

Table 7.23. Continuous authoring timeline for the March 26, 2026 break room door adaptation shown in Figure 7.27.

7.3.3. Two Table Sorting Extension (Alex, 2026-04-13 to 14)

From April 13 through 14, 2026, we extended the open house ball return behavior to sort colored balls between two tables with locomotion between stations. The measured total is 1 hour, 50 minutes, and 41 seconds, including 15 minutes and 30 seconds of off-robot pre-authoring before the real-robot follow-up session. The documented demonstration sorted nine of nine balls correctly, with three table approaches and two transitions between tables. A still from the task setup is shown in Figure 7.28. Authoring times are presented in Table 7.24.

Figure 7.28. The two table ball sorting task on April 14, 2026. A video is available at https://youtu.be/_3lqvcd_5WE.
PhaseDurationMilestone
Off-robot pre-authoring15 min 30 sFork demo/BallsInBins.json to eval/TwoTableSorting.json; restructure loop and color routing.
Real-robot follow-up1 h 35 min 11 sReach documented 9/9 two-table sorting demonstration.
Total measured1 h 50 min 41 sFirst successful table-B placement at 26 min 8 s within the real-robot session.

Table 7.24. Authoring summary for the April 13–14, 2026 two table sorting extension shown in Figure 7.28.