CodexGameDev/experiments/003_rig_trials/results/e1fa0f4d-analysis.md
2026-08-18 00:52:29 -04:00

61 lines
5.4 KiB
Markdown

# Playtest Analysis — Session e1fa0f4d
Date: 2026-08-16
Source log: `JSONL/rig-trials-e1fa0f4d-9828-431e-8158-ddf826a41770.jsonl`
## Observed Behavior
- Total logged duration was 407 seconds, about 6 minutes 47 seconds.
- All three trials were completed in the presented order.
- Haul occupied about 4 minutes 29 seconds. It produced 16 cargo attachments, 11 manual releases, 12 unsuccessful tractor activations, three deliveries, five obstacle collisions, and two thermal collapses.
- Haul was completed on attempt 4 with the four starter drives and two oppositely facing tractors. The successful attempt took about 61.7 seconds.
- Furnace occupied about 34 seconds. The first engaged attempt thermally collapsed at x≈0.676.
- After that collapse, the player replaced the tractor, three drives, and an added tractor with sinks in quick succession. The successful Furnace rig contained one right-facing drive and five sinks, with displayed cooling 19.2/s. It completed in about 7.9 seconds.
- Gale occupied about 85 seconds. Before the successful run, the player removed three sinks and tried/reoriented several drive placements over eleven cheap build-reset attempts.
- The successful Gale rig had the four cardinal starter drive directions plus two sinks. It had no ballast and completed in about 32.9 seconds.
- After completing Gale, the player removed and then restored one sink before exporting.
- Across the whole session there were 12 placements, six removals, one in-place rotation, two budget rejections, 23 obstacle collisions, and 222 paired drive-input sessions.
## Player Report
- The overall experience was “pretty boring.”
- Controls and tractor alignment were not awkward. The task was obvious rather than physically difficult.
- The player initially interpreted the heat bar as a limited movement budget and did not notice Sinks.
- Under that mistaken model, they added a second oppositely facing tractor and repeatedly juggled the two fragments back to the home bay.
- After learning that Sinks existed, they expected Haul would become even easier.
- Furnace was solved by replacing everything except the core and forward drive with Sinks, then driving straight through.
- Gale was solved by restoring the default rig.
- Placement did not feel important. Re-adding and orienting Drives was only mildly annoying.
## Important Confounds
Heat accumulation and 100° collapse applied in Haul even though the Haul briefing focused on tractor exposure, cargo mass, and recovery. The two Haul thermal failures may have felt like an unexplained cross-trial tax rather than meaningful coupled physics.
Haul telemetry suggests a large share of activity was execution/debugging rather than construction reasoning: repeated attach/release operations, failed alignment checks, and long direct piloting. This could mask or constitute the failure.
Furnace admitted an obvious extreme answer: remove almost every movement capability except the required rightward drive and fill the rest of the budget with sinks. Completion then took under eight seconds. This is qualitative part swapping, but it may be a prescribed checklist rather than fertile adaptation.
Gale did not require its nominally distinctive ballast part. Reconstructing four cardinal drives was sufficient. The placement sequence may reflect learning the builder's rotation semantics rather than reasoning about wind-responsive architecture.
## Questions Needed Before Interpretation
1. Did Haul feel primarily like awkward driving/tractor alignment, or was the underlying task already uninteresting even when controls behaved?
2. Did rebuilding for Furnace and Gale involve a decision you cared about, or did each trial merely announce which parts to stack?
3. Was there any moment when placement itself seemed likely to matter, or did the lattice feel like a slower equipment menu because counts dominated geometry?
## Final Interpretation
The answers rule out awkward piloting as the primary cause. They support the weaker-construction explanations:
- modules behaved mainly as scalar counters or required verbs;
- each trial advertised an obvious dominant composition;
- lattice geometry rarely changed capability;
- switching requirements caused near-total loadout replacement rather than knowledge-rich recomposition;
- orientation added interface work without producing a valued spatial decision.
The two-tractor solution is important counterevidence to treating voluntary experimentation as a sufficient fun signal. It was an unintended, self-devised workaround caused by a mistaken heat model, and it involved repeated execution. The player still found the experience boring. Voluntary deviation is strong evidence of agency or problem solving, but not necessarily curiosity, delight, or a fertile consequence space.
This experiment does not establish that physical construction is uninteresting. It establishes that construction whose geometry is largely cosmetic and whose parts are one-dimensional counters feels like a slower loadout menu. A richer craft prototype could test physical placement, but immediately building one risks polishing a favored prior after several shallow systems.
Experiment 004 should make an exploratory pivot to **legible discovery**. The first four prototypes either documented their laws or made the useful response obvious. None cleanly tested whether encountering a surprising, stable rule, forming a model, and transferring that knowledge to a new situation generates interest.