Mental Time Travel as Novel Viewpoint Synthesis
Type: intersection (second-order) Slug: intersection—mental-time-travel-novel-viewpoint-synthesis Parents: intersection—GQN-hippocampal-construction, intersection—big-loop-attention-episodic-consolidation Last updated: 2026-05-14 Epistemic status: Extrapolative
The convergence
GQN renders scenes from novel viewpoints via a single scene representation + query mechanism. Big-loop recurrence iteratively integrates information across episodes to build cross-episode representations. Combined: autobiographical recall is viewpoint synthesis over a cross-episode scene representation.
Remembering an event from a third-person perspective isn’t reconstructing a different memory — it’s re-rendering the same scene representation from a different viewpoint, exactly as GQN does. Big-loop attention builds the scene representation across sleep cycles; recall is just querying it from a particular viewpoint.
Why this isn’t obvious from either parent
The GQN×Construction intersection (A) identifies viewpoint generalisation as a parallel but doesn’t explain how the scene representation is built across episodes. The Big-Loop×Attention intersection (1) explains cross-episode integration but doesn’t ask what the integrated representation is for. Together: big-loop builds the representation; GQN-style querying uses it. The representation isn’t for “memory” — it’s for rendering, and “memory” is just rendering from a particular viewpoint.
Generative prediction
Neural scene representations built through big-loop integration should be viewpoint-invariant (same pattern regardless of imagined perspective), while the “query” signal should encode viewpoint. If fMRI during perspective-shifting imagination shows viewpoint-invariant hippocampal representations + viewpoint-specific prefrontal query signals, this would be striking evidence.
Falsification: If viewpoint manipulation in recall uses a different neural mechanism than viewpoint manipulation in perception (no shared GQN-like representation), the synthesis claim is false.