Skip to content
Shadow Theory

Module A / Sources and identification

What a source must preserve

Adequate sources, controlled lumpability, common decoders, exact equality certificates, native dependence and calibrated contrasts.

Adequate sources, quotients and calibrated identification

A description earns its adequacy by preserving the distinctions the investigation actually needs. Returning the right answer on one task is not enough to identify the source of a presentation. This chapter develops the exact tests: continuation, common decoding, calibrated equality, native dependence and full-law comparison.

A physical description can preserve a response while omitting variables needed for another response or for its interpretation. Adequacy is therefore assessed relative to specified ports, preparations and readers. A quotient or statistic is not promoted to an experiential bearer merely because it is sufficient for one task. These distinctions develop the programme’s source and intrinsic-grain analysis (Rodgers, 2026h,i).

1.1 Controlled lumpability and continuation

Let SS be a finite physical state set, aa a native control, yy an observed output and Ka(s,y,s′)K_a(s,y,s') a joint transition instrument. Let ϕ:S→B\phi:S\to B be a surjective proposed state quotient. It reproduces the complete nominated output/block process for arbitrary preparations exactly when

∑s′:ϕ(s′)=b′Ka(s,y,s′)depends on s only through ϕ(s).(1) \sum_{s':\phi(s')=b'}K_a(s,y,s')\quad\text{depends on }s\text{ only through }\phi(s). \tag{1}

This holds for every a,y,b′a,y,b'. For necessity, compare point preparations in one fibre. For sufficiency, define the reduced kernel by this value and induct over trajectories. Adaptive controls are also preserved when their policy kernels depend on the corresponding prior outputs. A weaker port family gives a weaker adequacy condition; returning one display does not reset the whole state.

For deterministic controlled updates FaF_a and output gg, define s∼ts\sim t when every finite control word gives the same future output word from ss and tt. Then gg is constant on classes and s∼t⇒Fa(s)∼Fa(t)s\sim t\Rightarrow F_a(s)\sim F_a(t). Hence the classes form an autonomous output-sufficient quotient. Conversely, any autonomous quotient with g=r∘ϕg=r\circ\phi has fibres contained in these classes, by induction on control words. Thus continuation equivalence is the coarsest such quotient. This is the familiar finite automata/sufficiency principle, now with an explicitly physical control alphabet. Refining the observation aperture may split these classes; it cannot justify deleting genuinely distinguishable native tests.

At zero error, distinguishable continuation classes need disjoint retained record supports. If a deterministic finite record has KK states, at most KK classes can be recovered. Counting distinct probability laws does not give that storage bound: many overlapping stochastic laws can use the same finite alphabet. Approximate or analogue records require a decision or information bound instead (§3.5).

For F(a,b)=(b,a⊕b)F(a,b)=(b,a\oplus b) with output g(a,b)=ag(a,b)=a, F3=IF^3=I and the first two outputs recover (a,b)(a,b). A report partition alone permits arbitrary refinements; requiring autonomous continuation and these separating outputs recovers the four-state quotient. The premise is physical observability, not a claim that four qualitative states exist.

1.2 Common decoder comparison

For finite source and target experiments Ex,GxE_x,G_x on the same input alphabet, define one-decoder deficiency

δ(E,G)=inf⁡Dmax⁡xTV⁡(ExD,Gx),TV⁡(p,q)=12∑z∣pz−qz∣. \delta(E,G)=\inf_D\max_x\operatorname{TV}(E_xD,G_x),\qquad \operatorname{TV}(p,q)=\frac12\sum_z|p_z-q_z|.

DD is one stochastic kernel, independent of the unknown input except through the accessible source. Total variation contracts under kernels, so any bounded target decision simulated through DD differs by at most δ\delta. If two preparations have target contrast γ\gamma and source contrast ζ\zeta, then γ≤ζ+2δ\gamma\le\zeta+2\delta, by triangle inequality and contraction. Errors of two approximate source/target descriptions add. In particular, a common binary decision with errors e0,e1e_0,e_1 requires source total variation at least 1−e0−e11-e_0-e_1.

For binary symmetric channels parametrized by their contrast, write Exζ(x)=(1+ζ)/2E_x^\zeta(x)=(1+\zeta)/2 and Gxγ(x)=(1+γ)/2G_x^\gamma(x)=(1+\gamma)/2, with 0≤ζ,γ≤10\le\zeta,\gamma\le1. Then

δ(Eζ,Gγ)=(γ−ζ)+2. \delta(E^\zeta,G^\gamma)=\frac{(\gamma-\zeta)_+}{2}.

Necessity is the contrast bound. If γ≤ζ\gamma\le\zeta, a symmetric output flip reduces contrast to γ\gamma; otherwise the identity decoder attains the bound. For a constant source and a deterministic target naming one of kk inputs, the decoder is one common law rr, so maximum error is 1−min⁡xrx≥1−1/k1-\min_xr_x\ge1-1/k, attained by uniform rr. Multiclass deficiency is a finite linear programme using absolute-value slacks. Coarsening target observations cannot increase it; common relabeling leaves it unchanged. Independent decoders selected separately for each input do not meet the premise.

An intermediate record may be better than the terminal output. If two inputs give intermediate binary contrast .9.9, a later fixed channel reduces it to .18.18, and target contrast is .8.8, intermediate deficiency is zero while terminal deficiency is .31.31. A terminally poor report is neither an absence of earlier information nor a timestamp for experience.

1.3 Exact qualitative equality certificates

Suppose independent calibration supplies exact same/different qualitative judgments on nominated tokens. Collapse the same-judgment components; different judgments give edges of a graph on the remaining kk components. Compatible qualitative partitions are precisely its proper colorings, with arbitrary unrestricted labels. Such data uniquely specify the partition if and only if this graph is complete: a missing edge permits those two components to merge; a complete graph forbids every merge. Autonomy can add equalities through continuation, but a report code alone cannot add calibration.

For nn original tokens and kk classes the smallest certificate has n−k+(k2)n-k+\binom{k}{2} comparisons. Every class needs a connected equality graph, requiring its size minus one edges; each pair of classes needs an inequality. Spanning trees and one inequality per pair attain the lower bound. A fixed known number of qualitative labels imposes a different coloring problem and is not assumed here.

With known metric prototypes separated by Δ\Delta, observation error at most ϵ\epsilon uniquely identifies a prototype when Δ>2ϵ\Delta>2\epsilon, by triangle inequality. If prototypes themselves are inferred from one noisy labelled anchor each, same-class points can be 2ϵ2\epsilon apart and different-class points as close as Δ−2ϵ\Delta-2\epsilon; separation Δ>4ϵ\Delta>4\epsilon suffices. The latter threshold is sharp without further information: at ϵ=.1\epsilon=.1, anchors .1,.5.1,.5 and new observation .3.3 fit centers .2,.6.2,.6 with the middle point in the first class, or centers 0,.40,.4 with it in the second. Both prototype separations are .4.4. Boundary equality does not secure uniqueness.

Even a calibrated stochastic factorization can be nonunique. Let a report matrix be R=ZDR=ZD, with positive row-stochastic full-rank factors. For an invertible TT near II with T1=1T\mathbf1=\mathbf1, factors ZT,T−1DZT,T^{-1}D remain positive and row-stochastic for small perturbations, and have the same product. They need not be label permutations. If DD is independently known with full row rank, a right inverse instead recovers ZZ uniquely. Factorization of public probabilities does not calibrate the latent labels by itself.

1.4 Native dependency and source fibres

Let F:∏iSi→∏jSjF:\prod_iS_i\to\prod_jS_j be a finite bijection with full Cartesian preparation support and nontrivial native ports. Join input ii to output jj when varying only ii can change FjF_j. The bipartite essential-dependency components give the unique finest routed factorization. Each output depends only on inputs in its component, so a product decomposition exists. Global injectivity and surjectivity force each component map to be bijective. Any other routed product cannot split an essential edge, proving fineness and uniqueness. For two bits, eight of the 24 bijections are products of local flips and a possible swap; sixteen are prime. Global mixed recoding is not native gauge: it can conjugate a swap to a controlled-XOR update while failing independent local clamp correspondence (Module B).

A downstream component without a return path into the executive component cannot alter that component’s kernels. The directed dependency graph’s return-strongly-connected component supplies a physical prefilter, not a phenomenal-inertness theorem for spectators.

For a graph on nn source bits, edge parities xi⊕xjx_i\oplus x_j have incidence rank n−cn-c over F2\mathbb F_2, where cc is the number of connected components. The kernel consists exactly of vectors constant on each component, hence has 2c2^c members. One source-bit anchor per component removes this ambiguity. Strong pair dependency does not entail a scalar triple term: the period-four map (a,b,c)↦(c,a⊕c,b⊕c)(a,b,c)\mapsto(c,a\oplus c,b\oplus c) has a strongly connected dependency graph while every coordinate depends on at most two inputs. The graph is an organization descriptor, not an identified qualitative relation.

1.5 Restricted adaptation and calibrated contrast

Suppose two contexts read one baseline-corrected latent mean zhz_h with fixed positive gains: rG=gGzhr_G=g_Gz_h, rP=gPzhr_P=g_Pz_h. Strict opposing means are impossible. If observed means are (x,−y)(x,-y) with x,y>0x,y>0 and total errors below x,yx,y, this model is excluded. For fixed k=gP/gG>0k=g_P/g_G>0,

inf⁡zmax⁡{∣x−z∣,∣−y−kz∣}=kx+y1+k.(2) \inf_z\max\{|x-z|,|-y-kz|\}=\frac{kx+y}{1+k}. \tag{2}

Indeed kx+y=k(x−z)+(kz+y)≤(k+1)ekx+y=k(x-z)+(kz+y)\le(k+1)e for a fit of uniform error ee; equality is attained at z=(x−y)/(k+1)z=(x-y)/(k+1). With unequal errors, the intervals [x−eG,x+eG][x-e_G,x+e_G] and [(−y−eP)/k,(−y+eP)/k][(-y-e_P)/k,(-y+e_P)/k] must intersect. Allowing arbitrary positive kk gives infimum min⁡(x,y)\min(x,y), sometimes only at an inadmissible zero/infinite gain limit.

A positive two-mode transfer matrix BB predicts opposing-dose responses (bGG−rbGP,bPG−rbPP)(b_{GG}-rb_{GP},b_{PG}-rb_{PP}). Positive first and negative second occur exactly when bPG/bPP<r<bGG/bGPb_{PG}/b_{PP}<r<b_{GG}/b_{GP}, a nonempty interval if and only if det⁡B>0\det B>0. For

B=(4112), B=\begin{pmatrix}4&1\\1&2\end{pmatrix},

state (1,−1)(1,-1) gives (3,−1)(3,-1). This is a model-class consequence, not a general two-dimensional lower bound. A smooth scalar counterexample takes controls z↦z+1z\mapsto z+1, z↦z+2z\mapsto z+2 and readouts fG(z)=zf_G(z)=z, fP(z)=z−z(z−1)(z−2)f_P(z)=z-z(z-1)(z-2): separate controls agree, their composition gives (3,−3)(3,-3). Positive state-dependent gains on equally likely z=±1z=\pm1 can also give means (1,−1)(1,-1), and increasing nonlinear functions zz and ez−1e^z-1 give opposite mean shifts for a half/half mixture of −2,+1-2,+1. Test-dependent drift is a further escape. Fixed gains and a common latent mean are substantive.

For two histories, let source laws Pw,PvP_w,P_v, content laws Qw,QvQ_w,Q_v and reader laws Rw,RvR_w,R_v obey common kernels with approximation budgets TV⁡(Qi,PiK)≤ai\operatorname{TV}(Q_i,P_iK)\le a_i and TV⁡(Ri,QiJ)≤ei\operatorname{TV}(R_i,Q_iJ)\le e_i. Then

TV⁡(Pw,Pv)≥TV⁡(Rw,Rv)−aw−av−ew−ev. \operatorname{TV}(P_w,P_v)\ge\operatorname{TV}(R_w,R_v)-a_w-a_v-e_w-e_v.

This follows by contraction and triangle inequality. The budgets must include relevant calibration, drift and timing; a returning display alone supplies none.

1.6 What relational contrasts leave unidentified

For δ∈L2(μ⊗ν)\delta\in L^2(\mu\otimes\nu) define a(x)=Eyδa(x)=\mathbb E_y\delta, b(y)=Exδb(y)=\mathbb E_x\delta, m=Eδm=\mathbb E\delta, and

Dδ=δ(x,y)−δ(x,y′)−δ(x′,y)+δ(x′,y′). D\delta=\delta(x,y)-\delta(x,y')-\delta(x',y)+\delta(x',y').

Orthogonally decompose δ=m+(a−m)+(b−m)+r\delta=m+(a-m)+(b-m)+r with both margins of rr zero. Independent product quadruples give ∥Dδ∥22=4∥r∥22\|D\delta\|_2^2=4\|r\|_2^2 because its four terms are orthogonal. Therefore

∥δ∥22=14∥Dδ∥22+∥a−m∥22+∥b−m∥22+m2.(3) \|\delta\|_2^2=\frac14\|D\delta\|_2^2+\|a-m\|_2^2+\|b-m\|_2^2+m^2. \tag{3}

Contrasts alone miss additive rows/columns. For example, δ=θxy\delta=\theta xy on independent uniform signs has contrast norm 2∣θ∣2|\theta| and zero margins; adding u(x)+v(y)u(x)+v(y) leaves that contrast unchanged. Correlated or selected quadruples need a separate law; the identity cannot be assumed there.

For a finite difference space and accessible test vectors vjv_j, a full Gram operator G=∑jvjvj∗G=\sum_jv_jv_j^* with lower bound G⪰aIG\succeq aI, a>0a>0, gives

∥δ∥2≤a−1∑j∣⟨vj,δ⟩∣2. \|\delta\|^2\le a^{-1}\sum_j|\langle v_j,\delta\rangle|^2.

Positive nonzero eigenvalues on a smaller span do not control its nullspace.

Finally, suppose finite atoms have diameter at most DD, slacks vanish on an affinely independent face FF and sum to at least γ\gamma outside. If a law pp has expected slack at most ϵ\epsilon, its escaped mass satisfies ℓ≤ϵ/γ\ell\le\epsilon/\gamma. Let qq be on FF with mean within ζ\zeta of pp, and let the inverse barycentric map have zero-sum norm bound ∥z∥1≤M∥∑jzjaj∥\|z\|_1\le M\|\sum_jz_ja_j\|. For ℓ<1\ell<1, normalized pFp_F has mean within ℓD\ell D of pp, hence

TV⁡(p,q)≤min⁡{1,ℓ+M2(ζ+ℓD)}. \operatorname{TV}(p,q)\le\min\left\{1,\ell+\frac M2(\zeta+\ell D)\right\}.

This supplies stable joint-law identification from support and means. Matching means is inadequate without the face/slack and inverse assumptions. Applying the bound requires physical tests that establish those data; the algebra alone does not determine what appeared.

Two further transfer facts make the full-law requirement explicit. If one common decoder satisfies sup⁡xTV⁡(Rx,D(Px))≤ϵ\sup_x\operatorname{TV}(R_x,D(P_x))\le\epsilon, independent mm-sample experiments differ after that decoder by at most mϵm\epsilon. Couple the coordinates independently and bound the probability of any disagreement. A success probability ss on RR therefore transfers with lower bound s−mϵs-m\epsilon; an input-dependent decoder would inject the answer.

For a full density comparison, let fi=eXiξi>0f_i=e^{X_i}\xi_i>0 and Zi=∫fiZ_i=\int f_i. If ∥X2−X1∥∞≤ϵ\|X_2-X_1\|_\infty\le\epsilon and Z1−1∫eX1∣ξ2−ξ1∣≤eϵ−1Z_1^{-1}\int e^{X_1}|\xi_2-\xi_1|\le e^\epsilon-1, expansion gives

Z1−1∫∣f2−f1∣≤(eϵ−1)(1+eϵ)=e2ϵ−1. Z_1^{-1}\int|f_2-f_1|\le(e^\epsilon-1)(1+e^\epsilon)=e^{2\epsilon}-1.

The normalizer difference costs at most the same L1L^1 discrepancy, so TV⁡(f1/Z1,f2/Z2)≤min⁡{1,e2ϵ−1}\operatorname{TV}(f_1/Z_1,f_2/Z_2)\le\min\{1,e^{2\epsilon}-1\}. Listed moments or separate margins do not supply these full positive-density and normalizer hypotheses.