Skip to content
Shadow Theory

Paper 4 · Section 5Identification

The algebra of a common stochastic process

When affine recodings preserve product laws, where fair and deterministic directions matter, and why the frozen pair has no fully supported common native continuation to its deterministic endpoint.

Section 6 of 11

5 Which stochastic continuations remain common?

5.1 The admissibility question

The official native IIT substrate requires next-unit conditional independence given the preceding complete state [17, 18]. A common stochastic comparison would additionally require

KϵG(Ey∣Ex)=KϵF(y∣x).K^G_\epsilon(Ey\mid Ex)=K^F_\epsilon(y\mid x). (20)

These are separate conditions. Adding the same independent flip rate in each implementation's own chart does not in general satisfy (20). Factoring the transported row into its marginals would change the joint process.

Corollary 4 (Full-rank common-law rigidity)

Suppose an exactly conjugate pair of strictly positive transition kernels is product in both native binary charts. If the centered-log matrix of the response rows has rank nn, the chart correspondence must be a signed permutation.

Proof

Pull the second kernel back to the first state set. Exact conjugacy makes its response rows identical after reindexing the input states, while its output chart is the conjugating bijection. Both charts factor the same positive family; input-row permutation does not change rank. Apply Theorem 1.

□

This observation connects identification and admissibility even for nonlinear recodings. The affine classification below describes the boundary cases—missing support or unexcited fair directions—in which common product laws can still occur.

The following classification includes deterministic coordinates, which are essential near the frozen endpoint. It is a finite binary specialization of ICA rigidity and its exceptions [9]; priority for a general independence-preservation theorem is not claimed.

Theorem 5 (Affine product-law compatibility)

Let XiX_i be independent Bernoulli variables with parameters pi∈[0,1]p_i\in[0,1], and Z=AX⊕bZ=AX\oplus b for invertible AA over F2\F. Let S={i:0<pi<1}S=\{i:0<p_i<1\} and let JJ be the union of the supports of the columns AiA_i for i∈Si\in S. Then the coordinates of ZZ are independent if and only if both conditions hold:

  1. ∣J∣=∣S∣|J|=|S|;

  2. for B=AJ,SB=A_{J,S}, every row of B−1B^{-1} corresponding to an index i∈Si\in S with pi≠1/2p_i\ne1/2 has Hamming weight one.

For S=∅S=\varnothing, the empty conditions mean the deterministic output is product.

Proof

Absorb deterministic input values into the output translation. The input support is the complete coordinate face on SS, and the output support is an affine subspace of dimension ∣S∣|S|. An output coordinate varies exactly when it belongs to JJ. A product distribution with these varying coordinates has the entire JJ-face as support. Hence independence requires ∣J∣=∣S∣|J|=|S|. Conversely this equality and invertibility of AA make BB square and invertible, and make the output support that complete face.

Restrict to the varying coordinates, whose probabilities are strictly positive. The log-density of XSX_S is a constant plus a sum of singleton Walsh characters with coefficients 12log⁡((1−pi)/pi)\frac12\log((1-p_i)/p_i). Under B−1B^{-1}, these become characters indexed by the distinct rows of B−1B^{-1}; a translation can change their signs but not their supports. A positive distribution on a complete binary cube is product exactly when its log-density contains no Walsh characters of degree at least two. Distinct rows cannot cancel each other's characters. The nonzero coefficients are precisely those with pi≠1/2p_i\ne1/2. Condition two is therefore necessary and sufficient.

□
Corollary 6 (Biased near-deterministic errors)

If 0≤pi<1/20\le p_i<1/2 for all ii, AX⊕bAX\oplus b is product if and only if every active column AiA_i, pi>0p_i>0, is a singleton coordinate vector. These singleton columns are distinct.

Proof

All active log coefficients are nonzero. Theorem 5 forces every row of B−1B^{-1} to be a singleton, hence BB is a permutation matrix. Including the zero rows outside JJ gives the stated condition. The converse is immediate independence of distinct surviving inputs.

□

For (2), the linear columns are

e0,e1+e3,e2,e0+e3,e4.e_0,\quad e_1+e_3,\quad e_2,\quad e_0+e_3,\quad e_4. (21)

Consequently, near the deterministic endpoint,

Eη has independent coordinates⟺p1=p3=0.E\eta\ \hbox{has independent coordinates}\quad\Longleftrightarrow\quad p_1=p_3=0. (22)

When all five pip_i are strictly between zero and one, the inverse rows of EE instead give

Eη has independent coordinates⟺p0=p3=12.E\eta\ \hbox{has independent coordinates}\quad\Longleftrightarrow\quad p_0=p_3=\tfrac12. (23)

The latter case is compatible but cannot approach a deterministic error law.

Corollary 7 (No fully supported common native continuation)

There is no family satisfying (20), product in both native charts, fully supported for every sufficiently small positive ϵ\epsilon, and converging rowwise to the frozen deterministic FF and GG.

Proof

Any product row tending to F(x)F(x) can be written F(x)⊕ηF(x)\oplus\eta with independent error probabilities pi(x,ϵ)→0p_i(x,\epsilon)\to0. There are finitely many states and coordinates, so all these probabilities lie below 1/21/2 for sufficiently small ϵ\epsilon. Equation (22) forces p1(x,ϵ)=p3(x,ϵ)=0p_1(x,\epsilon)=p_3(x,\epsilon)=0 in every row, contradicting full support. The argument permits state-dependent error probabilities.

□

This is not a prohibition of all stochastic comparisons. For example, (p0,p1,p2,p3,p4)=(p,0,p,0,p)(p_0,p_1,p_2,p_3,p_4)=(p,0,p,0,p) gives a sparse common family. Separately implemented independent-noise systems can also be compared, but they are not the same transported process. Enlarging the substrate with latent noise sources, using a different time step, or changing the model's causal factorization requires a new comparison contract.

5.2 Checks and official admission tests

Exact joint-law tests agree with Theorem 5 on all 55=3,1255^5=3{,}125 parameter choices from {0,1/4,1/2,3/4,1}\{0,1/4,1/2,3/4,1\} for EE; 725 are compatible. The near-endpoint and full-support subgrids each contain 27 compatible cases out of 243. A further 1,024 seeded invertible matrices in dimensions two through five agree with the criterion.

For the familiar independent Bernoulli-pp error family, two transported outputs are η1\eta_1 and η3⊕η1\eta_3\oplus\eta_1, whose covariance is p(1−p)(1−2p)p(1-p)(1-2p). It equals 21/25621/256 at p=1/8p=1/8. The official PyPhi constructor accepts the original product TPM but raises ConditionallyDependentError for its exact transported joint law. It accepts both native TPMs of the sparse common example and of the compatible full-support example (1/2,1/8,1/8,1/2,1/8)(1/2,1/8,1/8,1/2,1/8). All accepted joint laws round-trip exactly through the official conversion interface.

No stochastic complex or SPC-2 admission phase diagram is claimed. The compatibility theorem supplies the useful bounded result here; a numerical sweep of a changed or invalid process would not strengthen it.