← back to the atlas

d4-conf-aaai-2018-1209 (d4-conf-aaai-2018-1209)

Answer: Every admissible PCL run satisfies the stated inequality for every integer \(H\ge1\); the coefficient \(S\) can additionally be replaced by \(\sqrt S\).

The anchor (named result in the paper)

Theorem 1 — class: algorithmic

The continuous mirror question, as graded

Given a feasible configuration space \(X\), bounded features \(\phi\), basic parts \(\mathcal P\), an initial configuration, and a finite support \(T\) with binary-rational masses \(\mu_t\) summing to one, let each type have an unknown linear utility \(u_t(x)=\langle w_t,\phi(x)\rangle\), and let the population objective be \(\bar u_\mu(x)=\sum_{t\in T}\mu_tu_t(x)=\langle\bar w,\phi(x)\rangle\). At each round \(r\), a learner selects a part \(p_r\), holds the rest fixed, and receives a feasible replacement that is conditionally \(\alpha\)-informative for \(\bar u_\mu\). Does PCL achieve \(T^{-1}\sum_{r=1}^{T}\mathrm{CREG}^{\bar u_\mu}_{p_r}(x^r)\le 2DS\lVert\bar w\rVert/(\alpha\sqrt T)+(\alpha T)^{-1}\sum_{r=1}^{T}\bar\zeta_r\), where \(D\) bounds feature magnitudes, \(S\) is the largest part feature-set size, and \(\bar\zeta_r\) is the omitted-feature residual under the aggregate utility?

Packaged proof task (what the prover saw — nothing else)

Let \(X\) be a nonempty feasible configuration space with \(m\ge1\) features \(\phi:X\to\mathbb R^m\), bounded by \(\|\phi(x)\|_\infty\le D\). There are \(n\ge1\) basic parts whose partial configurations reconstruct each object; \(F_p(x)\) denotes the feasible configurations agreeing with \(x\) outside part \(p\). Assume all maxima below are attained.
Each part has a feature set \(I_p\subseteq[m]\): changing only \(p\) leaves features outside \(I_p\) unchanged. Require \(\bigcup_p I_p=[m]\) and \(I_p\setminus\bigcup_{q\ne p}I_q\ne\varnothing\). Fix an ordering \(p_1,\ldots,p_n\), define \(J_{p_k}=I_{p_k}\setminus\bigcup_{j>k}I_{p_j}\), and set \(S=\max_p|I_p|\).
A society is given by its support: a list \(\mathcal T\) of \(\tau\) types with positive binary-rational masses \(\mu_t\) summing to one. Here \(\tau\) is the support size, not the number of possible types; \(L\) is the bit length of the encoded input. State any running times in \(m,\tau,L,n\), the round horizon, and any oracle costs.
Each type has unknown weights \(w_t\in\mathbb R^m\), with unrestricted signs, and utility \(u_t(x)=\langle w_t,\phi(x)\rangle\). Write \(\bar w=\sum_t\mu_tw_t\) and \(\bar u_\mu(x)=\langle\bar w,\phi(x)\rangle\).
PCL starts with \(v^1=0\) and a feasible configuration \(z^0\). In round \(r\), select any basic part \(p_r\), put \(I_r=I_{p_r}\), \(J_r=J_{p_r}\), and choose \(x^r\in\arg\max_{y\in F_{p_r}(z^{r-1})}\langle v^r_{J_r},\phi_{J_r}(y)\rangle\); ties may be resolved arbitrarily.
Define \(\mathrm{CREG}^{\bar u_\mu}_p(x)=\max_{y\in F_p(x)}\bar u_\mu(y)-\bar u_\mu(x)\). Feedback is a configuration \(\hat x^r\in F_{p_r}(x^r)\) satisfying \(\bar u_\mu(\hat x^r)-\bar u_\mu(x^r)\ge\alpha\,\mathrm{CREG}^{\bar u_\mu}_{p_r}(x^r)\), for fixed \(\alpha\in(0,1]\).
Let \(\Delta^r=\phi(\hat x^r)-\phi(x^r)\). Set \(Q_r=I_r\) if \(\langle v^r_{I_r},\Delta^r_{I_r}\rangle\le0\), and \(Q_r=J_r\) otherwise; update \(v^{r+1}_{Q_r}=v^r_{Q_r}+\Delta^r_{Q_r}\), leaving other coordinates unchanged, and set \(z^r=x^r\).
Define the signed residual \(\bar\zeta_r=0\) when \(Q_r=I_r\), and \(\bar\zeta_r=\langle\bar w_{I_r\setminus J_r},\Delta^r_{I_r\setminus J_r}\rangle\) otherwise.
Does every admissible PCL run, for every integer \(H\ge1\), satisfy \(\frac1H\sum_{r=1}^H\mathrm{CREG}^{\bar u_\mu}_{p_r}(x^r)\le\frac{2DS\|\bar w\|_2}{\alpha\sqrt H}+\frac1{\alpha H}\sum_{r=1}^H\bar\zeta_r\), or is there an admissible counterexample?
Known: PCL has the displayed regret guarantee for an arbitrary real utility vector under these feature, inference, and feedback assumptions; this is a regret theorem, not a polynomial-time algorithm theorem. [Verified source](https://arxiv.org/pdf/1711.08247).
The stated population formulation is already covered by that guarantee, so this faithful question is not an open target.

Modeling choices made when packaging the task

Prover output (gpt-6.1-sol / high, Bolzano prover prompt)

Result

Every admissible run satisfies the stated inequality for every integer \(H\ge1\). In fact, the assumptions imply the stronger bound

\[ \frac1H\sum_{r=1}^H\mathrm{CREG}^{\bar u_\mu}_{p_r}(x^r) \le \frac{2D\sqrt S\,\|\bar w\|_2}{\alpha\sqrt H} +\frac1{\alpha H}\sum_{r=1}^H\bar\zeta_r. \]

This agrees with the supplied [PCL regret theorem](https://arxiv.org/pdf/1711.08247), applied to the aggregate utility vector. Below is a direct proof, including the signed residual.

1. Aggregate utility and feasible comparisons

The support is finite, so \(\bar w=\sum_{t\in\mathcal T}\mu_t w_t\) is a well-defined vector in \(\mathbb R^m\). By linearity, for every feasible configuration \(x\),

\[ \sum_{t\in\mathcal T}\mu_tu_t(x) =\left\langle\sum_{t\in\mathcal T}\mu_tw_t,\phi(x)\right\rangle =\langle\bar w,\phi(x)\rangle. \]

Fix any round \(r\). Since \(x^r\) agrees with \(z^{r-1}\) outside \(p_r\), and \(\hat x^r\) agrees with \(x^r\) outside \(p_r\), the feedback configuration also belongs to \(F_{p_r}(z^{r-1})\). Consequently, the maximizing property of \(x^r\) gives

\[ \langle v^r_{J_r},\phi_{J_r}(x^r)\rangle \ge \langle v^r_{J_r},\phi_{J_r}(\hat x^r)\rangle, \qquad \langle v^r_{J_r},\Delta^r_{J_r}\rangle\le0. \]

This holds for every allowed tie resolution.

Changing only \(p_r\) leaves features outside \(I_r\) unchanged. Thus \(\Delta_i^r=0\) for \(i\notin I_r\). Moreover, feature boundedness implies \(|\Delta_i^r|\le2D\) for every coordinate.

2. Norm growth of the update vector

Define \(g^r=v^{r+1}-v^r\). By the update rule, \(g_i^r=\Delta_i^r\) for \(i\in Q_r\) and \(g_i^r=0\) otherwise.

Both update branches satisfy \(\langle v^r,g^r\rangle\le0\):

Since \(Q_r\subseteq I_r\), we also have

\[ \|g^r\|_2^2 =\sum_{i\in Q_r}(\Delta_i^r)^2 \le4D^2|Q_r| \le4D^2S. \]

Expanding the squared norm therefore yields

\[ \|v^{r+1}\|_2^2 =\|v^r\|_2^2+2\langle v^r,g^r\rangle+\|g^r\|_2^2 \le\|v^r\|_2^2+4D^2S. \]

Starting from \(v^1=0\) and summing over the first \(H\) rounds gives

\[ \|v^{H+1}\|_2^2\le4D^2SH, \qquad \|v^{H+1}\|_2\le2D\sqrt{SH}. \]

Here \(D\ge0\), because \(X\) is nonempty and a norm is nonnegative.

3. Feedback gain and the signed residual

Write \(R_r=\mathrm{CREG}^{\bar u_\mu}_{p_r}(x^r)\). The feedback assumption and the vanishing of \(\Delta^r\) outside \(I_r\) give

\[ \alpha R_r \le\bar u_\mu(\hat x^r)-\bar u_\mu(x^r) =\langle\bar w_{I_r},\Delta^r_{I_r}\rangle. \]

In either update branch, the residual definition gives the exact identity

\[ \langle\bar w_{I_r},\Delta^r_{I_r}\rangle =\langle\bar w,g^r\rangle+\bar\zeta_r. \]

Indeed, for \(Q_r=I_r\), the update includes every potentially changing coordinate and the residual is zero. Otherwise, splitting \(I_r\) into the disjoint sets \(J_r\) and \(I_r\setminus J_r\) gives precisely the update contribution and the stated residual.

Summing the feedback inequalities, using \(\sum_{r=1}^Hg^r=v^{H+1}-v^1=v^{H+1}\), and applying Cauchy–Schwarz yields

\[ \alpha\sum_{r=1}^HR_r \le \langle\bar w,v^{H+1}\rangle+\sum_{r=1}^H\bar\zeta_r \le 2D\|\bar w\|_2\sqrt{SH}+\sum_{r=1}^H\bar\zeta_r. \]

Division by \(\alpha H>0\) proves the stronger bound.

Finally, coverage of the nonempty feature set implies \(S\ge1\), hence \(\sqrt S\le S\). Replacing \(\sqrt S\) by \(S\) proves exactly the requested inequality. No assumption on the signs of the weights or residuals was used.

⟨structured verdict parsed — rendered above⟩

Adversarial review (gpt-6.1-sol / medium, Bolzano verifier prompt)

Verdict

The proof is correct and resolves the assigned question. Every admissible run satisfies the requested inequality for every integer \(H\ge1\). The stronger coefficient \(2D\sqrt S\) is also justified. No major or minor mathematical issues were found.

Step-by-step verification

The finite support ensures that \(\bar w=\sum_{t\in\mathcal T}\mu_tw_t\) is a well-defined real vector. The displayed linearity identity holds for every \(x\in X\), without restrictions on weight signs. Neither rationality of the masses nor knowledge of the individual weights is needed for this identity.

Membership in \(F_{p_r}(z^{r-1})\) means agreement with \(z^{r-1}\) outside \(p_r\). Since \(\hat x^r\) agrees with \(x^r\) outside that same part, agreement is transitive, giving \(\hat x^r\in F_{p_r}(z^{r-1})\). Thus the maximizing property applies to the feedback configuration and establishes
\(\langle v^r_{J_r},\Delta^r_{J_r}\rangle\le0\).
This argument permits arbitrary maximizing tie resolutions.

The feature invariance assumption applies because \(\hat x^r\in F_{p_r}(x^r)\). Therefore \(\Delta_i^r=0\) outside \(I_r\). Boundedness of both configurations gives \(|\Delta_i^r|\le2D\). Both statements are justified.

The definition of \(g^r\) matches the update exactly. In the full update branch, \(\langle v^r,g^r\rangle\le0\) is the branch condition. In the restricted branch, it is the inference inequality from step 2. The equality case is correctly included in the full update branch.

Since \(Q_r\subseteq I_r\), the calculation
\(\|g^r\|_2^2\le4D^2|Q_r|\le4D^2S\)
is correct. The squared-norm expansion consequently gives the stated increment bound. Summation from \(v^1=0\) yields
\(\|v^{H+1}\|_2^2\le4D^2SH\).
Taking square roots is valid because \(D\ge0\), as the prover explicitly establishes. This calculation supports the stronger dependence on \(\sqrt S\).

The feedback inequality uses exactly the conditional regret specified in the task. The identity
\(\langle\bar w_{I_r},\Delta^r_{I_r}\rangle=\langle\bar w,g^r\rangle+\bar\zeta_r\)
holds in both branches: the full branch retains every changing coordinate, while the restricted branch omits precisely \(I_r\setminus J_r\). No nonnegativity assumption on \(\bar\zeta_r\) is introduced.

The update vectors telescope to \(v^{H+1}\). Cauchy–Schwarz supplies the required upper bound on \(\langle\bar w,v^{H+1}\rangle\), regardless of its sign. The residual sum is retained unchanged throughout. Division by \(\alpha H\) is legitimate because \(\alpha>0\) and \(H\ge1\).

Coverage of \([m]\), with \(m\ge1\), implies \(S\ge1\). Hence \(\sqrt S\le S\). Because the remaining coefficient is nonnegative, this substitution weakens the stronger bound in the correct direction.

Scope, edge cases, and feedback

The argument covers \(H=1\), \(D=0\), \(\bar w=0\), arbitrary part selections, unrestricted weight signs, and signed residuals. It requires no scheduling or probabilistic assumptions.

The reference to the supplied theorem is corroborative: the proof establishes the result directly rather than depending on an unstated theorem application. Its requested bound agrees with [Theorem 1 of the cited source](https://arxiv.org/pdf/1711.08247).

No repair or additional clarification is needed. The output proves a regret guarantee and makes no running-time claim. Consequently, it does not classify the continuous problem’s computational complexity; the JSON below records that distinction without weakening the mathematical verdict.

⟨structured verdict parsed — rendered above⟩

Tier: machine-proved, adversarially reviewed by an independent model. No human has checked this proof. Generated from pipeline artifacts by tools/atlas_build.py.