LBIT Proofs 5: Propositions 29-38

We're going to need to go out of order here a bit and do Proposition 31 before doing Propositions 29 and 30. Please have patience.

Proposition 31: All five characterizations of the pullback define the same infradistribution.

So, the two requirements of being able to do a pullback $g^{*} (h)$ are that: $h$ has $g (X)$ as a support, and $g$ is a proper function (preimage of a compact set is compact). And our five characterizations are:

1: For sets,

$g^{*} (H) := (g_{*})^{- 1} (H)$

ie, take the preimage of $H$ w.r.t. the linear operator that $g$ induces from $M^{a} (X) \to M^{a} (Y)$ .

2: For concave functionals, $g^{*} (h)$ is the concave monotone hull of the partial function $f \circ g \mapsto h (f)$ .

3: For concave functionals, $g^{*} (h)$ is the monotone hull of the partial function $f \circ g \mapsto h (f)$ , ie:

$g^{*} (h) (f) := {sup}_{f^{*} : f^{*} \circ g \leq f} h (f^{*})$

4: For concave functionals,

$g^{*} (h) = inf {h^{'} | h^{'} \in □ X, g_{*} (h^{'}) = h}$

take the inf of all infradistributions that could have made your infradistribution of interest via pushforward.

5: For sets, take the closed convex hull of all infradistribution sets which project down to be equivalent to $H$ .

The proof path proof path will be first establishing that 3 makes an infradistribution, then showing that 3 and 2 are equivalent, then showing that 2 and 4 are equivalent, then showing that 4 and 5 are equivalent. And now that 2, 3, 4, and 5 are in an equivalence class, we wrap up by showing that 2 implies 1 and 1 implies 5.

First up: Establishing that 3 makes an infradistribution, which is where the bulk of the work is.

Starting with normalization:

$g^{*} (h) (1) := {sup}_{f^{*} : f^{*} \circ g \leq 1} h (f^{*})$

And clearly, this supremum is attained by $f^{*} = 1$ , it can be no higher, by normalization, so we have $h (1) = 1$ and thus one part of normalization. For the other half of normalization,

$g^{*} (h) (0) = {sup}_{f^{*} : f^{*} \circ g \leq 0} h (f^{*})$

Now, in order for $f^{*} \circ g \leq 0$ to be the case, all we need is that $f^{*}$ be 0 on $g (X)$ . However, since $g (X)$ is assumed to be a support for $h$ , all functions like this must have $h (f^{*}) = h (0) = 0$ and we have the other part of normalization.

Monotonicity: This is immediate because if $f^{'} \geq f$ , then the supremum for $f^{'}$ has more options and can attain a higher value.

Concavity:

$p g^{*} (h) (f) + (1 - p) g^{*} (h) (f^{'}) = p {sup}_{f^{*} : f^{*} \circ g \leq 1} h (f^{*}) + (1 - p) {sup}_{f^{^{'} *} : f^{^{'} *} \circ g \leq 1} h (f^{^{'} *})$

And we can pick some $f^{*}$ and $f^{^{'} *}$ which very nearly attain the relevant values, as close as you wish, to go:

$≃ p h (f^{*}) + (1 - p) h (f^{^{'} *}) \leq h (p f^{*} + (1 - p) f^{^{'} *})$

And then,

$(p f^{*} + (1 - p) f^{^{'} *}) \circ g = p (f^{*} \circ g) + (1 - p) (f^{^{'} *} \circ g) \leq p f + (1 - p) f^{'}$

So, with that, we can go:

$\leq {sup}_{f^{*} : f^{*} \circ g \leq p f + (1 - p) f^{'}} h (f^{*}) = g^{*} (h) (p f + (1 - p) f^{'})$

And we're done with concavity.

For Lipschitzness, the proof will work as follows. We'll take two functions $f$ and $f^{'}$ , and show that $g^{*} (h) (f^{'}) \geq g^{*} (h) (f) - λ^{⊙} d (f, f^{'})$ in a way that generalizes to symmetrically show that $g^{*} (h) (f) \geq g^{*} (h) (f^{'}) - λ^{⊙} d (f, f^{'})$ to get our result that

$| g^{*} (h) (f) - g^{*} (h) (f^{'}) | \leq λ^{⊙} d (f, f^{'})$

where $λ^{⊙}$ is the Lipschitz constant of $h$ .

So, let's show

$g^{*} (h) (f^{'}) \geq g^{*} (h) (f) - λ^{⊙} d (f, f^{'})$

What we can do is, because

$g^{*} (h) (f) = {sup}_{f^{*} : f^{*} \circ g \leq f} h (f^{*})$

then we can consider this value to be approximately obtained by some specific function $f^{*}$ . Then,

$g^{*} (h) (f^{'}) \geq g^{*} (h) (inf (f, f^{'})) \geq g^{*} (h) (f - d (f, f^{'})) \geq h (f^{*} - d (f, f^{'}))$

$\geq h (f^{*}) - λ^{⊙} d (f, f^{'}) ≃ g^{*} (h) (f) - λ^{⊙} d (f, f^{'})$

The first two inequalities are from monotonicity. The third inequality is because $(f^{*} - d (f, f^{'})) \circ g \leq f - d (f, f^{'}))$ , where $f^{*}$ is our special function from a bit earlier, because $f^{*} \circ g \leq f$ . So, it isn't necessarily the supremum and doesn't attain maximum value. Then, there's just Lipschitzness of $h$ , and $h (f^{*})$ being approximately $g^{*} (h) (f)$ . And we're done with Lipschitzness, just swap $f$ and $f^{'}$ and use earlier arguments.

Before proceeding further, note the following information: Polish spaces are first-countable and Hausdorff so they're compactly generated, and Wikipedia says any proper map to a compactly generated space is closed (maps closed sets to closed sets). So, $g (X)$ is a closed set.

Now just leaves compact almost-support. Fix an $ϵ$ , and take a compact $ϵ$ -almost-support of $h$ , $C_{ϵ} \subseteq Y$ . Intersect with $g (X)$ if you haven't already, it still makes a compact set and it keeps being an $ϵ$ -almost-support. We will show that $g^{- 1} (C_{ϵ})$ , which is compact because we assumed our map was proper, is an $ϵ$ -almost-support of $g^{*} (h)$ .

This proof will proceed by showing that, if $f, f^{'}$ agree on $g^{- 1} (C_{ϵ})$ , then $g^{*} (h) (f) - ϵ d (f, f^{'}) \leq g^{*} (h) (f^{'})$ . Symmetrical arguments work by swapping $f$ and $f^{'}$ , showing that the two expectation values are only $ϵ d (f, f^{'})$ apart.

As usual, we have

$g^{*} (h) (f) ≃ h (f^{*})$

Where $f^{*}$ very nearly attains the supremum, and we know that $f^{*} \circ g \leq f$ .

Let the function $Θ : g (X) \to P (R)$ (a set-valued function) be defined as:

If $y \in C_{ϵ}$ , then $Θ (y) = f^{*} (y)$

If $y \notin C_{ϵ}$ , then

$Θ (y) := [f^{*} (y) - d (f, f^{'}), inf ({min}_{x \in g^{- 1} (y)} f^{'} (x), f^{*} (y) + d (f, f^{'}))]$

These sets are always concave, and also always nonempty, because, in the second case, the only way it could be nonempty is if

${min}_{x \in g^{- 1} (y)} f^{'} (x) < f^{*} (y) - d (f, f^{'})$

Now, g being a proper map, the preimage of the single point $y$ is a compact set, so we can actually minimize our function, pick out our particular $x$ that maps to $y$ . Then, we know:

$f^{'} (x) + d (f, f^{'}) \geq f (x) \geq f^{*} (g (x)) = f^{*} (y)$

The second inequality is because $f \geq f^{*} \circ g$ by assumption. Shuffling this around a bit, we have:

$f^{'} (x) \geq f^{*} (y) - d (f, f^{'})$

where our $x$ is minimizing, which is incompatible with nonemptiness.

So, we've got convexity and nonemptiness. Let's shower lower-hemicontinuity.

As a warmup for that, we'll need to show that the function $y \mapsto {min}_{x \in g^{- 1} (y)} f^{'} (x)$
Is lower-semicontinuous.

So, our proof goal is: if $y_{n}$ limits to $y$ , then

${liminf}_{n \to \infty} {min}_{x \in g^{- 1} (y_{n})} f^{'} (x) \geq {min}_{x \in g^{- 1} (y)} f^{'} (x)$

And we know that all our $y_{n}$ and $y$ itself, lie in $g (X)$ .

At this point, here's what we do. Isolate the subsequence of points we're using to attain the $liminf$ . This sequence of points $y_{n}$ (when unioned with $y$ itself) is compact in $Y$ , so its preimage in $X$ is compact. And you can minimize functions over compact sets. So, for each $y_{n}$ , pick a point $x_{n} \in g^{- 1} (y_{n})$ that minimizes $f^{'}$ . Our sequence of points $x_{n}$ is roaming around in a compact set, so we can pick a convergent subsequence. At this point, let's start indexing with $m$ . Said limit point $x$ must have $f^{'} (x) = {lim}_{m \to \infty} f^{'} (x_{m})$ by continuity for $f^{'}$ , and $g (x) = y$ by continuity for $g$ (all the $x_{m}$ get mapped to $y_{m}$ , so the limit point $x$ must go to the limit point $y$ ) Putting it all together,

${liminf}_{n \to \infty} {min}_{x \in g^{- 1} (y_{n})} f^{'} (x) = {lim}_{m \to \infty} f^{'} (x_{m}) = f^{'} (x) \geq {inf}_{x \in g^{- 1} (y)} f^{'} (x)$

And so we have that, if $y_{n}$ limits to $y$ , then

${liminf}_{n \to \infty} {min}_{x \in g^{- 1} (y_{n})} f^{'} (x) \geq {min}_{x \in g^{- 1} (y)} f^{'} (x)$

And $y \mapsto {min}_{x \in g^{- 1} (y)} f^{'} (x)$ is lower-semicontinuous over $g (X)$ .

At this point, we'll try to show that the set-valued function $Θ$ is lower-hemicontinuous over $g (X)$ . We'll use z to denote numbers in $R$ .

The criterion for lower-hemicontinuity of $Θ$ is: If $y_{n}$ limits to $y$ , and $z \in Θ (y)$ , then there's a subsequence $y_{m}$ and points $z_{m} \in Θ (y_{m})$ where ${lim}_{m \to \infty} z_{m} = z$

To show this, we'll divide into three cases. In our first case, only finitely many of the $y_{n}$ are in $C_{ϵ}$ . Let's pass to a subsequence where we remove all the $y_{n}$ that lie in $C_{ϵ}$ , and where ${min}_{x \in g^{- 1} (y_{m})} f^{'} (x)$ converges to a value. Let

$z_{m} := sup (inf (z, {min}_{x \in g^{- 1} (y_{m})} f^{'} (x), f^{*} (y_{m}) + d (f, f^{'})), f^{*} (y_{m}) - d (f, f^{'}))$

Then,

$z = sup (inf (z, {min}_{x \in g^{- 1} (y)} f^{'} (x), f^{*} (y) + d (f, f^{'})), f^{*} (y) - d (f, f^{'}))$

$= sup (inf (z, {lim}_{m \to \infty} {min}_{x \in g^{- 1} (y_{m})} f^{'} (x), {lim}_{m \to \infty} f^{*} (y_{m}) + d (f, f^{'}))), {lim}_{m \to \infty} f^{*} (y_{m}) - d (f, f^{'}))$

$= sup ({lim}_{m \to \infty} inf (z, {min}_{x \in g^{- 1} (y_{m})} f^{'} (x), f^{*} (y_{m}) + d (f, f^{'})), {lim}_{m \to \infty} f^{*} (y_{m}) - d (f, f^{'}))$

$= {lim}_{m \to \infty} sup (inf (z, {min}_{x \in g^{- 1} (y_{m})} f^{'} (x), f^{*} (y_{m}) + d (f, f^{'})), f^{*} (y_{m}) - d (f, f^{'})) = {lim}_{m \to \infty} z_{m}$

This was because all these sequences have their corresponding values converge, whether by continuity or assumption. So, this takes care of lower-hemicontinuity in one case.

Now for our second case, where only finitely may of the $y_{n}$ aren't in $C_{ϵ}$ . Pass to a subsequence where they are all removed, and where ${min}_{x \in g^{- 1} (y_{m})} f^{'} (x)$ converges to a value. Accordingly, all our $y_{m}$ lie in $C_{ϵ}$ . Let $z_{m} = f^{*} (y_{m})$ . Then

${lim}_{m \to \infty} z_{m} = {lim}_{m \to \infty} f^{*} (y_{m}) = f^{*} (y) = z$

Our third case is the trickiest, where there are infinitely many $y_{n}$ in $C_{ϵ}$ , and infinitely many outside that set, and accordingly, $y \in C_{ϵ}$ Let's pass to a subsequence where we remove all the $y_{n}$ that lie in $C_{ϵ}$ and where ${min}_{x \in g^{- 1} (y_{m})} f^{'} (x)$ converges to a value. We would be able to apply the proof from the first case if we knew that

$f^{*} (y) \in [f^{*} (y) - d (f, f^{'}), inf ({min}_{x \in g^{- 1} (y)} f^{'} (x), f^{*} (y) + d (f, f^{'}))]$

Obviously, we have $f^{*} (y) \geq f^{*} (y) - d (f, f^{'})$ , but we still need to show that

$f^{*} (y) \leq {min}_{x \in g^{- 1} (y)} f^{'} (x)$

and

$f^{*} (y) \leq f^{*} (y) + d (f, f^{'})$

The second one can be addressed trivially, so now we just have to show that

$f^{*} (y) \leq {min}_{x \in g^{- 1} (y)} f^{'} (x)$

Pick some minimizing $x$ , where $g (x) = y$ , and remember that this $y$ lies in $C_{ϵ}$ , so $x \in g^{- 1} (C_{ϵ})$ , the compact set where $f = f^{'}$ . Now we can just go:

$f^{*} (y) = f^{*} (g (x)) \leq f (x) = f^{'} (x)$

And we're done. That's the last piece we need to know that $Θ$ is lower-hemicontinuous.

Now we will invoke the Michael selection theorem, which gets us a continuous selection $f^{*^{'}} : Y \to R$ (bounded because $f$ and $f^{'}$ are) where, for all $y$ , $f^{*^{'}} (y) \in Θ (y)$ .

The conditions to invoke the Michael selection theorem are that $F$ is lower-hemicontinuous (check), that $Y$ is paracompact, and that $R$ is a Banach space (check). Fortunately, any metrizable space is paracompact, and Polish spaces are metrizable, so we can invoke the theorem and get our continuous $f^{*^{'}}$ .

Note two important things about this continuous $f^{*^{'}}$ we just constructed. First, it perfectly matches $f^{*}$ over $C_{ϵ}$ . Second, for all $x$ in $g (X)$ (remember, that's the space it's defined over)

$(f^{*^{'}} \circ g) (x) = f^{*^{'}} (g (x)) \leq {min}_{x^{'} \in g^{- 1} (g (x))} f^{'} (x^{'}) \leq f^{'} (x)$

Because of that worst-case bound thing being one of the upper bounds on $Θ (y)$ . Also, over $g (X)$ , it remains within $d (f, f^{'})$ of $f^{*}$ , again, because of the imposed bounds.

We can use the Tietze extension theorem to extend $f^{*^{'}}$ to all of $X$ while staying within $d (f, f^{'})$ of $f^{*}$ .

At this point, we can return to where we started out in this section, and go:

$g^{*} (h) (f) - ϵ d (f, f^{'}) = {sup}_{f^{*} : f^{*} \circ g \leq f} h (f^{*}) - ϵ d (f, f^{'}) ≃ h (f^{*}) - ϵ d (f, f^{'})$

$\leq (h (f^{^{'} *}) + ϵ d (f, f^{'})) - ϵ d (f, f^{'}) = h (f^{^{'} *})$

$\leq {sup}_{f^{^{'} *} : f^{^{'} *} \circ g \leq f^{'}} h (f^{^{'} *}) = g^{*} (h) (f^{'})$

The first equality was the definition of the preimage, the approximate equality was because $f^{*}$ is very very near attaining the true supremum, the $\leq$ is because $f^{^{'} *}$ and $f$ agree on $C_{ϵ}$ which is an $ϵ$ -almost-support for $h$ , the next inequality after that is because we just showered that $f^{*^{'}} \circ g \leq f^{'}$ , and then packing up the definition of preimage.

Perfectly symmetric arguments work when you swap $f^{'}$ and $f$ , yielding our net result that

$| g^{*} (h) (f) - g^{*} (h) (f^{'}) | \leq ϵ d (f, f^{'})$

And $f, f^{'}$ were selected to be arbitrary continuous functions that agree on $g^{- 1} (C_{ϵ})$ , which is compact, so we have a compact $ϵ$ -almost-support, so $g^{*} (h)$ has compact almost-support and is an infradistribution.

Ok, so we're done, we've defined a pullback, it's the monotone hull of the function $h$ under precomposition with $g$ , and this was definition 3. Now it's time to start showing equivalences.

First, the equality of definitions 2 and 3. The concave monotone hull of the partially defined pullback must be $\geq$ than the monotone hull of the partially defined pullback, because we're imposing an additional condition, there are less functions that fit the bill. But, we've showed that the monotone hull is concave, so it's actually an equality.

Now for the equality of of 2 and 4, that the concave monotone hull of the pullback is the same as the inf of all infradistributions that produce $h$ when pushfoward is applied.

We know that the concave monotone hull is indeed an infradistribution, and

$g_{*} (g^{*} (h)) (f) = g^{*} (h) (f \circ g) = {sup}_{f^{*} : f^{*} \circ g \leq f \circ g} h (f^{*}) = h (f)$

So, since its projection forward matches $h$ perfectly, we have

$g^{*} (h) \geq inf {h^{'} \in □ X | g_{*} (h^{'}) = h}$

For actual equality, we note that, if $g_{*} (h^{'}) = h$ , then

$h^{'} (f \circ g) = g_{*} (h^{'}) (f) = h (f)$

And since $g^{*} (h)$ is the concave monotone hull of the partial function $f \circ g \mapsto h (f)$ , and the concave monotone hull is the least concave monotone function compatible with said partial function, and any $h^{'}$ which pushes forward to map to $h$ must be concave and monotone and match this partial function, all the $h^{'}$ we're inf-ing together lie above $g^{*} (h)$ , so we have actual equality and

$g^{*} (h) = inf {h^{'} | g_{*} (h^{'}) = h}$

So, at this point, definitions 2, 3, and 4 of the concave hull are equal.

Now for equality of definitions 4 and 5. Taking the inf of infradistributions on the concave functional level is the same as unioning together all the infradistribution sets, and taking the closed concave hull (because that doesn't affect the expectation values), so "inf of infradistributions that pushfoward to make $h$ ", on the concave functional side of LF-duality, is the same as "closed concave hull and upper completion of infradistributions which pushforward to make $H$ " on the set side of LF-duality.

Now that we know definitions 2-5 of the pullback are all equal, and using $h_{3}, h_{1}, h_{5}$ for the expectation functionals corresponding to definitions 3, 1, and 5 of the pullback, we'll show $h_{5} \geq h_{1} \geq h_{3}$ , so $h_{1}$ , ie, the first definition of the pullback, must be equal to the rest.

First, $h_{1}$ is the functional corresponding to the set:

$g^{*} (H) := (g_{*})^{- 1} (H)$

Where $g_{*}$ in this case is the function of type signature $M^{a} (X) \to M^{a} (Y)$ given by keeping the $b$ term the same and pushing forward the signed measure component via the function $g$ . Note that said pushfoward can actually only make points in $M^{a} (g (X))$ , the measures can only be supported over that set.

We'll show that

$E_{g^{*} (H)} : C_{B} (X) \to R$

is monotone and that

$E_{g^{*} (H)} (f \circ g) = E_{H} (f)$

To begin with, for monotonicity, if $f^{'} \geq f$ , then

$E_{g^{*} (H)} (f^{'}) = {inf}_{(m, b) \in (g_{*})^{- 1} (H)} m (f^{'}) + b$

$\geq {inf}_{(m, b) \in (g_{*})^{- 1} (H)} m (f) + b$

$= E_{g^{*} (H)} (f)$

This is easy because our set is entirely of a-measures. So the corresponding $h_{1}$ is monotone.

Now, at this point, we can go:

$E_{g^{*} (H)} (f \circ g) = {inf}_{(m, b) \in (g_{*})^{- 1} (H)} m (f \circ g) + b$

$= {inf}_{(m, b) : (g_{*} (m), b) \in H} m (f \circ g) + b$

The next line is because $g_{*} (m) (f)$ (the continuous pushfoward of a measure, evaluated via $f$ ) is the same as $m (f \circ g)$ (old measure evaluating $f \circ g$ )

$= {inf}_{(m, b) : (g_{*} (m), b) \in H} g_{*} (m) (f) + b$

The next line is a bit tricky, because pushforward seems like it may only net some of the points in H. However, any measure supported over $g (X)$ has a measure over $X$ that, when pushfoward is applied, produces it. Just take each point $y \in g (X)$ , craft a Markov Kernel from $g (X)$ to $X$ that maps all $y \in g (X)$ to a probability distribution supported over $g^{- 1} (y)$ , take the semidirect product of your measure over $g (X)$ and your kernel, and project to $X$ to get such a measure. So, said pushfoward surjects onto $H$ , and we can get:

$= {inf}_{(m^{'}, b^{'}) \in H} m^{'} (f) + b^{'} = E_{H} (f)$

So, now that we've shown that

$E_{g^{*} (H)} : C_{B} (X) \to R$

is monotone and that

$E_{g^{*} (H)} (f \circ g) = E_{H} (f)$

We know that the corresponding functional $h_{1}$ has the property that it's monotone and $h_{1} (f \circ g) = h (f)$ . Thus, it must lie above the monontone hull of $f \circ g \mapsto h (f)$ , which is just $h_{3}$ (third definition of the pullback) and we have: $h_{1} \geq h_{3}$ .

Now for the other direction, showing that $h_{5} \geq h_{1}$ . The fifth definition of the pullback was the closed convex hull (and upper completion) of all the infradistributions which project to $H$ . So, if we can show that any infradistribution set $H^{'}$ which projects into $H$ must have its minimal points lie in $g^{*} (H)$ , we'll have that all infradistribution which project to $H$ are a subset of $g^{*} (H)$ , and thus is higher in the ordering on functionals, $h_{5} \geq h_{1}$ .

This is trivial by $g^{*} (H)$ just being a preimage, so any set which pushforwards into the set of interest must be a subset of the preimage.

And we have our desired result that any infradistribution set which projects into $H$ must be a subset of $g^{*} (H)$ (all minimal points are present in it), and higher in the information ordering, so the inf of all of them, ie, the functional $h_{5}$ , must lie above the corresponding functional $h_{1}$ .

So, we have $h_{5} \geq h_{1} \geq h_{3} = h_{5}$ and so $h_{1}$ equals all of them, and the restricted preimage of H is another formulation of the pullback, and we're done.

Proposition 29: The pullback of an infradistribution is an infradistribution, and it preserves all properties indicated in the table for this section.

So, we know from the proof of Proposition 31 that the pullback of an infradistribution is an infradistribution. Now, to show preservation of properties, we'll work with the formulation of the pullback as:

$g^{*} (H) = (g_{*})^{- 1} (H)$

For homogenity, 1-Lipschitzness, cohomogenity, C-additivity, and crispness, they are all characterized by all minimal points having certain properties of their $λ$ and $b$ values. All minimal points of $g^{*} (H)$ must pushforward to minimal points of $H$ (otherwise the $b$ term of your original minimal point could be strictly decreased and it'd still pushforward into $H$ ), which have the property of interest, and because pushforward $g_{*}$ preserves the $λ$ and $b$ values of a-measures, we know that all minimal points of $g^{*} (H)$ have the same property on their $λ$ and $b$ , so all these properties are preserved under pullback.

Sharpness takes a slightly more detailed argument. Let's say that $H$ is sharp, ie, its minimal points consist entirely of the probability distributions on $C$ . We know from crispness preservation that $g^{*} (H)$ has its minimal points consist entirely of probability distributions. If there was a probability distribution that wasn't supported on $g^{- 1} (C)$ (preimage of $C$ , which, by the assumed properness of $g$ , is compact), that was present as a minimal point, then it would pushfoward to make a minimal point in $H$ that was a probability distribution that had some measure outside of $C$ , which is impossible. Further, any probability distribution that is supported on $g^{- 1} (C)$ would pushfoward to make a probability distribution supported on $C$ , which would be a minimal point of $H$ , so said point must be minimal in $g^{*} (H)$ . Thus, the minimal points of $g^{*} (H)$ consist entirely of probability distributions supported on $g^{- 1} (C)$ , so $g^{*} (h)$ is sharp, and all nice properties are therefore preserved.

Proposition 30: Pullback then pushforward is identity, $g_{*} (g^{*} (h)) = h$ , and pushforward then pullback is below identity, $g^{*} (g_{*} (h)) \leq h$

The first part is easy to show,

$g_{*} (g^{*} (h)) (f) = g^{*} (h) (f \circ g) = {sup}_{f^{*} : f^{*} \circ g \leq f \circ g} h (f^{*}) = h (f)$

Yielding pullback then pushforward being identity. For the reverse direction, we use Proposition 31, in particular the part about the pullback being the least infradistribution that pushes forward to produce the target. And we have $g_{*} (g^{*} (g_{*} (h))) = g_{*} (h)$ , therefore $g^{*} (g_{*} (h))) \leq h$

Proposition 32: The free product of two infradistributions exists and is an infradistribution iff:
1: There are points $(λ μ, 0) \in H_{1}^{min}$ and $(λ^{'} μ^{'}, 0) \in H_{2}^{min}$ where $λ = λ^{'}$
2: There are points $(λ μ, b) \in H_{1}^{min}$ and $(λ^{'} μ^{'}, b^{'}) \in H_{2}^{min}$ where $λ = λ^{'}$ , and $b = b^{'}$ , and $λ + b = 1$ .

So, to show this, what we'll be doing is using our set-form characterization of the pullback as a preimage and the supremum as an intersection. We already know that, from proposition 14, a necessary condition for the intersection of infradistributions being an infradistribution is normalization, ie, on the set level, the presence of a point with $b = 0$ and a point with $λ + b = 1$ . The presence of a point with $b = 0$ in the intersection of the preimages would pushforward to make a $b = 0$ point in $H_{1}$ and $H_{2}$ , respectively, with equal $λ$ values, fulfilling condition 1.

Also, the presence of a point with $λ + b = 1$ in the intersection of the preimages would pushforward to make a $λ + b = 1$ minimal point in $H_{1}$ and $H_{2}$ respectively, with equal $λ$ values and $b$ values, fufilling condition 2.

Thus, if the free product exists and is an infradistribution, the two properties are fulfilled. That just leaves the reverse direction of establishing that the free product exists and is an infradistribution if both properties are fulfilled.

We'll be handling the set conditions on an infradistribution. For nonemptiness and normalization, observe that if condition 1 is fulfilled, you can make the a-measure $(λ (μ \times μ^{'}), 0)$ which projects down to $(λ μ, 0)$ and $(λ μ^{'}, 0)$ , so it's present in the intersection of the preimages of $H_{1}$ and $H_{2}$ under the projection mappings. This witnesses nonemptiness and one half of normalization.

For the second half of normalization, any point with $λ + b < 1$ would project down to make a point outside of $H_{1}$ and $H_{2}$ , so it can't exist. Further, if condition 2 is fulfilled, you can make the a-measure $(λ (μ \times μ^{'}), b)$ , with $λ + b = 1$ , and it projects down to $(λ μ, b)$ and $(λ μ^{'}, b)$ in $H_{1}$ and $H_{2}$ respectively, witnessing that it's present in the free product, and witnessing that the other half of normalization works out.

For closure and convexity and upper-completeness, the intersection of two closed convex upper-complete sets (the pullback of closed convex upper-complete sets along a continuous linear mapping that preserves the $b$ term) is closed-convex upper-complete, so that works out.

That leaves the compact-projection property, which is the only one where we may have issues. Remember, the necessary-and-sufficient conditions for compactness of a set of measures are: bounded $λ$ value, and, for all $ϵ$ , there's a compact subset of $X \times Y$ where all the measure components of the points have all but $ϵ$ measure on said set.

Any point in the intersection of preimages with the measure component having a $λ$ value above the minimum of the two $λ_{1}^{⊙}$ and $λ_{2}^{⊙}$ values (maximum amount of measure present in points in $H_{1}$ and $H_{2}$ respectively) would project down to not be in $H_{1}$ or $H_{2}$ , respectively, so those are ruled out, and we've got a bound on the amount of measure present.

As for an $ϵ$ -almost-support for all the measure components in $H_{1} * H_{2}$ , what you do is find a $C_{\frac{ϵ}{2}}^{X}$ compact $\frac{ϵ}{2}$ -almost-support for $H_{1}$ and a $C_{\frac{ϵ}{2}}^{Y}$ compact $\frac{ϵ}{2}$ -almost-support for $H_{2}$ , and consider $C_{\frac{ϵ}{2}}^{X} \times C_{\frac{ϵ}{2}}^{Y}$

We claim this is a compact (product of compact sets) $ϵ$ -almost-support for all measure components in $H_{1} * H_{2}$ .

This is because any measure component in $H_{1} * H_{2}$ must project down to be a measure component of $H_{1}$ and a measure component of $H_{2}$ . So, if there was more than $ϵ$ measure outside

$C_{\frac{ϵ}{2}}^{X} \times C_{\frac{ϵ}{2}}^{Y}$

then it would project down to either $H_{1}$ or $H_{2}$ and have more than $\frac{ϵ}{2}$ measure outside of the two compact sets, which is impossible by the projection landing in $H_{1}$ (or $H_{2}$ ) and the two compact sets being $\frac{ϵ}{2}$ -almost-supports for $H_{1}$ and $H_{2}$ respectively.

For any $ϵ$ we can make a compact subset of $X \times Y$ that accounts for all but $ϵ$ of the measure present of a measure in $H_{1} * H_{2}$ , so it's got the compact-projection property, which is the last thing we need to certify it's an infradistribution.

Proposition 33: Having (homogenity or 1-Lipschitzness) present on both of the component infradistributions is a sufficient condition to guarantee the existence of the free product.

From Proposition 32, all we need to do is to verify properties 1 and 2, ie
1: There are points $(λ μ, 0) \in H_{1}^{min}$ and $(λ^{'} μ^{'}, 0) \in H_{2}^{min}$ where $λ = λ^{'}$
2: There are points $(λ μ, b) \in H_{1}^{min}$ and $(λ^{'} μ^{'}, b^{'}) \in H_{2}^{min}$ where $λ = λ^{'}$ , and $b = b^{'}$ , and $λ + b = 1$ .

Given only that (without loss of generality) $H_{1}$ is 1-Lipschitz or homogenous, and same for $H_{2}$ , we'll show properties 1 and 2.

The trick to this is showing that 1-Lipschitzness and homogenity both imply that an infradistribution contains some point with $λ = 1$ and $b = 0$ , and if both infradistributions fulfill that, then conditions 1 and 2 are fulfilled for free, as can be verified with inspection.

So, let's show that 1-Lipschitzness and homogenity imply there's a point with $λ = 1$ and $b = 0$ . For 1-Lipschitzness, $λ \leq 1$ , and since there must be a point with $b = 0$ by normalization, and all points have $λ + b \geq 1$ by normalization, said point must have $λ = 1$ . As for homogenity, all minimal points have $b = 0$ , and normalization says there's a point with $λ + b = 1$ , getting that there's a point with $λ = 1, b = 0$ . So, we're done.

Proposition 34: $p r_{X *} (h_{1} * h_{2}) \geq h_{1}$ and $p r_{Y *} (h_{1} * h_{2}) \geq h_{2}$ , with equality when $h_{1}$ and $h_{2}$ are C-additive.

$p r_{X *} (h_{1} * h_{2}) = p r_{X *} (sup (p r_{X}^{*} (h_{1}), p r_{Y}^{*} (h_{2}))) \geq p r_{X *} (p r_{X}^{*} (h_{1})) = h_{1}$

And same for $h_{2}$ . For equality in the C-additive case, we need to show that every point in $H_{1}$ has some point in $H_{1} * H_{2}$ which surjects onto it. Remember, C-additivity is "all minimal points have $λ = 1$ ", which, by our notion of upper-completion, is equivalent to all measure components in the set just being ordinary probability distributions.

The existence of minimal points with $b = 0$ means that, given any point $(μ, b) \in H_{1}$ , you can find a point with the same $b$ value in $H_{2}$ , call it $(μ^{'}, b) \in H_{2}$ , and then $(μ \times μ^{'}, b) \in H_{1} * H_{2}$ because it projects down into both sets, showing that $H_{1} * H_{2}$ surjects onto $H_{1}$ when projected down and so must have equal expectation value. Same for $H_{2}$ .

Proposition 35: Free product is commutative and associative.

This is because supremum is commutative (order doesn't matter) and associative (parentheses don't matter), because on the set level it's just intersection, which is order-and-grouping agnostic.

Proposition 36: The free product of countably many infradistributions exists and is an infradistribution iff:
1: There are points $(λ_{i} μ_{i}, 0) \in H_{i}^{min}$ where, $\forall i, i^{'} \in I : λ_{i} = λ_{i^{'}}$
2: There are points $(λ_{i} μ_{i}, b_{i}) \in H_{i}^{min}$ where $\forall i, i^{'} \in I : λ_{i} = λ_{i^{'}} \land b_{i} = b_{i^{'}} \land λ_{i} + b_{i} = 1$

We recap the proof of Proposition 32. The presence of a point with $b = 0$ or $λ + b = 1$ in a hypothetical infinite free product must project down into all the $H_{i}$ , and cause the fulfillment of conditions 1 and 2.

For the set conditions on an infradistribution, for nonemptiness and normalization, observe that if condition 1 is fulfilled, you can make the a-measure $(λ \prod_{i} μ_{i}, 0)$ which is present in the intersection of all the a-measure pullbacks. This witnesses nonemptiness and one half of normalization.

For the second half of normalization, any point with $λ + b < 1$ would project down to make a point outside of all the $H_{i}$ so it can't exist. Further, if condition 2 is fulfilled, you can make the a-measure $(λ \prod_{i} μ_{i}, b)$ , with $λ + b = 1$ , and it is present in the intersection of all the a-measure pullbacks, witnessing that the other half of normalization works out.

For closure and convexity and upper-completeness, the intersection of closed convex upper-complete sets (the pullback of closed convex upper-complete sets along a continuous linear mapping that preserves the $b$ term) is closed-convex upper-complete, so that works out.

That leaves the compact-projection property, which is the only one where we may have issues. For Lipschitzness, we remember that any point in the intersection of preimages with the measure component having a $λ$ value above ${min}_{i} λ_{i}^{⊙}$ has some $H_{i}$ that it can't project down into, so we get a contradiction, and we've got a bound on the amount of measure present.

As for an $ϵ$ -almost-support for all the measure components, you biject your $H_{i}$ with the natural numbers, and find a compact set $C_{\frac{ϵ}{2^{n + 1}}}^{X_{n}}$ which is a $\frac{ϵ}{2^{n + 1}}$ -almost-support for $H_{n}$ and take the product of them. It's compact by Tychonoff, and because each speck of measure of the measure component of a point in the infinite free product that doesn't land in this set projects down to be outside of one of the $C_{\frac{ϵ}{2^{n + 1}}}^{X_{n}}$ sets, the total amount of measure outside this set is upper-bounded by:

$\sum_{n = 0}^{\infty} \frac{ϵ}{2^{n + 1}} = ϵ$

So it's a compact $ϵ$ -almost-support for the measure components of all a-measures in the infinite free product, and this can work for any $ϵ$ , so the infinite free product fulfills the compact almost-support property and has compact projection, which is the last condition we needed.

Proposition 37: $p r_{(X_{j}) *} (*_{i} (h_{i})) \geq h_{j}$ , with equality when all the $h_{i}$ are C-additive.

$p r_{(X_{j}) *} (*_{i} (h_{i})) = p r_{(X_{j}) *} ({sup}_{i} (p r_{X_{i}}^{*} (h_{i}))) \geq p r_{(X_{j}) *} (p r_{X_{j}}^{*} (h_{j})) = h_{j}$

For equality in the C-additive case, we need to show that every point in $H_{j}$ has some point in $*_{i} H_{i}$ which surjects onto it. Remember, C-additivity is "all minimal points have $λ = 1$ ", which, by our notion of upper-completion, is equivalent to all measure components in the set just being ordinary probability distributions.

The existence of minimal points with $b = 0$ means that, given any point $(μ_{j}, b) \in H_{j}$ , you can find a point with the same $b$ value in $H_{i}$ (regardless of $i$ ), call it $(μ_{i}, b) \in H_{i}$ , and then $(\prod_{i} μ_{i}, b) \in *_{i} H_{i}$ because it projects down into all sets, showing that $*_{i} H_{i}$ surjects onto $H_{j}$ when projected down and so must have equal expectation value.

Proposition 38: Ultradistributions $H$ are isomorphic to convex, monotone, normalized, Lipschitz, CAS, functions $h : C_{B} (X) \to R$ .

We'll be going over the proof of Theorem 1 again, but with some stuff swapped around.

Our first order of business is establishing the isomorphism. Our first direction is $H$ to $h$ and back is $H$ exactly. By lower completion, and reproved analogues of Proposition 2 and Theorem 1 from "Basic inframeasure theory", which an interested party can reprove if they want to see it, we can characterize $H$ as

${(m, b) | \forall f \in C_{B} (X) : m (f) + b \leq {sup}_{(m^{'}, b^{'}) \in H} (m^{'} (f) + b^{'})}$

And then, our $H$ can further be reexpressed as

${(m, b) | \forall f \in C_{B} (X) : m (f) + b \leq E_{H} (f)}$

${(m, b) | \forall f \in C_{B} (X) : b \leq E_{H} (f) - m (f)}$

${(m, b) | b \leq {inf}_{f \in C_{B} (X)} (E_{H} (f) - m (f))}$

and, by the definition of the convex conjugate, and the space of finite signed measures being the dual space of $C_{B} (X)$ , and $m (f)$ being a functional applied to an element, this is...

${(m, b) | b \leq - (h)^{*} (m)}$

So, our original set $H$ is identical to the convex-conjugate set, when we go from $H$ to $h$ back to a set of a-measures.

Proof Phase 2: In the reverse direction for isomorphism, assume that $h$ fulfills the conditions (we'll really only need continuity and concavity)We want to show that

$E_{{(m, b) | b \leq - (h)^{*} (m)}} (f) = h (f)$

Let's begin.

$E_{{(m, b) | b \leq - (h)^{*} (m)}} (f) = {sup}_{(m, b) : b \leq - (h)^{*} (m)} (m (f) + b)$

Given an $m$ , we have a natural candidate for maximizing the $b$ , just set it equal to $- (h)^{*} (m)$ .

So then we get

$= {sup}_{m} (m (f) - (h)^{*} (m))$

And this is just... $(h)^{* *} (f)$ , and, because $h$ is continuous over $C_{B} (X)$ , and convex, $h = (h)^{* *}$ . From that, we get

$E_{{(m, b) | b \leq - (h)^{*} (m)}} (f) = (h)^{* *} (f) = h (f)$

and we're done with isomorphism.

So, in our first direction, we're going to derive the conditions on the functional from the condition on the set, so we can assume nonemptiness, closure, convexity, upper completion, projected-compactness, and normalization, and derive monotonicity, concavity, normalization, Lipschitzness, and compact almost-support (CAS) from that.

For monotonicity, remember that all points in the infradistribution set are a-measures, so if $f^{'} \geq f$ , then

$h (f^{'}) = {sup}_{(m, b) \in H} m (f^{'}) + b \geq {sup}_{(m, b) \in H} m (f) + b = h (f)$

We could do that because all the measure components are actual measures.

For convexity

$h (p f + (1 - p) f^{'}) = {sup}_{(m, b) \in H} m (p f + (1 - p) f^{'}) + b$

$= {sup}_{(m, b) \in H} (p m (f) + (1 - p) m (f^{'}) + p b + (1 - p) b)$

$\leq {sup}_{(m, b) \in H} (p m (f) + p b) + {sup}_{(m, b) \in H} ((1 - p) m (f^{'}) + (1 - p) b)$

$= p {sup}_{(m, b) \in H} (m (f) + b) + (1 - p) {sup}_{(m, b) \in H} (m (f^{'}) + b) = p h (f) + (1 - p) h (f^{'})$

And we're done with that. For normalization,

$h (0) = {sup}_{(m, b) \in H} m (0) + b = {sup}_{(m, b) \in H} b = 0$

And

$h (1) = {sup}_{(m, b) \in H} m (1) + b = {sup}_{(λ μ, b) \in H} λ μ (1) + b = {sup}_{(λ μ, b) \in H} λ + b = 1$

So we have normalization.

For Lipschitzness, we first observe that compact-projection (the minimal points, when projected up to their measure components, make a set with compact closure) enforces that there's an upper bound on the $λ$ value of a minimal point $(λ μ, b) \in H^{max}$ , because otherwise you could pick a sequence with unbounded $λ$ , and it'd have no convergent subsequence of measures, which contradicts precompactness of the minimal points projected up to their measure components.

Then, we observe that points in $H$ correspond perfectly to hyperplanes that lie below the graph of $h$ , and a maximal point is "you shift your hyperplane up as much as you can until you can't shift it up any more without starting to cut into the function $h$ ". Further, for every function $f \in C_{B} (X)$ , you can make a hyperplane tangent to the function $h$ at that point by the Hahn-Banach theorem, which must correspond to a maximal point.

Putting it together, the epigraph of $h$ is exactly the region above all its tangent hyperplanes. And we know all the tangent hyperplanes correspond to maximal points, and their Lipschitz constants correspond to the $λ$ value of the minimal points. Which are bounded. So, Compact-Projection in H implies h is Lipschitz.

Finally, we'll want compact almost-support. A set of measures is compact iff the amount of measure is upper-bounded, and, for all $ϵ$ , there is a compact set $C_{ϵ} \subseteq X$ where all the measures $m$ have $< ϵ$ measure outside of $C_{ϵ}$ .

So, given that the set of measures corresponding to $H$ is compact by the compact-projection property, we want to show that the functional $h$ has compact almost-support. To do this, we'll observe that if $h$ is the sup of a bunch of functions, and all functions think two different points are only a little ways apart in value, then h must think they're only a little distance apart in value. Keeping that in mind, we have:

$| d h (f; f^{'}) | = {lim}_{δ \to 0} \frac{| h (f + δ f^{'}) - h (f) |}{δ} = {lim}_{δ \to 0} \frac{| {sup}_{(m, b) \in H} (m (f + δ f^{'}) + b) - {sup}_{(m^{'}, b^{'}) \in H} (m^{'} (f) + b^{'}) |}{δ}$

And then, we can think of a minimal point as corresponding to a hyperplane $ϕ$ and $ψ$ , and $h$ is the sup of all of them, so to bound the distance between these two values, we just need to assess the maximum size of the gap between those values over all minimal points/tangent hyperplanes. Thus, we can get:

${lim}_{δ \to 0} \frac{| {sup}_{(m, b) \in H} (m (f + δ f^{'}) + b) - {sup}_{(m^{'}, b^{'}) \in H} (m^{'} (f) + b^{'}) |}{δ}$

$\leq {lim}_{δ \to 0} \frac{{sup}_{(m, b) \in H} | (m (f + δ f^{'}) + b) - (m (f) + b)) |}{δ}$

And then, we can do some canceling and get:

$= {lim}_{δ \to 0} \frac{{sup}_{(m, b) \in H} | m (δ f^{'}) |}{δ} = {lim}_{δ \to 0} \frac{{sup}_{(m, b) \in H} | δ m (f^{'}) |}{δ}$

$= {lim}_{δ \to 0} {sup}_{(m, b) \in H} | m (f^{'}) | = {sup}_{(m, b) \in H} | m (f^{'}) |$

And then, because $f^{'}$ was selected to be 0 on $C_{ϵ}$ , which makes up all but $ϵ$ of the measure for all measures present in $H$ , we can upper-bound $| m (f^{'}) |$ by $ϵ | | f^{'} | |$ , so we have that

$f_{↓ C_{ϵ}}^{'} \to \forall f : | d h (f; f^{'}) | \leq ϵ | | f^{'} | |$

And so, $C_{ϵ}$ is a compact $ϵ$ -almost-support for h, and this argument works for all $ϵ$ , so $h$ is CAS, and that's the last condition we need. Thus, if $H$ is an infradistribution (set form), the expectation functional $h$ is an infradistribution (expectation form).

Now for the other direction, where we assume monotonicity, concavity, normalization, Lipschitzness, and CAS on an infradistribution (expectation form) and show that the induced form fulfills nonemptiness, convexity, closure, upper completion, projection-compactness, normalization, and being a set of a-measures.

Remember, our specification of the corresponding set was:

${(m, b) | b \leq - (h)^{*} (m)}$

Where $(h)^{*}$ is the convex conjugate of $h$ .

First, being a nonempty set of a-measures with 0 or negative $b$ value. Because there's an isomorphism linking points of the set and hyperplanes below the graph of $h$ , we just need to establish that no hyperplanes below the graph of $h$ can slope down in the direction of a nonnegative function (as this certifies that the measure component must be an actual measure), and no hyperplanes below the graph of $h$ can assign 0 a value above 0 (as this corresponds to the $b$ term, and can be immediately shown by normalization).

What we do is go "assume there's a $ϕ$ where the linear functional corresponding to $ϕ$ isn't a measure, ie, there's some negative function $f$ where $ϕ (f) > ϕ (0)$ ". Well, because of monotonicity for $h$ (one of the assumed properties), we have $h (0) \geq h (f) \geq h (2 f) \geq h (3 f)$ .... And, because all affine functionals are made by taking a linear functional and displacing it, $ϕ (0) < ϕ (f) < ϕ (2 f) < ϕ (3 f)$ ..., increases at a linear rate, so eventually the hyperplane and $h$ cross over, but $ϕ$ was assumed to be below $h$ always, so we have a contradiction.

Therefore, all hyperplanes below $h$ must have their linear functional component corresponding to an actual measure. And we get nonemptiness from the concavity of $h$ , so we can pick any function and use the Hahn-Banach theorem to make a tangent hyperplane to $h$ that touches at that point, certifying nonemptiness.

By the way, the convex conjugate, $(h)^{*} (m)$ , can be reexpressed as ${sup}_{f} (h (f) - m (f))$ .

For closure and convexity: $h$ is proper, continuous on $C_{B} (X)$ , and convex, so, by the Wikipedia page on "Closed Convex Function", $(h)^{*}$ is a closed convex function, and then by the Wikipedia page on "Convex Conjugate" in the Properties section, $(h)^{*}$ is convex and closed, so $- (h)^{*}$ is concave and closed. From the Wikipedia page on "Closed Convex Function", this means that the hypograph of $- (h)^{*}$ is closed, and also the hypograph of a concave function is convex. This takes care of closure and convexity for our $H$ .

Time for lower-completeness. Assume that $(m, b)$ lies in the epigraph. Our task now is to show that $(m, b) - (0, b^{'})$ lies in the epigraph. This is equivalent to showing that $b - b^{'} \leq - (h)^{*} (m)$ . Let's begin.

$- (h)^{*} (m) \geq b \geq b - b^{'}$

And we're done.

Normalization of the resulting set is easy. Going from h to a (maybe)-inframeasure $H$ back to $h$ is identity as established earlier, so all we have to do is show that a failure of normalization in a (maybe)-inframeasure makes the resulting $h$ not normalized. Thus, if our $h$ is normalized, and it makes an $H$ that isn't normalized, then going back makes a non-normalized $h$ , which contradicts isomorphism. So, assume there's a failure of normalization in $H$ . Then $E_{H} (0) \neq 0$ , or $E_{H} (1) \neq 1$ , so either $h (0) \neq 0$ or $h (1) \neq 1$ and we get a failure of normalization for $h$ which is impossible. So $H$ must be normalized.

That just leaves compact-projection. We know that a set of measures is precompact iff there's a bound on their $λ$ values, and for all $ϵ$ , there's a compact set $C_{ϵ} \subseteq X$ where all the measure components have $< ϵ$ measure outside of that set.

First, we can observe that no hyperplane below $h$ can have a Lipschitz constant above the maximal Lipschitz constant for the function $h$ , because if it increased more steeply in some direction, you could go in that direction, and eventually the hyperplane would grow past the rate $h$ grows at and cross it, and the hyperplane must be below $h$ . Thus, Lipschitzness of $h$ enforces that there can be no point in the set $H$ with too much measure, which gives us one half of compact-projection for $H$ .

For the other half, CAS for $h$ ensures that for all $ϵ$ , there is a compact set $C_{ϵ}$ where

$f_{↓ C_{ϵ}}^{'} = 0 \to | d h (f; f^{'}) | \leq ϵ | | f^{'} | |$

What we'll do is establish that no hyperplane lying above h can have a slope more than $ϵ$ in the direction of a function that's in $[0, 1]$ and is 0 on $C_{ϵ}$ . Let $f^{'}$ be such a function fulfilling those properties that makes some hyperplane below $h$ slope up too hard. Then

$d h (0; f^{'}) \geq ϵ$

Because going in the direction of a positive function increases your value.

Now, we can realize that as we travel from 0 to $f^{'}$ to $2 f^{'}$ to $3 f^{'}$ , our vector of travel is always in the direction of $f^{'}$ , which can't be too negative. Each additional $f^{'}$ added ramps up the value of $h$ by at most $ϵ | | f^{'} | |$ . However, each additional $f^{'}$ added raises the value of $ψ$ (our assumed functional that's sloping up too hard in the $f^{'}$ direction) by more than that quantity, so eventually $ψ$ will cross over to be higher than $h$ , so $ψ$ can't correspond to a point in $H$ , and we have a contradiction.

Therefore, regardless of the point in $H$ , its measure component must assign any function that's 0 on $C_{ϵ}$ and bounded in $[0, 1]$ a value of $ϵ$ at most. We can then realize that this can only happen to a measure that assigns $ϵ$ or less measure to the set $C_{ϵ}$ (otherwise you can back off from your continuous function to a discontinuous indicator function).

Thus, given our $ϵ$ , we've found a compact set $C_{ϵ}$ where the measure component of all points in $H$ assign $ϵ$ or less value to the outside of that set, and this can be done for all $ϵ$ , certifying the last missing piece for compact-projection of $H$ (because the projection is precompact iff the set of measures is bounded above in amount of measure present, and for all $ϵ$ , there's a compact set $C_{ϵ}$ where all the measures assign $\leq ϵ$ measure outside of that set.

And that's the last condition we need to conclude that the set form of an ultradistribution (functional form) is an ultradistribution (set form), and we're done.

Theorem 2: Infra-Disintegration Theorem: Let $h$ be some arbitrary infradistribution over $X$ , and $K$ be some arbitrary infrakernel $X i k \to Y$ . Then $(h ⋉ K) |^{g} L = h^{'} ⋉ K^{'}$ , where:
$g_{x} := λ y . g (x, y)$
$L_{x} := λ y . L (x, y)$
$α (x) := K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})$
$β (x) := K (x) (0 ★^{L_{x}} g_{x})$
$K^{'} (x) := K (x) |^{g_{x}} L_{x}$
$h^{'} (f) := \frac{h (λ x . α (x) f (x) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

Our first order of business is showing that putting this together makes the orginal thing. Let $f$ be a continuous function $X \times Y \to R$ in this case.

$(h^{'} ⋉ K^{'}) (f) = h^{'} (λ x . K^{'} (x) (λ y . f (x, y)))$

$= \frac{h (λ x . α (x) K^{'} (x) (λ y . f (x, y)) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

And now, we just need to show that

$h (λ x . α (x) K^{'} (x) (λ y . f (x, y)) + β (x)) = (h ⋉ K) (f ★^{L} g)$

in order to wrap up our disintegration argument. There's a subtlety here, which is that when unpacking the definition of $K^{'}$ we can't cancel the $α (x)$ out of the inside and outside, because you've got division-by-zero errors. So, actually, let's take a detour and show that for all $x$ ,

$α (x) K^{'} (x) (λ y . f (x, y)) + β (x)$

$= K (x) (λ y . L (x, y) f (x, y) + (1 - L (x, y)) g (x, y))$

We've got two possible cases. In case one, $α (x) \neq 0$ . Then, we can go:

$α (x) K^{'} (x) (λ y . f (x, y)) + β (x)$

$= α (x) (\frac{K (x) (λ y . L (x, y) f (x, y) + (1 - L (x, y)) g (x, y)) - β (x)}{α (x)}) + β (x)$

$= K (x) (λ y . L (x, y) f (x, y) + (1 - L (x, y)) g (x, y))$

And we're done. In our second case, $α (x) = 0$ , so

$α (x) K^{'} (x) (λ y . f (x, y)) + β (x) = β (x)$

However,

$α (x) = P_{K (x)}^{g_{x}} (L_{x}) = K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})$

Thus,

$K (x) (λ y . L (x, y) + (1 - L (x, y)) g (x, y)) = K (x) (λ y . (1 - L (x, y)) g (x, y)) = β (x)$

so we have our desired result that

$α (x) K^{'} (x) (λ y . f (x, y)) + β (x) = β (x) = K (x) (λ y . L (x, y) f (x, y) + (1 - L (x, y)) g (x, y))$ .

Anyways, moving on, now that we have that result, what can we do? Well, from earlier, we had:

$(h^{'} ⋉ K^{'}) (f) = \frac{h (λ x . α (x) K^{'} (x) (λ y . f (x, y)) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

So, we can swap this out to get:

$= \frac{h (λ x . K (x) (λ y . L (x, y) f (x, y) + (1 - L (x, y)) g (x, y))) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) (L f + (1 - L) g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) (f ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= ((h ⋉ K) |^{g} L) (f)$

And so we have that:

$h^{'} ⋉ K^{'} = (h ⋉ K) |^{g} L$

Now, there is a bit of work that we need to put in, in order to verify that h' and K' are valid infradistributions and infrakernels, respectively.

Our first order of business is verifying that $β$ and $α$ are continuous bounded functions $X \to R$ . We recall our note that for any continuous bounded function $f : X \times Y \to R$ , and any infrakernel $K$ , the function $λ x . K (x) (λ y . f (x, y))$ must be continuous and bounded, otherwise the semidirect product would be ill-defined. Now, $β$ was defined as:

$λ x . K (x) (0 ★^{L_{x}} g_{x})$

$= λ x . K (x) (λ y . (1 - L (x, y)) g (x, y))$

and $(1 - L) g$ is obviously continuous and bounded, so $β$ must be continuous and bounded. For $α$ , it's similar, it's defined as:

$λ x . K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})$

$= λ x . K (x) (λ y . L (x, y) + (1 - L (x, y)) g (x, y)) - K (x) (λ y . (1 - L (x, y)) g (x, y))$

and similarly, we can verify that $L + (1 - L) g$ and $(1 - L) g$ are both continuous and bounded, so this is a continuous bounded function as well. Now that that's out of the way, the conditions we need to check for $h^{'}$ being a valid infradistribution are: Normalization, monotonicity, concavity, Lipschitzness, and compact almost-support.

For normalization,

$h^{'} (1) = \frac{h (λ x . α (x) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

And,

$α (x) + β (x)$

$= K (x) (λ y . L (x, y) + (1 - L (x, y)) g (x, y)) - K (x) (λ y . (1 - L (x, y)) g (x, y))$

$+ K (x) (λ y . (1 - L (x, y)) g (x, y))$

$= K (x) (λ y . L (x, y) + (1 - L (x, y)) g (x, y))$

So, with that, we get:

$= \frac{h (λ x . K (x) (λ y . L (x, y) + (1 - L (x, y)) g (x, y))) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) (L + (1 - L) g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} = 1$

And that half of normalization is done. For the other half,

$h^{'} (0) = \frac{h (λ x . β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

And, $β (x) = K (x) (λ y . (1 - L (x, y)) g (x, y))$

So, with that, we get:

$= \frac{h (λ x . K (x) (λ y . (1 - L (x, y)) g (x, y))) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) ((1 - L) g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{(h ⋉ K) (0 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} = 0$

Monotonicity is an easy one to show. If $f^{'} \geq f$ , then $α f^{'} + β \geq α f + β$ because $α (x) \geq 0$ always, and then monotonicity for h transfers that to the outside, and so you get monotonicity for $h^{'}$ , because

$h^{'} (f) = \frac{h (λ x . α (x) f (x) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

For concavity,

$h^{'} (p f + (1 - p) f^{'}) = \frac{h (α (p f + (1 - p) f^{'}) + β) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{h (p α f + (1 - p) α f^{'} + p β + (1 - p) β) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{h (p (α f + β) + (1 - p) (α f^{'} + β)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

And then by concavity of $h$ , we get:

$\geq \frac{p h (α f + β) + (1 - p) h (α f^{'} + β) - p (h ⋉ K) (0 ★^{L} g) - (1 - p) (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= \frac{p (h (α f + β) - (h ⋉ K) (0 ★^{L} g)) + (1 - p) (h (α f^{'} + β) - (h ⋉ K) (0 ★^{L} g))}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= p \frac{h (α f + β) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} + (1 - p) \frac{h (α f^{'} + β) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)}$

$= p h^{'} (f) + (1 - p) h^{'} (f^{'})$

This just leaves Lipschitzness and compact almost-support for $h^{'}$ . We can abbreviate

$(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)$

as $P_{h ⋉ K}^{g} (L)$ and go like this:

$| h^{'} (f) - h^{'} (f^{'}) |$

$= ∣ ∣ ∣ \frac{h (λ x . α (x) f (x) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} - \frac{h (λ x . α (x) f^{'} (x) + β (x)) - (h ⋉ K) (0 ★^{L} g)}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} ∣ ∣ ∣$

$= \frac{1}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} | h (λ x . α (x) f (x) + β (x)) - h (λ x . α (x) f^{'} (x) + β (x)) |$

$= \frac{1}{P_{h ⋉ K}^{g} (L)} | h (λ x . α (x) f (x) + β (x)) - h (λ x . α (x) f^{'} (x) + β (x)) |$

$\leq \frac{1}{P_{h ⋉ K}^{g} (L)} λ_{h}^{⊙} d (λ x . α (x) f (x) + β (x), λ x . α (x) f^{'} (x) + β (x))$

$= \frac{1}{P_{h ⋉ K}^{g} (L)} λ_{h}^{⊙} d (λ x . α (x) f (x), λ x . α (x) f^{'} (x))$

$\leq \frac{1}{P_{h ⋉ K}^{g} (L)} λ_{h}^{⊙} | | α | | d (f, f^{'})$

And $\frac{1}{P_{h ⋉ K}^{g} (L)} λ_{h}^{⊙} | | α | |$ Is a constant, so we've shown that $h^{'}$ is Lipschitz.

Now for compact almost-support. For an $ϵ$ , pick a compact $\frac{ϵ \cdot P_{h ⋉ K}^{g} (L)}{| | α | |}$ -almost-support for h. If $f$ and $f^{'}$ agree on it, then:

$| h^{'} (f) - h^{'} (f^{'}) |$

$= \frac{1}{(h ⋉ K) (1 ★^{L} g) - (h ⋉ K) (0 ★^{L} g)} | h (λ x . α (x) f (x) + β (x)) - h (λ x . α (x) f^{'} (x) + β (x)) |$

$= \frac{1}{P_{h ⋉ K}^{g} (L)} | h (λ x . α (x) f (x) + β (x)) - h (λ x . α (x) f^{'} (x) + β (x)) |$

And then, since these two functions agree on the compact set, we have:

$\leq \frac{1}{P_{h ⋉ K}^{g} (L)} \frac{ϵ \cdot P_{h ⋉ K}^{g} (L)}{| | α | |} d (λ x . α (x) f (x) + β (x), λ x . α (x) f^{'} (x) + β (x))$

$= \frac{ϵ}{| | α | |} d (λ x . α (x) f (x), λ x . α (x) f^{'} (x)) \leq ϵ d (f, f^{'})$

And so we can make compact almost-supports for any $ϵ$ we want, so $h^{'}$ fulfills the CAS property. And that's the last piece we need to know that $h^{'}$ is an infradistribution.

Further, $support (α)$ is a support for $h^{'}$ , because any two functions disagreeing off the support of $α$ only disagree where $α$ is 0, and from the definition of $h^{'}$ it's clear to see that they both induce identical results. So, we can view $h^{'}$ as having type signature $□ (support (α))$ .

For $K^{'}$ , we'll show that it's (almost) an infrakernel of type $support (α) i k \to Y$ , only missing the Lipschitz constant constraint.

However, what's going on here is that it's kind of like, how, if you want to specify a function that's guaranteed to have a finite value when you integrate it w.r.t. any probability distribution, you need a uniform bound on the values of that function. But if you've got a specific probability distribution you're integrating that function w.r.t. to, the function can run off to infinity but in areas of low measure, so the net integral is finite. So we should expect the "common Lipschitz constant" property to be the first property to break in an infrakernel.

We do still have to check compact-shared CAS and pointwise convergence, as well as all the $K^{'} (x)$ being infradistributions.

For the first one, $K^{'} (x) := K (x) |^{g_{x}} L_{x}$ , and the update of an infradistribution $K (x)$ is an infradistribution when the update is well-defined, so we need to check whether the update is well-defined. The update would fail to be well-defined iff

$K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x}) = 0$

We can rewrite this as $P_{K (x)}^{g_{x}} (L_{x})$ , but that's just $α (x)$ , and we know $α (x) > 0$ , so we have that all the updates are well-defined and make infradistributions.

For number 2 and 3, the ones with compact subsets of $support (α)$ , we should note something important. If $C_{α} \subseteq support (α)$ is compact, then $inf {α (x) | x \in C_{α}} > 0$ . If it was otherwise, you could fix a sequence of points with lower and lower $α$ values, identify a convergent subsequence by compactness, and then by continuity of $α$ , conclude that the limit point $x$ had $α (x) = 0$ , so it isn't in the support of $α$ and can't be in $C_{α}$ , and we'd have a contradiction. Therefore, ${inf}_{x \in C_{α}} α (x) > 0$ . $C_{α}$ will also be a compact subset of $X$ .

If you pick an $ϵ$ and a $C_{α}$ , then a $ϵ {inf}_{x \in C_{α}} α (x)$ -almost support for all the $K (x)$ , which is guaranteed to exist by compact-shared compact almost-support for $K$ is an $ϵ$ -almost support for all the $K^{'} (x)$ with $x \in C_{α}$ . Here's how to show it. Let $f, f^{'}$ agree on your almost-support of interest.

${sup}_{x \in C_{α}} | K^{'} (x) (f) - K^{'} (x) (f^{'}) |$

$= {sup}_{x \in C_{α}} ∣ ∣ ∣ \frac{K (x) (f ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}{K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})} - \frac{K (x) (f^{'} ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}{K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})} ∣ ∣ ∣$

$= {sup}_{x \in C_{α}} ∣ ∣ ∣ \frac{K (x) (f ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}{α (x)} - \frac{K (x) (f^{'} ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}{α (x)} ∣ ∣ ∣$

$= {sup}_{x \in C_{α}} (\frac{1}{α (x)} | K (x) (f ★^{L_{x}} g_{x}) - K (x) (f^{'} ★^{L_{x}} g_{x}) |)$

$\leq ({sup}_{x \in C_{α}} \frac{1}{α (x)}) \cdot ({sup}_{x \in C_{α}} | K (x) (f ★^{L_{x}} g_{x}) - K (x) (f^{'} ★^{L_{x}} g_{x}) |)$

$= \frac{1}{{inf}_{x \in C_{α}} α (x)} {sup}_{x \in C_{α}} | K (x) (f ★^{L_{x}} g_{x}) - K (x) (f^{'} ★^{L_{x}} g_{x}) |$

and then, because $f$ and $f^{'}$ agree on our almost-support, so do the bigger functions, and we have:

$\leq \frac{1}{{inf}_{x \in C_{α}} α (x)} {sup}_{x \in C_{α}} (ϵ {inf}_{x^{'} \in C_{α}} α (x^{'})) d (L_{x} f + (1 - L_{x}) g_{x}, L_{x} f^{'} + (1 - L_{x}) g_{x})$

$= ϵ d (L_{x} f, L_{x} f^{'})$

However, $L_{x}$ is always bounded in $[0, 1]$ so we have:

$\leq ϵ d (f, f^{'})$

and we're done, we've shown a compact $ϵ$ -almost-support for all the $K^{'} (x)$ where the $x$ were selected from a compact set, so we have compact-shared CAS.

Finally, for pointwise convergence, the first thing we'll observe is that the function

$λ x . K (x) (λ y . L (x, y) f (y) + (1 - L (x, y)) g (x, y))$

is continuous, as

$(h ⋉ K) (L f + (1 - L) g) = h (λ x . K (x) (λ y . L (x, y) f (y) + (1 - L (x, y)) g (x, y)))$

So, if the inner function wasn't continuous, then it couldn't be evaluated by $h$ , and $h ⋉ K$ would be undefined for a continuous function input, which is impossible because $K$ is an infrakernel, so we can take semidirect product and always make an infradistribution.
At this point, we can go:

${lim}_{n \to \infty} K^{'} (x_{n}) (f)$

$= {lim}_{n \to \infty} (K (x_{n}) |^{g_{x_{n}}} L_{x_{n}}) (f)$

$= {lim}_{n \to \infty} \frac{K (x_{n}) (f ★^{L_{x_{n}}} g_{x_{n}}) - K (x_{n}) (0 ★^{L_{x_{n}}} g_{x_{n}})}{K (x_{n}) (1 ★^{L_{x_{n}}} g_{x_{n}}) - K (x_{n}) (0 ★^{L_{x_{n}}} g_{x_{n}})}$

$= {lim}_{n \to \infty} \frac{K (x_{n}) (f ★^{L_{x_{n}}} g_{x_{n}}) - β (x_{n})}{α (x_{n})}$

$= {lim}_{n \to \infty} \frac{K (x_{n}) (λ y . L (x_{n}, y) f (y) + (1 - L (x_{n}, y)) g (x_{n}, y)) - β (x_{n})}{α (x_{n})}$

And then, because we've shown that $β$ and $α$ are continuous and the limit point is in the support of $α$ so $α (x) > 0$ , and that the function

$λ x . K (x) (λ y . L (x, y) f (y) + (1 - L (x, y)) g (x, y))$

is continuous, we have:

$= \frac{K (x) (λ y . L (x, y) f (y) + (1 - L (x, y)) g (x, y)) - β (x)}{α (x)}$

$= \frac{K (x) (f ★^{L_{x}} g_{x}) - β (x)}{α (x)}$

$= \frac{K (x) (f ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}{K (x) (1 ★^{L_{x}} g_{x}) - K (x) (0 ★^{L_{x}} g_{x})}$

$= (K (x) |^{g_{x}} L_{x}) (f)$

$= K^{'} (x) (f)$

And pointwise continuity is shown, so $K^{'}$ is (almost) an infrakernel of type $support (α) i k \to Y$ .

AI ALIGNMENT FORUM
AF

AI ALIGNMENT FORUM
AF

4

LBIT Proofs 5: Propositions 29-38

4