Conditional Mutual Information Images

In probability theory, and in particular, information theory, the conditional mutual information is, in its most basic form, the expected value of the mutual information of two random variables given the value of a third.

where the marginal, joint, and/or conditional probability mass functions are denoted by with the appropriate subscript. This can be simplified as

Conditional mutual information can also be rewritten to show its relationship to mutual information