PPT Slide
Maximum Entropy Discrimination Approach
Many solutions may be valid.
Use coarser description of sol’n instead of a single optimum.
Solve for distribution P(Q) over all good Q (instead of Q *).
Find that mins subject to constraints:
Where is a prior distribution over models & margins.
Information Transfer / Projection:
*Information transferred to
*Entropic Regularization and Margin
Penalties are on the Same Scale