Contextual and multi-class bandits

Active learning

Teaching

Explanations and interpretations

Other forms of interactions and feedback