Comedic Fool's Gold: Reward Exploits and Countermeasures in Conversational Humor

We investigate automated rewards for training language models in conversational humor, focusing on reward exploits and countermeasures. Two approaches aim to capture understandable surprise and predicted audience amusement.