John Jr. and Caroline would frolic in the Oval Office and get treats like gum from their father, the president, when their mom, First Lady Jackie Kennedy, was out of town.