Vice President Mike Pence defends his decision to leave Indianapolis Colts game early