Can You Judge a Book By Its Cover?