Fans banned from Summer Games