Boris Johnson was seen to be ‘economically illiterate’: Alexander Downer