Tom Fitton says he 'shouldn't be punished' for doing his job