Where are the former speakers of the house at and what are they doing?

Why don't they speak up. Newt has said something here and there. The 3rd most powerful position in America. There are 4 of them aside from Newt, that we never hear from. Where are they?