James Madison is often referred to as the "Father of the Constitution"