Warde Manuel has patience with Jim Harbaugh, never had backup plan