Plans to bring homes to an abandoned golf course is getting push back from residents