Neighbors worried transients will start more fires