Dozens not allowed to go home because of a brush fire