Wealthy LA residents are buying homes in this California beach town