Unveiling the Surprising Power of Vector Databases for Language Models