Recognizing What You Ask For