To Learn Or Not to Learn?