Teach to Learn, Learn to Teach: A Symphony of Knowledge