Listen, Watch, and Learn: The Power of Observing During Disagreements