When Machines Replace Humans, Who Holds the Remote?