Why is outsourcing a big deal?

After Carillion - the UK's second biggest construction firm - collapsed, the question of private companies providing public services became a hot political issue. But why would governments get companies to do their work for them, and what's at risk if it goes wrong?