A big difference is that governments should be accountable to the people. Not all are, in which case they are indeed pretty much like a legitimised mafia.

It's the democratic basis that gives a government its legitimacy.