A weird thing about those that wish for less government is that it does not hold any concrete idea on how state systems are supposed to work. A government will be present in every aspect of our lives, the matter is moreso if its laws are just and not arbitrary.
An unregulated market it subject to abuse, thus laws are in place in many countries to prevent people being fired on a whim or for unjustifiable reasons. On the other hand, the same laws should never be arbitrary and it's institutions must themselves be held accountable.
The bigger issue is when governmental corruption takes place, as we unfortunately see rather frequently. With power being unchecked, the entire reason for a representative government is lost as it will no longer serve the people. Such governments cannot be allowed to exist.