Yes, you can be unproductive in the office - but the temptation and opportunities to do next to nothing on a daily basis are too big a temptation for many people, and becomes a nightmare for the people that are supposed to manage the slackers.

It seems if you have a large number of employees who are unable or unwilling to do their job, asking everyone to work from the office isn't the optimal solution to the problem.