Most of our entertainment in the western world world could also be classified as frivolous ... how are video games any different than movies, books or even art? Those who spend an excessive amount of time doing any of those things may have a problem but human creativity shouldn't need arbitrary constraints. I would argue that the military-industrial complex is far more detrimental to society both in wasted engineering talent and in directly contributing to suffering.