I've often thought about this myself. We already have 3D games, and some time in the future we'll probably have 4D gaming. The technology may, as Twilight Sparkle said, bring us into the game; or perhaps it will somehow project the game from the TV into the room in which we play. And I'm sure we'll have widespread use of hologram technology within 100 years, because we've already seen laser-projected computer keyboards.
For example:
It's definitely a possibility.