My team not playing in a board meeting game never played a factor, nor did missing a home game when I had tickets.
You go for the people and if you're lucky enough to have your team there, well good. If not, TV is an option.
Some of those times I and others never even went to the stadium. More fun to hang out with the board in some bar, somewhere.