I agree with what you're saying about it being a collective effort, but, not everyone has the access to a venue to hold something something weekly/bi-weekly/monthly etc. So when those that do, drop the game off their roster, that's just one step closer to nobody playing it.
The whole, "if more people put effort in, I would too", attitude is the whole reason the game is in the state that it currently is. You can't keep it going on your own, no, but, if you remain apart of those who don't give up, you are giving it the chance to grow. If you just give up because not enough people play, then you're just helping to smother it.
Just food for thought.