I ride with my son and one of his buddies quite a bit, but I really enjoy getting out and going solo wherever the wind blows. That way, there's no schedule to meet, nobody to answer to, and nobody to coordinate with. The more people you've got, the more problems you've got.
Some might think that's selfish, maybe they're right. I've noticed that some people who like large groups also tend to be controlling. That's something I don't need.