I have the exact same relationship with volleyball. I love playing it but am an absolute muppet when it comes to actually getting the ball over the net.
I enjoy golf with the right people. They have to suck proportionately to me. When I play with someone good, it's frustrating. I know that they're annoyed that I hit the ball twice for their every one time. Also, the "can you help me find my ball" thing gets pretty old. Much easier to find them when they're smacked down the center of the fairway. That said, I think I could be good if I did it more often, but who has the time? Golf takes forever.
Yeah it really does take too long. Me and my buddies used to go out to a little 9-hole par 3 course nestled right in on downtown Austin, half a city block. Really neat course, mostly an unofficial homeless shelter now, like most places downtown. You Austinites -- it's at Barton Springs, the little green area next to the giant dinosaur and the McDonalds. I guess it's probably been sold by now, though.
I enjoy golfing with my father. He's a decent golfer, but he's patient. In fact, I get so impatient golfing that I tend to run to my ball from the cart. On more than one occasion my father has quipped, "Steven, there is no running in golf!" On a sidenote, my dad has been golfing for about 20 years and a few weeks ago he got his first hole in one. Pretty cool!
I enjoy being on the golf course a lot. Always loved driving the carts around. Private courses are very peaceful places to be on drugs. But the game itself drives me nuts 92 percent of the time. I do like the idea of going your whole life waiting for that hole in one and finally nailing it. Not too many other hobbyist sports have that holey grail.