Geocaching is sort of like global hide-and-seek (with hints) for technology geeks.
I stumbled upon a non-GPS version of this diversion, known as Letterboxing (not to be confused with letterboxed movies, another subject entirely).
By the way, if geocaching isn't enough "fun with a GPS" for you, you can try The Degree Confluence ...