User Comments

Excellent. I gotta try this out at playboy.com :-)

Oh boy, I’m really having some fun with this. I’ll post useful/interesting wgets/cURLs here as I develop them.

Aaron - why are you squinting? ;-)

Some sites require authentification which is not based on HTTP’s understanding of the word, as cURL and wget can use out-of-the-box, so what you need to do is login by hand and look at the places cookie (a session id mostly) and have wget send that cookie too.

As long as your session doesn’t expire (20 minute on many sites I built, for example) you can use the same cookie value.

Damn, I wish people would use HTTP security more instead of fiddling with their own stuff. Even form-based HTTP security will do, although I’d love to see more sites used basic HTTP security (when a user/password/ok/cancel pop-up appears)

nice post. i’m shutting down my site, unfortunately, but i think my pal at http://www.them.ws might be taking it over. i dumped the sql data to him.

I’m sorry you feel you have to shut your website down Matt. I’ll especially miss wgets & cURLs.

So long, and thanks for all the fish! :-)