Wget ignores robot.txt entry

[news@garydjones.mailshell.com]

On 14 Feb 2003, Randall R Schulz <rrschulz@cris.com> wrote:

> Wget [...] seems to have it
> all over cURL. (Sure. Go ahead and prove me wrong.

Wget has fewer protocols (one can argue whether the extra 
protocols are worthwhile, but there y'go), can't do uploads 
AFAICS, and HTTP POST also doesn't seem to be mentioned. OTOH 
Wget has features that cURL does not; they're not better & 
worse, just different.

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Bug reporting:         http://cygwin.com/bugs.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/