Cygwin Time Machine

[Richard Campbell]

Peter Castro wrote:
>
> (if there's a way to make wget ignore robots.txt, I'd love to know
it!)

http://www.gnu.org/software/wget/faq.html#3.0
"3.0 How can I make GNU wget ignore a robots.txt file?

Try using:

wget -erobots=off http://your.site.here "

-Richard Campbell

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/