At this point yeah. I now have 56k URLs in the queue, and at 20 seconds a URL… Pareto is the idea here, what are the main sites worth preserving?
I guess ribbon farm and Paul Graham would be the 2 big ones from my list.
At this point yeah. I now have 56k URLs in the queue, and at 20 seconds a URL… Pareto is the idea here, what are the main sites worth preserving?
I guess ribbon farm and Paul Graham would be the 2 big ones from my list.