The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
Ruby can be used with a variety of networking protocols to download web pages and send email. These pages will address how to use HTTP, SMTP and raw sockets to implement your own networking protocols.
