For a large project in my Computer Science class at BYU (cs240), I needed to implement a simple webcrawler, that would create a database of words, each page that contains each word, and a database of all of the pages that were crawled (whether they had parsed words on them or not). It was a pretty large project, with the added complexity that many of the standard library tools like
Boring and un-interesting, here is a link to the 41 page design document for my webcrawler project in CS 240 at BYU. None of the method bodies have been implemented so this document is pretty much worthless.