Interesting idea.... I have been idly working on an web crawler / indexing / organizing system that uses NLP etc to sort of solve the OP's problem(s) - if you don't mind, could you send me an email about your needs? See my HN account for contact info.