My favourite linguist (forget Chomsky, he's too compromised!), Clif High, here gives a very exciting explanation of what he does, and why and how the 'webbot' works. Encouragingly he doesn't see the complete AI cage that is being predicted by others coming to pass, because of the complexity and the fact that computers don't have self-awareness:
Unfortunately the interviewer is awful, but as I trust Clif High, he'll be choosing certain venues where he wants to give out his information - i.e. not to corportate individuals or websites.
Here's another Clif High podcast, hot off the press:
And one from the other day: