I’ve gone on and on lately about taking away some comforts for the sake of effective site analysis. There are some aspects of a good site analysis that you just can’t accomplish in a browser’s naturally cheery and helpful state. Today I’d like to present the last step toward making your browser as stiff and humorless as a web crawler.
Google has steadily improved their algorithms over the years, and are constantly getting better at “seeing” a site the way a human’s puny optical nerves do. Similarly, the way a bot understands a web page has gone from finding keyword occurrences in the right places to something much more closely resembling a human’s puny cerebral processes. With Latent Semantic Indexing and other word relationship technologies, Google can determine what a site is about in a much more “natural language” sort of way.
Even with all these advancements though, Google is still a long way from Skynet. (Or at least that’s what they want us to believe…)
And in your spare time, make sure you’re preparing to do your part in the human resistance. Robots are ruthless oppressors you know.