At the Shmoo Con hacker conference, an engineer at Atlanta company SPI Dynamics called Billy Hoffman says he has a web crawler that acts like you or me. It hits links, javascript, flash, and other page elements like a human does, slowly, with indeterminate pauses. Not only that, Hoffman’s crawler acts like a browser [...]

{ 0 comments }