Wikia has acquired the distributed web crawling engine Grub from Looksmart. Grub utlizes spare computing cycles on users’ computers to index the web, a similar concept to that used by SETI@home in the ...

As the quantity of information on the Internet continues to grow, so does the question of how to process it all and make it useful. A startup called 80legs, based in Houston, TX, is hoping that an ...

During a keynote address at the O'Reilly Open Source Convention in Portland, Oregon, Wikia co-founder Jimmy Wales announced that his company has acquired the distributed web crawler Grub. The company ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Cory Benfield discusses the evolution of ...

Editors Note: I’ve known Wolf and Gosia Garbe from FAROO for a long time, and so I asked Wolf if he would write a guest post explaining the differences between single index Google type search ...