Why is it so hard?
Anna Patterson, Software Engineer. As well as contributed to search engines and artificial intelligence at Google, and co-founded Cuil. Makes following quotation about developing search engines:
“There must be 4,000 programmers typing away in their basements trying to build the next “world’s most scalable” search engine. It has been done only a few times. It has never been done by a big group; always one to four people did the core work, and the big team came on to build the elaborations and the production infrastructure. Why is it so hard?”
Let me introduce Anna Patterson
What Wikipedia knows about her:
Patterson received her B.S. in Computer Science and another in Electrical Engineering from Washington University. As well her Ph.D. from the University of Illinois at Urbana–Champaign and was a Research Scientist at Stanford University in artificial intelligence working on Phenomenal Data Mining.
She was working in Google’s Android organization. Patterson was responsible for scaling up Android from 40 million phones to over 800 million phones.
She was a co-founder of Cuil, a clustering-based search engine (which she created after leaving Google in 2007). And also wrote Recall.archive.org (part of the Wayback Machine), a history-based search engine out of the Internet Archive, which showed trends over time.
Patterson was a winner of the 2016 ABIE Award, and one of the seminal contributors to search engines. As of 2017 she was Founder and Managing Partner at Gradient Ventures and Vice President of Engineering at Google.
Read the hole Story
In addition to this, please read the complete article that Anna Patterson had already written in 2004 about “Why Writing Your Own Search Engine is Hard” and still so true: https://queue.acm.org/detail.cfm?id=988407
Table of Contents
[…] This blog has dedicated a separate page: Perhaps the most famous post with the exception of the original Google paper. Written by Anna Patterson. She was the developer of the search engine Cuil and Archive.org. It highlights the difficulties of developing and running a search engine. From crawling to indexing to delivering the ranked search engine result page: https://www.suchmaschine.biz/writing-your-own-search-engine/ […]