Daypop Search Engine Optimization

Daypop search was founded by creator Dan Chan, who formulated the idea during the 2000 election. He ran a blog on the event, but was frustrated to find there was no efficient way to share and retrieve blog information over the web search engines at that time were not accessing dynamic content. Chan began working on Daypop in May 2001, and it was completed and live by August 2001. Daypop search claims to access over 59000 top-notch news sites and weblogs every day. *Check out Metamend's search engine blog pages.

Daypop search works off of the World Live Web, or as Daypop refers to it, the "Living Web," indexing syndicated web content, typically providing results at least once a day. Daypop's webcrawler, daypopbot/0.2, finds and indexes only relevant sites, which include: news, weblogs and RSS feeds. In order for sites to be listed by daypopbot/0.2, they must be relevant to these forms. Daypop also accepts sites by submission, and although pages are bot indexed, lists are still edited by humans. In order for your weblog or RSS feed to be indexed by Daypop, it should be tuned with a good search engine optimization strategy.

Note: daypopbot/0.2 can be configured to avoid crawling your site, by adding the appropriate text to the robots.txt file. Caching can also be eliminated with the NOARCHIVE meta tag.

Daypop crawls major news sites every three hours. These include places such as CNN and Fox etc. Lesser known news sites are crawled once per day. On the other hand, weblogs are crawled every 12 hours. This process can be expedited if webloggers make use of the Weblogs.com pings notification. If webloggers use this function, Daypop will index their blogs every hour.

Daypop's bot uses its own Page Similarity' algorithm to locate blogs that match in terms of word content. This allows webloggers with similar interests and viewpoints to find each other. Furthermore, the bot utilizes RSS 0.91, so that search results can be output in RSS formatcustom news feeds in RSS can be created via Daypop search results, by accessing the XML button located off the main site.

Daypop claims its RSS feeds and RSS feeds update information from NewsIsFree. NewsIsFree crawls existing feeds on a regular basis, and even builds RSS feeds based on some HTML content. Then, "NewsIsFree publishes this update information, Daypop makes use of it every hour to crawl RSS feeds."

Daypop's Search Algorithm' is geared to index sites based on keyword placement within the content, as well as keyword nearness (how close these terms are placed between one another). The Search Algorithm' ranks pages based on an importance score. However, this score is not taken into account when returning search results, so popularity does not end up outweighing relevance. It is able to do this because currently the index is edited by human hands. According to Daypop, "Daypop only uses this score to perform explicit ranking of authority of pages relative to each other as on the Top Weblogs page. In the future, Daypop may make use of authority in ranking search results depending on some tests on relevance."

Daypop treats links with high importance. It will follow links between pages and sites, analyzing them in real-time.

With the 'Advanced Searches' feature, users can select searches for just RSS, weblogs, news, or all three. Searches can also be narrowed down by dates and language, through a drop down menu.

book markDel.icio.us to digg.comDigg