Talk:Web crawler

Computing Mid‑importance

	This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.ComputingWikipedia:WikiProject ComputingTemplate:WikiProject ComputingComputing articles
Mid	This article has been rated as Mid-importance on the project's importance scale.

Internet High‑importance

	Internet portal This article is within the scope of WikiProject Internet, a collaborative effort to improve the coverage of the Internet on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.InternetWikipedia:WikiProject InternetTemplate:WikiProject InternetInternet articles
High	This article has been rated as High-importance on the project's importance scale.

This article is prone to spam. Please monitor the References and External links sections.

Archives (index)

Index 1

This page has archives. Sections older than 730 days may be automatically archived by when more than 4 sections are present.

Phrasing

I would like to bring attention to this paragraph on the article:

"The number of Internet pages is extremely large; even the largest crawlers fall short of making a complete index. For this reason, search engines struggled to give relevant search results in the early years of the World Wide Web, before 2000. Today, relevant results are given almost instantly."

I wanted to get other people's insight on how to rephrase this. Akdulj (talk) 20:29, 5 February 2023 (UTC)[reply]

sher alam 188.54.121.141 (talk) 01:33, 23 December 2023 (UTC)[reply]

Low quality citation

First citation ^[1] in this Wikipedia entry is a website with just one article, hosted on Wordpress, with no data about the article's author, dead for about a year at this point. Due to all of those facts, it seems that the cited article is low effort, and low quality. Maciej Błędkowski (talk) 15:55, 20 January 2024 (UTC)[reply]

References

^ "Web Crawlers: Browsing the Web". Archived from the original on 2021-12-06.

[1] "Web Crawlers: Browsing the Web". Archived from the original on 2021-12-06.

[1]