Веб боты 2024 - Поисковые агенты

Веб Бот Live 2024 Список - Список всех известных веб-ботов и поисковых роботов в Интернете, сканирующих сайты для поисковых систем и других целей. Это включает Google бот, Yahoo бот, Bing бот, Baidu бот, и других роботов. Читать далее
Также вы можете смотреть:
     - Google/Yahoo/Bing ботов IP адреса
     - Список неизвестных ботов которые маскируются под обычных пользователей
     - Список пользовательских веб агентов (более 600,000 польз. веб агентов в нашей базе данных)

Онлайн IP проверка      Экспорт в текстовой файл »      1 - 50  из  10,206 записей   № Веб боты Число известных IP адресов с кот. использ. этот браузер агент 1 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 117,728 ip 2 Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) 54,857 ip 3 SirdataBot 31,402 ip 4 Googlebot/2.1 (+http://www.google.com/bot.html) 16,400 ip 5 Clickagy Intelligence Bot v2 15,441 ip 6 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) 14,418 ip 7 Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot) 6,888 ip 8 Mozilla/5.0 (compatible; BomboraBot/1.0; +http://www.bombora.com/bot) 6,832 ip 9 A6-Indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/) 6,826 ip 10 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 4,814 ip 11 Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/) 4,525 ip 12 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html 4,482 ip 13 Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html) 4,283 ip 14 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 4,100 ip 15 Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot) 4,043 ip 16 Screaming Frog SEO Spider/9.2 3,131 ip 17 Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) 3,101 ip 18 CCBot/2.0 (http://commoncrawl.org/faq/) 2,804 ip 19 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2,536 ip 20 YisouSpider 2,533 ip 21 Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2,130 ip 22 Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 2,040 ip 23 Mozilla/5.0 (compatible; Cliqzbot/1.0; +http://cliqz.com/company/cliqzbot) 1,939 ip 24 Googlebot/2.1 (+http://www.googlebot.com/bot.html) 1,917 ip 25 Googlebot-Video/1.0 1,842 ip 26 Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html) 1,814 ip 27 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net) 1,803 ip 28 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 1,787 ip 29 Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/) 1,705 ip 30 Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620 1,647 ip 31 SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,575 ip 32 Mozilla/5.0 (Linux; Android 7.0; SM-G930V Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36 (compatible; Google-Read-Aloud; +https://support.google.com/webmasters/answer/1061943) 1,521 ip 33 Mozilla/5.0 (iPhone; U; CPU iPhone OS 41 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,474 ip 34 msnbot/2.0b (+http://search.msn.com/msnbot.htm) 1,444 ip 35 Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html) 1,370 ip 36 DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,338 ip 37 Mozilla/5.0 (iPhone; CPU iPhone OS 60 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 1,225 ip 38 Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) 1,220 ip 39 ClaudeBot 1,215 ip 40 Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider 1,208 ip 41 Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender) 1,151 ip 42 Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36 1,100 ip 43 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 1,098 ip 44 msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) 1,088 ip 45 CCBot/2.0 (https://commoncrawl.org/faq/) 1,064 ip 46 Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 1,029 ip 47 Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/) 977 ip 48 acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) 961 ip 49 Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; +http://docs.google.com) 948 ip 50 DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html) 830 ip 1 - 50  из  10,206 записей   Пожалуйста подождите...