Aide
Ce sujet est fermé
Posté 29 septembre 2004 - 17:24
( Configuration Générale > Search Engine Spiders > Dans la dernière boîte de texte. )
googlebot=Google.com slurp@inktomi=Hot Bot ask jeeves=Ask Jeeves lycos=Lycos.com whatuseek=What You Seek ia_archiver=Archive.org Alexa=Alexa wisenutbot=Looksmart msnbot=MSN GigaBlast=Gigablast Gigabot=Gigablast archive_org=Archive.org jeeves=Ask Jeeves google=Google.com Asterias=Singingfish Spider Slurp=Inktomi Spider ZyBorg=LookSmart Bot slurp@inktomi=HotBot lycos=Lycos.com LinkWalker=Link Walker Slurp/2.0=HotBot ABCdatos BotLink/1.0.2=ABC Bot 'Ahoy! The Homepage Finder'=Ahoy Spider appie/1.1=Walhello Spider InfoSeek Robot 1.0=Infoseek Infoseek Sidewinder=Infoseek MSNBOT/0.1=MSNBot Openbot=OpenBot inktomisearch.com=Yahoo Slurp.so/1.0=Yahoo Slurp/2.0j=Yahoo Slurp/2.0-KiteHourly=Yahoo Slurp/2.0-OwlWeekly=Yahoo Slurp/3.0-AU=Yahoo UltraSeek=InfoSeek MuscatFerret=WebTop appie=Walhello UK Searcher Spider=UK Searcher teoma_agent1=Teoma.com HenryTheMiragoRobot=MiragoBot Lycos_Spider_(T-Rex)=Lycos Toutatis 2.5-2=Hoppa.com Hubater=Hubat.com IlTrovatore-Setaccio=IlTrovatore.it IncyWincy=IncyWincy.com Mole2/1.0=Intags.de MP3Bot=MP3bot.de LNSpiderguy=Lexis-Nexis.com kuloko-bot/0.2=Kuloko.com NetResearchServer=Look.com MantraAgent=Look Smart Arachnoidea=EuroSeek EZResult=EZResult ArchitextSpider=Excite ArchitectSpider=Excite Inktomi=InktomiBot GAIS Robot/1.0B2=Seednet Gulliver/1.2=Northern Light Infoseek Sidewinder/0.9=Sidewinder lwp-trivial/1.27=Search 4 Free Lycos_Spider_(T-Rex)/3.0=Lycos Scooter/1.0=AltaVista sexsearcher=Sex Searcher WebCrawler/3.0 Robot libwww/5.0a=WebCrawler WebCrawler-AddURL/2.0=WebCrawler WiseWire=WiseWire WiseWire-Alpha-1.0=WiseWire WiseWire-Alpha-Spider=WiseWire WiseWire-Alpha12-Spider971219a=WiseWire WiseWire-Alpha12-Spider(971223a)=WiseWire WiseWire-HotSpider-1.0=WiseWire WiseWire-Spider=WiseWire WiseWire-Spider-1.0=WiseWire WiseWire-Spider2=WiseWire WiseWire-Widow-1.0=WiseWire WiseWire-Widow-1.0r=WiseWire WiseWire-Widow-1.0-ALPHA12=WiseWire AbachoBOT=Abacho abcdatos_botlink=ABCDatos AESOP_com_SpiderMan-AESOP.com Scooter=AltaVista Mercator=AltaVista Scooter2_Mercator_3-1.0=Scooter2 Spider roach.smo.av.com-1.0=Roach SPider Tv<nn>_Merc_resh_26_1_D-1.0=Merc Spider Wget=All The Web antibot=AntiSearch.net Atomz=Atomz CanSeek/=Can Seek ChristCRAWLER=Christ CRAWLER DaAdLe.com ROBOT/=DaAdLe.com contact/jylee@kies.co.kr=Jylee Spider RaBot=Daum.net Agent-admin/=Daum.net DeepIndex=DeepIndex DittoSpyder=Ditto.com Jack=Jack Spider EZResult=EZResults.com FyberSearch=FyberSearch.com GalaxyBot=Galaxy.com geckobot=geckobot.com GenCrawler=GenDoor.com GeonaBot=Geona.com moget/2.0=goo.ne.jp JoocerBot=Joocer.com HenryTheMiragoRobot=Mirago.co.uk mozDex/=MozDex.com MSNBOT/0.1=MSN ObjectsSearch/0.01=ObjectsSearch.com PicoSearch/=PicoSearch.com PJspider=PortalJuice.com DIIbot=PowerInter.net gazz/1.0=Gazz Spider NationalDirectory-SuperSpider=NationalDirectory.com psbot=PicSearch.org AlkalineBOT=AlkalineBOT Scrubby/=ScrubTheWeb.com asterias=SingingFish.com Kototoi/0.1=Kototoi Spider Searchspider/=Searchspider.com SightQuestBot/=SightQuest.com Spider_Monkey/=Spider_Monkey.ca teoma_agent1=Teoma.com ESISmartSpider=Travel-Finder.com appie=Walhello.com MuscatFerret=WebTop.com WSCbot=WorldSearchCenter.com Yandex=Yandex.com Yellopet-Spider=Yellopet.com libwww-perl=Libwww Spider citenikbot/=CitenikBot CLIPS-index=CLIPS Spider cosmos=XYleme.com Computer_and_Automation_Research_Institute_Crawler=CARI Spider DiaGem/=DiaGem Spider EchO!/2.0=Voila.com FinaleRobot=FinaleRobot larbin=Larbin Spider MultiText=MultiText Spider OntoSpider=OntoSpider sherlock_spider=Sherlock Spider Steeler=Steeler Spider 0.1_hseo(at)cs.rutgers.edu=Rutgers.eduSpider Zao/0.2=Zao Spider xcrawler@inria.fr=Xcrawler xyro=Xyro Spider WebGather=WebGather Spider Ad Muncher=Ad Muncher Spider ADSAComponent=ADSA Spider ADSARobot=ADSARobot Albert Indexer=Albert Indexer AnswerChase=AnswerChase ASPSeek=ASPSeek ATA-Translation-Service=ATA Spider AVSearch=AVSearch Spider beholder=Beholder Spider e-sense=E-sense Spider BravoBrian=BravoBrian Spider bumblebee@relevare.com=BumbleBee Spider Checkbot=Checkbot contype=ConType Spider Convera Internet Spider=Convera Spider DaviesBot=DaviesBot deepweb=Deepweb Spider EbiNess=EbiNess Spider EmailWolf=EmailWolf Spider Excalibur Internet Spider=Excalibur Spider Expired Domain Sleuth=Domain Slueth GigaBaz=GigaBaz Spider GigaBazVStheWeb=GigaBaz2 Spider crawler@brainbot.com=BrainBot Spider Giskard=Giskard Spider grub-client=Grub Spider htdig=HT Dig Spider infoGIST=infoGIST Spider InterGO=InterGO Spider InternetArchive=Internet Archive Internet Ninja=Internet Ninja Spider InternetSeer=InternetSeer ipiumBot=ipiumBot InternetAmi IOR=InternetAmi InsumaScout/=InsumaScout Katriona=Katriona Spider larbin=Larbin Spider LEIA=LEIA Spider LexiBot=LexiBot logikabot=LogikaBot Mister Pix II=Mister Pix Spider MOSES 2.0 Spider=Moses 2.0 Spider Mata Hari=MataHari Spider metabot=MetaBot NetCruiser=NetCruiser NPBot=NPBot NetZippy=NetZippy NZBot=NZBot Opencola=Opencola Spider ORA_checksite=ORA Spider Onekit.com - PAD File Get.=Onekit.com Oxxbot1=Oxxbot1 Pansophica=Pansophica Spider Phoaks=Phoaks Spider phpMySearch-Crawler=phpMySearch PICgrabber=PICgrabber PictureOfInternet=POI Spider rik@malfunction.org=Malfunction.orgr PintaSpider=PintaSpider Pita (Chub.Stanford.EDU)=Pita (Stanford.edu) PitSpyder Thread<n>0=PitSpyder psbot=PSbot PolyBot=PolyBot PureSight=PureSight Rumours-Agent=Rumours Spider RepoMonkey Bait & Tackle=RepoMonkey Spider Robot2.0(PingSoft)=Robot2.0 SilentSurf=SilentSurf SlySearch=SlySearch Slysearch@slysearch.com=SlySearch.com SpaceBison=SpaceBison SpotOn=SpotOn Spider SQ Webscanner=Webscanner Squid=Squid Spider Sqworm=Sqworm Spider SurfControl=SurfControl Tagword=Tagword TaWWWantula=TaWWWantula Tcl http client package=TCL Spider TeraCrawl=TeraCrawl TurnitinBot=TurnitinBot UCmore=UCmore UdmSearch=UdmSearch unlostBot=unlostBot unlostBot@unlost.com=Unlost.com URLBlaze=URLBlaze Spider utopy=Utopy Spider crawler@utopy.com=Utopy.com UtilMind HTTPGet=UtilMind Spider UrlScope=UrlScope Spider Vagabondo=Vagabondo Spider VCI WebViewer=VCI Spider vspider=VSpider WAVETools=WAVETools Spider Webbandit=Webbandit Spider Webclipping.com=Webclipping Spider webcollage=WebCollage Spider WebCompass=WebCompas Spider WebGenie=WebGenie Spider Web Hound=WebHound Spider Web Magnet=WebMagnet Spider WebMiner=WebMiner Spider Webpush=Webpush Spider WebSymmetrix=WebSymmetrix Spider webrank=WebRank Spider webwasher=WebWasher Spider WhosTalking=WhosTalking XupiterToolbar=Xupiter Spider
voilà
