User-agent: * Disallow: /pdf/ User-agent: libwww-perl Disallow: / User-agent: libwwwperl Disallow: / User-agent: attach Disallow: / User-agent: ASPSeek Disallow: / User-agent: appie Disallow: / User-agent: AbachoBOT Disallow: / User-agent: autoemailspider Disallow: / User-agent: anarchie Disallow: / User-agent: antibot Disallow: / User-agent: asterias Disallow: / User-agent: B2w Disallow: / User-agent: BackWeb Disallow: / User-agent: BackDoorBot Disallow: / User-agent: Bandit Disallow: / User-agent: BatchFTP Disallow: / User-agent: Black\ Hole Disallow: / User-agent: Baidu Disallow: / User-agent: BlowFish Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: Bot\ mailto Disallow: / User-agent: BotALot Disallow: / User-agent: Buddy Disallow: / User-agent: Bullseye Disallow: / User-agent: bumblebee Disallow: / User-agent: BunnySlippers Disallow: / User-agent: ClariaBot Disallow: / User-agent: curl Disallow: / User-agent: clsHTTP Disallow: / User-agent: ChinaClaw Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: Crescent Disallow: / User-agent: CherryPickerSE Disallow: / User-agent: CherryPickerElite Disallow: / User-agent: Collector Disallow: / User-agent: COAST\ WebMaster Disallow: / User-agent: cosmos Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: ColdFusion Disallow: / User-agent: Copier Disallow: / User-agent: Crescent Disallow: / User-agent: DA Disallow: / User-agent: DTS\ Agent Disallow: / User-agent: DISCo\ Pump Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Diamond Disallow: / User-agent: Download\ Demon Disallow: / User-agent: Download\ Wonder Disallow: / User-agent: Downloader Disallow: / User-agent: dloader Disallow: / User-agent: Drip Disallow: / User-agent: eCatch Disallow: / User-agent: EirGrabber Disallow: / User-agent: Express\ WebPictures Disallow: / User-agent: Extreme\ Picture\ Finder Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EasyDL Disallow: / User-agent: EirGrabber Disallow: / User-agent: EroCrawler Disallow: / User-agent: ExtractorPro Disallow: / User-agent: EyeNetIE Disallow: / User-agent: FAST\ WebCrawler Disallow: / User-agent: FileHound Disallow: / User-agent: Fetch\ API\ Request Disallow: / User-agent: FlashGet Disallow: / User-agent: FlickBot Disallow: / User-agent: FrontPage Disallow: / User-agent: FreeFind.com Disallow: / User-agent: GetRight Disallow: / User-agent: GetSmart Disallow: / User-agent: Generic Disallow: / User-agent: Go!Zilla Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: gotit Disallow: / User-agent: Grabber Disallow: / User-agent: GrabNet Disallow: / User-agent: Grafula Disallow: / User-agent: Gulliver Disallow: / User-agent: Harvest Disallow: / User-agent: HMView Disallow: / User-agent: Heretrix Disallow: / User-agent: HitboxDoctor Disallow: / User-agent: HTTPapp Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTPTrack Disallow: / User-agent: HTTPviewer Disallow: / User-agent: httplib Disallow: / User-agent: httpfetcher Disallow: / User-agent: httpscraper Disallow: / User-agent: hloader Disallow: / User-agent: humanlinks Disallow: / User-agent: ia_archiver Disallow: / User-agent: InterGET Disallow: / User-agent: Internet\ Ninja Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: Iria Disallow: / User-agent: IRLbot Disallow: / User-agent: JetCar Disallow: / User-agent: JOC Disallow: / User-agent: JOC\ Web\ Spider Disallow: / User-agent: JoBo Disallow: / User-agent: Java Disallow: / User-agent: JustView Disallow: / User-agent: Jonzilla Disallow: / User-agent: JennyBot Disallow: / User-agent: Kenjin\ Spider Disallow: / User-agent: Keyword\ Density Disallow: / User-agent: larbin Disallow: / User-agent: LeechFTP Disallow: / User-agent: Lachesis Disallow: / User-agent: LexiBot Disallow: / User-agent: libWeb Disallow: / User-agent: Libby_ Disallow: / User-agent: LinkScan Disallow: / User-agent: LinkWalker Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: lftp Disallow: / User-agent: likse Disallow: / User-agent: Link Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp\ request Disallow: / User-agent: Magnet Disallow: / User-agent: Mag-Net Disallow: / User-agent: Mass\ Downloader Disallow: / User-agent: MIIxpc Disallow: / User-agent: Microsoft\ URL\ Control Disallow: / User-agent: MSFrontPage Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MicrosoftURL Disallow: / User-agent: Missigua Disallow: / User-agent: Mewsoft\ Search\ Engine Disallow: / User-agent: moget Disallow: / User-agent: Mata\ Hari Disallow: / User-agent: Memo Disallow: / User-agent: Metacarta Disallow: / User-agent: Mercator Disallow: / User-agent: MIDown\ tool Disallow: / User-agent: MFC_Tear_Sample Disallow: / User-agent: Mirror Disallow: / User-agent: MIIxpc Disallow: / User-agent: Mister\ PiX Disallow: / User-agent: NationalDirectory\ WebSpider Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Nikto Disallow: / User-agent: Navroad Disallow: / User-agent: NearSite Disallow: / User-agent: NetAnts Disallow: / User-agent: NetSpider Disallow: / User-agent: NICErsPRO Disallow: / User-agent: NetResearchServer Disallow: / User-agent: NetMechanic Disallow: / User-agent: Net\ Vampire Disallow: / User-agent: Net\ Probe Disallow: / User-agent: NetZip Disallow: / User-agent: nexuscache Disallow: / User-agent: Ninja Disallow: / User-agent: NPBot Disallow: / User-agent: our\ agent Disallow: / User-agent: onestop Disallow: / User-agent: oBot Disallow: / User-agent: Octopus Disallow: / User-agent: Offline\ Explorer Disallow: / User-agent: Openfind Disallow: / User-agent: Openfind\ data\ gatherer Disallow: / User-agent: OrangeBot Disallow: / User-agent: PageGrabber Disallow: / User-agent: Papa\ Foto Disallow: / User-agent: PHP\ version Disallow: / User-agent: PHP Disallow: / User-agent: PHPot Disallow: / User-agent: Perl Disallow: / User-agent: pcBrowser Disallow: / User-agent: pavuk Disallow: / User-agent: Pockey Disallow: / User-agent: Ping Disallow: / User-agent: PingALink\ Monitoring\ Services Disallow: / User-agent: ProWebWalker Disallow: / User-agent: ProPowerBot Disallow: / User-agent: Pump Disallow: / User-agent: Pompos Disallow: / User-agent: psbot Disallow: / User-agent: Python\ urllib Disallow: / User-agent: Python-urllib Disallow: / User-agent: QueryN Disallow: / User-agent: RealDownload Disallow: / User-agent: Reaper Disallow: / User-agent: Recorder Disallow: / User-agent: RepoMonkey Disallow: / User-agent: psycheclone Disallow: / User-agent: RMA Disallow: / User-agent: Rico Disallow: / User-agent: Robozilla Disallow: / User-agent: ReGet Disallow: / User-agent: Siphon Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: SmartDownload Disallow: / User-agent: Snake Disallow: / User-agent: spanner Disallow: / User-agent: Stealer Disallow: / User-agent: SpaceBison Disallow: / User-agent: SpankBot Disallow: / User-agent: Spinne Disallow: / User-agent: Stripper Disallow: / User-agent: slysearch Disallow: / User-agent: Sucker Disallow: / User-agent: Snoopy Disallow: / User-agent: ScoutAbout Disallow: / User-agent: Scooter Disallow: / User-agent: SuperBot Disallow: / User-agent: SuperHTTP Disallow: / User-agent: Snapbot Disallow: / User-agent: Surfbot Disallow: / User-agent: suzuran Disallow: / User-agent: Szukacz Disallow: / User-agent: Sqworm Disallow: / User-agent: tAkeOut Disallow: / User-agent: Teleport\ Pro Disallow: / User-agent: Telesoft Disallow: / User-agent: TurnitinBot Disallow: / User-agent: turingos Disallow: / User-agent: toCrawl Disallow: / User-agent: TightTwatBot Disallow: / User-agent: True_Robot Disallow: / User-agent: The\ Intraformant Disallow: / User-agent: TheNomad Disallow: / User-agent: Titan Disallow: / User-agent: UrlDispatcher Disallow: / User-agent: URLy\ Warning Disallow: / User-agent: Vayala Disallow: / User-agent: Vagabondo Disallow: / User-agent: Vintage Disallow: / User-agent: Vacuum Disallow: / User-agent: VCI Disallow: / User-agent: VoidEYE Disallow: / User-agent: W3C_Validator Disallow: / User-agent: Webdownloader Disallow: / User-agent: Web\ Downloader Disallow: / User-agent: Webhook Disallow: / User-agent: Webmole Disallow: / User-agent: Webminer Disallow: / User-agent: Webmirror Disallow: / User-agent: Websucker Disallow: / User-agent: Websites Disallow: / User-agent: Web\ Image\ Collector Disallow: / User-agent: Web\ Sucker Disallow: / User-agent: WebAuto Disallow: / User-agent: WebCopier Disallow: / User-agent: WebFetch Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: Website Disallow: / User-agent: Webster Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: WebViewer Disallow: / User-agent: WebWhacker Disallow: / User-agent: WebEnhancer Disallow: / User-agent: Wells Disallow: / User-agent: WebZIP Disallow: / User-agent: Wget Disallow: / User-agent: Whacker Disallow: / User-agent: Widow Disallow: / User-agent: Xaldon Disallow: / User-agent: Wildsoft\ Surfer Disallow: / User-agent: WinHttpRequest Disallow: / User-agent: WinHttp Disallow: / User-agent: Webster\ Pro Disallow: / User-agent: Web\ Image\ Collector Disallow: / User-agent: WebZip Disallow: / User-agent: WebAuto Disallow: / User-agent: Website\ Quester Disallow: / User-agent: WWWOFFLE Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: Xaldon\ WebSpider Disallow: / User-agent: Xenu Disallow: / User-agent: Xara Disallow: / User-agent: Y!TunnelPro Disallow: / User-agent: YahooYSMcm Disallow: / User-agent: Zade Disallow: / User-agent: ZBot Disallow: / User-agent: Zeus Disallow: / User-agent: Rogerbot Disallow: / User-agent: Exabot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Dotbot Disallow: / User-agent: Gigabot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BlackWidow Disallow: / User-agent: Bot\ mailto:craftbot@yahoo.com Disallow: / User-agent: ChinaClaw Disallow: / User-agent: Custo Disallow: / User-agent: DISCo Disallow: / User-agent: Download\ Demon Disallow: / User-agent: eCatch Disallow: / User-agent: EirGrabber Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Express\ WebPictures Disallow: / User-agent: ExtractorPro Disallow: / User-agent: EyeNetIE Disallow: / User-agent: FlashGet Disallow: / User-agent: GetRight Disallow: / User-agent: GetWeb! Disallow: / User-agent: Go!Zilla Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: GrabNet Disallow: / User-agent: Grafula Disallow: / User-agent: HMView Disallow: / User-agent: HTTrack Disallow: / User-agent: Image\ Stripper Disallow: / User-agent: Image\ Sucker Disallow: / User-agent: Indy\ Library Disallow: / User-agent: InterGET Disallow: / User-agent: Internet\ Ninja Disallow: / User-agent: JetCar Disallow: / User-agent: JOC\ Web\ Spider Disallow: / User-agent: larbin Disallow: / User-agent: LeechFTP Disallow: / User-agent: Mass\ Downloader Disallow: / User-agent: MIDown\ tool Disallow: / User-agent: Mister\ PiX Disallow: / User-agent: Navroad Disallow: / User-agent: NearSite Disallow: / User-agent: NetAnts Disallow: / User-agent: NetSpider Disallow: / User-agent: Net\ Vampire Disallow: / User-agent: NetZIP Disallow: / User-agent: Octopus Disallow: / User-agent: Offline\ Explorer Disallow: / User-agent: Offline\ Navigator Disallow: / User-agent: PageGrabber Disallow: / User-agent: Papa\ Foto Disallow: / User-agent: pavuk Disallow: / User-agent: pcBrowser Disallow: / User-agent: RealDownload Disallow: / User-agent: ReGet Disallow: / User-agent: SiteSnagger Disallow: / User-agent: SmartDownload Disallow: / User-agent: SuperBot Disallow: / User-agent: SuperHTTP Disallow: / User-agent: Surfbot Disallow: / User-agent: tAkeOut Disallow: / User-agent: Teleport\ Pro Disallow: / User-agent: VoidEYE Disallow: / User-agent: Web\ Image\ Collector Disallow: / User-agent: Web\ Sucker Disallow: / User-agent: WebAuto Disallow: / User-agent: WebCopier Disallow: / User-agent: WebFetch Disallow: / User-agent: WebGo\ IS Disallow: / User-agent: WebLeacher Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: Website\ eXtractor Disallow: / User-agent: Website\ Quester Disallow: / User-agent: WebStripper Disallow: / User-agent: WebWhacker Disallow: / User-agent: WebZIP Disallow: / User-agent: Wget Disallow: / User-agent: Widow Disallow: / User-agent: WWWOFFLE Disallow: / User-agent: Xaldon\ WebSpider Disallow: /