#MISC bots User-agent: SBIder Disallow: / User-agent: webalta Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: NaverBot Disallow: / User-agent: Naver Disallow: / User-agent: R6_FeedFetcher Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Charlotte Disallow: / User-agent: SurveyBot Disallow: / User-agent: MLBot Disallow: / #TWICELER User-agent: Twiceler-0.9 Disallow: / User-agent: twiceler Disallow: / User-agent: cuill Disallow: / #END of TWICELER User-agent: ScoutJet Disallow: / User-agent: Gigabot Disallow: / #MSN #User-agent: msnbot #Disallow: / #User-agent: msnbot-media #Disallow: / #GOOGLE #User-agent: Googlebot #Disallow: / #User-agent: Google #Disallow: / #YAHOO Bots #User-agent: Slurp #Disallow: / #ALL go away #User-agent: * #Disallow: / User-agent: * Disallow: /blastU/ Disallow: /blastU/index.html Disallow: /Audio/ Disallow: /Audio_Public/ Disallow: /BACKUPS/ Disallow: /G/ Disallow: /Journal/ Disallow: /MyCreations/ Disallow: /MySpace/ Disallow: /OLDCRAP/ Disallow: /css/ Disallow: /dare/ Disallow: /flash/ Disallow: /imvu/ Disallow: /wp-litterbox/ Disallow: /wp/wp-content/plugins/ Disallow: /wp/wp-admin/ Disallow: /wp-includes/ Crawl-delay: 20 # BEGIN XML-SITEMAP-PLUGIN Sitemap: http://www.spiritfreedoms.com/sitemap.xml.gz # END XML-SITEMAP-PLUGIN