+ Reply to Thread
Results 1 to 9 of 9

Thread: Google bot. Anyone faced problems?

  1. #1
    jensen's Avatar
    jensen is offline x10 Lieutenant jensen is an unknown quantity at this point
    Join Date
    Nov 2005
    Location
    At my desk
    Posts
    438

    Google bot. Anyone faced problems?

    Just got an email from a friend warning me about the dangers of Google bot. It seemed that a website got deleted because a google bot visited the site and wipoed out the site. It was because of some script that the bot craled.

    Is this a major danger?
    "For I am not ashamed of the gospel of Christ: for it is the power of God unto salvation to every one that believeth" Romans 1:16

  2. #2
    bigguy's Avatar
    bigguy is offline Retired bigguy is an unknown quantity at this point
    Join Date
    Mar 2005
    Location
    Canada
    Posts
    5,426

    Re: Google bot. Anyone faced problems?

    No, I really can`t see this happening at all.
    P.C. Tweakr - For all your computer and internet support
    P.C. Tweakr - For all your SMF help and support

  3. #3
    Bryon is offline Administrator Bryon has disabled reputation
    Join Date
    Apr 2005
    Location
    Northfield, NH
    Posts
    7,608

    Re: Google bot. Anyone faced problems?

    If you have a script on yoru server that is in your web root (public_html) and can cause harm to your site if it's ran, then it's pretty much your fault. You should always keep things like that below your web root directory.

    You could do what is described here though to help if you come across problems:
    http://google.com/webmasters/bot.html

    Overall though, like Geoff said, there isn't much to worry about unless you have links to "hidden files" floating around.

  4. #4
    Nathan Guest

    Re: Google bot. Anyone faced problems?

    MSNBot - 48
    Googlebot - 19
    Inktomi Slurp - 5
    Unknown robot (identified by 'crawl') - 2


    Information provided by AwStats on http://dewayne-smith.com

    The latest all bots crawled my site was yesterday.

  5. #5
    Spartan Erik's Avatar
    Spartan Erik is offline Retired Spartan Erik is an unknown quantity at this point
    Join Date
    Aug 2005
    Posts
    3,382

    Re: Google bot. Anyone faced problems?

    lol good grief, if you're that paranoid of a google bot (which you shouldnt be since google bots only want to see what pages you've got), you can set up a robots.txt file to block them..

    ive set it to block them all.. if you need a simple tut PM me

  6. #6
    echo_unlimited is offline x10 Elder echo_unlimited is an unknown quantity at this point
    Join Date
    Dec 2005
    Posts
    633

    Re: Google bot. Anyone faced problems?

    Why did you block them?

  7. #7
    Bryon is offline Administrator Bryon has disabled reputation
    Join Date
    Apr 2005
    Location
    Northfield, NH
    Posts
    7,608

    Re: Google bot. Anyone faced problems?

    You could easily block all bots from crawling you pages by placing this at the top of everyone. (Or by using a robots.txt file.. )

    Code:
    <meta name="robots" content="noindex,nofollow">
    Why though? :-\
    Last edited by Bryon; 04-21-2006 at 05:42 PM.

  8. #8
    Conor's Avatar
    Conor is offline Lord Of The Keys Conor is an unknown quantity at this point
    Join Date
    Jan 2005
    Location
    Toronto
    Posts
    1,785

    Re: Google bot. Anyone faced problems?

    If you want traffic for your site don't worry about spiders.

  9. #9
    jensen's Avatar
    jensen is offline x10 Lieutenant jensen is an unknown quantity at this point
    Join Date
    Nov 2005
    Location
    At my desk
    Posts
    438

    Re: Google bot. Anyone faced problems?

    Thanks for the assurance guys. I surely want the bots to crawl my site so that it would be found easily via google. Hmm.. yeah why won't you want the bots on your site? (since deletion is not a problem)
    Last edited by jensen; 04-21-2006 at 08:12 PM.
    "For I am not ashamed of the gospel of Christ: for it is the power of God unto salvation to every one that believeth" Romans 1:16

+ Reply to Thread

Similar Threads

  1. 2 more possiblites for google
    By vonnesh in forum Scripts & 3rd Party Apps
    Replies: 21
    Last Post: 04-03-2010, 07:49 AM
  2. Google As Your (Free) Broadband Provider?
    By subvertman in forum Scripts & 3rd Party Apps
    Replies: 17
    Last Post: 03-07-2010, 05:40 AM
  3. Google builds an empire to rival Microsoft!
    By FeestBijtje in forum Crossfire
    Replies: 62
    Last Post: 09-05-2008, 12:46 PM
  4. Google, Yahoo, MSN Search and the Government
    By Chris S in forum Crossfire
    Replies: 21
    Last Post: 02-01-2006, 02:42 PM
  5. Google wants your car listings, events, etc.
    By n4tec in forum Off Topic
    Replies: 3
    Last Post: 10-26-2005, 06:32 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
x10hosting free hosting for the masses
dedicated servers