News:




  • November 19, 2017, 02:50:09 PM

Login with username, password and session length

Author Topic: SSW  (Read 2801 times)

Offline RC Storick

  • From concept to reality
  • Administrator
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 11400
  • The finish starts with the first piece of wood cut
    • Stunt Hangar
SSW
« on: May 27, 2012, 12:33:38 PM »
Seems SSW is having issues again.
AMA 12366


Online Bruce Hautamaki

  • Trade Count: (0)
  • Lieutenant
  • ***
  • Posts: 57
Re: SSW
« Reply #1 on: May 27, 2012, 12:47:06 PM »
     I think he is trying to get rid of the "bot". Hope it works.

Offline RC Storick

  • From concept to reality
  • Administrator
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 11400
  • The finish starts with the first piece of wood cut
    • Stunt Hangar
Re: SSW
« Reply #2 on: May 27, 2012, 02:33:07 PM »
     I think he is trying to get rid of the "bot". Hope it works.

Bot? Whats that?
AMA 12366

Online Brett Buck

  • Trade Count: (0)
  • Admiral
  • ******
  • Posts: 7924
Re: SSW
« Reply #3 on: May 27, 2012, 03:00:12 PM »
Bot? Whats that?

  In this case it seems to be something that is crawling his website and indexing it, for some reason. It's the same sort of thing that enables Google to see what is on a site and then make the words available to be searched. May be malicious or may be innocent but has bugs.

    Brett

Offline RC Storick

  • From concept to reality
  • Administrator
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 11400
  • The finish starts with the first piece of wood cut
    • Stunt Hangar
Re: SSW
« Reply #4 on: May 27, 2012, 03:02:57 PM »
 In this case it seems to be something that is crawling his website and indexing it, for some reason. It's the same sort of thing that enables Google to see what is on a site and then make the words available to be searched. May be malicious or may be innocent but has bugs.

    Brett

The bot you speak of is on another server not his. I am not sure if your saying someone downloaded it to his site? Seems I have fixed the harvesting of email address problem we had here. They were trolling us and looking to harvest email addresses. That is why I had it closed for so long. It was hard to find the answer. I am sure a pro scripter could have fixed it quick but I am just a mechanic.
AMA 12366

Online Bruce Hautamaki

  • Trade Count: (0)
  • Lieutenant
  • ***
  • Posts: 57
Re: SSW
« Reply #5 on: May 27, 2012, 03:53:36 PM »
    I think the problem is something was using up all his space. He pays for it himself. I read where he might have to shut down to get it to move on. Len has been there since "Isky's" ( and yes my Honda runs good). I am sure the archives the fine.

Offline Dave Denison

  • Trade Count: (0)
  • Commander
  • ****
  • Posts: 164
Re: SSW
« Reply #6 on: May 27, 2012, 03:58:04 PM »
Let's get the Round-Up out and spray the "crawleis" and the "bots".....keep our Yard clean.


  Dave.
  ama 41041
Regards
Dave

ama 41041

Offline Mike Keville

  • AMA Member
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 2282
Re: SSW
« Reply #7 on: May 27, 2012, 04:04:36 PM »
  I think the problem is something was using up all his space.....

Excessive number of "build thread" photos, perhaps?
"I have always abhorred change of any kind."
-James Herriot

Electric:  The death of Old Time Stunt!!!

Offline Bob Kruger

  • 2014 Supporters
  • Trade Count: (0)
  • Commander
  • *
  • Posts: 280
Re: SSW
« Reply #8 on: May 27, 2012, 06:41:14 PM »
Excessive number of "build thread" photos, perhaps?


Mike;

No, its not that.  Wish it were that simple.

Search engines around the world are crawling sites to index what is on them.  It has gotten so pervasive that total bandwidth has gone from about 1 GB/month to 9GB/month in the course of 12 months.  And, Leonard has to pay for that.

Based on some info that Leonard got yesterday, we instituted some changes, and it looks as if the bandwidth usage has dropped off exponentially, albeit the outage today.  The outage was actually my fault, as we had to make some changes that did not reflect properly in the configuration file.  Simple fix, and all seems to be well.  We will see if the changes limiting search engine bots gets the desired results.

Bob
Bob Kruger
AMA 42014

Offline BillLee

  • AMA Member
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 932
Re: SSW
« Reply #9 on: May 27, 2012, 08:31:13 PM »
Just exactly what did you do, Bob?
Bill Lee
AMA 20018

Offline Bob Kruger

  • 2014 Supporters
  • Trade Count: (0)
  • Commander
  • *
  • Posts: 280
Re: SSW
« Reply #10 on: May 28, 2012, 06:51:11 AM »
Just exactly what did you do, Bob?

Bill;

Bill,

Nothing fancy, just followed some of the guidance from these web site:

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449

http://www.robotstxt.org/robotstxt.html

Seems to be working, as the bandwidth trending from the last two days shows a huge drop in bandwidth, yet the logs show that user activity on the site to be about the same, save for an outage yesterday.

I never realized that these web crawling robots were as invasive on bandwidth as the are.

Bob
Bob Kruger
AMA 42014

Online john e. holliday

  • 2017
  • Trade Count: (0)
  • Admiral
  • *
  • Posts: 18742
Re: SSW
« Reply #11 on: May 28, 2012, 08:23:47 AM »
Too bad they can't catch these idiot nerds and hang them by their gonads. VD~
I was always taught to respect my elders, but it keeps getting harder to find one.
Today I broke my personal record for most consecutive days lived.
John E. "DOC" Holliday
10421 West 56th Terrace
Shawnee, KANSAS  66203
AMA 23530

Offline Bob Kruger

  • 2014 Supporters
  • Trade Count: (0)
  • Commander
  • *
  • Posts: 280
Re: SSW
« Reply #12 on: May 28, 2012, 01:52:01 PM »
Too bad they can't catch these idiot nerds and hang them by their gonads. VD~

Yep....

Bob Kruger
AMA 42014


Tags: