NoteMe
Search:
Blog tags:
Python:
- Formating time and date
- Regular expressions
- Range, in for loops
- Check if a file exists
- Find file size
- Simple use of lists
- Random filename or string
- Add digits to a file name
- Common string methods
- Notes on slicing
PHP:
Visitors:
- Online now: 8
- Most users online: 1394
- Total page views: 1867321
Pounding my page:
Tags: NoteMe.comDate: 23.11.2006
I was just working on a new feature on my page now. It will show what browses most often visits my page. It will be in the right menu under the visitor counts. And I started with the easy part logging the different browsers. I took only 4 big browser brands and the beginning and said that the rest was other. There shouldn`t be too many of them anyway right?
Well not quite right. What about crawlers. Yeah, what about them crawlers. After working on some of the other functions to display the results I checked back to see what it had logged, and I got quite surprised. The majority is not IE, nor Firefox, and at least not Opera, but Others.
I bet 98% of these are crawlers. Why are they so many, or why do they want to fetch my front page so many times. Do they really need to do this? Does it help us that most of the web traffic these days are crawlers? Or does the spam bots just take a liking to my page? Well sometimes it really looks like they pick a favorite and keep on spamming that one, not because it is necessary, but because it is possible. Just take a look at Jesse Ruderman while he is out of town.
