Bot traffic: earthscrapers.com

all sites · all domains · last 15 days

All sites · All Domains · Visit earthscrapers.com

Who is really visiting earthscrapers.com?

Between Oct 23 and Nov 6, earthscrapers.com received 56,985 requests. About 99% came from automated software and about 0.5% look like real people.

That works out to about 105 human visitors, roughly 7 a day, who opened 186 pages between them. 39 of them read more than one page.

The biggest source is scanners hunting for security holes. They try the same list of common weak spots on every site they find.

Bottom line: the hit counts on the All Domains worksheet are almost entirely bots. Use the human visitor figure here to judge this site's real audience.

99%of requests from bots
105human visitors (estimate)
186pages opened by people
56,985total requests, 15 days

Where the requests came from

People 0.5%Named bots 6.7%Disguised bots 13%Scanners 78%Unclear 0.8%

Requests per day

PeopleNamed botsDisguised botsScannersUnclear
02,0004,0006,0008,000Oct 23Oct 25Oct 27Oct 29Oct 31Nov 2Nov 4Nov 6

Human visitors per day

Same days, people only, on their own scale so they are visible.

0481216Oct 23Oct 25Oct 27Oct 29Oct 31Nov 2Nov 4Nov 6

The breakdown

SourceRequestsΣ 56,985ShareData sentBlockedby the serverWhat this means
Break-in scanners39,47469%62 MB25,557Probing for WordPress logins, password files and other common weak spots.
Disguised scrapers6,61612%56 MB9Claims to be a normal browser but only downloads pages, never the images or icons a real browser fetches, reads many pages without ever clicking a link, or runs from a cloud provider.
Scanners posing as browsers5,2319.2%27 MB53Other requests from an address also caught probing for weak spots.
Other named bots1,2992.3%10 MB15Any other software that identifies itself as a bot.
Search engines1,2642.2%6 MB7Crawlers that say who they are, such as Google, Bing, Apple and Amazon. Usually welcome: this is how people find the site.
AI crawlers1,1101.9%3 MB102AI companies gathering pages or answering a user's question, and saying so.
Scripts and tools1,0581.9%3 MB7Programs such as curl or Python, or anything with an unrecognizable name.
Unclear4730.8%<1 MB0Browser name, but fetched only an image or data file and no page. Could be either.
Likely people2390.4%2 MB0Opened a page and also fetched its images or icons, at a human pace, from a non-cloud address.
SEO and marketing tools1690.3%<1 MB53Commercial tools that sell data about websites.
Possibly people480.1%<1 MB0Read 1 to 3 pages, arrived from a search engine or social link, no icons fetched. Referrers can be faked, so treat these as maybe.
No name given40.0%<1 MB1Requests that give no software name at all.

Named bots

Botas it names itselfTypeRequests
PetalBotSearch engines495
GooglebotSearch engines236
ClaudeBotAI crawlers219
bingbotSearch engines179
OAI-SearchBotAI crawlers118
QlyzeBotOther named bots114
BytespiderAI crawlers110
ChatGPT-UserAI crawlers103
facebook.comOther named bots93
PerplexityBotAI crawlers86
ibou-searchOther named bots85
meta-webindexerOther named bots81
Amzn-SearchBotSearch engines74
NebulaCVEOther named bots73
SERankingBacklinksBotSEO and marketing tools67

What people opened

Pages opened by at least two different human visitors.

PageHuman visitors
/56
/about/9
/news/8
/rss-api8
/benefits-and-challenges/7
/resources/7
/faq/5
/underground-cities/4
/index2606130533/resources/2
/iconic-projects/2
/building-down/2
/earth-sheltered-homes/2

How people arrived

Referring siteHuman visitors
m.baidu.com23
www.google.com5
duckduckgo.com4
www.bing.com2
kagi.com1
www.baidu.com1
yandex.ru1
www.facebook.com1

Where disguised bots operate from

Address blocks, not individual addresses. A heavily used block with many addresses suggests one operator rotating through them.

Address blockRequestsAddresses used
192.42.0.0/1625046
34.130.0.0/162342
73.190.0.0/161581
143.105.0.0/161573
104.164.0.0/161355
66.249.0.0/161343
103.196.0.0/161313
102.90.0.0/161263

Day by day

DayHuman visitorsHuman pagesNamed botsrequestsDisguisedrequestsScannersrequestsUnclearrequestsAllrequestsBot share
Oct 2310133434293,536254,35599%
Oct 2412221882683,482173,98999%
Oct 25343552273,114313,73499%
Oct 2612182534502,263163,01498%
Oct 277162857692,684243,78099%
Oct 28551596453,885184,71799.4%
Oct 29461743913,457134,04399.5%
Oct 3012162924851,981502,83697%
Oct 31461143135,680176,13399.6%
Nov 115228031,6594,154386,68999%
Nov 27142224523,715994,50897%
Nov 3231824993,305494,03899%
Nov 415222592581,061441,65995%
Nov 55141335841,625212,37998%
Nov 64580249763111,11198%

How this was measured

Every request in the server log was sorted by what it did, not only what it claimed to be. Bots that name themselves are counted as named. Anything claiming to be a browser had to act like one: open a page, fetch its images or icons, move at human speed, and come from outside the big cloud providers. These are estimates. A careful bot can pass the test, and a person with images blocked or a cached icon can fail it, so read the human figures as a good approximation, not an exact count. One person using two devices counts as two visitors. Google Analytics-style tools would show different numbers because most bots never run their script. Logs are kept for 15 days.

Built 2026-11-06 22:43 UTC from 15 log files.