ASL Scenario Archive is down

Honza

The Art Of Wargames
Silver Supporting Member
Joined
Dec 30, 2005
Messages
12,707
Reaction score
1,402
Location
Oxfordshire
First name
Jan
Country
llCzechia
"database not found" was the latest report.
 

Blofeld

Member
Joined
Jun 23, 2019
Messages
31
Reaction score
25
Country
llGermany
Or perhaps von Marwitz overloaded the system by feeding the the Scenario Archive with the map Esebeck's Pursuit.... 😇:D
 

Michael Dorosh

der Spieß des Forums
Gold Supporting Member
Joined
Feb 6, 2004
Messages
14,990
Reaction score
1,723
Location
Calgary, AB
First name
Michael
Country
llCanada
I get this:

Code:
Warning:  mysqli_connect(): (08004/1040): Too many connections in /var/www/asl/top.php on line 57

Notice:  Trying to get property 'connect_errno' of non-object in /var/www/asl/top.php on line 58

Warning:  mysqli_query() expects parameter 1 to be mysqli, boolean given in /var/www/asl/top.php on line 72

Notice:  Trying to get property 'error' of non-object in /var/www/asl/top.php on line 72
Failed Query 123: Select * from users where is_bot=0 and (lower(login)='michael dorosh' or lower(email)='michael dorosh') and (enc_password='c3f2a47cd6bc5a64393f72ee770741bf766' or enc_password=sha1('c3f2a47cd6bc5a64393f72ee770741bf766'))

Ended
 

JRKrejsa

Elder Member
Joined
Sep 21, 2005
Messages
3,416
Reaction score
844
Location
USA
Country
llUnited States
I get this:

Code:
Warning:  mysqli_connect(): (08004/1040): Too many connections in /var/www/asl/top.php on line 57

Notice:  Trying to get property 'connect_errno' of non-object in /var/www/asl/top.php on line 58

Warning:  mysqli_query() expects parameter 1 to be mysqli, boolean given in /var/www/asl/top.php on line 72

Notice:  Trying to get property 'error' of non-object in /var/www/asl/top.php on line 72
Failed Query 123: Select * from users where is_bot=0 and (lower(login)='michael dorosh' or lower(email)='michael dorosh') and (enc_password='c3f2a47cd6bc5a64393f72ee770741bf766' or enc_password=sha1('c3f2a47cd6bc5a64393f72ee770741bf766'))

Ended
Same here. But it is up now.
 

Michael Dorosh

der Spieß des Forums
Gold Supporting Member
Joined
Feb 6, 2004
Messages
14,990
Reaction score
1,723
Location
Calgary, AB
First name
Michael
Country
llCanada
Seems like this website is up and down a lot. Is it still being maintained as of July 2020?
I used it last week with no problems. They just underwent a site redesign so it seems unlikely it would be abandoned. The feller who does the Illuminating Round youtube channel maintains it.

Actually, looks like he named his channel after the archive:

 

daveramsey

Senior Member
Joined
Jun 10, 2006
Messages
1,606
Reaction score
465
Location
Hertfordshire
First name
Dave
Country
llUnited Kingdom
Hey guys,

Just to explain.. Every now and again (usually every couple of days) a bot hits the site and requests thousands of advanced searches. The database connections are recycled and are closed correctly, but there are a finite number of connections, and if you open a request faster than a slow(ish) advanced (25-200ms) search runs you eat into the connections available. At a certain point the database just gives up and seems to die. Now - that shouldn't happen - but I think what goes on is that if a connection is recycled every few minutes, and at that point the bot has queued up a few thousand more requests, no matter how many connections are recycled, the site can't recover because each time a new connection is available the request has been lined up ready to request another search.

My latest change has been to automate a reboot every 3 days (I may make this every night) just to mean that - worst case - the site will automatically come back the next time 4am uk time rolls around (if I haven't caught it before then) and to add a "no robots" meta tag to the advanced search page. I'm not particularly hopeful that this will resolve it, but rest assured I am maintaining the site and generally someone tags me, either on facebook, email or here when the site goes down. The problem is sometimes I'm sleeping, or travelling/away from a keyboard and I don't see the alert for a few hours.

If anyone wants to investigate log files, etc - I can provide stuff. Mysql, Apache, php and Ubuntu 20.something is the platform.

Cheers,

Dave
 

Pacman Ghost

Member
Joined
Feb 25, 2017
Messages
326
Reaction score
170
Location
A maze of twisty little passages, all alike
Country
llAustralia
Every now and again (usually every couple of days) a bot hits the site and requests thousands of advanced searches.
You have to rate-limit requests. I've dealt with these assholes before, and they can be tenacious :-/ But as a quick fix, banning IP's and/or user agents might be enough. If you send me the logs, I can write you a quick script to extract that information.

I use the Uptime Robot to monitor my sites. They have a free tier, and it seems to work 🤷 You could maybe automate a reboot based on what it's telling you, but it'd be better to fix the underlying problem :)
 

holdit

Senior Member
Joined
Mar 4, 2006
Messages
258
Reaction score
352
Location
Ireland
Country
llIreland
Hey guys,

Just to explain.. Every now and again (usually every couple of days) a bot hits the site and requests thousands of advanced searches. The database connections are recycled and are closed correctly, but there are a finite number of connections, and if you open a request faster than a slow(ish) advanced (25-200ms) search runs you eat into the connections available. At a certain point the database just gives up and seems to die. Now - that shouldn't happen - but I think what goes on is that if a connection is recycled every few minutes, and at that point the bot has queued up a few thousand more requests, no matter how many connections are recycled, the site can't recover because each time a new connection is available the request has been lined up ready to request another search.
Your site is fantastic, by the way. Big massive, gi-normous thumbs up. 👍👍👍
 

pixelgeek

Just some guy
Joined
Jan 2, 2013
Messages
119
Reaction score
90
Location
Calgary
First name
Zac
Country
llCanada
Hey guys,

Just to explain.. Every now and again (usually every couple of days) a bot hits the site and requests thousands of advanced searches.
Have you tried to restrict its access via a robots.txt file?
 

daveramsey

Senior Member
Joined
Jun 10, 2006
Messages
1,606
Reaction score
465
Location
Hertfordshire
First name
Dave
Country
llUnited Kingdom
Have you tried to restrict its access via a robots.txt file?
Yep - see my post above.

You have to rate-limit requests.
Rate-limiting from my initial investigation wasn't quite right as that seemed to do things on a bandwidth level, the search results page isn't very resource intensive from a bandwidth perspective, I need limit the actual number of requests per minute from any given source (to somewhere around 30-60 I'd think). I think mod_evasive does this, and that's the next step, if it continues.

Cheers all!
 
Top