× Discuss the BigJimny Shop and Website in this section. Whats good, whats bad, whats ugly! - what would you like to see!

Re:Re:Re:Major Outage

More
20 Dec 2022 10:47 #246458 by mlines
Major Outage was created by mlines
Bigjimny has suffered a major outage in the last two days.

I have work through a lot of scenarios and found nothing (I know what is stopping working but I dont know why).

I have turned on a lot of tracing diagnostics which may make it slow (and of course it could crash at any time)

Martin

Martin

2003 M13 early KAP build.
3" Trailmaster lift with 1.5 Spacers on front
Customised winch bumper and roll cage
235/85R16 Maxxis Bighorns on 16" Rims, 4:1 Rocklobster, Rear ARB locker and on-board air
Corrected arms all-round, rear disks, Recaro seats and harnesses
The following user(s) said Thank You: grumyoldjoe, Lambert, Soeley

Please Log in or Create an account to join the conversation.

  • Lambert
  • Lambert's Avatar
  • Away
  • Moderator
  • Moderator
    Registered
  • The quickest Jimny in Harrogate...(that I own)
More
20 Dec 2022 10:50 #246459 by Lambert
Replied by Lambert on topic Major Outage
As ever thank you for your efforts

Temeraire (2018 quasar grey automatic)
One of the last 200ish of the gen3s, probably.
ADOS Attention Deficit Ooooh Shiny!

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 11:00 #246461 by grumyoldjoe
Replied by grumyoldjoe on topic Major Outage
Well done and thank you.

Wine improves with age.
The older I get the more I like it

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 11:25 #246462 by Soeley
Replied by Soeley on topic Major Outage
Hope you manage to find a good resolution.

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 11:57 #246464 by Old Neil
Replied by Old Neil on topic Re:Major Outage
Nice work Martin, this forum is an amazing resource, cheers from oz

Sent from my SM-A336E using Tapatalk

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 12:13 #246467 by DrRobin
Replied by DrRobin on topic Re:Major Outage
Hi Martin,

We really appreciate all of the hard work you put in, hope it gets fixed soon and you can go back to looking forwards to Xmas.

I have no direct experience of this website platform, but do have experience of other related systems, not sure if I could help? There might be other IT professionals on here with a lot more experience.

Anyway the message is don't be afraid to ask for help, I am quite happy if you want to contact me if you need to pass anything by me?

In my experience things like this that were working just fine and sudenly stop are nearly always as a result of upgrades somewhere, sometimes in the core offering.. Usually others experience the same problem so the forum is full of postings.

Robin

2020 blue SZ5 (one of the last to be registered in the UK)
Ex 2011 Blue Jimny SZ4
Northumberland Jimny Blog

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 13:15 #246469 by mlines
Replied by mlines on topic Re:Major Outage
Robin.

Its the mysql database server (in this case, MariaDb). It loses all knowledge of the attached databases roughly 15 minutes after booting. It loses them to the extent that it will not recover the connections unless the entire drive volume is restored from backup.

I have turned on SQL logging in the hope of trapping whats going on as the only thing in the syslog is that MariaDb is commanded to shutdown. However, inevitably, since turning on logging it has behaved just fine.

Martin

2003 M13 early KAP build.
3" Trailmaster lift with 1.5 Spacers on front
Customised winch bumper and roll cage
235/85R16 Maxxis Bighorns on 16" Rims, 4:1 Rocklobster, Rear ARB locker and on-board air
Corrected arms all-round, rear disks, Recaro seats and harnesses

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 18:16 #246471 by DrRobin
Replied by DrRobin on topic Re:Major Outage
I don't have any experience with MariaDb, but do have some experience of MySQL. My last problem was that as MySQL filled up queries would take so long to run that they would time out. This left errors in the tables and eventually I had to rebuild the tables to get rid of the accumulated errors.

The only solution we found was to archive much of the database off, year old data wasn't of much use in any case.

I did a quick search for MariaDb shut down after 15 minutes, there are a few entries on Serverfault, one person found a cron job which was shutting MariaDb down, another found that he had previously used MySQL and there were settings in that which conflicted with MariaDb.

I don't suppose the syslog tells you which process shut down MariaDb? If it isn't by name, it might be by PID and you could look up the processes with ps.

I don't suppose you have a DB tidy up/clean running as a cron job do you?

Hope that helps

Robin

2020 blue SZ5 (one of the last to be registered in the UK)
Ex 2011 Blue Jimny SZ4
Northumberland Jimny Blog

Please Log in or Create an account to join the conversation.

More
20 Dec 2022 18:30 #246472 by mlines
Replied by mlines on topic Re:Re:Major Outage
Robin,

Thanks, the tables are all clean with no errors

I have also looked at Cron to see if something was shutting it down but couldn't see anything.

It has been happily running MariaDb for years now. In previous years MariaDb had run out of memory so I increased the VM memory as the first attempt fix. The large database sizes seem to be no issue if it has the memory.

However it's only today that I have turned on logging ( it eats disk space) so it's a matter of waiting to catch it doing it, but now it's suddenly stable

Martin

Sent from my moto g42 using Tapatalk

Martin

2003 M13 early KAP build.
3" Trailmaster lift with 1.5 Spacers on front
Customised winch bumper and roll cage
235/85R16 Maxxis Bighorns on 16" Rims, 4:1 Rocklobster, Rear ARB locker and on-board air
Corrected arms all-round, rear disks, Recaro seats and harnesses

Please Log in or Create an account to join the conversation.

More
21 Dec 2022 14:06 #246485 by DrRobin
Replied by DrRobin on topic Re:Re:Major Outage
Typical, it won't fail when you want it to. It will probably go down Xmas or New Year's Eve just to be awkward.

Robin

2020 blue SZ5 (one of the last to be registered in the UK)
Ex 2011 Blue Jimny SZ4
Northumberland Jimny Blog

Please Log in or Create an account to join the conversation.

More
21 Dec 2022 15:36 #246486 by mlines
Replied by mlines on topic Re:Re:Major Outage

Typical, it won't fail when you want it to. It will probably go down Xmas or New Year's Eve just to be awkward.

Robin
I am sure it will. (If nothing else the log files will fill the disk and bring it to a halt!)

Martin

2003 M13 early KAP build.
3" Trailmaster lift with 1.5 Spacers on front
Customised winch bumper and roll cage
235/85R16 Maxxis Bighorns on 16" Rims, 4:1 Rocklobster, Rear ARB locker and on-board air
Corrected arms all-round, rear disks, Recaro seats and harnesses

Please Log in or Create an account to join the conversation.

More
01 Jan 2023 10:45 #246607 by mlines
Replied by mlines on topic Re:Re:Major Outage
Sods law.

I removed the diagnostic logging yesterday. Today it crashed.......

Martin

2003 M13 early KAP build.
3" Trailmaster lift with 1.5 Spacers on front
Customised winch bumper and roll cage
235/85R16 Maxxis Bighorns on 16" Rims, 4:1 Rocklobster, Rear ARB locker and on-board air
Corrected arms all-round, rear disks, Recaro seats and harnesses

Please Log in or Create an account to join the conversation.

Time to create page: 0.192 seconds
Powered by Kunena Forum

I hope you enjoy using this forum. Please consider making a donation towards the upkeep of this forum website.

We use cookies to give you the best online experience. Please let us know if you agree to all of these cookies. Accepting the Cookies also accepts the Disclaimers for the website.