Forums intermittently going down?

2018-09-17 Thread Michael via Digitalmars-d
It has been occurring for the past two weeks now, at least. When I try to load the forum (on different networks) it will often hang for a while, and when it does eventually load a page, it is likely that clicking a link will cause it to get stuck loading again, or eventually display the followi

Re: Forums intermittently going down?

2018-09-17 Thread Vladimir Panteleev via Digitalmars-d
On Monday, 17 September 2018 at 11:02:39 UTC, Michael wrote: It has been occurring for the past two weeks now, at least. When I try to load the forum (on different networks) it will often hang for a while, and when it does eventually load a page, it is likely that clicking a link will cause it

Re: Forums intermittently going down?

2018-09-17 Thread Paolo Invernizzi via Digitalmars-d
On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: On Monday, 17 September 2018 at 11:02:39 UTC, Michael wrote: It has been occurring for the past two weeks now, at least. When I try to load the forum (on different networks) it will often hang for a while, and when it does

Re: Forums intermittently going down?

2018-09-17 Thread Michael via Digitalmars-d
On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: On Monday, 17 September 2018 at 11:02:39 UTC, Michael wrote: It has been occurring for the past two weeks now, at least. When I try to load the forum (on different networks) it will often hang for a while, and when it does

Re: Forums intermittently going down?

2018-09-17 Thread Petar via Digitalmars-d
On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: [..] The high load is temporary, but will take a week or two to resolve. How feasible would be to have a simple page like https://status.github.com/ for sharing such information?

Re: Forums intermittently going down?

2018-09-17 Thread Vladimir Panteleev via Digitalmars-d
On Monday, 17 September 2018 at 16:51:42 UTC, Petar Kirov [ZombineDev] wrote: On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: [..] The high load is temporary, but will take a week or two to resolve. How feasible would be to have a simple page like https://status.gith

Re: Forums intermittently going down?

2018-09-20 Thread Vladimir Panteleev via Digitalmars-d
On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: The high load is temporary, but will take a week or two to resolve. Performance should now be back to normal.

Re: Forums intermittently going down?

2018-09-25 Thread PassingBy via Digitalmars-d
On Friday, 21 September 2018 at 00:57:42 UTC, Vladimir Panteleev wrote: On Monday, 17 September 2018 at 11:51:04 UTC, Vladimir Panteleev wrote: The high load is temporary, but will take a week or two to resolve. Performance should now be back to normal. forum.dlang.org is temporarily down fo

Re: Forums intermittently going down?

2018-09-25 Thread CharlesM via Digitalmars-d
On Monday, 17 September 2018 at 11:02:39 UTC, Michael wrote: ... Yeah it happened again today. I heard this site was made in D, maybe is because the GC?

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Tuesday, 25 September 2018 at 18:26:58 UTC, CharlesM wrote: Yeah it happened again today. I heard this site was made in D, maybe is because the GC? No, just old server hardware and database fragmentation.

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Friday, 21 September 2018 at 00:57:42 UTC, Vladimir Panteleev wrote: Performance should now be back to normal. Looks like my previous hunch as to why it was slow was off. Should be fixed now.

Re: Forums intermittently going down?

2018-09-25 Thread H. S. Teoh via Digitalmars-d
On Tue, Sep 25, 2018 at 08:41:51PM +, Vladimir Panteleev via Digitalmars-d wrote: > On Tuesday, 25 September 2018 at 18:26:58 UTC, CharlesM wrote: > > Yeah it happened again today. I heard this site was made in D, maybe > > is because the GC? > > No, just old server hardware and database frag

Re: Forums intermittently going down?

2018-09-25 Thread Steven Schveighoffer via Digitalmars-d
On 9/25/18 5:05 PM, H. S. Teoh wrote: On Tue, Sep 25, 2018 at 08:41:51PM +, Vladimir Panteleev via Digitalmars-d wrote: On Tuesday, 25 September 2018 at 18:26:58 UTC, CharlesM wrote: Yeah it happened again today. I heard this site was made in D, maybe is because the GC? No, just old serv

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Tuesday, 25 September 2018 at 21:12:54 UTC, Steven Schveighoffer wrote: I'll note that when I started running into DB slowdowns on a system (not related to D), adding one index fixed the issue. Sometimes linear searches are fast enough to hide in plain sight :) I'm no DBA. Here's the schem

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Tuesday, 25 September 2018 at 21:12:54 UTC, Steven Schveighoffer wrote: Well, I thought it might be GC related also. It behaves similarly to how you would expect a GC pause to behave (several fast responses, then one that takes 5 seconds to come back). I think that would be plausible if par

Re: Forums intermittently going down?

2018-09-25 Thread bachmeier via Digitalmars-d
On Tuesday, 25 September 2018 at 21:20:29 UTC, Vladimir Panteleev wrote: Sometimes the database (SQLite) behaves unusually slow until you tell it to analyze itself, then it figures out some internal index it has to use that it wasn't using before (with no changes to schema). Those analysis ru

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Tuesday, 25 September 2018 at 21:42:40 UTC, bachmeier wrote: How much data can there possibly be for a mailing list? Currently, 3.8 GB. A good part of that is the full-text index required for searching. (It does work really well, though - no need for Lucene or such.) I regularly see sto

Re: Forums intermittently going down?

2018-09-25 Thread H. S. Teoh via Digitalmars-d
On Wed, Sep 26, 2018 at 01:07:29AM +, Vladimir Panteleev via Digitalmars-d wrote: [...] > One thing possible with a traditional RDBMS that's not possible with > SQLite is processing several simultaneous requests. The synchronous > API translates to the synchronous nature of the entire program:

Re: Forums intermittently going down?

2018-09-25 Thread CharlesM via Digitalmars-d
On Wednesday, 26 September 2018 at 01:52:31 UTC, H. S. Teoh wrote: I don't know what your schema looks like, so it's hard to give specifics https://github.com/CyberShadow/DFeed/blob/master/schema.sql

Re: Forums intermittently going down?

2018-09-25 Thread CharlesM via Digitalmars-d
On Tuesday, 25 September 2018 at 21:20:29 UTC, Vladimir Panteleev wrote: Sometimes the database (SQLite) https://github.com/CyberShadow/DFeed/blob/master/schema.sql CREATE TABLE [Groups] ( [Group] VARCHAR(50) NULL, [ArtNum] INTEGER NULL, [ID] VARCHAR(50) NULL , Time INTEGER); If you're usi

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Wednesday, 26 September 2018 at 01:52:31 UTC, H. S. Teoh wrote: What version of SQLite are you using? AFAIK, SQLite itself does support concurrent access. Though it does have to be explicitly compiled with that option, otherwise it will only issue a runtime error. Of course, locking is no

Re: Forums intermittently going down?

2018-09-25 Thread Vladimir Panteleev via Digitalmars-d
On Wednesday, 26 September 2018 at 02:28:27 UTC, CharlesM wrote: If you're using SQLite you don't need to specify the size of the columns, for what I gather it's useless for this DB. Yep, this is mostly descriptive. Types in column declarations have mostly the same effect. And if I'm not mis

Re: Forums intermittently going down?

2018-09-25 Thread CharlesM via Digitalmars-d
On Wednesday, 26 September 2018 at 02:42:15 UTC, Vladimir Panteleev wrote: On Wednesday, 26 September 2018 at 02:28:27 UTC, CharlesM wrote: If you're using SQLite you don't need to specify the size of the columns, for what I gather it's useless for this DB. Yep, this is mostly descriptive. Typ

Re: Forums intermittently going down?

2018-09-25 Thread Abdulhaq via Digitalmars-d
On Tuesday, 25 September 2018 at 21:20:29 UTC, Vladimir Panteleev wrote: Sometimes the database (SQLite) SQLite was designed initially to be single local process, one connection. You should get much better results with postgres though of course it has some maintenance overhead (mainly inst

Re: Forums intermittently going down?

2018-09-26 Thread H. S. Teoh via Digitalmars-d
On Wed, Sep 26, 2018 at 02:33:27AM +, Vladimir Panteleev via Digitalmars-d wrote: > On Wednesday, 26 September 2018 at 01:52:31 UTC, H. S. Teoh wrote: [...] > > but basically, any column used in a WHERE clause is a candidate for > > indexing. > > Yep, I think we're past that already. > > The

Re: Forums intermittently going down?

2018-10-04 Thread JN via Digitalmars-d
On Wednesday, 26 September 2018 at 02:33:27 UTC, Vladimir Panteleev wrote: fixed this by limiting the check to the first unread post instead of reusing a function to count all unread messages in the subscription queue: https://github.com/cybershadow/DFeed/commit/9cfcab2 Seems like the issues

Re: Forums intermittently going down?

2018-10-04 Thread Vladimir Panteleev via Digitalmars-d
On Thursday, 4 October 2018 at 19:18:15 UTC, JN wrote: Seems like the issues with the forum got worse. It's hardly usable today, most of the time I am being greeted by "forums are being overloaded" message. Yeah, painfully aware. I've been trying a bunch of different things all day, and looks

Re: Forums intermittently going down?

2018-10-05 Thread H. S. Teoh via Digitalmars-d
On Thu, Oct 04, 2018 at 11:51:02PM +, Vladimir Panteleev via Digitalmars-d wrote: > On Thursday, 4 October 2018 at 19:18:15 UTC, JN wrote: > > Seems like the issues with the forum got worse. It's hardly usable > > today, most of the time I am being greeted by "forums are being > > overloaded"

Re: Forums intermittently going down?

2018-10-05 Thread AlCaponeJr via Digitalmars-d
On Friday, 5 October 2018 at 16:11:05 UTC, H. S. Teoh wrote: On Thu, Oct 04, 2018 at 11:51:02PM +, Vladimir Panteleev via Digitalmars-d wrote: On Thursday, 4 October 2018 at 19:18:15 UTC, JN wrote: > Seems like the issues with the forum got worse. It's hardly > usable today, most of the tim

Re: Forums intermittently going down?

2018-10-05 Thread H. S. Teoh via Digitalmars-d
On Fri, Oct 05, 2018 at 07:35:11PM +, AlCaponeJr via Digitalmars-d wrote: > On Friday, 5 October 2018 at 16:11:05 UTC, H. S. Teoh wrote: > > On Thu, Oct 04, 2018 at 11:51:02PM +, Vladimir Panteleev via > > Digitalmars-d wrote: [...] > > > Yeah, painfully aware. I've been trying a bunch of d

Re: Forums intermittently going down?

2018-10-06 Thread Jacob Carlborg via Digitalmars-d
On 2018-10-05 22:32, H. S. Teoh wrote: Yes, and have it go down when things like the infamous AWS Outage happens. Centralization is evil. And you think that cannot happen when you're managing the hardware yourself? If you're hardware is not failing you're ISP still can. If you're really par

Re: Forums intermittently going down?

2018-10-06 Thread Jacob Carlborg via Digitalmars-d
On 2018-10-05 22:32, H. S. Teoh wrote: Yes, and have it go down when things like the infamous AWS Outage happens. Centralization is evil. How is having single server (I assume) behind a single ISP any less centralization than a cloud provider? Another advantage of using the cloud is that i

Re: Forums intermittently going down?

2018-10-06 Thread Basile B via Digitalmars-d
On Saturday, 6 October 2018 at 09:29:42 UTC, Jacob Carlborg wrote: Just see what has happened to the DMD nightly builds. It's been down for weeks (soon a month?) I've checked the logs from my stuff at Semaphore and it's since Sept 7 to be exactly.