Re: [AOLSERVER] Null responses
Hi Cyan, Yes, there's still a few subscribers. Do you know if this connection dropping happens mostly when there is a lot of activity or more frequently when there is very low activity? I recall a few edge cases in the thread pooling where a thread would in some circumstances wait until another connection came in before running, and there might have been a related case where a connection could get dropped. IIRC, these both happened generally when there was low traffic (or more specifically low concurrent traffic). Playing with maxconns might diminish the problem in this case. You also mention favicon.ico; is it mostly or always that? It's notable for being a small static file, which could point to other causes, like a corrupt interpreter state as Peter suggested. Or there might be some weirdness with mmap if you have that enabled. One other thought, can you switch to naviserver? The connection handling there has evolved somewhat differently not to mention more recently) than aolserver, but programming-wise there are not a lot of differences. -J Cyan ogilvie wrote: Hi I'm hoping there are still some subscribers to this list ;) I'm trying to debug a strange condition we're seeing on a small percentage of our connections: connections are being closed by the server without any response being sent back on the connection (verified by looking at network packet traces and inserting a logging transparent proxy between the client and server). The network packet pattern we see is: normal TCP setup - SYN, SYN/ACK, ACK Request data (in a single frame, or multiple), ACK Then the connection is closed by the server after 10 - 70 ms, without any data being sent, with a FIN/ACK (still getting confirmation on this - these logs are from the other side of the man-in-the-middle proxy I'm using to get debugging info). For some of the failed requests, the server processing never gets as far as the start of our Tcl code (a preauth filter that starts with an ns_log that doesn't show up in the server log). For others the request is processed normally and an access.log message written indicating that a response was generated with HTTP code 200, but no packet shows up on the network. There is no pattern to the failed requests (sometimes requests for favicon.ico fail), and retrying the exact request shortly afterwards often succeeds. Has anyone seen anything like this before, or have any advice on how to narrow down the cause further? We're running a slightly patched version of the last 4.5.2 rc, on Ubuntu 12.04.5 64bit on Amazon EC2 instances, with Tcl 8.6.1 Thanks Cyan -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] Roadmap Revisited (was Re: Is there anyone out there?)
Ok, I've been sitting on this response for far too long now, I may as well just send it out, perfection be damned. That was probably my thread on 4.6 and beyond you mentioned. Lots of energy ... then life happened, and time vanished. I'd still love to make things happen, I'm just short on energy right now. I don't think the existing userbase has particularly held anyone back from making changes, bold or otherwise. After all, people can always not upgrade. (According to the reports, a significant portion of aolserver users are still using version 4.0 or even 3). So if you want to make changes - make them! The wonderful thing about source control is that you get to keep your old stuff around. About source control - this isn't the first time someone has suggested using something else. Frankly, the strongest arguments for moving away from CVS and to something else from from Chris Tsai at SF support. To paraphrase, cvs hosting is absolutely awful to support for a lot of reasons, and needs regular maintenance windows. Pretty much anything else is better. The SCM system in use is not going to attract developers that would not have been otherwise interested, IMHO. That's not to say a change would hurt, but my strongest inclination at this point would be to move to svn or hg. (or fossil, but that seems to be even less mainstream than cvs, plus SF doesn't support it). If there's an overwhelming outcry of voices demanding a move, that increases the motivation. Overwhelming here would mean 2 or 3 :) Until then (or after) if you have any patches to submit, by all means send then and I'll be happy to take a look, and most likely merge it in - I've mellowed somewhat since the last time a patch was shared (sorry John) All this said, NaviServer *IS* much more active these days, and lacks the smirk factor that the name AOLserver carries. And a lot of the goals you mention (in particular, code cleanup) are regularly undertaken by Gustaf. WRT Maurizio's comments: 1. social media are making legacy CMS and standard web sites less and less important 2. web and mobile application are moving towards architectures with rich clients (e.g. html5 based like SensaTouch, Oracle ADF, SAP SUP) and these architectures are moving away from the legacy web application and development model offered by Aolserver/Naviserver - OpenACS. Legacy CMS and standard web sites are by no means going away. Even the html5-iest site needs a server behind it, and even if most of the display logic is on the client in the javascript framework of the week if you want to be able to persist and share your updates the best way is still to have a database backing it up. What is getting less important is the ADP programming style of interleaving logic and layout. acs-templating is a great approach to this tho, and there will continue to be a need to take data from a database and put it into some deliverable form. Which raises a few questions with suggestions of projects around them. The data format of choice these days seems to be json, with xml still being a significant player. So, how is our support for those things? XML - tdom works very well with aolserver, and is better than most xml handling anywhere, regardless of programming language. (It doesn't do XQuery, but I can live with that). My only gripe is that it's a standard tcl package rather than an aolserver module, but that's a difference hardly worth quibbling over. JSON - not so much. At least, not that people have talked about. There is a good json library available in yajl-tcl (aside from the array-list mapping that plagues all the tcl-json libraries), which I have every expectation would work well in aolserver, but I haven't tested. Plus it could probably benefit from integration with the native database operators, rather than only working with postgres handles. Anyone interested in putting together the pieces here? Speaking of databases, one of aolserver's biggest strengths has always been its database connectivity. Granted, in the early days that was because Oracle took 5 minutes and 5Mb for a connection so pooling was a huge win when no one else was doing it, but it's still a good thing. But that's about relational database, what about these fancy newfangled no-ess-kyoo-ell databases that I've been hearing so much about (in between yelling at kids to stay off my lawn)? Some of them have purely REST apis (e.g., couchdb) while others have C apis that might benefit from ns_db style pooling, or might just benefit from having a nice interfact (mongodb, redis). They may or may not have a query language, but the bdb driver shows a way with that. Anyone interested in writing drivers for these? (BTW: I *WILL* fix the sqlite driver soon - I promise! Although, since no one has complained about it, I doubt anyone is actually using it, which is a shame.) There's other cool stuff that could be integrated too.
Re: [AOLSERVER] Is there a way to kill one connection in AolServer?
It depends on why the connection has been running a long time. The ns_loop_ctl command lets you examing running loops (i.e., while and foreach loops) and lets you interrupt them in case something got back a much larger dataset than expected. If it's just a slow network connection not letting data be flushed quickly enough, that's a bit harder to interrupt. There are ways to free up the connection thread so that further requests can be serviced, but they're not entirely straightforward in aolserver (recent versions of naviserver do better in this regard). -J Paula Giangeruso wrote: Is there a way to kill a connection in AOLServer? There are times when one connection has been running for a long time and it would be nice if that connection could be killed directly versus having to restart the entire server. Is this possible? Thanks -Paula -- */Paula Giangeruso/*- /*Sr. Application Developer*/ pgianger...@wineaccess.com mailto:pgianger...@wineaccess.com | www.wineaccess.com http://www.wineaccess.com/ /*O:*/ (610) 664-2026 x126 | */*F:*/*(610) 664-4968 | /*C:*/ (609) 731-8092 *wine*/access/ ® direct from the source -- Shape the Mobile Experience: Free Subscription Software experts and developers: Be at the forefront of tech innovation. Intel(R) Software Adrenaline delivers strategic insight and game-changing conversations that shape the rapidly evolving mobile landscape. Sign up now. http://pubads.g.doubleclick.net/gampad/clk?id=63431311iu=/4140/ostg.clktrk ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk -- Shape the Mobile Experience: Free Subscription Software experts and developers: Be at the forefront of tech innovation. Intel(R) Software Adrenaline delivers strategic insight and game-changing conversations that shape the rapidly evolving mobile landscape. Sign up now. http://pubads.g.doubleclick.net/gampad/clk?id=63431311iu=/4140/ostg.clktrk ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] Fatal error laoding aolserver4-nssha1
It's not that hard to believe that a distro could have a link error in a less-used package (which aolserver probably is, alas). Especially since that particular missing symbol error is (if it is what I think it is) fairly new and related to gcc changes in default symbol visibility, and the fix is only in the most recent tarfiles (or cvs). -J Iuri Sampaio wrote: Hi there, In attempt to install OpenACS from scratch on ubuntu precise 12.04 I got the following error on aolserver4-nssha1. could not find Ns_ModuleInit When I start up aolserver service I get a warning then a fatal error as decribed bellow: [19/May/2013:19:27:15][18052.714974976][-main-] Notice: modload: loading '/usr/lib/aolserver4/bin/nssha1.so' [19/May/2013:19:27:15][18052.714974976][-main-] Warning: modload: could not find Ns_ModuleInit in /usr/lib/aolserver4/bin/nssha1.so [19/May/2013:19:27:15][18052.714974976][-main-] Fatal: modload: failed to load module '/usr/lib/aolserver4/bin/nssha1.so' I verified that both files are correctly in place /usr/lib/aolserver4/bin/nssha1.so /usr/lib/aolserver4/lib/libnssha1.so Furthermore, I installed aolserver packages via apt-get I believe the package available on ubuntu repository was compiled without Ns_ModuleInit block. Although, I'm reluctant to believe so I removed nssha1 and installed again fro tarball and the problem was solved. Does anyone have any idea what it could be? or if my assumption is valid? Best wishes, Iuri -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] aolserver startup crash
Gustaf Neumann wrote: On 28.09.12 12:57, Wolfgang Winkler wrote: Hi! The only problem we have is similar to Johns occasional crashes. But I have 2 test servers and 1 pre production server, where AOLserver crashes with Fatal: received fatal signal 11 or alloc: invalid block: 0xc595660: b0 6, somtimes even 4 or 5 times while starting up. Nearly the same code works for other very similar installations with much higher load. are you using at the backend SSL? do you have a backtrace from gdb? We are using SSL a lot, but this is handled by nginx. should have asked more precisely ... handled in aolserver. This are some gdb backtraces: The crash happens in CallCommandTraces() ? which version of tcl 8.5 is this? Since you say, this happens during bootup, i assume this happens before the first request. What is your minthreads setting? -gustaf neumann The stack trace shows it down inside NsConnThread, which suggests it's not during server startup. The location in NsTclICtlObjCmd is in 'ns_ictl update', in the case where the init script has been updated. My first guess would be some weirdness with ns_eval. -J -- Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] Suggestions for a future aolserver
John Buckman wrote: SUGGESTIONS FOR A FUTURE AOLSERVER The state of the art is, I think, happening in the javascript world, with things such as node.js. If the aolserver community were really interested in getting new users, making it a top notch embedded-javascript web server would be a way. I'm not sure this makes any strategic sense (nor that I need it), but there you go... I'm far from the first person to chuckle at how netscape introduced server-side javascript 15 years ago, it pretty much vanished for a while, and has now come roaring back as the next big thing. Plus ça change, plus c'est la même chose. Still, a ns_spidermonkey module would be a interesting project. The other area where state of the art thinking is occurring, is in scaling web sites to many, many machines. aolserver has some features to make that happen, but imagine if we had multi-machine ns_cache support, perhaps with a file system backup (ie, memcached)? I was thinking about this also. There is a nsmemcache module for naviserver, but it uses some of the C apis that have been changed slightly in naviserver, so it doesn't work with aolserver, but it shouldn't be difficult to port. A version (not sure if it's the most current) is at http://naviserver.cvs.sourceforge.net/naviserver/modules/nsmemcache/ Another bit of existing code to build a high-scalability cluster is the Digital City extensions that the guys at AOL built sometime before 2006 (I don't know exactly when, just estimating based on timestamps) and I believe ran some pretty big (for the day) sites on. It looks like a hidden treasure of functionality that never got the respect it deserved. Looking at the archives, there was some chatter about it on this list back in 2007. What's that french saying again? :) It currently lives at http://code.google.com/p/nsdci/ Also, support for sending an http page request to another machine (or pool of machines) would very handy, with a single http daemon handling them all with async io. I don't think this would be difficult as things are now; it would make a nice piece of example code. -J -- Got visibility? Most devs has no idea what their production app looks like. Find out how fast your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219671;13503038;y? http://info.appdynamics.com/FreeJavaPerformanceDownload.html ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] Race conditions with Ns Set Persist?
ns_sets are not internally interlocked. If you are using the same shared set in multiple threads, you need to protect it with a mutex. Do you specifically need the indexability of ns_sets? nsvs are easier to use for most cases, and if you have more than a few keys probably faster too. -J Sep Ng wrote: I have several ns_set objects in my aolserver with the persist flag on to manage several things but I'm noticing that some of the ns_set objects are losing keys for no apparent reason. Also at one instance, the ns_set object retrieved belongs to a totally different one. I'm not sure if there's a bug with ns_set or if there's something wrong with my code, but I thought I'd throw this one out there to see if you guys have experienced this issue before. Thanks in advance. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] aolserver not liking tcl8.6 beta 7
I'd guess this is related to the code to rebuild namespaces, there may be something different enough about tcloo namespaces to break it. It could be something as simple as using namespace instead of ::namespace. I'll try building with the latest tcl and see what I run into. -J John Buckman from BookMooch wrote: I tried tcl8.6.0.0b7 (from the current ActiveTcl) an it does build fine with aolserver, but when loading adp pages, I get: [15/Sep/2012:10:14:36][60416.32952320][-default:5-] Error: Tcl exception: wrong # args: should be namespace objName while executing namespace export {[a-z]*} (in namespace eval ::oo::InfoObject script line 1) invoked from within namespace eval ::oo::InfoObject {namespace export {[a-z]*} } invoked from within ns_ictl update the problem appears to be centered around this ns_ictl code in bin/init.tcl # # Register the init and cleanup callbacks. # ns_ictl trace create {ns_ictl update} ns_ictl trace allocate ns_init ns_ictl trace deallocate ns_cleanup I wasn't able to solve the problem (banged on it for an hour), but just wanted to post an FYI in case anyone else has seen it or worked on it. -john -- How fast is your code? 3 out of 4 devs don\\\'t know how their code performs in production. Find out how slow your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219672;13503038;z? http://info.appdynamics.com/FreeJavaPerformanceDownload.html ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://ad.doubleclick.net/clk;258768047;13503038;j? http://info.appdynamics.com/FreeJavaPerformanceDownload.html ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk
Re: [AOLSERVER] AOLserver 4.5.1 - running but unable to load pages on browser
First thought, do you have a firewall that might be blocking incoming network traffic on that port? Can you connect from a non-web browser (e.g., telnet or nc)? Maybe chrome is doing something odd. -J Thorpe Mayes wrote: Hi, My guess is that this is simple, but it eludes me. I have AOLserver 4.5.1 running. Here is the log: [19/Jul/2012:13:55:06][2047.3049257840][-nssock:driver-] Notice: starting [19/Jul/2012:13:55:06][2047.3049257840][-nssock:driver-] Notice: nssock: listening on 64.58.34.215:80 Sure enough, it is listening on 64.58.34.215: netstat -tulpn Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 64.58.34.215:80 0.0.0.0:* LISTEN 2047/nsd I can ping it: --- 64.58.34.215 ping statistics --- 18 packets transmitted, 18 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 41.027/42.837/45.061/1.362 ms There is a file to serve in the pages directory. Yet, when I try to load that file (http://64.58.34.215) in a browser I get: Oops! Google Chrome could not connect to 64.58.34.215 What am I missing here? Thanks, Thorpe -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ aolserver-talk mailing list aolserver-talk@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/aolserver-talk