Waiting for you at ApacheCon Attendee Check In
To the Directory team members in Amsterdam, It turns out that I am not allowed to get into the conference this time. :( I am waiting for you guys at the ApacheCon attendee check in. Would you mind stopping by and talking to me? That would be much appreciated. I am attaching a picture, but I am the woman who sits right across from Charel and typing on the laptop. Yeliz. attachment: Yeliz_head and shoulder March2008.jpg
[jira] Commented: (DIRSERVER-1161) search results are not streamed to the client until final done response is queued
[ https://issues.apache.org/jira/browse/DIRSERVER-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12587882#action_12587882 ] Norval Hope commented on DIRSERVER-1161: So far my testing of the spawn a thread to iterate through the search results approach looks very promising. I'll do further testing before tidying up (probably use an Executor etc) and submitting a patch against 1.5.1 and any other releases of interest. search results are not streamed to the client until final done response is queued - Key: DIRSERVER-1161 URL: https://issues.apache.org/jira/browse/DIRSERVER-1161 Project: Directory ApacheDS Issue Type: Bug Components: core Affects Versions: 1.0 Environment: JDK 1.5.0_11 Reporter: Norval Hope Attachments: apacheds_1.5.1_streaming.patch, apacheds_1.5.1_streaming_log_output.txt, installers_1.5.1_streaming.patch, mina_1.1.2_streaming.patch, pom.xml, streaming_log_output.txt, streaming_logging.patch Original Estimate: 120h Remaining Estimate: 120h Search results accumulate in Events on the SessionBuffer.eventQueue within ExecutorFilter.fireEvent() until final done response for the search is written to the session and then all results for the search (possibly millions depending on the search and state of the directory) are written out at once. This is a big problem for scalability and I gather from previous correspondence with Alex that this behaviour is unexpected. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (DIRSERVER-1161) search results are not streamed to the client until final done response is queued
[ https://issues.apache.org/jira/browse/DIRSERVER-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12587952#action_12587952 ] Norval Hope commented on DIRSERVER-1161: Pretty sure this solution is going to fly now. Also think that the SessionBuffer should use a BlockingQueue with fixed size to stop the same unbounded growth problem is the case that the JNDI client is slow reading search results compared to the speed that the server produces them. A possible problem s that I think I saw evidence of an assumption that a null event can be written to the queue, which Blocking Queue doesn't allow, but I need to investigate further. Note this would be a fix to MINA. search results are not streamed to the client until final done response is queued - Key: DIRSERVER-1161 URL: https://issues.apache.org/jira/browse/DIRSERVER-1161 Project: Directory ApacheDS Issue Type: Bug Components: core Affects Versions: 1.0 Environment: JDK 1.5.0_11 Reporter: Norval Hope Attachments: apacheds_1.5.1_streaming.patch, apacheds_1.5.1_streaming_log_output.txt, installers_1.5.1_streaming.patch, mina_1.1.2_streaming.patch, pom.xml, streaming_log_output.txt, streaming_logging.patch Original Estimate: 120h Remaining Estimate: 120h Search results accumulate in Events on the SessionBuffer.eventQueue within ExecutorFilter.fireEvent() until final done response for the search is written to the session and then all results for the search (possibly millions depending on the search and state of the directory) are written out at once. This is a big problem for scalability and I gather from previous correspondence with Alex that this behaviour is unexpected. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: Upgrading to maven 2.0.9 on CI
Yeah go for it. I think we should upgrade in general to this new release. Alex On Thu, Apr 10, 2008 at 10:11 AM, Felix Knecht [EMAIL PROTECTED] wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi all If there aren't any objections I'm going to update maven on the CI server to the latest release (2.0.9). Regards Felix -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkf+H/cACgkQ2lZVCB08qHF7NACgkbV6POt9DCn+kIVyLl0yxwtP c3MAoNYf+8l8QhzKWnjw/PJ0wAULA6lp =hS6p -END PGP SIGNATURE-
Re: Upgrading to maven 2.0.9 on CI
+1. Anyway, if we have problems, we just have to rollback to 2.0.8 ! We just have to make it clear that we mandate the use of 2.0.9 on our web site somehow. On Fri, Apr 11, 2008 at 3:53 PM, Alex Karasulu [EMAIL PROTECTED] wrote: Yeah go for it. I think we should upgrade in general to this new release. Alex On Thu, Apr 10, 2008 at 10:11 AM, Felix Knecht [EMAIL PROTECTED] wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi all If there aren't any objections I'm going to update maven on the CI server to the latest release (2.0.9). Regards Felix -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkf+H/cACgkQ2lZVCB08qHF7NACgkbV6POt9DCn+kIVyLl0yxwtP c3MAoNYf+8l8QhzKWnjw/PJ0wAULA6lp =hS6p -END PGP SIGNATURE- -- Regards, Cordialement, Emmanuel Lécharny www.iktek.com
Re: Upgrading to maven 2.0.9 on CI
you can also set the minimum maven version in the pom.xml as well http://maven.apache.org/plugins/maven-enforcer-plugin/usage.html cheers! jesse On Fri, Apr 11, 2008 at 9:26 AM, Emmanuel Lecharny [EMAIL PROTECTED] wrote: +1. Anyway, if we have problems, we just have to rollback to 2.0.8 ! We just have to make it clear that we mandate the use of 2.0.9 on our web site somehow. On Fri, Apr 11, 2008 at 3:53 PM, Alex Karasulu [EMAIL PROTECTED] wrote: Yeah go for it. I think we should upgrade in general to this new release. Alex On Thu, Apr 10, 2008 at 10:11 AM, Felix Knecht [EMAIL PROTECTED] wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi all If there aren't any objections I'm going to update maven on the CI server to the latest release (2.0.9). Regards Felix -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkf+H/cACgkQ2lZVCB08qHF7NACgkbV6POt9DCn+kIVyLl0yxwtP c3MAoNYf+8l8QhzKWnjw/PJ0wAULA6lp =hS6p -END PGP SIGNATURE- -- Regards, Cordialement, Emmanuel Lécharny www.iktek.com -- jesse mcconnell [EMAIL PROTECTED]
Re: How do I compile for Java 1.5?
Emmanuel Lecharny wrote: Where are the sources coming from ? Can you give us the command you used to get the sources on your computer ? There are no sources for this. I'm simply compiling a schema as per the documentation I found on the ads website (maybe 2 years ago?). The pom.xml I pasted into a previous email was all that was ever necessary. Just the pom.xml and my schema. *** Strange, I guess the latest 1.0.x pom is downloaded? I didn't notice 1.0.5 was used... Downloading: http://repo1.maven.org/maven2/org/apache/directory/build/1.0.5/build-1.0.5.pom This is totally different. We are using 4 different sub-projects : - apacheds - daemon - installers - project - shared I think the disconnect here is that you think I'm building ADS and I'm not, I'm just trying to compile a schema. Each project has its own version. As you may have noticed, shared is version 0.9.5.3. The 1.0.5 version applies to the 'project' version It's just that the API seems to have changed too. F.e. a previous schema compile that worked fine no longer works and produces compile errors that aren't 1.5 related, but class files that are completely missing: It seems that the maven build you are using is not the good one... I'm not trying to build ADS :-) Is there an easy way perhaps for me to force maven to use an older 1.0 instead of 1.0.5 so I can build the schema? No, because this is unrelated. Let me try to build ADS 1.0 and come back to you. I truly thank you for your help, but I'm not having trouble building ADS. I don't actually do that - I just use the shipped jars. Quite likely I'm one of the few folks actually building a custom schema in the stable release branch of ADS... I realize it's painful to drop working on the cool new beta and support the stable release. If it's too much work don't worry about it and just ignore this request. FYI - the amount of work required to upgrade from 1.0 to the next version seems a bit intimidating. I wish you folks had released stable versions more often. Cheers.
Re: How do I compile for Java 1.5?
Ahhh Sorry, I really thought you were trying to compile the whole server ! Ok, I'm back from Apache Conference, but will move to have some rest for a week. I will try to squeeze a few hours this week-end to find out what's your problem can be. I already have a full 1.0 code base compiling on my laptop, and will have a 5 hours train trip tomorrow, so hopefully, I may have time for this issue :) Mark Swanson wrote: Emmanuel Lecharny wrote: Where are the sources coming from ? Can you give us the command you used to get the sources on your computer ? There are no sources for this. I'm simply compiling a schema as per the documentation I found on the ads website (maybe 2 years ago?). The pom.xml I pasted into a previous email was all that was ever necessary. Just the pom.xml and my schema. *** Strange, I guess the latest 1.0.x pom is downloaded? I didn't notice 1.0.5 was used... Downloading: http://repo1.maven.org/maven2/org/apache/directory/build/1.0.5/build-1.0.5.pom This is totally different. We are using 4 different sub-projects : - apacheds - daemon - installers - project - shared I think the disconnect here is that you think I'm building ADS and I'm not, I'm just trying to compile a schema. Each project has its own version. As you may have noticed, shared is version 0.9.5.3. The 1.0.5 version applies to the 'project' version It's just that the API seems to have changed too. F.e. a previous schema compile that worked fine no longer works and produces compile errors that aren't 1.5 related, but class files that are completely missing: It seems that the maven build you are using is not the good one... I'm not trying to build ADS :-) Is there an easy way perhaps for me to force maven to use an older 1.0 instead of 1.0.5 so I can build the schema? No, because this is unrelated. Let me try to build ADS 1.0 and come back to you. I truly thank you for your help, but I'm not having trouble building ADS. I don't actually do that - I just use the shipped jars. Quite likely I'm one of the few folks actually building a custom schema in the stable release branch of ADS... I realize it's painful to drop working on the cool new beta and support the stable release. If it's too much work don't worry about it and just ignore this request. FYI - the amount of work required to upgrade from 1.0 to the next version seems a bit intimidating. I wish you folks had released stable versions more often. Cheers. -- -- cordialement, regards, Emmanuel Lécharny www.iktek.com directory.apache.org
Re: ApacheDS for ASF
Just a quick heads up for Graham, mainly : we have had a BoF last thursday where we discussed about using ADS to manage the ASF. To make a long story short, we agreed on a few things : - we have to install ADS on the zone Graham created - we must first try to manage our own users (ADS users) - we have to define complete and validated uses-cases for what we want to do - to avoid f*cking up access to the ASF servers for our users, we must be sure that we keep the current text file updated - we might start with access to Confluence, as it's not a critical component - some sites like Jim's page (http://people.apache.org/~jim/committers.html) or http://people.apache.org/committers.html might also be seen as perfect target for initial experimentations Graham Leggett wrote: Emmanuel Lecharny wrote: I suggest we discuss that during AMS, and have a chat session then. Alex is just totally dead (he finished the release last night), and will be flying tomorrow morning. I emphathise, was flying over Easter and was wiped out afterwards... I may also create a place on the directory wiki where we can discuss the project. That may be an idea. Part of the driver for getting a proper LDAP server going is that I have just landed some more user friendly login module options with httpd, meaning that it is easier to create a per user website (backed by LDAP) for the ASF. PS : I saw that you were moving from Africa to London ? A new job there ? Been in London for the last year or so, finally got round to updating my details :) Regards, Graham -- -- -- cordialement, regards, Emmanuel Lécharny www.iktek.com directory.apache.org
[OT] I'll be almost off for one week
Hi guys, I will take a little break (one week) so I won't be reachable next week. Hopefully, many other committers will remain active while I will have good time sailing a boat :) Have fun ! -- -- cordialement, regards, Emmanuel Lécharny www.iktek.com directory.apache.org
