Re: [xwiki-users] Monitoring an Xwiki stack

2014-11-03 Thread Bryn Jeffries
(Sorry for top-posting - I'm stuck with Outlook Live :-(

My system's very small - approx 20 users and very little content at present. 
It's for a small collaborative research group which may grew to ~100 members. I 
expect quite a few largish attachments and have already configured filesystem 
attachments.

I'm using PostgreSQL for various reasons, so can't add all the suggested 
indexes (names the string prefix ones that are specific to MySQL), but I'd be 
surprised to be hitting limits so soon.

The slowdown occurred soon after I opened the wiki to the other members, who 
probably did some exploring and perhaps triggered something painful.

From: Paul Libbrecht [p...@hoplahup.net]
Sent: 02 November 2014 22:21
To: XWiki Users
Subject: Re: [xwiki-users] Monitoring an Xwiki stack

Btw,

I am not sure you could say the XWiki installs are that pesky.
However, depending on the user base, it may really need quite some tuning.
For example, if your xwiki manipulates complex documents the document cache may 
be too big for the memory, and that you only reach with some time (it could be 
a week or two). OutOfMemoryErrors then appear on a regular basis.

Another example has been the amount of registered users. This is a bit too much 
on curriki to store into a page of objects, so special treatment has been 
applied.
Yet another example would be the mass of attachments, e.g if people use this as 
a shared disk, where the file-system-attachments solution has helped quite many 
(I think).

I think all wikis and CMSs that I know of are rather limited in their default 
goals (beyond XWiki, I have experience with Drupal and Wordpress) and special 
treatment maybe be quickly available, in config, install, or custom development.

Monitoring tools can help you adjust this.

Bryn, maybe you want to indicate how big is your system?
Maybe it's just a matter of some too eager clients (e.g. some ever repeat 
javascript-based-requests served to tens of users every second or so)?

paul
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] Monitoring an Xwiki stack

2014-11-03 Thread Paul Libbrecht
 My system's very small - approx 20 users and very little content at present. 
 It's for a small collaborative research group which may grew to ~100 members. 
 I expect quite a few largish attachments and have already configured 
 filesystem attachments.

Sounds quite reasonable.
Limited memory?

 I'm using PostgreSQL for various reasons, so can't add all the suggested 
 indexes (names the string prefix ones that are specific to MySQL), but I'd be 
 surprised to be hitting limits so soon.

The database difference might be something to explore.
I've seen rather often that things are more battle-tested for MySQL.
But I fully agree you have reasons to prefer PostgreSQL.

 The slowdown occurred soon after I opened the wiki to the other members, who 
 probably did some exploring and perhaps triggered something painful.

You definitely need to explore when it happens.
- something such as show full processlist (that's a MySQL thing) should be 
available to show if there's an SQL query taking long and if others are slow 
(typically, big LIKE queries tend to block all writes)
- invoke a thread-dump (kill -HUP or use JMX or 
http://extensions.xwiki.org/xwiki/bin/view/Extension/JMX+Access#HExample5:gettingafullthread-dump):
 the threads generally carry the path of the http requests
- check memory
- make sure you enable -verbose:gc as a JVM option to indicate when memory 
limits are reached

paul

___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


[xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

2014-11-03 Thread Ji Zhang
Guys,

I am new to Xwiki.

I have a xwiki deployed on tomcat 6. I need to use authentication against 
tomcat JDBC realm. AppServerTrustedAuthServiceImpl seems to my option. Are 
there some detailed documents or examples for using it?

Thanks inadvance.

Ji Zhang
Trade Informatics, LLC.
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

2014-11-03 Thread Clemens Klein-Robbenhaar
On 11/03/2014 05:15 PM, Ji Zhang wrote:
 Guys,
 
 I am new to Xwiki.
 
 I have a xwiki deployed on tomcat 6. I need to use authentication against 
 tomcat JDBC realm. AppServerTrustedAuthServiceImpl seems to my option. Are 
 there some detailed documents or examples for using it?
 

yes: add a line do the xwiki.cfg in the WEB-INF folder, as explained here:

 
http://platform.xwiki.org/xwiki/bin/view/AdminGuide/Authentication#HContainerAuthentication

That (and restarting tomcat) should be everything you need to do.

Cheers,
Clemens
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

2014-11-03 Thread Ji Zhang
Thanks Clemens.

How do I test if this authentication works? For example, I have an user 
jsmith/password in Tomcat JDBC realm. How do I assign the viewing privileges to 
jsmith?

Thanks again.

Ji


-Original Message-
From: users [mailto:users-boun...@xwiki.org] On Behalf Of Clemens 
Klein-Robbenhaar
Sent: Monday, November 03, 2014 11:42 AM
To: users@xwiki.org
Subject: Re: [xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

On 11/03/2014 05:15 PM, Ji Zhang wrote:
 Guys,
 
 I am new to Xwiki.
 
 I have a xwiki deployed on tomcat 6. I need to use authentication against 
 tomcat JDBC realm. AppServerTrustedAuthServiceImpl seems to my option. Are 
 there some detailed documents or examples for using it?
 

yes: add a line do the xwiki.cfg in the WEB-INF folder, as explained here:

 
http://platform.xwiki.org/xwiki/bin/view/AdminGuide/Authentication#HContainerAuthentication

That (and restarting tomcat) should be everything you need to do.

Cheers,
Clemens
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] Monitoring an Xwiki stack

2014-11-03 Thread Bryn Jeffries
Says Paul Libbrecht:
 My system's very small - approx 20 users and very little content at present. 
 It's 
 for a small collaborative research group which may grew to ~100 members. I
 expect quite a few largish attachments and have already configured filesystem
 attachments.

 Sounds quite reasonable.
 Limited memory?

Well I'm running everything off a single VM configured with 8GB RAM and 2 
VCPUS. If necessary I can use more VMs but I wanted to keep things simple until 
I knew what my actual performance needs were. I also have access to plenty of 
persistent storage.

I have Tomcat configured with CATALINA_OPTS=-server -Xms800m -Xmx800m 
-XX:MaxPermSize=196m

 I'm using PostgreSQL for various reasons, so can't add all the suggested 
 indexes (names the string prefix ones that are specific to MySQL), but I'd 
 be 
 surprised to be hitting limits so soon.

 The database difference might be something to explore.
 I've seen rather often that things are more battle-tested for MySQL.
 But I fully agree you have reasons to prefer PostgreSQL.

Yes, and I'd be interested to look into optimising common searches once things 
have grown and I understand the query workload. Alternatives to MySQL string 
prefix indexes would be GIN or GIST - the pg_trgm package looks promising.


___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] [Proposal] Statistics

2014-11-03 Thread Andreea Popescu
Hello all,

After your feedback I made this draft with QA Stats:
http://dev.xwiki.org/xwiki/bin/view/Drafts/QA+Stats

I await your reply and feedback regarding the draft and stats.


Thank you.

On Thu, Oct 2, 2014 at 3:29 PM, vinc...@massol.net vinc...@massol.net
wrote:

 Hi Andrea,

 On 2 Oct 2014 at 10:01:17, Andreea Popescu (andreea.pope...@xwiki.com
 (mailto:andreea.pope...@xwiki.com)) wrote:

  Hello everyone,
 
 
  If you’re wondering what kept the QA team busy during the last few days,

 What QA team, there’s no such team/role in the XWiki project ATM :)

 I think yo meant the XWiki SAS QA Team. Since I’m also from XWiki SAS I
 can explain a bit more about this team:
 - it’s globally in charge of ensuring the quality of the XWiki releases
 from the point of view of XWiki SAS clients (for example some XWiki SAS
 clients are using Oracle and this team takes special care to ensure there’s
 no regression on Oracle, same for browser versions, and globally for
 anything that could impact XWiki SAS clients)
 - XWiki SAS is delegating Andrea full time (and Manuel 1/3rd of this time)
 to help the xwiki.org project by doing manual testing of XWiki releases.
 They are maintaining the http://test.xwiki.org wiki and filling the
 manual testing part of the Release notes.

  the answer is a lot of testing and a brainstorming effort in order to
  devise a series of statistics for the product, which would be featured
 with
  the product version 6.2.

 cool

  We believe that the statistics ought to be implemented for the following
  reasons:
 
  a) They would allow for better communication between us and the community

 You’re not community? :) Personally I’ve always considered you community
 like anyone else contributing something to the xwiki project!

  b) Each version would be more easily evaluated this way
 
  c) The product’s evolution would be more easily observable by tracking
 the
  changes in these statistics from one version to another
 
  d) A more complete overview on the long-term evolution of the product
  would be possible, with an opportunity to analyze a series of items in
  detail

 Yes what’s important are not the raw values, but the trends between
 versions.

 I started working on this here:
 http://dev.xwiki.org/xwiki/bin/view/Community/ProjectHealth

 Thomas also recently started working on performance stats here:
 http://test.xwiki.org/xwiki/bin/view/Performances/Jetty+HSQLDB+single+wiki

 See also this mail thread on the topic of having regular perf reports at
 each release:
 http://markmail.org/message/dprnorr37ox7tvfu

 IMO this needs to be included in the page you’re going to create for each
 release.

 See below for more on that.

  We consider some of the above-mentioned items to be quite important. Here
  is a list of the most important ones:
 
  - No. of downloads
  - No. of active installs
  - No. of tests executed / added

 Not very easy to compute but I know how to do it if you need help on that.

  - Jira issues fixed - by resolution, by priority, by type
  - Jira issues opened - by priority, by type
  - Closed vs open tickets
  - Stats for important tags: e.g. ie10, mobile, flamingo
  - Stats for major features: e.g. flamingo, extension manager, solr
 
 
  - Top overall issues reporters
  - Top non-XWiki SAS issues reporters
 
 
  - Extensions quality: issues reported (top 10 extensions)
  - Extensions quality: issues closed (top 10 extensions)
 
 
  - l10n translations: existent, missing
 
 
  - Performance stats

 Yes!

  Therefore, your opinion on the following issues would be of great use to
  us:
 
  a) The list offered a number of items that we deem important for our
  measurements and assessments. We would like to know whether you agree
 with
  the list and we would like to have your opinion regarding other items
 that
  we would consider inserting in the list?

 Just to stress it again, what’s important is to get the figure for the
 past releases and compare so that we get trends over several releases and
 see where we’re going.

 - Global TPC is also interesting to compute and see the evolution. Sorin
 started doing this in the past (he did it once only unfortunately ;)). I
 can also explain how to compute this.

 Now you don’t have to start with 100 metrics. Just 3-4 is enough. It’s
 more important to send the reports regularly and have the trends for each
 metrics than to have too many metrics.

 Also, what’s important is to analyze them. There’s no point in having the
 metrics and not doing anything about them. So we’ll need to think about
 that too but we can decide after.

  b) Where would you like us to publish the statistics and the conclusions
  that would result from their analysis? We were thinking about the
 following:
 
 
  - On a ‘Project Health’ page
  - On a page designated to each product version (each version would have
  its own page with statistics)
  - In the test.xwiki.org
  - Within a blogpost
  - A mix of the above

 Here’s my POV:

 1)

 * I’d 

Re: [xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

2014-11-03 Thread Thomas Mortagne
To know if you are authenticated from XWiki point of view look at the
top right corner, you should see you name or id there (so probably
jsmith here). If you are not authenticated then you should have a
login button/link instead.

You can also enable debug log for this authenticator. Search for it in
Administration - Logging and set log level to TRACE or DEBUG. When
this is done you should see details on what is happening in this
authenticator in your application server log.

On Mon, Nov 3, 2014 at 7:10 PM, Ji Zhang jzh...@tradeinformatics.com wrote:
 Thanks Clemens.

 How do I test if this authentication works? For example, I have an user 
 jsmith/password in Tomcat JDBC realm. How do I assign the viewing privileges 
 to jsmith?

 Thanks again.

 Ji


 -Original Message-
 From: users [mailto:users-boun...@xwiki.org] On Behalf Of Clemens 
 Klein-Robbenhaar
 Sent: Monday, November 03, 2014 11:42 AM
 To: users@xwiki.org
 Subject: Re: [xwiki-users] Question regarding AppServerTrustedAuthServiceImpl

 On 11/03/2014 05:15 PM, Ji Zhang wrote:
 Guys,

 I am new to Xwiki.

 I have a xwiki deployed on tomcat 6. I need to use authentication against 
 tomcat JDBC realm. AppServerTrustedAuthServiceImpl seems to my option. Are 
 there some detailed documents or examples for using it?


 yes: add a line do the xwiki.cfg in the WEB-INF folder, as explained here:

  
 http://platform.xwiki.org/xwiki/bin/view/AdminGuide/Authentication#HContainerAuthentication

 That (and restarting tomcat) should be everything you need to do.

 Cheers,
 Clemens
 ___
 users mailing list
 users@xwiki.org
 http://lists.xwiki.org/mailman/listinfo/users
 ___
 users mailing list
 users@xwiki.org
 http://lists.xwiki.org/mailman/listinfo/users



-- 
Thomas Mortagne
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users