[VOTE] Release Apache ManifoldCF 0.4-incubating

2011-12-17 Thread Karl Wright
I've uploaded an apache-manifoldcf-0.4-incubating package which you
can download from http://people.apache.org/~kwright.  If you agree
this should be released please vote +1.

[Note that the release of this artifact is dependent on the release of
the three plugin packages upon which it depends.  If we need to change
those packages we'll need to spin a new RC of this one.  Also please
note that I've include SHA1 signatures for the first time, as per
Jukka's suggestion.]

Thanks!
Karl


[WITHDRAW][VOTE] Release Apache ManifoldCF 0.4-incubating

2011-12-17 Thread Karl Wright
I'm going to back this out and try again; the HSQLDB tests are now
failing on the release branch, despite succeeding last night in trunk.

Sorry about that - and stay tuned.
Karl


On Sat, Dec 17, 2011 at 5:18 AM, Karl Wright daddy...@gmail.com wrote:
 I've uploaded an apache-manifoldcf-0.4-incubating package which you
 can download from http://people.apache.org/~kwright.  If you agree
 this should be released please vote +1.

 [Note that the release of this artifact is dependent on the release of
 the three plugin packages upon which it depends.  If we need to change
 those packages we'll need to spin a new RC of this one.  Also please
 note that I've include SHA1 signatures for the first time, as per
 Jukka's suggestion.]

 Thanks!
 Karl


[jira] [Created] (CONNECTORS-330) HSQLDB external database tests fail

2011-12-17 Thread Karl Wright (Created) (JIRA)
HSQLDB external database tests fail
---

 Key: CONNECTORS-330
 URL: https://issues.apache.org/jira/browse/CONNECTORS-330
 Project: ManifoldCF
  Issue Type: Bug
  Components: Framework core
Affects Versions: ManifoldCF 0.4
Reporter: Karl Wright
Assignee: Karl Wright
Priority: Blocker
 Fix For: ManifoldCF 0.4


Here's the exception we get:

[junit] Database exception: Exception doing query: user lacks privilege or o
bject not found: PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCH
AR(255) NOT NULL PRIMARY KEY)]
[junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database
exception: Exception doing query: user lacks privilege or object not found: PUBL
IC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL PRIM
ARY KEY)]
[junit] at org.apache.manifoldcf.core.database.Database.executeViaThread
(Database.java:672)
[junit] at org.apache.manifoldcf.core.database.Database.executeUncachedQ
uery(Database.java:716)
[junit] at org.apache.manifoldcf.core.database.Database$QueryCacheExecut
or.create(Database.java:1363)
[junit] at org.apache.manifoldcf.core.cachemanager.CacheManager.findObje
ctsAndExecute(CacheManager.java:144)
[junit] at org.apache.manifoldcf.core.database.Database.executeQuery(Dat
abase.java:179)
[junit] at org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.perform
Modification(DBInterfaceHSQLDB.java:746)
[junit] at org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.perform
Create(DBInterfaceHSQLDB.java:361)
[junit] at org.apache.manifoldcf.core.database.BaseTable.performCreate(B
aseTable.java:111)
[junit] at org.apache.manifoldcf.agents.agentmanager.AgentManager.instal
l(AgentManager.java:72)
[junit] at org.apache.manifoldcf.agents.system.ManifoldCF.installTables(
ManifoldCF.java:73)
[junit] at org.apache.manifoldcf.agents.tests.BaseHSQLDBext.localSetUp(B
aseHSQLDBext.java:65)
[junit] at org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.localSetUp(
BaseHSQLDBext.java:60)
[junit] at org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.setUp(BaseH
SQLDBext.java:48)
[junit] Caused by: java.sql.SQLException: user lacks privilege or object not
 found: PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) N
OT NULL PRIMARY KEY)]
[junit] at org.hsqldb.jdbc.Util.sqlException(Util.java:255)
[junit] at org.hsqldb.jdbc.JDBCStatement.fetchResult(JDBCStatement.java:
1838)
[junit] at org.hsqldb.jdbc.JDBCStatement.execute(JDBCStatement.java:636)

[junit] at org.apache.manifoldcf.core.database.Database.execute(Database
.java:777)
[junit] at org.apache.manifoldcf.core.database.Database$ExecuteQueryThre
ad.run(Database.java:632)
[junit]
[junit]


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CONNECTORS-330) HSQLDB external database tests fail

2011-12-17 Thread Karl Wright (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/CONNECTORS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13171527#comment-13171527
 ] 

Karl Wright commented on CONNECTORS-330:


The story points back to HSQLDB again, unfortunately.  Here's an annotated 
trace:

{code}
Here's the schema creation
   [junit] Created HSQLDB instance
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679 with user sa 
which is meant to work with schema administration
   [junit] Creating schema DBNAME using instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679
Here's the alter user
   [junit] Altering user manifoldcf
   [junit]  Alter User succeeded! ALTER USER manifoldcf SET INITIAL SCHEMA 
DBNAME
Here's the table create
   [junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e with user 
manifoldcf which is meant to work with schema dbname
   [junit] Checking for table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
   [junit] Creating table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
   [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database 
exception: Exception doing query: user lacks privilege or object not found: 
PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL 
PRIMARY KEY)]
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:672)
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeUncachedQuery(Database.java:716)
   [junit] at 
org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1363)
   [junit] at 
org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:179)
   [junit] at 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.performModification(DBInterfaceHSQLDB.java:752)
   [junit] at 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.performCreate(DBInterfaceHSQLDB.java:364)
   [junit] at 
org.apache.manifoldcf.core.database.BaseTable.performCreate(BaseTable.java:111)
   [junit] at
org.apache.manifoldcf.agents.agentmanager.AgentManager.install(AgentManager.java:72)
   [junit] at
org.apache.manifoldcf.agents.system.ManifoldCF.installTables(ManifoldCF.java:73)
   [junit] at
org.apache.manifoldcf.agents.tests.BaseHSQLDBext.localSetUp(BaseHSQLDBext.java:65)
   [junit] at
org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.localSetUp(BaseHSQLDBext.java:60)
   [junit] at
org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.setUp(BaseHSQLDBext.java:48)
   [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   [junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   [junit] at java.lang.reflect.Method.invoke(Method.java:592)
   [junit] at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
   [junit] at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
   [junit] at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
   [junit] at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
   [junit] at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
   [junit] at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
   [junit] at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
   [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
   [junit] at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
   [junit] at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
   [junit] at 
org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
   [junit] at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
   [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
   [junit] at 
junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
   [junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
   [junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
   [junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)
   [junit] Caused by: java.sql.SQLException: user lacks privilege or
object not found: PUBLIC in statement [CREATE CACHED TABLE
agents(classname VARCHAR(255) NOT NULL PRIMARY KEY)]
   [junit] at 

[jira] [Issue Comment Edited] (CONNECTORS-330) HSQLDB external database tests fail

2011-12-17 Thread Karl Wright (Issue Comment Edited) (JIRA)

[ 
https://issues.apache.org/jira/browse/CONNECTORS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13171527#comment-13171527
 ] 

Karl Wright edited comment on CONNECTORS-330 at 12/17/11 12:12 PM:
---

The story points back to HSQLDB again, unfortunately.  Here's a trace:

{code}
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@113beb5 with user 
manifoldcf which is meant to work with schema dbname
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@747fa2 with user 
manifoldcf which is meant to work with schema dbname
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@6782a9 with user sa which 
is meant to work with schema administration
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@17200b4 with user 
manifoldcf which is meant to work with schema dbname
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679 with user sa 
which is meant to work with schema administration
[junit] Creating schema DBNAME using instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679
[junit] Altering user manifoldcf
[junit]  Alter User succeeded! ALTER USER manifoldcf SET INITIAL SCHEMA 
DBNAME
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e with user 
manifoldcf which is meant to work with schema dbname
[junit] Checking for table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
[junit] Creating table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
[junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database 
exception: Exception doing query: user lacks privilege or object not found: 
PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL 
PRIMARY KEY)]
[junit] at 
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:672)
...
{code}


  was (Author: kwri...@metacarta.com):
The story points back to HSQLDB again, unfortunately.  Here's an annotated 
trace:

{code}
Here's the schema creation
   [junit] Created HSQLDB instance
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679 with user sa 
which is meant to work with schema administration
   [junit] Creating schema DBNAME using instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c3679
Here's the alter user
   [junit] Altering user manifoldcf
   [junit]  Alter User succeeded! ALTER USER manifoldcf SET INITIAL SCHEMA 
DBNAME
Here's the table create
   [junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e with user 
manifoldcf which is meant to work with schema dbname
   [junit] Checking for table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
   [junit] Creating table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@289d2e
   [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database 
exception: Exception doing query: user lacks privilege or object not found: 
PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL 
PRIMARY KEY)]
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:672)
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeUncachedQuery(Database.java:716)
   [junit] at 
org.apache.manifoldcf.core.database.Database$QueryCacheExecutor.create(Database.java:1363)
   [junit] at 
org.apache.manifoldcf.core.cachemanager.CacheManager.findObjectsAndExecute(CacheManager.java:144)
   [junit] at 
org.apache.manifoldcf.core.database.Database.executeQuery(Database.java:179)
   [junit] at 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.performModification(DBInterfaceHSQLDB.java:752)
   [junit] at 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB.performCreate(DBInterfaceHSQLDB.java:364)
   [junit] at 
org.apache.manifoldcf.core.database.BaseTable.performCreate(BaseTable.java:111)
   [junit] at
org.apache.manifoldcf.agents.agentmanager.AgentManager.install(AgentManager.java:72)
   [junit] at
org.apache.manifoldcf.agents.system.ManifoldCF.installTables(ManifoldCF.java:73)
   [junit] at
org.apache.manifoldcf.agents.tests.BaseHSQLDBext.localSetUp(BaseHSQLDBext.java:65)
   [junit] at
org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.localSetUp(BaseHSQLDBext.java:60)
   [junit] at
org.apache.manifoldcf.crawler.tests.BaseHSQLDBext.setUp(BaseHSQLDBext.java:48)
   [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit] at

[jira] [Commented] (CONNECTORS-330) HSQLDB external database tests fail

2011-12-17 Thread Karl Wright (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/CONNECTORS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13171535#comment-13171535
 ] 

Karl Wright commented on CONNECTORS-330:


It looks like this may be JDBC related.  The JDBC instance that fails is 
created BEFORE the ALTER USER is done, and it apparently just never gets 
updated:

{code}
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@2f0d54 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@e0a386
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@193f6e2 with user 
manifoldcf which is meant to work with schema dbname
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@2f0d54 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@193f6e2
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@6782a9 with user 
manifoldcf which is meant to work with schema dbname
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1b34126 with user sa 
which is meant to work with schema administration
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@17200b4 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1b34126
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@4c47db with user 
manifoldcf which is meant to work with schema dbname
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74 with user sa which 
is meant to work with schema administration
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@17200b4 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@17200b4 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74
[junit] Creating schema DBNAME using instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@17200b4 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74
[junit] Altering user manifoldcf
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@17200b4 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@18c74
[junit]  Alter User succeeded! ALTER USER manifoldcf SET INITIAL SCHEMA 
DBNAME
[junit] Created HSQLDB instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1f2cea2 with user 
manifoldcf which is meant to work with schema dbname
[junit] Checking for table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1f2cea2
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@2f0d54 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1f2cea2
[junit] Creating table in schema DBNAME in instance 
org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1f2cea2
[junit] Using JDBC connection com.bitmechanic.sql.PooledConnection@2f0d54 
within database org.apache.manifoldcf.core.database.DBInterfaceHSQLDB@1f2cea2
[junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: Database 
exception: Exception doing query: user lacks privilege or object not found: 
PUBLIC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL 
PRIMARY KEY)]
[junit] at 
org.apache.manifoldcf.core.database.Database.executeViaThread(Database.java:673)
{code}

Since these are pooled objects, I basically have to figure out how to flush the 
pool - or create a different pool for instances where the schema has not yet 
been created.  Or, maybe HSQLDB should try to update existing JDBC instances?  
Seems like a funky implementation detail of hsqldb we're seeing really.

I've alerted the hsqldb team yet again...

 HSQLDB external database tests fail
 ---

 Key: CONNECTORS-330
 URL: https://issues.apache.org/jira/browse/CONNECTORS-330
 Project: ManifoldCF
  Issue Type: Bug
  Components: Framework core
Affects Versions: ManifoldCF 0.4
Reporter: Karl Wright
Assignee: Karl Wright
Priority: Blocker
 Fix For: ManifoldCF 0.4


 Here's the exception we get:
 [junit] Database exception: Exception doing query: user lacks privilege 
 or o
 bject not found: PUBLIC in statement [CREATE CACHED TABLE agents(classname 
 VARCH
 AR(255) NOT NULL PRIMARY KEY)]
 [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException: 
 Database
 exception: Exception doing query: user lacks privilege or object not found: 
 PUBL
 IC in statement [CREATE CACHED TABLE agents(classname VARCHAR(255) NOT NULL 
 PRIM
 ARY KEY)]
 [junit] at 
 

[VOTE] Release Apache ManifoldCF 0.4-incubating, RC0

2011-12-17 Thread Karl Wright
I've again uploaded an apache-manifoldcf-0.4-incubating package which you
can download from http://people.apache.org/~kwright.  If you agree
this should be released please vote +1.

[Note that the release of this artifact is dependent on the release of
the three plugin packages upon which it depends.  If we need to change
those packages we'll need to spin a new RC of this one.  Also please
note that I've include SHA1 signatures for the first time, as per
Jukka's suggestion.]

I apologize again for the earlier hiccup.  This one is the real thing,
though, and passes all tests.

Thanks!
Karl