Dave,
Patch attached which let me build against 0.20.205.0
Run: mvn package -Dhadoop.profile=0.20 -Passemble
I took the extra second to follow the same convention we have for Hadoop
1 and 2. I completely guessed on the version of jackson-mapper-asl we
should use, so that's why I didn't commit this directly. I think I also
want to mark the jackson-mapper-asl deps as provided? I dunno; it's odd
because the 0.20.205.0 pom didn't directly depend on j-m-a and it's been
far too long a week already to dig further atm ;)
Hope that helps.
On 04/16/2013 08:39 PM, [email protected] wrote:
Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble
-Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should
work. A bunch of tests failed in core with:
Caused by: java.lang.ClassNotFoundException:
org.codehaus.jackson.map.JsonMappingException
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Has anyone else seen this?
-- Dave
----- Original Message -----
From: "Eric Newton" <[email protected]>
To: [email protected]
Sent: Tuesday, April 16, 2013 7:52:09 PM
Subject: Re: VFS class reloading?
We have tests for dynamic loading of classes so I'm pretty sure it works.
John, can you repeat the failure?
-Eric
On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <[email protected]> wrote:
Looking at the code, it should work. Keith and I had several conversations
about what the new classloader should do. I believe that he wanted it to
behave like the old one and what I see in the code supports that. If it is
not working, then I would say create a ticket for it for now. I'll try to
replicate it tonight if I have time.
-----Original Message-----
From: Dave Marion [mailto:[email protected]]
Sent: Tuesday, April 16, 2013 6:41 PM
To: [email protected]
Subject: RE: VFS class reloading?
The implementation changed several times, so the pre-1.5 layout may not
work. In 1.5, using the bootstrap script, it should put the accumulo jars
into HDFS and dynamic loading from there should occur. I'll try and test
tonight if I have time.
-----Original Message-----
From: John Vines [mailto:[email protected]]
Sent: Tuesday, April 16, 2013 6:30 PM
To: Accumulo Dev List
Subject: VFS class reloading?
Maybe I missed something with the switch to the VFS classloader, but does
dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
threw an iterator in there, but had to restart tserver to get the new
iterator picked up. Was that an intentional change?
Index: core/pom.xml
===================================================================
--- core/pom.xml (revision 1468702)
+++ core/pom.xml (working copy)
@@ -133,6 +133,28 @@
</build>
</profile>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: examples/simple/pom.xml
===================================================================
--- examples/simple/pom.xml (revision 1468702)
+++ examples/simple/pom.xml (working copy)
@@ -77,6 +77,28 @@
</build>
<profiles>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: pom.xml
===================================================================
--- pom.xml (revision 1468702)
+++ pom.xml (working copy)
@@ -752,6 +752,45 @@
</reporting>
</profile>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <properties>
+ <hadoop.version>0.20.205.0</hadoop.version>
+ <slf4j.version>1.4.3</slf4j.version>
+ </properties>
+ <dependencyManagement>
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ <version>${hadoop.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-test</artifactId>
+ <version>${hadoop.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-tools</artifactId>
+ <version>${hadoop.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ <version>1.0.1</version>
+ </dependency>
+ </dependencies>
+ </dependencyManagement>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: proxy/pom.xml
===================================================================
--- proxy/pom.xml (revision 1468702)
+++ proxy/pom.xml (working copy)
@@ -138,6 +138,28 @@
</build>
</profile>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: server/pom.xml
===================================================================
--- server/pom.xml (revision 1468702)
+++ server/pom.xml (working copy)
@@ -153,6 +153,27 @@
</build>
</profile>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: start/pom.xml
===================================================================
--- start/pom.xml (revision 1468702)
+++ start/pom.xml (working copy)
@@ -99,6 +99,32 @@
</build>
<profiles>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-test</artifactId>
+ <scope>test</scope>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
Index: test/pom.xml
===================================================================
--- test/pom.xml (revision 1468702)
+++ test/pom.xml (working copy)
@@ -130,6 +130,33 @@
</build>
<profiles>
<profile>
+ <!-- profile for building against Hadoop 0.20.x
+ Activate using: mvn -Dhadoop.profile=0.20 -->
+ <id>hadoop-0.20</id>
+ <activation>
+ <property>
+ <name>hadoop.profile</name>
+ <value>0.20</value>
+ </property>
+ </activation>
+ <dependencies>
+ <dependency>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-core</artifactId>
+ <scope>provided</scope>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-tools</artifactId>
+ <scope>test</scope>
+ </dependency>
+ </dependencies>
+ </profile>
+ <profile>
<!-- profile for building against Hadoop 1.0.x
Activate by not specifying hadoop.profile -->
<id>hadoop-1.0</id>
