[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12879950#action_12879950 ] Carl Steinbach commented on HIVE-1095: -- The patch applies cleanly, but I get the following error when I run the prepare-maven-publish target: {code} % ant maven-publish-artifact Buildfile: /Users/carl/Projects/hive/build.xml ant-task-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/maven/maven-ant-tasks/2.1.0/maven-ant-tasks-2.1.0.jar [get] To: /Users/carl/Projects/hive/build/maven-ant-tasks-2.1.0.jar mvn-taskdef: maven-publish-artifact: [artifact:pom] An error has occurred while processing the Maven artifact tasks. [artifact:pom] Diagnosis: [artifact:pom] [artifact:pom] Unable to initialize POM hive-${hive.project}-0.6.0.pom: Could not find the model file '/Users/carl/Projects/hive/build/maven/poms/hive-${hive.project}-0.6.0.pom'. for project unknown [artifact:pom] /Users/carl/Projects/hive/build/maven/poms/hive-${hive.project}-0.6.0.pom (No such file or directory) BUILD FAILED /Users/carl/Projects/hive/build.xml:410: Unable to initialize POM hive-${hive.project}-0.6.0.pom: Could not find the model file '/Users/carl/Projects/hive/build/maven/poms/hive-${hive.project}-0.6.0.pom'. for project unknown Total time: 5 seconds {code} It looks like the make-pom target needs to depend on ivy-init? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Attachments: HIVE-1095-trunk.patch, hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1095: - Fix Version/s: (was: 0.6.0) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Attachments: HIVE-1095-trunk.patch, hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Status: Patch Available (was: Open) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-trunk.patch, hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: (was: HIVE-1095-0.4.1.patch) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: (was: HIVE-1095-Sample.patch) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: (was: HIVE-1095-trunk.patch) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: hiveReleasedToMaven.tar.gz This package is meant to be used to prepare the hive 0.4.1 and 0.5.0 jars for maven deploy as per http://www.apache.org/dev/release-publishing.html#repository-guide. The tar.gz contains: - build.xml -resources/ -0.5.0/ -poms, licences -0.4.1/ -poms, licences How to use for hive 0.4.1: 1)Extract the hiveReleasedToMaven.tar.gz to a directory. 2)At command line type: ant preparejars-0.4.1 3)On success the poms, jars, licences directories can be found at build/dist/0.4.1 4)Use scp to deploy to [username]:[passwo...@people.apache.org:/www/people.apache.org/repo/m1-ibiblio-rsync-repository/org/apache/hadoop/hive/ How to use for hive 0.5.0: 1)Extract the hiveReleasedToMaven.tar.gz to a directory. 2)At command line type: ant preparejars-0.5.0 3)On success the poms,jars, licences directories can be found at build/dist/0.5.0 4)Use scp to deploy to [username]:[passwo...@people.apache.org:/www/people.apache.org/repo/m1-ibiblio-rsync-repository/org/apache/hadoop/hive/ Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: HIVE-1095-trunk.patch This patch is meant to be commited (if accepted) to the hive trunk. Purpose: Firstly to create a build/maven directory structure with the jar, autogenerated pom files and, licences (apache LICENCE-2.0). Optional deploy target for deploying to the maven Nexus repository Manager. How to create maven directory structure: 1) Type in ant prepare-maven-publish The maven directory structure will be in build/maven/ containing poms,jars,licences folders. I'll write a comment on the different deployment strategies. Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-trunk.patch, hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12845389#action_12845389 ] Gerrit Jansen van Vuuren commented on HIVE-1095: Hi, I've been doing some research and browsing and have find 2 major ways in which ASF projects can do deployments for maven, scp or using the ASF Nexus Maven Repo Manager. Please ignore step 4 on the above patch for uploading versions 0.4.1 and 0.5.0. One option is using the scp to the http://people.apache.org/repo/m2-ibiblio-rsync-repository repository but this is not the most appropriate and from what I've read ASF projects should use the ASF Nexus Maven Repo Manager. I've looked at the hadoop core build.xml files and it uses this strategy. There are 2 ways of deploying using Nexus: 1) Goto https://repository.apache.org/ and deploy the jar files manually see ( http://www.sonatype.com/books/nexus-book/reference/staging-sect-uploading-staged.html) 2) Via maven - Use the ant target provided in this patch called maven-publish Prior to doing either of these access credentials must be applied for, the https://issues.apache.org/jira/browse/INFRA-1896 tasks contains the information on how to go about this, with some reference documentation links. Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-trunk.patch, hiveReleasedToMaven.tar.gz Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12842720#action_12842720 ] Gerrit Jansen van Vuuren commented on HIVE-1095: Yep would be easier. So then we have: - Patch for trunk as Hive-1095-trunk.patch - I'll generate the ant script to do the hive for verions 0.4.1 and 0.5 How does that sound? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12841783#action_12841783 ] Gerrit Jansen van Vuuren commented on HIVE-1095: I might not be making sense but thinking again, should I just use this to generate the poms and jars for 0.3.0, 0.4.0, 0.4.1, and 0.5.0, i.e. have a tar.gz containing the poms, jars and licences folders for each version. Then attach those to this task. Then these can be scp(ed) over to the apache servers (I'll include a little ant build.xml to do this). Then we only have to worry about commit on the trunk. using Hive-1095-trunk.patch. Any thoughts? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12842007#action_12842007 ] Edward Capriolo commented on HIVE-1095: --- If it is a lot of effort making patches for 0.3.0 and 0.4.0 could be skipped. Generally we have been applying most changes to trunk and sometimes the latest branch. Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12841573#action_12841573 ] He Yongqiang commented on HIVE-1095: Would somebody be able to apply this patch after review (not commit) Does this mean the patch need to regenerated after any conflicting changes? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12841600#action_12841600 ] Gerrit Jansen van Vuuren commented on HIVE-1095: What I said was a bit confusing I've realized :) and what I meant was: There are two parts: - Commiting (if reviewed and accepted) the HIVE-1095-trunk.patch to the trunk. This is generated against trunk. - Using the HIVE-1095-0.4.1.patch against the version 0.4.1 of hive to generate the maven artifacts for 0.4.1 hive, are commits allowed for already versioned releases? if so then it would be better to have it committed cause any changes to build.xml, ivy.xml or build-common.xml would mean that the patch needs generation. So the broad scope and idea would be to publish the already released hive versions to the maven repo: 0.3.0 0.4.0 0.4.1 0.5.0 and then have the build in trunk so that when another release is made the maven publishing code is already in the build and its only needed to run ant maven-publish. By writing this I've realized that I probably need to generate the patches for the builds on the other versions of hive also, should I do this and attach to this task? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Tags: HIVE-1095-trunk.patch Fix Version/s: 0.6.0 Affects Version/s: 0.6.0 Status: Patch Available (was: Open) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Affects Versions: 0.6.0 Reporter: Gerrit Jansen van Vuuren Priority: Minor Fix For: 0.6.0 Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: HIVE-1095-Sample.patch Hi, I've finally got around to doing writing the ant tasks needed to help deploy hive jars to maven. The maven upload is simpler for apache software foundation projects. The procedure for uploading is explained at http://www.apache.org/dev/release-publishing.html#repository-guide and this is what the ant tasks in the patch does. 1. The patch changes ivy.xml files to include a info tag with licence information. 2. uses a makepom task that will generate the pom.xml file for each sub project i.e. ql. shims etc. 3. prepare the maven deploy a. by creating a build/maven directory, b. copying the jar files like hive_exec.jar and naming them hive-exec-${version}.jar c. copying the pom.xml files d. copying over the apache 2 licence (hope this is the correct licence. e. creating the required checksums for all files in the build/maven directory So to use this and generate the contents for the build/maven directory that will contain jars, poms, and licences folder just run the prepare-maven-publish task. The final task is the maven-publish task that does a scp to people.apache.org:/www/people.apache.org/repo/m1-ibiblio-rsync-repository/org/apache/hadoop/hive/, if the poms,jars, and licences folders are in here it will automatically be synced with the main maven repo. I have some questions: - Do you guys have access to the /www/people.apache.org/repo/m1-ibiblio-rsync-repository/org/apache/hadoop/hive/ ? - Is the assumption correct that hive uses the APACHE 2.0 licence? - Would somebody be able to apply this patch after review (not commit) but just to generate the jars,poms for the hive-4x release to deploy this to maven and then for the hive-5x release? Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Reporter: Gerrit Jansen van Vuuren Priority: Minor Attachments: HIVE-1095-Sample.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: HIVE-1095-0.4.1.patch Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Reporter: Gerrit Jansen van Vuuren Priority: Minor Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Attachment: HIVE-1095-trunk.patch Hi this patch is exactly the same as the others expect that its for the current hive trunk. It also used ${version} inside the ivy.xml files to be more generic. Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Reporter: Gerrit Jansen van Vuuren Priority: Minor Attachments: HIVE-1095-0.4.1.patch, HIVE-1095-Sample.patch, HIVE-1095-trunk.patch Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12828108#action_12828108 ] Gerrit Jansen van Vuuren commented on HIVE-1095: OK, I've given some thought on this and propose the following: Have a task called make-pom in the build-common.xml that uses the ivy makepom ant task to auto generate a pom for each project: The ant task is: target name=make-pom ivy:makepom ivyfile=${basedir}/ivy.xml pomfile=${basedir}/pom.xml mapping conf=default scope=compile/ mapping conf=runtime scope=runtime/ /ivy:makepom /target The generated pom for CLI is: ?xml version=1.0 encoding=UTF-8? !-- Apache Maven 2 POM generated by Apache Ivy http://ant.apache.org/ivy/ Apache Ivy version: 2.1.0 20090925235825 -- project xmlns=http://maven.apache.org/POM/4.0.0; xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation=http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd; modelVersion4.0.0/modelVersion groupIdorg.apache.hadoop.hive/groupId artifactIdcli/artifactId packagingjar/packaging version0.4.1/version dependencies dependency groupIdhadoop/groupId artifactIdcore/artifactId version0.19.0/version optionaltrue/optional /dependency /dependencies /project From here I can make an ant task that will load the JAR and POM for all the hive subprojects into a maven2 repo. The next step would be to setup a hive maven repo. Basically how this works is: Hive has its own repo and makes ONLY releases to this. Then send a request (I can do that) to the maven repos to be synched up with then. And voila, you'll have all hive releases that are released to the hive maven repo available on the main maven repos. Does your team have access to a server to do this setup? Below I write a mini how to for artifactory: Easiest is as standalone: - Download the artifactory zip at http://sourceforge.net/projects/artifactory/ - run bin/artifactory.sh As a WAR: - Download the zip file - copy to webapps/artifactory.war to tomcat or jetty. Setup is done via the artifactory admin window: defaults are: username: admin password: password (must be changed :) ) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Reporter: Gerrit Jansen van Vuuren Priority: Minor Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1095) Hive in Maven
[ https://issues.apache.org/jira/browse/HIVE-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerrit Jansen van Vuuren updated HIVE-1095: --- Affects Version/s: (was: 0.4.1) Fix Version/s: (was: 0.4.1) Hive in Maven - Key: HIVE-1095 URL: https://issues.apache.org/jira/browse/HIVE-1095 Project: Hadoop Hive Issue Type: Task Components: Build Infrastructure Reporter: Gerrit Jansen van Vuuren Priority: Minor Getting hive into maven main repositories Documentation on how to do this is on: http://maven.apache.org/guides/mini/guide-central-repository-upload.html -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: Hive in maven
Hi, Yes I'll start on creating the pom.xml The fastest and recommended way of doing this is by having a maven repo and sync it with the official maven repos (one way ). Also future hive releases would be just a matter of loading to this repo and its automatically synced with the official maven repo. If a manual upload is requested it takes more time. (says that on there website ) shall I open a jira for this? Cheers, Gerrit On Thu, 2010-01-21 at 12:28 -0800, Yongqiang He wrote: Hi Gerrit, Can you help uploading to maven? Thanks Yongqiang On 1/20/10 2:21 AM, Gerrit gvanvuu...@specificmedia.com wrote: Yep: The main maven page is: http://maven.apache.org/guides/mini/guide-central-repository-upload.html (see section Sync'ing your own repository to the central repository automatically) For groupId and artifactId conventions see: http://maven.apache.org/guides/mini/guide-naming-conventions.html) I have been a maven user for some time now and can help out to make the pom, document how to; setup and deploy, if you need help. For internal repos you could use: http://nexus.sonatype.org/ http://www.jfrog.org/products.php On Tue, 2010-01-19 at 23:31 -0800, Zheng Shao wrote: This is a good idea. Can you point us to some references on how to upload it to maven? Zheng On Mon, Jan 18, 2010 at 1:20 PM, Gerrit gvanvuu...@specificmedia.comwrote: Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive.artifactI d}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${hadoop.versio n}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${hadoop.versio n}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit
RE: Hive in maven
Yes you should open a JIRA for this. Ashish -Original Message- From: Gerrit [mailto:gvanvuu...@specificmedia.com] Sent: Friday, January 22, 2010 7:33 AM To: hive-dev@hadoop.apache.org Subject: Re: Hive in maven Hi, Yes I'll start on creating the pom.xml The fastest and recommended way of doing this is by having a maven repo and sync it with the official maven repos (one way ). Also future hive releases would be just a matter of loading to this repo and its automatically synced with the official maven repo. If a manual upload is requested it takes more time. (says that on there website ) shall I open a jira for this? Cheers, Gerrit On Thu, 2010-01-21 at 12:28 -0800, Yongqiang He wrote: Hi Gerrit, Can you help uploading to maven? Thanks Yongqiang On 1/20/10 2:21 AM, Gerrit gvanvuu...@specificmedia.com wrote: Yep: The main maven page is: http://maven.apache.org/guides/mini/guide-central-repository-upload. html (see section Sync'ing your own repository to the central repository automatically) For groupId and artifactId conventions see: http://maven.apache.org/guides/mini/guide-naming-conventions.html) I have been a maven user for some time now and can help out to make the pom, document how to; setup and deploy, if you need help. For internal repos you could use: http://nexus.sonatype.org/ http://www.jfrog.org/products.php On Tue, 2010-01-19 at 23:31 -0800, Zheng Shao wrote: This is a good idea. Can you point us to some references on how to upload it to maven? Zheng On Mon, Jan 18, 2010 at 1:20 PM, Gerrit gvanvuu...@specificmedia.comwrote: Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive .artifactI d}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${had oop.versio n}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${had oop.versio n}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit
Re: Hive in maven
Hi Gerrit, Can you help uploading to maven? Thanks Yongqiang On 1/20/10 2:21 AM, Gerrit gvanvuu...@specificmedia.com wrote: Yep: The main maven page is: http://maven.apache.org/guides/mini/guide-central-repository-upload.html (see section Sync'ing your own repository to the central repository automatically) For groupId and artifactId conventions see: http://maven.apache.org/guides/mini/guide-naming-conventions.html) I have been a maven user for some time now and can help out to make the pom, document how to; setup and deploy, if you need help. For internal repos you could use: http://nexus.sonatype.org/ http://www.jfrog.org/products.php On Tue, 2010-01-19 at 23:31 -0800, Zheng Shao wrote: This is a good idea. Can you point us to some references on how to upload it to maven? Zheng On Mon, Jan 18, 2010 at 1:20 PM, Gerrit gvanvuu...@specificmedia.comwrote: Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive.artifactI d}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${hadoop.versio n}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${hadoop.versio n}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit
Re: Hive in maven
Yep: The main maven page is: http://maven.apache.org/guides/mini/guide-central-repository-upload.html (see section Sync'ing your own repository to the central repository automatically) For groupId and artifactId conventions see: http://maven.apache.org/guides/mini/guide-naming-conventions.html) I have been a maven user for some time now and can help out to make the pom, document how to; setup and deploy, if you need help. For internal repos you could use: http://nexus.sonatype.org/ http://www.jfrog.org/products.php On Tue, 2010-01-19 at 23:31 -0800, Zheng Shao wrote: This is a good idea. Can you point us to some references on how to upload it to maven? Zheng On Mon, Jan 18, 2010 at 1:20 PM, Gerrit gvanvuu...@specificmedia.comwrote: Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive.artifactId}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit
Re: Hive in maven
This is a good idea. Can you point us to some references on how to upload it to maven? Zheng On Mon, Jan 18, 2010 at 1:20 PM, Gerrit gvanvuu...@specificmedia.comwrote: Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive.artifactId}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit -- Yours, Zheng
Hive in maven
Hi guys, Would it be possible to add the hive jars to the main maven repo? If there is not objections I can make the request to the main repo if you agree. The reason for this need is that I've created a Loader for the pig project to read HiveRCTables (https://issues.apache.org/jira/browse/PIG-1117) and currently use ant to directly download the libraries from the apache site using: get verbose=true src=${apache.dist.site}/${hive.groupId}/${hive.artifactId}/${hive.artifactId}-${hive.version}/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz dest=lib-hivedeps/${hive.artifactId}-${hive.version}-hadoop-${hadoop.version}-bin.tar.gz/ I would much prefer using ivy or maven and it makes this much cleaner. Thanks, Gerrit