[ https://issues.apache.org/jira/browse/TRAFODION-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060079#comment-16060079 ]
ASF GitHub Bot commented on TRAFODION-2637: ------------------------------------------- GitHub user zellerh opened a pull request: https://github.com/apache/incubator-trafodion/pull/1141 [TRAFODION-2637] Library management with Cloudera parcels Also in this commit: [TRAFODION-2581] Combine JVM startup code of SQL executor and UDR server We have library management SPJs that allow a user to deploy library files from a client machine. These SPJs make use of the pdcp command that is installed on many clusters, but not always. The new method uses temporary HDFS files and a TMUDF to distribute the library file to all nodes of the cluster. For now I left the old PUT method in place and added a new PUTFILE method. We can remove the old method later. A few other things fixed in the process: - Make sure that when a UDR server calls the executor and uses a JVM, we share the same JVM. To do this, we need to use the same startup method, and I needed to change the executor startup method to accept the extra options used for the UDR server. - Got rid of the "HBase compatibility mode" in JavaObjectInterface. - A common method to execute SQL in the library management code. - removed the obsolete init_libmgmt.sh file. - We have special code that makes sure a UDR can request to run in parallel, including a request to run on all nodes. Expanded this special code from predefined UDFs to any UDF. You can merge this pull request into a Git repository by running: $ git pull https://github.com/zellerh/incubator-trafodion bug/cses_jan-17 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1141.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1141 ---- commit ba20e3fabf1adf58fdb1287dc9b67055118aab23 Author: Hans Zeller <hzel...@apache.org> Date: 2017-06-22T21:58:59Z [TRAFODION-2637] Library management with Cloudera parcels Also in this commit: [TRAFODION-2581] Combine JVM startup code of SQL executor and UDR server We have library management SPJs that allow a user to deploy library files from a client machine. These SPJs make use of the pdcp command that is installed on many clusters, but not always. The new method uses temporary HDFS files and a TMUDF to distribute the library file to all nodes of the cluster. For now I left the old PUT method in place and added a new PUTFILE method. We can remove the old method later. A few other things fixed in the process: - Make sure that when a UDR server calls the executor and uses a JVM, we share the same JVM. To do this, we need to use the same startup method, and I needed to change the executor startup method to accept the extra options used for the UDR server. - Got rid of the "HBase compatibility mode" in JavaObjectInterface. - A common method to execute SQL in the library management code. - removed the obsolete init_libmgmt.sh file. - We have special code that makes sure a UDR can request to run in parallel, including a request to run on all nodes. Expanded this special code from predefined UDFs to any UDF. ---- > Library management in the absence of password-less ssh > ------------------------------------------------------ > > Key: TRAFODION-2637 > URL: https://issues.apache.org/jira/browse/TRAFODION-2637 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-general > Affects Versions: 2.1-incubating > Reporter: Hans Zeller > Assignee: Hans Zeller > Fix For: 2.2-incubating > > > We have a set of built-in stored procedures that can be used to deploy > libraries for UDRs to a Trafodion cluster. Some of these stored procedures > rely on the pdsh command, which in turn relies on password-less ssh between > the nodes of a cluster. Some installations, however, don't support > password-less ssh. We therefore need to find another method to distribute the > files. -- This message was sent by Atlassian JIRA (v6.4.14#64029)