[
https://issues.apache.org/jira/browse/TRAFODION-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060079#comment-16060079
]
ASF GitHub Bot commented on TRAFODION-2637:
-------------------------------------------
GitHub user zellerh opened a pull request:
https://github.com/apache/incubator-trafodion/pull/1141
[TRAFODION-2637] Library management with Cloudera parcels
Also in this commit:
[TRAFODION-2581] Combine JVM startup code of SQL executor and UDR server
We have library management SPJs that allow a user to deploy library
files from a client machine. These SPJs make use of the pdcp command
that is installed on many clusters, but not always. The new method
uses temporary HDFS files and a TMUDF to distribute the library
file to all nodes of the cluster.
For now I left the old PUT method in place and added a new PUTFILE
method. We can remove the old method later.
A few other things fixed in the process:
- Make sure that when a UDR server calls the executor and uses a JVM,
we share the same JVM. To do this, we need to use the same startup
method, and I needed to change the executor startup method to accept
the extra options used for the UDR server.
- Got rid of the "HBase compatibility mode" in JavaObjectInterface.
- A common method to execute SQL in the library management code.
- removed the obsolete init_libmgmt.sh file.
- We have special code that makes sure a UDR can request to run in
parallel, including a request to run on all nodes. Expanded this
special code from predefined UDFs to any UDF.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zellerh/incubator-trafodion bug/cses_jan-17
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/1141.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1141
----
commit ba20e3fabf1adf58fdb1287dc9b67055118aab23
Author: Hans Zeller <hzel...@apache.org>
Date: 2017-06-22T21:58:59Z
[TRAFODION-2637] Library management with Cloudera parcels
Also in this commit:
[TRAFODION-2581] Combine JVM startup code of SQL executor and UDR server
We have library management SPJs that allow a user to deploy library
files from a client machine. These SPJs make use of the pdcp command
that is installed on many clusters, but not always. The new method
uses temporary HDFS files and a TMUDF to distribute the library
file to all nodes of the cluster.
For now I left the old PUT method in place and added a new PUTFILE
method. We can remove the old method later.
A few other things fixed in the process:
- Make sure that when a UDR server calls the executor and uses a JVM,
we share the same JVM. To do this, we need to use the same startup
method, and I needed to change the executor startup method to accept
the extra options used for the UDR server.
- Got rid of the "HBase compatibility mode" in JavaObjectInterface.
- A common method to execute SQL in the library management code.
- removed the obsolete init_libmgmt.sh file.
- We have special code that makes sure a UDR can request to run in
parallel, including a request to run on all nodes. Expanded this
special code from predefined UDFs to any UDF.
----
> Library management in the absence of password-less ssh
> ------------------------------------------------------
>
> Key: TRAFODION-2637
> URL: https://issues.apache.org/jira/browse/TRAFODION-2637
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-general
> Affects Versions: 2.1-incubating
> Reporter: Hans Zeller
> Assignee: Hans Zeller
> Fix For: 2.2-incubating
>
>
> We have a set of built-in stored procedures that can be used to deploy
> libraries for UDRs to a Trafodion cluster. Some of these stored procedures
> rely on the pdsh command, which in turn relies on password-less ssh between
> the nodes of a cluster. Some installations, however, don't support
> password-less ssh. We therefore need to find another method to distribute the
> files.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
