[jira] [Commented] (TRAFODION-2848) vanilla hadoop version in install_local_hadoop should change
[ https://issues.apache.org/jira/browse/TRAFODION-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299212#comment-16299212 ] ASF GitHub Bot commented on TRAFODION-2848: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1349 > vanilla hadoop version in install_local_hadoop should change > > > Key: TRAFODION-2848 > URL: https://issues.apache.org/jira/browse/TRAFODION-2848 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: Gong Pengju >Priority: Minor > > if install vanilla hadoop by exec install_local_hadoop, the hadoop version is > 2.5.2, this version is incompatible with hive 1.1+ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2846) BatchUpdateException does not give enough error info
[ https://issues.apache.org/jira/browse/TRAFODION-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299161#comment-16299161 ] ASF GitHub Bot commented on TRAFODION-2846: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1347 > BatchUpdateException does not give enough error info > > > Key: TRAFODION-2846 > URL: https://issues.apache.org/jira/browse/TRAFODION-2846 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: mashengchen >Assignee: mashengchen > > when using ETL tools like kettle to do batch insert, if there met any problem > client side just get "Batch Update Failed, See next exception for details", > but it's not easy to get next exception, someone must change source code of > ETL tools, so it's suggeted that BatchUpdateException should give the really > error message, or brief msg at least. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2855) Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* 2
[ https://issues.apache.org/jira/browse/TRAFODION-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299151#comment-16299151 ] ASF GitHub Bot commented on TRAFODION-2855: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1356#discussion_r158144904 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc --- @@ -443,24 +443,39 @@ specify one or more of these options: ** `CONTINUE ON ERROR` + -LOAD statement will continue after errors encountered while scanning rows from source table. +LOAD statement will continue after ignorable errors while scanning rows from source table or loading into the target table. The ignorable errors are usually data conversion errors. + Errors during the load or sort phase will cause the LOAD statement to abort. + -Error rows will be logged by default in HDFS files in the directory `/user/trafodion/bulkload/logs`. The default name of the error files will be of the form `ERR___`, where `` is a numeric identifier unique to the process where the error was seen. -+ -This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified and it is not enabled by default. +This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified. ** `LOG ERROR ROWS [TO _error-location-name_]` +*** Error rows + If error rows must be written to a specified location, then specify TO _error-location-name_, otherwise they will be written to the default location. +`_error-location-name_` must be a HDFS directory name to which trafodion has write access. + -Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location. -The actual log file location is displayed in the load command output. +Error rows will be logged in HDFS files in the *directory* `/user/trafodion/bulkload/logs` if the error log location is not specified. ++ +The default name of the *subdirectory* is `_ERR_catalog.schema.target_table_date_id_`, where `_id_` is a numeric identifier timestamp (MMDD_HHMMSS) unique to the process where the error was seen. ++ +The default name of the *error file* is `_loggingFileNamePrefix_catalog.schema.target_table_instanceID_`, where `_loggingFileNamePrefix_` is hive_scan_err or traf_upsert_err depending on the data source table, and `_instanceID_` is the ID of instance starting from 0, generally there is only one instance. --- End diff -- Suggest "...is the instance ID starting from 0, ..." > Correct the syntax descriptions of LOAD Statement for *Trafodion SQL > Reference Manual* 2 > - > > Key: TRAFODION-2855 > URL: https://issues.apache.org/jira/browse/TRAFODION-2855 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2855) Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* 2
[ https://issues.apache.org/jira/browse/TRAFODION-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299152#comment-16299152 ] ASF GitHub Bot commented on TRAFODION-2855: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1356#discussion_r158144917 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_utilities.adoc --- @@ -443,24 +443,39 @@ specify one or more of these options: ** `CONTINUE ON ERROR` + -LOAD statement will continue after errors encountered while scanning rows from source table. +LOAD statement will continue after ignorable errors while scanning rows from source table or loading into the target table. The ignorable errors are usually data conversion errors. + Errors during the load or sort phase will cause the LOAD statement to abort. + -Error rows will be logged by default in HDFS files in the directory `/user/trafodion/bulkload/logs`. The default name of the error files will be of the form `ERR___`, where `` is a numeric identifier unique to the process where the error was seen. -+ -This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified and it is not enabled by default. +This option is implied if `LOG ERROR ROWS [TO _error-location-name_]` or `STOP AFTER _num_ ERROR ROWS` is specified. ** `LOG ERROR ROWS [TO _error-location-name_]` +*** Error rows + If error rows must be written to a specified location, then specify TO _error-location-name_, otherwise they will be written to the default location. +`_error-location-name_` must be a HDFS directory name to which trafodion has write access. + -Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location. -The actual log file location is displayed in the load command output. +Error rows will be logged in HDFS files in the *directory* `/user/trafodion/bulkload/logs` if the error log location is not specified. ++ +The default name of the *subdirectory* is `_ERR_catalog.schema.target_table_date_id_`, where `_id_` is a numeric identifier timestamp (MMDD_HHMMSS) unique to the process where the error was seen. ++ +The default name of the *error file* is `_loggingFileNamePrefix_catalog.schema.target_table_instanceID_`, where `_loggingFileNamePrefix_` is hive_scan_err or traf_upsert_err depending on the data source table, and `_instanceID_` is the ID of instance starting from 0, generally there is only one instance. ++ +For example, the full path of the table test_load_log is `/user/trafodion/bulkload/logs/test/ERR_TRAFODION.SEABASE.TEST_LOAD_LOG_20171218_035918/traf_upsert_err_TRAFODION.SEABASE.TEST_LOAD_LOG_0`, ++ +where: ++ +1. `/user/trafodion/bulkload/logs/test` is the default name of *directory*. ++ +2. `ERR_TRAFODION.SEABASE.TEST_LOAD_LOG_20171218_035918` is the default name of *subdirectory*. ++ +3. `traf_upsert_err_TRAFODION.SEABASE.TEST_LOAD_LOG_0` is the default name of *error file*. -*** `_error-location-name_` +*** Error logs ++ +Error logs are written in separate files by the processes involved in the load command under sub-directory representing the load command in the given location. + -must be a HDFS directory name to which trafodion has write access. +The actual log file location is displayed in the load command output. It is recommended that use the same location for load as it’s easier to find the error logs. --- End diff -- Suggest "It is recommended that you use..." (add the word "you") > Correct the syntax descriptions of LOAD Statement for *Trafodion SQL > Reference Manual* 2 > - > > Key: TRAFODION-2855 > URL: https://issues.apache.org/jira/browse/TRAFODION-2855 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2856) Add optimizer/UdrErrors to analyzeMessageGuide.py
[ https://issues.apache.org/jira/browse/TRAFODION-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299141#comment-16299141 ] ASF GitHub Bot commented on TRAFODION-2856: --- GitHub user DaveBirdsall opened a pull request: https://github.com/apache/incubator-trafodion/pull/1358 [TRAFODION-2856] Add optimizer/UdrErrors.h to analyzeMessageGuide.py This allows the script to search for references to certain messages using these enums as well as the numbers themselves. You can merge this pull request into a Git repository by running: $ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion2856 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1358.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1358 commit 38dc10cbc608f56e474e1e83e35b25e08854fa4a Author: Dave Birdsall Date: 2017-12-20T21:33:45Z [TRAFODION-2856] Add optimizer/UdrErrors.h to analyzeMessageGuide.py > Add optimizer/UdrErrors to analyzeMessageGuide.py > - > > Key: TRAFODION-2856 > URL: https://issues.apache.org/jira/browse/TRAFODION-2856 > Project: Apache Trafodion > Issue Type: Sub-task > Components: dev-environment >Affects Versions: 2.3-incubating >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall >Priority: Minor > > The file optimizer/UdrErrors.h has an enum that is used for certain > Binder-time UDR-related error messages. This file should be added to the list > that analyzeMessageGuide.py knows about. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299114#comment-16299114 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1350 > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2852) Update Messages Guide for some messages in the range 1200-1299
[ https://issues.apache.org/jira/browse/TRAFODION-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299092#comment-16299092 ] ASF GitHub Bot commented on TRAFODION-2852: --- GitHub user DaveBirdsall opened a pull request: https://github.com/apache/incubator-trafodion/pull/1357 [TRAFODION-2852] Bring Messages Guide up-to-date for msgs 1200-1299 +others This set of changes brings most of the messages in the range 1200-1299 in the Messages Guide up-to-date. Several obsolete messages were removed, and previously-undocumented messages were added. A few minor code changes were made removing dead code. You can merge this pull request into a Git repository by running: $ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion2852 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1357.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1357 commit 1304c577a0ba9e5e6a61c5552ee5e26186f2c3dd Author: Dave Birdsall Date: 2017-12-20T21:01:42Z [TRAFODION-2852] Bring Messages Guide up-to-date for msgs 1200-1299 + others > Update Messages Guide for some messages in the range 1200-1299 > -- > > Key: TRAFODION-2852 > URL: https://issues.apache.org/jira/browse/TRAFODION-2852 > Project: Apache Trafodion > Issue Type: Sub-task > Components: documentation >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298894#comment-16298894 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158099468 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298892#comment-16298892 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158101687 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298896#comment-16298896 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158095073 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path --- End diff -- This command needs a help text that should mention the following: - Who should use this script (people who want to set up a single node development system on a machine where they have sudo privileges) - What does the script do (e.g. yum install, build/setup tools). - A link to the Contributor guide wiki page that describes these steps (https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environment) - What environment variables must be set before calling this script - What optional environment variables can be set - What directories are created by the script, and how they can be customized Once this PR is merged, we can also update the wiki page and mention this command. > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type: New Feature > Components: Build Infrastructure >Affects Versions: any > Environment: Red Hat and CentOS first >Reporter: xiaozhong.wang > Fix For: any > > Original Estimate: 24h > Remaining Estimate: 24h > > Newbie cann't create build environment without a hitch. > Although has a script traf_tools_setup.sh, there are a lot of process needed > to prepare before that. > Give a script that can create build environment by one command, it's very > useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1629#comment-1629 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158090398 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298886#comment-16298886 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158089957 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command --- End diff -- Maybe better to say "check some basic commands" > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type:
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298895#comment-16298895 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158091099 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298890#comment-16298890 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158091915 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298893#comment-16298893 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158094093 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298898#comment-16298898 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158090483 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298891#comment-16298891 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158093989 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298897#comment-16298897 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158098624 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298887#comment-16298887 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158090237 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} +MY_INSTALL_SW_DIST=${MY_INSTALL_SW_DIST-${HOME}/installed_software_tools} +MY_DOWNLOAD_SW_DIST=${MY_DOWNLOAD_SW_DIST-${HOME}/download_software_tools} + +CHECKLOG=${LOGFILE-$(pwd)/$0.log} +local_sws=(udis llvm mpich bison icu zookeeper thrift apache-maven protobuf apache-log4cxx hadoop) +http_sws=( +http://sourceforge.net/projects/udis86/files/udis86/1.7/udis86-1.7.2.tar.gz +http://llvm.org/releases/3.2/llvm-3.2.src.tar.gz +http://www.mpich.org/static/downloads/3.0.4/mpich-3.0.4.tar.gz +http://ftp.gnu.org/gnu/bison/bison-3.0.tar.gz +http://download.icu-project.org/files/icu4c/4.4/icu4c-4_4-src.tgz +https://archive.apache.org/dist/zookeeper/zookeeper-3.4.5/zookeeper-3.4.5.tar.gz +http://archive.apache.org/dist/thrift/0.9.0/thrift-0.9.0.tar.gz +http://archive.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz +https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz +https://dist.apache.org/repos/dist/release/logging/log4cxx/0.10.0/apache-log4cxx-0.10.0.tar.gz +http://archive.apache.org/dist/hadoop/common/hadoop-2.6.0/hadoop-2.6.0.tar.gz +) + +# check the local software directory +if [ ! -d ${MY_LOCAL_SW_DIST} ]; then +echo "WARNING: Local software tools aren't present. Will download all tools from the internet. This will be very slow. If you do have the local software tools present, set the environment variable MY_LOCAL_SW_DIST to point to them and run this script again. The default local software directory is [${MY_LOCAL_SW_DIST}]. Do you want to continue? Enter y/n (default: n):" +read YN +case ${YN} in + Y|y|Yes|YES) + ;; + *) + echo "Downloading the following build tools from the internet:" + for i in `seq ${#local_sws[@]}` + do + printf "%2d.%15s: %s\n" ${i} ${local_sws[${i}-1]} ${http_sws[${i}-1]} + done + exit 1 + ;; +esac +else +# check the local software's source exist or not +for local_sw in ${local_sws[@]} +do + local_file=`ls ${MY_LOCAL_SW_DIST} | grep ${local_sw}` + if [ "x${local_file}" = "x" ]; then +echo "WARNING: [${local_sw}] source file does not exist in directory [${MY_LOCAL_SW_DIST}]" + fi +done +fi + +# check the permission. +(${MY_SUDO} touch /etc/trafpermise) >>${LOGFILE}2>&1 +if [ "x$?" != "x0" ]; then +echo "ERROR: you must run this script with sudo without password permission." +exit 1 +fi + +# check the based command +basecmds=(yum lsb_release awk cut uname) +for basecmd in ${basecmds[@]} +do +basecmdpath=`which ${basecmd}` +if [ "x$?" != "x0" ]; then + case ${basecmd} in + yum) + echo "ERROR: You must first install yum." + exit 1 + ;; + lsb_release) + (${
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298889#comment-16298889 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user zellerh commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1353#discussion_r158095765 --- Diff: install/traf_checkset_env.sh --- @@ -0,0 +1,243 @@ +#!/bin/bash +# +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# make sure the environment can build the code of trafodion or not. +# must configure the yum repo right before execute this script. +# run this script with normal user, while must has sudo permission. + +#default path +MY_JVM_PATH=${MY_JVM_PATH-"/usr/lib/jvm"} +MY_JAVA_VER=${MY_JAVA_VER-"java-1.7.0-openjdk"} +MY_SUDO=${MY_SUDO-"sudo"} +MY_YUM=${MY_YUM-"${MY_SUDO} yum -y"} + +# for setup tools +MY_LOCAL_SW_DIST=${MY_LOCAL_SW_DIST-${HOME}/local_software_tools} --- End diff -- It's pretty common that the root directory of a server is small (at least on the OpenStack and Amazon VMs I have seen). Maybe add yet another variable like this one: ``` MY_SW_HOME=${MY_SW_HOME-${HOME}} ``` Then use $MY_SW_HOME instead of $HOME below. > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type: New Feature > Components: Build Infrastructure >Affects Versions: any > Environment: Red Hat and CentOS first >Reporter: xiaozhong.wang > Fix For: any > > Original Estimate: 24h > Remaining Estimate: 24h > > Newbie cann't create build environment without a hitch. > Although has a script traf_tools_setup.sh, there are a lot of process needed > to prepare before that. > Give a script that can create build environment by one command, it's very > useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2850) Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298712#comment-16298712 ] ASF GitHub Bot commented on TRAFODION-2850: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1354#discussion_r158074821 --- Diff: docs/lob_guide/src/asciidoc/_chapters/working_with_lob.adoc --- @@ -235,6 +235,8 @@ The source for inserting into a LOB can be any of the following: An unnamed parameter can be used to prepare a statement and then during an execution, either a function or a simple string parameter can be passed in which will be converted to LOB data. * `EMPTY_BLOB()` or `EMPTY_CLOB()` ++ +NOTE: If you want to insert `EMPTY_BLOB()` or `EMPTY_CLOB()` into a lob column, the CQD `TRAF_CLOB_AS_VARCHAR` which is *ON* by default must be turned *OFF* before creating the table. --- End diff -- Oops... I meant to say, "The CQD must be 'OFF' at the time the table with the BLOB / CLOB column is created. (Otherwise the table is created with a VARCHAR.)" Apologies. My fault for typing that comment quickly before rushing off to an appointment. > Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects > Guide* > > > Key: TRAFODION-2850 > URL: https://issues.apache.org/jira/browse/TRAFODION-2850 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2850) Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298714#comment-16298714 ] ASF GitHub Bot commented on TRAFODION-2850: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1354#discussion_r158074973 --- Diff: docs/lob_guide/src/asciidoc/_chapters/working_with_lob.adoc --- @@ -235,6 +235,8 @@ The source for inserting into a LOB can be any of the following: An unnamed parameter can be used to prepare a statement and then during an execution, either a function or a simple string parameter can be passed in which will be converted to LOB data. * `EMPTY_BLOB()` or `EMPTY_CLOB()` ++ +NOTE: If you want to insert `EMPTY_BLOB()` or `EMPTY_CLOB()` into a lob column, the CQD `TRAF_CLOB_AS_VARCHAR` which is *ON* by default must be turned *OFF* before creating the table. --- End diff -- And yes, your suggested comment looks right to me. > Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects > Guide* > > > Key: TRAFODION-2850 > URL: https://issues.apache.org/jira/browse/TRAFODION-2850 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2853) Memory leak of ComDiagsArea in Context
[ https://issues.apache.org/jira/browse/TRAFODION-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297971#comment-16297971 ] ASF GitHub Bot commented on TRAFODION-2853: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1355 > Memory leak of ComDiagsArea in Context > -- > > Key: TRAFODION-2853 > URL: https://issues.apache.org/jira/browse/TRAFODION-2853 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-exe >Affects Versions: any >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > There were instances that the executor master process has more than 1 GB of > memory account memory allocated, Looking at the size of allocation by > traversing the heap, it was found ComDiagsArea is leaked in ContextHeap. > The heap traversal shows the addresses and the allocated size that were part > of context Heap that was leaking > 0x7fdef4cc69b8 336 > 0x7fdef4cc6bc8 336 > 0x7fdef4cc6d18 336 > 0x7fdef4cc6e68 336 > 0x7fdef4cc6fb8 336 > 0x7fdef4cc71e0 336 > 0x7fdef4cc7330 336 > 0x7fdef4cc7480 336 > The actual address of the objects is 16 bytes from the above address > (gdb) p *(ComDiagsArea *)0x7fdef4cc69c8 > $9 = { >= { > _vptr.IpcMessageObj = 0x7fdfbe4bbc50, > s_ = { > objType_ = 13501, > objVersion_ = 0, > refCount_ = 1, > objLength_ = 0, > next_ = 0x0, > endianness_ = 1 '\001', > spare1_ = 0 '\000', > spare2_ = 0, > vPtrPad_ = 0x0 > } > }, > members of ComDiagsArea: > collHeapPtr_ = 0x7fdfb18eb128, > errors_ = { > > = { >= { > _vptr.NABasicObject = 0x7fdfbe4bbf10, > h_ = 0x0 > }, > members of NACollection: > maxLength_ = 0, > usedLength_ = 0, > entries_ = 0, > arr_ = 0x0, > usages_ = 0x0, > heap_ = 0x7fdfb18eb128 > }, > members of NAList: > first_ = 1, > last_ = 1, > userIndexCache_ = 1, > arrayIndexCache_ = 1 > }, > warnings_ = { > ---Type to continue, or q to quit--- > > = { >= { > _vptr.NABasicObject = 0x7fdfbe4bbf10, > h_ = 0x0 > }, > members of NACollection: > maxLength_ = 0, > usedLength_ = 0, > entries_ = 0, > arr_ = 0x0, > usages_ = 0x0, > heap_ = 0x7fdfb18eb128 > }, > members of NAList: > first_ = 1, > last_ = 1, > userIndexCache_ = 1, > arrayIndexCache_ = 1 > }, > newCondition_ = 0x0, > areMore_ = 0, > lengthLimit_ = 30, > rowCount_ = 0, > theSQLFunction_ = 0, > maxDiagsId_ = 0, > avgStreamWaitTime_ = -1, > cost_ = 0, > flags_ = 0, > rowsetRowCountArray_ = 0x0, > fillers_ = '\000' > } > (gdb) (gdb) p *(NAHeap *)0x7fdfb18eb128 > $10 = { >= { > = { > _vptr.NABasicObject = 0x7fdfc1001870, > h_ = 0x0 > }, > members of NAMemory: > name_ = "Heap in ContextCli\000\000", > type_ = NAMemory::DERIVED_MEMORY, > initialSize_ = 524288, > maximumSize_ = 18446744073709551615, > incrementSize_ = 4194304, > parent_ = 0xf18b38, > firstBlk_ = 0x7f3a44f75030, > allocSize_ = 1375405192, > upperLimit_ = 0, > highWaterMark_ = 1447646816, > intervalWaterMark_ = 1447646816, > allocCnt_ = 2837663, > totalSize_ = 1529356096, > blockCnt_ = 381, > thBlockCnt_ = 40, > segGlobals_ = 0x0, > memoryList_ = 0x7fdfb0e7aac0, > lastListEntry_ = 0x7fdeef140608, > nextEntry_ = 0x7fdfb18f12c8, > debugLevel_ = 0, > heapJumpBuf_ = 0xf18a30, > exhaustedMem_ = 0, > errorsMask_ = 0, > heapID_ = { > heapNum = -1 > }, -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297968#comment-16297968 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157948980 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3526,7 +3526,7 @@ EMPTY_CLOB() * If EMPTY_CLOB() is specified, then a dummy lob handle is created. -** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate the LOB with new data. If the LOB had data previously associated with it, it will be erased. ** The dummy LOB handle will get the same datatype as the underlying column. + --- End diff -- Thanks Sandhya, I've updated this paragrahy based on you suggestions. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2850) Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297886#comment-16297886 ] ASF GitHub Bot commented on TRAFODION-2850: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1354#discussion_r157937569 --- Diff: docs/lob_guide/src/asciidoc/_chapters/working_with_lob.adoc --- @@ -235,6 +235,8 @@ The source for inserting into a LOB can be any of the following: An unnamed parameter can be used to prepare a statement and then during an execution, either a function or a simple string parameter can be passed in which will be converted to LOB data. * `EMPTY_BLOB()` or `EMPTY_CLOB()` ++ +NOTE: If you want to insert `EMPTY_BLOB()` or `EMPTY_CLOB()` into a lob column, the CQD `TRAF_CLOB_AS_VARCHAR` which is *ON* by default must be turned *OFF* before creating the table. --- End diff -- Hi @DaveBirdsall, 1. The CQD must be turned **'OFF'** before creating a table, otherwise an error will be raised if `EMPTY_BLOB()` or `EMPTY_CLOB()` is inserted into a lob column, and the **column definition** of lob column is **VARCHAR** (see the first attachment). 2. Correct behaviour: Set the CQD 'OFF', then create a table and insert `EMPTY_BLOB()` or `EMPTY_CLOB()`, it will succeed and the column definition is **CLOB** rather than VARCHAR (see the second attachment). 3. The default value of this CQD is ON. Thanks for your reminding, may I change this note to the following? Note: If you want to insert `EMPTY_BLOB()` or `EMPTY_CLOB()` into a lob column, the CQD `TRAF_CLOB_AS_VARCHAR` which is **ON** by default must be turned **OFF** before creating a table, otherwise an error will be raised and the column definition of the lob column is VARCHAR. ![turn the cqd off after creating a table](https://user-images.githubusercontent.com/20532956/34191895-71acb302-e585-11e7-89c5-acb9f8c50640.jpg) ![set the cqd off before creating a table](https://user-images.githubusercontent.com/20532956/34191896-764771e0-e585-11e7-9823-983e28839440.jpg) > Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects > Guide* > > > Key: TRAFODION-2850 > URL: https://issues.apache.org/jira/browse/TRAFODION-2850 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2850) Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297480#comment-16297480 ] ASF GitHub Bot commented on TRAFODION-2850: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1354#discussion_r157883840 --- Diff: docs/lob_guide/src/asciidoc/_chapters/working_with_lob.adoc --- @@ -235,6 +235,8 @@ The source for inserting into a LOB can be any of the following: An unnamed parameter can be used to prepare a statement and then during an execution, either a function or a simple string parameter can be passed in which will be converted to LOB data. * `EMPTY_BLOB()` or `EMPTY_CLOB()` ++ +NOTE: If you want to insert `EMPTY_BLOB()` or `EMPTY_CLOB()` into a lob column, the CQD `TRAF_CLOB_AS_VARCHAR` which is *ON* by default must be turned *OFF* before creating the table. --- End diff -- You may want to elaborate: The CQD must be 'ON' at the time the table with the BLOB / CLOB column is created. (Otherwise the table is created with a VARCHAR.) > Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects > Guide* > > > Key: TRAFODION-2850 > URL: https://issues.apache.org/jira/browse/TRAFODION-2850 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296416#comment-16296416 ] ASF GitHub Bot commented on TRAFODION-2802: --- Github user sumory closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1342 > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type: New Feature > Components: Build Infrastructure >Affects Versions: any > Environment: Red Hat and CentOS first >Reporter: xiaozhong.wang > Fix For: any > > Original Estimate: 24h > Remaining Estimate: 24h > > Newbie cann't create build environment without a hitch. > Although has a script traf_tools_setup.sh, there are a lot of process needed > to prepare before that. > Give a script that can create build environment by one command, it's very > useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2855) Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* 2
[ https://issues.apache.org/jira/browse/TRAFODION-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296404#comment-16296404 ] ASF GitHub Bot commented on TRAFODION-2855: --- GitHub user liuyu000 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1356 [TRAFODION-2855] Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* 2 You can merge this pull request into a Git repository by running: $ git pull https://github.com/liuyu000/incubator-trafodion LoadStatement2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1356.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1356 commit 30f3ea9a2b3ed6bd52e83227911b46b17dd9c99b Author: liu.yu Date: 2017-12-19T07:42:53Z Correct the syntax descriptions of LOAD Statement for *Trafodion Reference Manual* 2 > Correct the syntax descriptions of LOAD Statement for *Trafodion SQL > Reference Manual* 2 > - > > Key: TRAFODION-2855 > URL: https://issues.apache.org/jira/browse/TRAFODION-2855 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296352#comment-16296352 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user sandhyasun commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157678749 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3526,7 +3526,7 @@ EMPTY_CLOB() * If EMPTY_CLOB() is specified, then a dummy lob handle is created. -** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate the LOB with new data. If the LOB had data previously associated with it, it will be erased. ** The dummy LOB handle will get the same datatype as the underlying column. + --- End diff -- Here, maybe you can elaborate by explaining what "getting the same datatype as column " means . If the column is declared as type LOB 'external' in the create statement, the dummy lob handle will get the type external and this LOB can only handle LOB's that are external. If the column is declared without the external clause, the LOB data will be maintained within the Trafodion space in the internal location maintained by Trafodion. > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296099#comment-16296099 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655684 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -7182,6 +7404,40 @@ SELECT STDDEV (price * qty_available) FROM sales.parts; --- 1 row(s) selected. ``` +<<< +[[stringtolob_function]] +== STRINGTOLOB Function + +[[stringtolob_function_syntax]] +=== Syntax Descriptions of STRINGTOLOB Function + +The STRINGTOLOB function converts a simple string literal into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296100#comment-16296100 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655715 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_language_elements.adoc --- @@ -367,6 +369,9 @@ SECOND 0-59 + FRACTION(n) 0-99 + in which n is the number of significant digits (default is 6; minimum is 1; maximum is 6); + stored in 2, 4, or 8 bytes depending on number of digits^2^ +.2+| LOB Data Types .2+| LOB | BLOB | Binary Large Object .2+| 10G – no limit + +Currently it sets to 10G (default) and it’s controlled by the `CQD LOB_MAX_SIZE`, the size can be changed depending on your needs. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296098#comment-16296098 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655670 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3638,6 +3776,52 @@ The example displays only part of the result table of the EXPLAIN function. It first uses the EXPLAIN function to generate the table and then selects the desired columns. +<<< +[[externaltolob_function]] +== EXTERNALTOLOB Function + +[[externaltolob_function_syntax]] +=== Syntax Descriptions of EXTERNALTOLOB Function + +The EXTERNALTOLOB function converts data from an external file into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- "an INSERT or UPDATE statement" is preferable, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296097#comment-16296097 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655659 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3679,40 +3863,43 @@ EXTRACT (YEAR FROM INTERVAL '01-09' YEAR TO MONTH) + The result is 1. - <<< -[[hour_function]] -=== HOUR Function +[[filetolob_function]] +== FILETOLOB Function -The HOUR function converts a TIME or TIMESTAMP expression into an -INTEGER value in the range 0 through 23 that represents the -corresponding hour of the day. +[[filetolob_function_syntax]] +=== Syntax Descriptions of FILETOLOB Function -HOUR is a {project-name} SQL extension. +The FILETOLOB function converts data from a local linux/hdfs file into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296091#comment-16296091 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655538 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. --- End diff -- "an INSERT or UPDATE statement" is preferable, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296092#comment-16296092 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655567 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_CLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion LOB Guide]. + +``` +EMPTY_CLOB() +``` + +[[considerations_for_emptyclob_function]] +=== Considerations for EMPTY_CLOB() Function + +* If EMPTY_CLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296089#comment-16296089 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655475 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. --- End diff -- thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296090#comment-16296090 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655482 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. --- End diff -- thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296088#comment-16296088 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655468 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296085#comment-16296085 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655159 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. --- End diff -- "an INSERT or UPDATE statement" is preferable, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296082#comment-16296082 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655082 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -926,6 +944,45 @@ The following are BITAND restrictions: --- 1 row(s) selected ``` +<<< +[[buffertolob_function]] +== BUFFERTOLOB Function + +[[buffertolob_function_syntax]] +=== Syntax Descriptions of BUFFERTOLOB Function + +The BUFFERTOLOB function takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB. This function can be used in INSERT or UPDATE statement. + +BUFFERTOLOB function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +BUFFERTOLOB(LOCATION lob source buffer address, LENGTH lob length value) +``` + +* _lob source buffer address_ ++ +The long value of the user buffer address in int64. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296084#comment-16296084 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157655101 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296079#comment-16296079 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157654894 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -926,6 +944,45 @@ The following are BITAND restrictions: --- 1 row(s) selected ``` +<<< +[[buffertolob_function]] +== BUFFERTOLOB Function + +[[buffertolob_function_syntax]] +=== Syntax Descriptions of BUFFERTOLOB Function + +The BUFFERTOLOB function takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB. This function can be used in INSERT or UPDATE statement. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296078#comment-16296078 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157654856 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. +| <> | Converts a simple string literal into LOB format. +| <> | Converts data from a local linux/hdfs file into LOB format. +| <> | Takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB format. +| <> | Converts data from an external file into LOB format. +| LOBTOSTRING | Converts LOB data into simple string literal. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296077#comment-16296077 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157654813 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. +| <> | Converts a simple string literal into LOB format. +| <> | Converts data from a local linux/hdfs file into LOB format. +| <> | Takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB format. --- End diff -- OK, thanks Dave, for your detailed explanations. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296076#comment-16296076 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user liuyu000 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157654703 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. --- End diff -- OK, thanks Dave. :) > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295934#comment-16295934 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157637308 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. --- End diff -- Similarly > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295947#comment-16295947 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157639136 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_language_elements.adoc --- @@ -367,6 +369,9 @@ SECOND 0-59 + FRACTION(n) 0-99 + in which n is the number of significant digits (default is 6; minimum is 1; maximum is 6); + stored in 2, 4, or 8 bytes depending on number of digits^2^ +.2+| LOB Data Types .2+| LOB | BLOB | Binary Large Object .2+| 10G – no limit + +Currently it sets to 10G (default) and it’s controlled by the `CQD LOB_MAX_SIZE`, the size can be changed depending on your needs. --- End diff -- Possible word smith: "Currently the limit defaults to 10Gb. This limit can be configured as needed using 'CQD LOB_MAX_SIZE'. > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295943#comment-16295943 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638744 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3638,6 +3776,52 @@ The example displays only part of the result table of the EXPLAIN function. It first uses the EXPLAIN function to generate the table and then selects the desired columns. +<<< +[[externaltolob_function]] +== EXTERNALTOLOB Function + +[[externaltolob_function_syntax]] +=== Syntax Descriptions of EXTERNALTOLOB Function + +The EXTERNALTOLOB function converts data from an external file into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- "an INSERT or UPDATE statement" or "INSERT or UPDATE statements" sounds a bit better > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295941#comment-16295941 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638640 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_CLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion LOB Guide]. + +``` +EMPTY_CLOB() +``` + +[[considerations_for_emptyclob_function]] +=== Considerations for EMPTY_CLOB() Function + +* If EMPTY_CLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. --- End diff -- Similar to previous comment > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295946#comment-16295946 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638536 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. --- End diff -- "...of type CLOB" sounds better to my ears. > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295942#comment-16295942 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638255 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. --- End diff -- Either "an INSERT or UPDATE statement" or "INSERT or UPDATE statements" is better > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295948#comment-16295948 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157637289 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. --- End diff -- Suggested wordsmith: "Creates a dummy LOB handle of type BLOB" > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295949#comment-16295949 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638951 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -7182,6 +7404,40 @@ SELECT STDDEV (price * qty_available) FROM sales.parts; --- 1 row(s) selected. ``` +<<< +[[stringtolob_function]] +== STRINGTOLOB Function + +[[stringtolob_function_syntax]] +=== Syntax Descriptions of STRINGTOLOB Function + +The STRINGTOLOB function converts a simple string literal into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- same comment as before > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295938#comment-16295938 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157637747 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. +| <> | Converts a simple string literal into LOB format. +| <> | Converts data from a local linux/hdfs file into LOB format. +| <> | Takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB format. --- End diff -- Nit: To my ears, "Takes an address and the size of an input buffer..." sounds better. Probably the reason it sounds better to me is that I know the address is pointing to the input buffer. So, once we have said "an address" we have identified a specific input buffer, and "size" refers to the size of that specific buffer. So it requires the definite article rather than the indefinite article. That said, perhaps another way of saying this is, "Takes the address and size of an input buffer, and converts the contents of that buffer into LOB format." > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295937#comment-16295937 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638107 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -926,6 +944,45 @@ The following are BITAND restrictions: --- 1 row(s) selected ``` +<<< +[[buffertolob_function]] +== BUFFERTOLOB Function + +[[buffertolob_function_syntax]] +=== Syntax Descriptions of BUFFERTOLOB Function + +The BUFFERTOLOB function takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB. This function can be used in INSERT or UPDATE statement. + +BUFFERTOLOB function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +BUFFERTOLOB(LOCATION lob source buffer address, LENGTH lob length value) +``` + +* _lob source buffer address_ ++ +The long value of the user buffer address in int64. --- End diff -- Perhaps, "The int64 value of the user buffer address"? > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295944#comment-16295944 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638612 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. + +** The dummy LOB handle will get the same datatype as the underlying column. ++ +For example, if the LOB column was defined as `‘EXTERNAL’` during table creation, then the LOB column gets that type. If it’s not defined, then it is considered as a regular LOB. + +* An empty LOB is distinct from a LOB containing a string of length zero or a null LOB. + +[[examples_of_emptyblob_function]] +=== Examples of EMPTY_BLOB() Function + +* This example uses the EMPTY_BLOB to insert an empty LOB and creates a dummy LOB handle. ++ +``` +insert into test1 values (1, empty_blob()); +``` + +<<< +[[emptyclob_function]] +== EMPTY_CLOB() Function + +[[syntax_descriptions_of_emptyclob_function]] +=== Syntax Descriptions of EMPTY_CLOB() Function + +The EMPTY_CLOB() function creates a dummy LOB handle with CLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. --- End diff -- "an INSERT or UPDATE statement" or "INSERT or UPDATE statements" sounds better to my ears. > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295935#comment-16295935 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157637887 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -213,6 +213,24 @@ corresponding week of the year. See the individual entry for the function. +[[lob_functions]] +== LOB Functions + +Trafodion provides following LOB functions to process LOB data. + +[cols="25%,75%"] +|=== +| <> | Creates a dummy LOB handle with BLOB. +| <> | Creates a dummy LOB handle with CLOB. +| <> | Converts a simple string literal into LOB format. +| <> | Converts data from a local linux/hdfs file into LOB format. +| <> | Takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB format. +| <> | Converts data from an external file into LOB format. +| LOBTOSTRING | Converts LOB data into simple string literal. --- End diff -- I would say, "Converts LOB data into a simple string literal." > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295940#comment-16295940 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638376 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. + +This function can be used in INSERT or UPDATE statement, to initialize a LOB column or attribute to EMPTY. + +EMPTY_BLOB() function is a Trafodion SQL extension. + +For more information, see http://trafodion.incubator.apache.org/docs/lob_guide/index.html[Trafodion SQL Large Objects Guide]. + +``` +EMPTY_BLOB() +``` + +[[considerations_for_emptyblob_function]] +=== Considerations for EMPTY_BLOB() Function + +* If EMPTY_BLOB() is specified, then a dummy lob handle is created. + +** No data is associated with the empty LOBs yet, but these dummy LOB handles can later be used to populate with new LOB data. If the LOB had data previously associated with it, it will be erased. --- End diff -- I would say, "...can later be used to populate the LOB with new data. ..." > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295945#comment-16295945 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638866 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3679,40 +3863,43 @@ EXTRACT (YEAR FROM INTERVAL '01-09' YEAR TO MONTH) + The result is 1. - <<< -[[hour_function]] -=== HOUR Function +[[filetolob_function]] +== FILETOLOB Function -The HOUR function converts a TIME or TIMESTAMP expression into an -INTEGER value in the range 0 through 23 that represents the -corresponding hour of the day. +[[filetolob_function_syntax]] +=== Syntax Descriptions of FILETOLOB Function -HOUR is a {project-name} SQL extension. +The FILETOLOB function converts data from a local linux/hdfs file into LOB format. This function can be used in INSERT or UPDATE statement. --- End diff -- same comment as before > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295936#comment-16295936 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157637971 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -926,6 +944,45 @@ The following are BITAND restrictions: --- 1 row(s) selected ``` +<<< +[[buffertolob_function]] +== BUFFERTOLOB Function + +[[buffertolob_function_syntax]] +=== Syntax Descriptions of BUFFERTOLOB Function + +The BUFFERTOLOB function takes an address and a size of an input buffer, and converts the data pointed to by that buffer into LOB. This function can be used in INSERT or UPDATE statement. --- End diff -- Again, "...the size..." sounds better to my ears. > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295939#comment-16295939 ] ASF GitHub Bot commented on TRAFODION-2849: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1350#discussion_r157638195 --- Diff: docs/sql_reference/src/asciidoc/_chapters/sql_functions_and_expressions.adoc --- @@ -3405,6 +3461,88 @@ DIFF2_I1TS --- 5 row(s) selected. ``` +<<< +[[emptyblob_function]] +== EMPTY_BLOB() Function + +[[syntax_descriptions_of_emptyblob_function]] +=== Syntax Descriptions of EMPTY_BLOB() Function + +The EMPTY_BLOB() function creates a dummy LOB handle with BLOB. --- End diff -- "...of type BLOB" perhaps > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2853) Memory leak of ComDiagsArea in Context
[ https://issues.apache.org/jira/browse/TRAFODION-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295830#comment-16295830 ] ASF GitHub Bot commented on TRAFODION-2853: --- GitHub user selvaganesang opened a pull request: https://github.com/apache/incubator-trafodion/pull/1355 [TRAFODION-2853] Memory leak of ComDiagsArea in Context CLI entry points to LOB and Sequence generator didn't deallocate the local diags area. You can merge this pull request into a Git repository by running: $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2853 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1355.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1355 commit 84679539534747e52a18c07070011641062f8783 Author: selvaganesang Date: 2017-12-18T23:18:42Z [TRAFODION-2853] Memory leak of ComDiagsArea in Context CLI entry points to LOB and Sequence generator didn't deallocate the local diags area. > Memory leak of ComDiagsArea in Context > -- > > Key: TRAFODION-2853 > URL: https://issues.apache.org/jira/browse/TRAFODION-2853 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-exe >Affects Versions: any >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > There were instances that the executor master process has more than 1 GB of > memory account memory allocated, Looking at the size of allocation by > traversing the heap, it was found ComDiagsArea is leaked in ContextHeap. > The heap traversal shows the addresses and the allocated size that were part > of context Heap that was leaking > 0x7fdef4cc69b8 336 > 0x7fdef4cc6bc8 336 > 0x7fdef4cc6d18 336 > 0x7fdef4cc6e68 336 > 0x7fdef4cc6fb8 336 > 0x7fdef4cc71e0 336 > 0x7fdef4cc7330 336 > 0x7fdef4cc7480 336 > The actual address of the objects is 16 bytes from the above address > (gdb) p *(ComDiagsArea *)0x7fdef4cc69c8 > $9 = { >= { > _vptr.IpcMessageObj = 0x7fdfbe4bbc50, > s_ = { > objType_ = 13501, > objVersion_ = 0, > refCount_ = 1, > objLength_ = 0, > next_ = 0x0, > endianness_ = 1 '\001', > spare1_ = 0 '\000', > spare2_ = 0, > vPtrPad_ = 0x0 > } > }, > members of ComDiagsArea: > collHeapPtr_ = 0x7fdfb18eb128, > errors_ = { > > = { >= { > _vptr.NABasicObject = 0x7fdfbe4bbf10, > h_ = 0x0 > }, > members of NACollection: > maxLength_ = 0, > usedLength_ = 0, > entries_ = 0, > arr_ = 0x0, > usages_ = 0x0, > heap_ = 0x7fdfb18eb128 > }, > members of NAList: > first_ = 1, > last_ = 1, > userIndexCache_ = 1, > arrayIndexCache_ = 1 > }, > warnings_ = { > ---Type to continue, or q to quit--- > > = { >= { > _vptr.NABasicObject = 0x7fdfbe4bbf10, > h_ = 0x0 > }, > members of NACollection: > maxLength_ = 0, > usedLength_ = 0, > entries_ = 0, > arr_ = 0x0, > usages_ = 0x0, > heap_ = 0x7fdfb18eb128 > }, > members of NAList: > first_ = 1, > last_ = 1, > userIndexCache_ = 1, > arrayIndexCache_ = 1 > }, > newCondition_ = 0x0, > areMore_ = 0, > lengthLimit_ = 30, > rowCount_ = 0, > theSQLFunction_ = 0, > maxDiagsId_ = 0, > avgStreamWaitTime_ = -1, > cost_ = 0, > flags_ = 0, > rowsetRowCountArray_ = 0x0, > fillers_ = '\000' > } > (gdb) (gdb) p *(NAHeap *)0x7fdfb18eb128 > $10 = { >= { > = { > _vptr.NABasicObject = 0x7fdfc1001870, > h_ = 0x0 > }, > members of NAMemory: > name_ = "Heap in ContextCli\000\000", > type_ = NAMemory::DERIVED_MEMORY, > initialSize_ = 524288, > maximumSize_ = 18446744073709551615, > incrementSize_ = 4194304, > parent_ = 0xf18b38, > firstBlk_ = 0x7f3a44f75030, > allocSize_ = 1375405192, > upperLimit_ = 0, > highWaterMark_ = 1447646816, > intervalWaterMark_ = 1447646816, > allocCnt_ = 2837663, > totalSize_ = 1529356096, > blockCnt_ = 381, > thBlockCnt_ = 40, > segGlobals_ = 0x0, > memoryList_ = 0x7fdfb0e7aac0, > lastListEntry_ = 0x7fdeef140608, > nextEntry_ = 0x7fdfb18f12c8, > debugLevel_ = 0, > heapJumpBuf_ = 0xf18a30, > exhaustedMem_ = 0, > errorsMask_ = 0, > heapID_ = { > heapNum = -1 > }, -- This message was sent by Atlassian JIRA (v6.4.14#640
[jira] [Commented] (TRAFODION-2398) Update Messages Guide for some messages from 1100-1199
[ https://issues.apache.org/jira/browse/TRAFODION-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295500#comment-16295500 ] ASF GitHub Bot commented on TRAFODION-2398: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1352 > Update Messages Guide for some messages from 1100-1199 > -- > > Key: TRAFODION-2398 > URL: https://issues.apache.org/jira/browse/TRAFODION-2398 > Project: Apache Trafodion > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.1-incubating >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2823) some test case donot close connection
[ https://issues.apache.org/jira/browse/TRAFODION-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295272#comment-16295272 ] ASF GitHub Bot commented on TRAFODION-2823: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1320 > some test case donot close connection > - > > Key: TRAFODION-2823 > URL: https://issues.apache.org/jira/browse/TRAFODION-2823 > Project: Apache Trafodion > Issue Type: Bug >Reporter: Gong Pengju >Priority: Minor > > some classes in > incubator-trafodion/dcs/src/test/jdbc_test/src/test/java/org/trafodion/jdbc_test > do not close statement and connection, which will lead to no connection can > be use. > classes include : > PropTest.java > TestNetworkTimeout.java > TestWrap.java -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2845) Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295236#comment-16295236 ] ASF GitHub Bot commented on TRAFODION-2845: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1346 > Correct the syntax descriptions of LOAD Statement for *Trafodion SQL > Reference Manual* > -- > > Key: TRAFODION-2845 > URL: https://issues.apache.org/jira/browse/TRAFODION-2845 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2842) Correct the description of connectionTimeout in *Trafodion JDBC Type 4 Programmer’s Reference Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295232#comment-16295232 ] ASF GitHub Bot commented on TRAFODION-2842: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1339 > Correct the description of connectionTimeout in *Trafodion JDBC Type 4 > Programmer’s Reference Guide* > > > Key: TRAFODION-2842 > URL: https://issues.apache.org/jira/browse/TRAFODION-2842 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2850) Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide*
[ https://issues.apache.org/jira/browse/TRAFODION-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294634#comment-16294634 ] ASF GitHub Bot commented on TRAFODION-2850: --- GitHub user liuyu000 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1354 [TRAFODION-2850] Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects Guide* You can merge this pull request into a Git repository by running: $ git pull https://github.com/liuyu000/incubator-trafodion Note_for_EMPTYBLOB Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1354.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1354 commit 083fcb020e53ec0fb4e198059a866c34831e62e3 Author: liu.yu Date: 2017-12-18T08:08:57Z Add a Note for EMPTY_BLOB() and EMPTY_CLOB() > Add a Note for EMPTY_BLOB() and EMPTY_CLOB() for *Trafodion SQL Large Objects > Guide* > > > Key: TRAFODION-2850 > URL: https://issues.apache.org/jira/browse/TRAFODION-2850 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294463#comment-16294463 ] ASF GitHub Bot commented on TRAFODION-2802: --- GitHub user sumory opened a pull request: https://github.com/apache/incubator-trafodion/pull/1353 [TRAFODION-2802] Prepare the build environment with one command You can merge this pull request into a Git repository by running: $ git pull https://github.com/sumory/incubator-trafodion fix-2802 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1353.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1353 commit d1f1db6e922994a6292e7a7ba119e91813c4692b Author: sumory.wu Date: 2017-12-18T02:26:54Z [TRAFODION-2802] Prepare the build environment with one command > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type: New Feature > Components: Build Infrastructure >Affects Versions: any > Environment: Red Hat and CentOS first >Reporter: xiaozhong.wang > Fix For: any > > Original Estimate: 24h > Remaining Estimate: 24h > > Newbie cann't create build environment without a hitch. > Although has a script traf_tools_setup.sh, there are a lot of process needed > to prepare before that. > Give a script that can create build environment by one command, it's very > useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2818) For Server 2008, function pow() in driver ODBC throws STATUS_ILLEGAL_INSTRUCTION
[ https://issues.apache.org/jira/browse/TRAFODION-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294140#comment-16294140 ] ASF GitHub Bot commented on TRAFODION-2818: --- Github user Weixin-Xu commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1311#discussion_r156836851 --- Diff: win-odbc64/odbcclient/drvr35/sqltocconv.cpp --- @@ -36,6 +36,34 @@ #define MAXCHARLEN 32768 //32K +// for server2008 when using function pow() then throws STATUS_ILLEGAL_INSTRUCTION +__int64 pow(int base, short scale) +{ + DWORD dwVersion = 0; + DWORD dwBuild = 0; + + dwVersion = GetVersion(); + + // Get the build number. + + if (dwVersion < 0x8000) + dwBuild = (DWORD)(HIWORD(dwVersion)); + + __int64 retValue = 1; + if (dwBuild == 7600) + { + scale = scale > 18 ? 18 : scale; + for (int i = 0; i < scale; i++) + retValue = retValue * 10; --- End diff -- For the function used only in sqltocconv.cpp, server always gives a scale less than 19. The function is only used to figure up the fractional length of numeric whose precision is not more than 18. Actually, it need not to be compared with 18. > For Server 2008, function pow() in driver ODBC throws > STATUS_ILLEGAL_INSTRUCTION > > > Key: TRAFODION-2818 > URL: https://issues.apache.org/jira/browse/TRAFODION-2818 > Project: Apache Trafodion > Issue Type: Bug > Components: client-odbc-windows >Affects Versions: any > Environment: Server 2008 R2 >Reporter: XuWeixin >Assignee: XuWeixin > Fix For: any > > > SQL_NUMERIC to SQL_C_CHAR > ***ERROR: SQLGetData: Expected: SQL_SUCCESS Actual: SQL_ERROR >State: HY000 >Native Error: 29 >Error: [TRAF][Trafodion ODBC Driver] General error.EXCEPTION: UNKNOWN - > Exception Code = c01d -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2398) Update Messages Guide for some messages from 1100-1199
[ https://issues.apache.org/jira/browse/TRAFODION-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293973#comment-16293973 ] ASF GitHub Bot commented on TRAFODION-2398: --- GitHub user DaveBirdsall opened a pull request: https://github.com/apache/incubator-trafodion/pull/1352 [TRAFODION-2398] Revise Message Guide msgs 1146-1199 + isolated others This change brings the Messages Guide up to date for messages in the range 1146 through 1199 + a few isolated other messages. Where messages are no longer used, the documentation for them has been removed. Also, text for some unused messages was removed from bin/SqlciErrors.txt and enums from various files were removed. A few code changes were made to eliminate obsolete code. A few edits to SqlciErrors.txt to improve the text were made. You can merge this pull request into a Git repository by running: $ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion2398a Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1352.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1352 commit 4669c079f0ac81604ddc6c965c9442843c857039 Author: Dave Birdsall Date: 2017-12-17T00:19:01Z [TRAFODION-2398] Revise Message Guide msgs 1146-1199 + isolated others > Update Messages Guide for some messages from 1100-1199 > -- > > Key: TRAFODION-2398 > URL: https://issues.apache.org/jira/browse/TRAFODION-2398 > Project: Apache Trafodion > Issue Type: Sub-task > Components: documentation >Affects Versions: 2.1-incubating >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2733) Provide an improved memory quota assignment for big memory operators (BMO)
[ https://issues.apache.org/jira/browse/TRAFODION-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293919#comment-16293919 ] ASF GitHub Bot commented on TRAFODION-2733: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1351 > Provide an improved memory quota assignment for big memory operators (BMO) > -- > > Key: TRAFODION-2733 > URL: https://issues.apache.org/jira/browse/TRAFODION-2733 > Project: Apache Trafodion > Issue Type: Improvement > Components: sql-cmp, sql-exe >Affects Versions: 2.3-incubating >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > The big memory operators in Trafodion are HashJoin, HashGroupBy and Sort. > Trafodion deploys multiple executor server processes (ESPs) to execute a > query via its data flow architecture. Each ESPs can have an instance of this > BMO operator. Currently, each instance of this operator can potentially have > memory quota of 800 MB assigned to do its BMO operation. However, the memory > allocation is usually limited by the memory pressure when this BMO attempts > to allocate memory within the assigned quota. The assignment doesn't depend > upon the estimation of memory needed by this operation. > Improvement needed in BMO memory assignment are: > 1. Limit the memory quota assignment for these BMO operations per node > 2. Memory quota assigned taking into consideration estimated memory needed > at every operator. > 3. Ensure that the BMO gets the minimum memory needed at least to function > smoothly -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2839) compGeneral/TEST023 leaves a bunch of stuff in /home/xxx/cbfs directory
[ https://issues.apache.org/jira/browse/TRAFODION-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293048#comment-16293048 ] ASF GitHub Bot commented on TRAFODION-2839: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1345 > compGeneral/TEST023 leaves a bunch of stuff in /home/xxx/cbfs directory > --- > > Key: TRAFODION-2839 > URL: https://issues.apache.org/jira/browse/TRAFODION-2839 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp > Environment: All >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > > The UPDATE STATISTICS incremental code leaves CBF files in the /home/xxx/cbfs > directory. These stick around even after tables are deleted. There should be > a way to clean these up. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2733) Provide an improved memory quota assignment for big memory operators (BMO)
[ https://issues.apache.org/jira/browse/TRAFODION-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293000#comment-16293000 ] ASF GitHub Bot commented on TRAFODION-2733: --- GitHub user selvaganesang opened a pull request: https://github.com/apache/incubator-trafodion/pull/1351 [TRAFODION-2733] BMO quota changes Fix for hive/TEST009 regression failure with commit 375eeeab7a You can merge this pull request into a Git repository by running: $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2733 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1351.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1351 commit d189467f396a2831e6fc0aef1a8799a7e7fa9f6d Author: selvaganesang Date: 2017-12-15T18:35:57Z [TRAFODION-2733] BMO quota changes Fix for hive/TEST009 regression failure with commit 375eeeab7a > Provide an improved memory quota assignment for big memory operators (BMO) > -- > > Key: TRAFODION-2733 > URL: https://issues.apache.org/jira/browse/TRAFODION-2733 > Project: Apache Trafodion > Issue Type: Improvement > Components: sql-cmp, sql-exe >Affects Versions: 2.3-incubating >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > The big memory operators in Trafodion are HashJoin, HashGroupBy and Sort. > Trafodion deploys multiple executor server processes (ESPs) to execute a > query via its data flow architecture. Each ESPs can have an instance of this > BMO operator. Currently, each instance of this operator can potentially have > memory quota of 800 MB assigned to do its BMO operation. However, the memory > allocation is usually limited by the memory pressure when this BMO attempts > to allocate memory within the assigned quota. The assignment doesn't depend > upon the estimation of memory needed by this operation. > Improvement needed in BMO memory assignment are: > 1. Limit the memory quota assignment for these BMO operations per node > 2. Memory quota assigned taking into consideration estimated memory needed > at every operator. > 3. Ensure that the BMO gets the minimum memory needed at least to function > smoothly -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2849) Add BLOB and CLOB for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292319#comment-16292319 ] ASF GitHub Bot commented on TRAFODION-2849: --- GitHub user liuyu000 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1350 [TRAFODION-2849] Add BLOB and CLOB for *Trafodion SQL Reference Manual* You can merge this pull request into a Git repository by running: $ git pull https://github.com/liuyu000/incubator-trafodion SQLLOB Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1350.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1350 commit 3f09ff5ce425cc004009b44bb1e28f7a51663ce8 Author: liu.yu Date: 2017-12-15T10:28:15Z Add BLOB and CLOB for *Trafodion SQL Reference Manual* commit bb6864a78d3922e6d313ce03528d4be25f6e0d88 Author: liu.yu Date: 2017-12-15T10:34:20Z Remove redundancies > Add BLOB and CLOB for *Trafodion SQL Reference Manual* > -- > > Key: TRAFODION-2849 > URL: https://issues.apache.org/jira/browse/TRAFODION-2849 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292306#comment-16292306 ] ASF GitHub Bot commented on TRAFODION-2844: --- Github user kevinxu021 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1344#discussion_r157155029 --- Diff: dcs/src/main/java/org/trafodion/dcs/server/ServerManager.java --- @@ -242,7 +246,7 @@ private void cleanupZk() { zkc.delete(registeredPath, -1); } catch (Exception e) { e.printStackTrace(); -LOG.debug(e); +LOG.error(e); --- End diff -- LOG.error(e.getMessage(), e); > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292305#comment-16292305 ] ASF GitHub Bot commented on TRAFODION-2844: --- Github user kevinxu021 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1344#discussion_r157156557 --- Diff: dcs/src/main/java/org/trafodion/dcs/server/ServerManager.java --- @@ -242,7 +246,7 @@ private void cleanupZk() { zkc.delete(registeredPath, -1); } catch (Exception e) { --- End diff -- Make the changes for the exception type which should be real exception instead of a general exception. > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292303#comment-16292303 ] ASF GitHub Bot commented on TRAFODION-2844: --- Github user kevinxu021 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1344#discussion_r157153197 --- Diff: dcs/src/main/java/org/trafodion/dcs/Constants.java --- @@ -201,6 +201,12 @@ /** Default value for user program restart handler retry interval millis */ public static final int DEFAULT_DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_RETRY_INTERVAL_MILLIS = 5000; +/** Configuration key for user program restart handler retry interval millis */ +public static final String DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_RETRY_INTERVAL_MINUTES = "dcs.server.user.program.restart.handler.retry.interval.minutes"; --- End diff -- I would suggest to be "dcs.server.user.program.restart.handler.retry.timeout.minutes" Add this new setting into dcs-default.xml > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292304#comment-16292304 ] ASF GitHub Bot commented on TRAFODION-2844: --- Github user kevinxu021 commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1344#discussion_r157166199 --- Diff: dcs/src/main/java/org/trafodion/dcs/util/RetryCounter.java --- @@ -20,54 +20,79 @@ */ package org.trafodion.dcs.util; +import java.util.LinkedList; +import java.util.Queue; import java.util.concurrent.TimeUnit; import org.apache.commons.logging.Log; import org.apache.commons.logging.LogFactory; public class RetryCounter { - private static final Log LOG = LogFactory.getLog(RetryCounter.class); - private final int maxRetries; - private int retriesRemaining; - private final int retryIntervalMillis; - private final TimeUnit timeUnit; +private static final Log LOG = LogFactory.getLog(RetryCounter.class); +private final int maxRetries; +private int retriesRemaining; +private int retryInterval; +private Queue queue; - public RetryCounter(int maxRetries, - int retryIntervalMillis, TimeUnit timeUnit) { -this.maxRetries = maxRetries; -this.retriesRemaining = maxRetries; -this.retryIntervalMillis = retryIntervalMillis; -this.timeUnit = timeUnit; - } +public RetryCounter(int maxRetries, int retryInterval) { --- End diff -- Not very reasonable to remove last parameter. > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2848) vanilla hadoop version in install_local_hadoop should change
[ https://issues.apache.org/jira/browse/TRAFODION-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292261#comment-16292261 ] ASF GitHub Bot commented on TRAFODION-2848: --- GitHub user gpj1987 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1349 TRAFODION-2848 hadoop-2.5 incompatible with hive-1.1+ You can merge this pull request into a Git repository by running: $ git pull https://github.com/gpj1987/incubator-trafodion TRAFODION-2848 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1349.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1349 commit 5d1d5b8764a399658ed6eab1bfa1a0ac1b0c7dc3 Author: gpj1987 Date: 2017-12-15T09:39:02Z TRAFODION-2848 > vanilla hadoop version in install_local_hadoop should change > > > Key: TRAFODION-2848 > URL: https://issues.apache.org/jira/browse/TRAFODION-2848 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: Gong Pengju >Priority: Minor > > if install vanilla hadoop by exec install_local_hadoop, the hadoop version is > 2.5.2, this version is imcompatible with hive 1.1+ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2847) Hard to locate issue throw dcs log
[ https://issues.apache.org/jira/browse/TRAFODION-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292238#comment-16292238 ] ASF GitHub Bot commented on TRAFODION-2847: --- GitHub user gpj1987 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1348 TRAFODION-2847 optimize dcs log format previous logs look like 2017-12-14 05:31:11,417, INFO, org.trafodion.dcs.util.VersionInfo, Node Number: , CPU: , PIN: , Process Name: , , ,Dcs 2.3.0 2017-12-14 05:31:11,417, INFO, org.trafodion.dcs.util.VersionInfo, Node Number: , CPU: , PIN: , Process Name: , , ,Revision 1efa9db 2017-12-14 05:31:11,417, INFO, org.trafodion.dcs.util.VersionInfo, Node Number: , CPU: , PIN: , Process Name: , , ,Compiled by traf on Thu Dec 14 05:30:52 UTC 2017 2017-12-14 05:31:12,544, INFO, org.trafodion.dcs.master.DcsMaster, Node Number: , CPU: , PIN: , Process Name: , , ,Connected to ZooKeeper now logs look like 2017-12-14 10:52:21,056, [Thread-2], INFO, org.trafodion.dcs.util.VersionInfo.logVersion(VersionInfo.java:107), , ,Dcs 2.3.0 2017-12-14 10:52:21,059, [Thread-2], INFO, org.trafodion.dcs.util.VersionInfo.logVersion(VersionInfo.java:107), , ,Revision 1efa9db 2017-12-14 10:52:21,059, [Thread-2], INFO, org.trafodion.dcs.util.VersionInfo.logVersion(VersionInfo.java:107), , ,Compiled by traf on Thu Dec 14 09:46:05 UTC 2017 2017-12-14 10:52:22,172, [Thread-2], INFO, org.trafodion.dcs.master.DcsMaster.run(DcsMaster.java:141), , ,Connected to ZooKeeper You can merge this pull request into a Git repository by running: $ git pull https://github.com/gpj1987/incubator-trafodion TRAFODION-2847 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1348.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1348 > Hard to locate issue throw dcs log > -- > > Key: TRAFODION-2847 > URL: https://issues.apache.org/jira/browse/TRAFODION-2847 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: Gong Pengju >Priority: Minor > > sometimes when dcs met problem , it's hard to locate issue happened in which > line and in which thread -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2846) BatchUpdateException does not give enough error info
[ https://issues.apache.org/jira/browse/TRAFODION-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292050#comment-16292050 ] ASF GitHub Bot commented on TRAFODION-2846: --- GitHub user mashengchen opened a pull request: https://github.com/apache/incubator-trafodion/pull/1347 TRAFODION-2846 optimize for batchException message display You can merge this pull request into a Git repository by running: $ git pull https://github.com/mashengchen/incubator-trafodion batchExceptionMsg Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1347.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1347 commit 3fb277efbfccaf4f0b8439fe7b532baf98611085 Author: aven Date: 2017-12-15T05:29:35Z TRAFODION-2846 optimize for batchException message display > BatchUpdateException does not give enough error info > > > Key: TRAFODION-2846 > URL: https://issues.apache.org/jira/browse/TRAFODION-2846 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: mashengchen >Assignee: mashengchen > > when using ETL tools like kettle to do batch insert, if there met any problem > client side just get "Batch Update Failed, See next exception for details", > but it's not easy to get next exception, someone must change source code of > ETL tools, so it's suggeted that BatchUpdateException should give the really > error message, or brief msg at least. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2845) Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual*
[ https://issues.apache.org/jira/browse/TRAFODION-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292007#comment-16292007 ] ASF GitHub Bot commented on TRAFODION-2845: --- GitHub user liuyu000 opened a pull request: https://github.com/apache/incubator-trafodion/pull/1346 [TRAFODION-2845] Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* You can merge this pull request into a Git repository by running: $ git pull https://github.com/liuyu000/incubator-trafodion LoadStatement Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1346.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1346 commit 1006ee725a5f06f327ac650861377a915392da56 Author: liu.yu Date: 2017-12-15T03:49:10Z Correct the syntax descriptions of LOAD Statement for *Trafodion SQL Reference Manual* > Correct the syntax descriptions of LOAD Statement for *Trafodion SQL > Reference Manual* > -- > > Key: TRAFODION-2845 > URL: https://issues.apache.org/jira/browse/TRAFODION-2845 > Project: Apache Trafodion > Issue Type: Documentation >Reporter: Liu Yu >Assignee: Liu Yu > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2328) There is no active DcsMaster in the output of the dcscheck when stop the lead zookeeper that is the active DcsMaster
[ https://issues.apache.org/jira/browse/TRAFODION-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291946#comment-16291946 ] ASF GitHub Bot commented on TRAFODION-2328: --- Github user orrk closed the pull request at: https://github.com/apache/incubator-trafodion/pull/817 > There is no active DcsMaster in the output of the dcscheck when stop the lead > zookeeper that is the active DcsMaster > > > Key: TRAFODION-2328 > URL: https://issues.apache.org/jira/browse/TRAFODION-2328 > Project: Apache Trafodion > Issue Type: Bug >Reporter: taian.wei >Assignee: taian.wei > > Suppose the active DcsMaster and the lead zookeeper are both node A, now stop > the lead zookeepr node A, do dcscheck on node B and check the active > DcsMaster from its output, we find some errors, no active DcsMaster displayed. > erorrs: > Exception in thread "main" > org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode > = ConnectionLoss for /trafodion/dcs/master > at > org.apache.zookeeper.KeeperException.create(KeeperException.java:99) > at > org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468) > at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496) > at > org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:725) > at > org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:593) > at > org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:365) > at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:323) > at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:282) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291688#comment-16291688 ] ASF GitHub Bot commented on TRAFODION-2844: --- Github user hegdean commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1344#discussion_r157074271 --- Diff: dcs/src/main/java/org/trafodion/dcs/server/ServerManager.java --- @@ -255,33 +259,17 @@ private void cleanupZk() { CountDownLatch startSignal = new CountDownLatch(1); RetryCounter retryCounter; -public void reset() { -startSignal.countDown(); -startSignal = new CountDownLatch(1); -boolean isRunning = this.serverMonitor.monitor(); -String nid = this.serverMonitor.nid; -String pid = this.serverMonitor.pid; - -if (isRunning) { -LOG.info("mxosrvr " + nid + "," + pid + " still running"); -this.retryCounter.resetAttemptTimes(); -} else { -LOG.info("mxosrvr " + nid + "," + pid + " exited, restarting, restart attempt time : " -+ this.retryCounter.getAttemptTimes()); -} -} - public ServerHandler(Configuration conf ,int childInstance) { int maxRestartAttempts = conf.getInt(Constants.DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_ATTEMPTS, Constants.DEFAULT_DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_ATTEMPTS); -int retryIntervalMillis = conf.getInt( - Constants.DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_RETRY_INTERVAL_MILLIS, - Constants.DEFAULT_DCS_SERVER_USER_PROGRAM_RESTART_HANDLER_RETRY_INTERVAL_MILLIS); +int retryIntervalMinutes = conf.getInt( --- End diff -- Why did we change from millis to minutes. Millis is more granular and you can achieve mins from millis > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2839) compGeneral/TEST023 leaves a bunch of stuff in /home/xxx/cbfs directory
[ https://issues.apache.org/jira/browse/TRAFODION-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291603#comment-16291603 ] ASF GitHub Bot commented on TRAFODION-2839: --- GitHub user DaveBirdsall opened a pull request: https://github.com/apache/incubator-trafodion/pull/1345 [TRAFODION-2839] Change Incr UPDATE STATS to not use CBFs by default Change the default for CQD USTAT_INCREMENTAL_UPDATE_STATISTICS from 'ON' to 'SAMPLE'. This causes the incremental update statistics logic to skip using Counting Bloom Filters, but instead always rebuild the histograms from the incremental sample. By doing so, we avoid accumulating CBF files in the $HOME/cbfs directories. As a side benefit, it turns out there is an elapsed time improvement to incremental update statistics in doing this. (Making this change was suggested by @blfritch a year ago actually, for performance reasons.) You can merge this pull request into a Git repository by running: $ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion2839 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1345.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1345 commit 149d1cfed176c511f8ac4826d840af7b5894c625 Author: Dave Birdsall Date: 2017-12-14T21:05:43Z [TRAFODION-2839] Change Incr UPDATE STATS to not use CBFs by default > compGeneral/TEST023 leaves a bunch of stuff in /home/xxx/cbfs directory > --- > > Key: TRAFODION-2839 > URL: https://issues.apache.org/jira/browse/TRAFODION-2839 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp > Environment: All >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > > The UPDATE STATISTICS incremental code leaves CBF files in the /home/xxx/cbfs > directory. These stick around even after tables are deleted. There should be > a way to clean these up. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2733) Provide an improved memory quota assignment for big memory operators (BMO)
[ https://issues.apache.org/jira/browse/TRAFODION-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291280#comment-16291280 ] ASF GitHub Bot commented on TRAFODION-2733: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1341 > Provide an improved memory quota assignment for big memory operators (BMO) > -- > > Key: TRAFODION-2733 > URL: https://issues.apache.org/jira/browse/TRAFODION-2733 > Project: Apache Trafodion > Issue Type: Improvement > Components: sql-cmp, sql-exe >Affects Versions: 2.3-incubating >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > The big memory operators in Trafodion are HashJoin, HashGroupBy and Sort. > Trafodion deploys multiple executor server processes (ESPs) to execute a > query via its data flow architecture. Each ESPs can have an instance of this > BMO operator. Currently, each instance of this operator can potentially have > memory quota of 800 MB assigned to do its BMO operation. However, the memory > allocation is usually limited by the memory pressure when this BMO attempts > to allocate memory within the assigned quota. The assignment doesn't depend > upon the estimation of memory needed by this operation. > Improvement needed in BMO memory assignment are: > 1. Limit the memory quota assignment for these BMO operations per node > 2. Memory quota assigned taking into consideration estimated memory needed > at every operator. > 3. Ensure that the BMO gets the minimum memory needed at least to function > smoothly -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2830) odb export will scan full table with splitby column
[ https://issues.apache.org/jira/browse/TRAFODION-2830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291256#comment-16291256 ] ASF GitHub Bot commented on TRAFODION-2830: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1325 > odb export will scan full table with splitby column > --- > > Key: TRAFODION-2830 > URL: https://issues.apache.org/jira/browse/TRAFODION-2830 > Project: Apache Trafodion > Issue Type: Improvement > Components: db-utility-odb >Affects Versions: 2.1-incubating >Reporter: 苏锦佩 >Assignee: 苏锦佩 > Fix For: 2.2-incubating > > > use odb to extract data parallel with splitby column, when get min/max value > from table, it will missing pwhere condition. > step to reproduce: > {code:java} > odb64luo -u db__root -p xx -d traf -e "src=cdr:pwhere=[service_id > > 100]:tgt=cdr.txt:parallel=4:splitby=service_id", > {code} > we can got the query to get min/max service_id,it is full table scan, the > query missing the [service_id > 100] condition. > {code:java} > [trafodion@esggy-poc-n012 ~]$ offender -s active > EsgynDB Advanced Conversational Interface 2.3.0 > Copyright (c) 2015-2017 Esgyn Corporation > >>+>+>+>+>+>+>+>+>+>+>+>+>+> > CURRENT_TIMESTAMP LAST_ACTIVITY_SECS QUERY_ID EXECUTE_STATE SOURCE_TEXT > -- > > 2017-12-05 11:58:34.230648 18 > MXID110030447252123791175981272260206U308T15000_32_SQL_CUR_13 > OPEN "SELECT MIN(SERVICE_ID), MAX(SERVICE_ID) FROM CDR > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2829) The example of Python is wrong
[ https://issues.apache.org/jira/browse/TRAFODION-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291249#comment-16291249 ] ASF GitHub Bot commented on TRAFODION-2829: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1324 > The example of Python is wrong > -- > > Key: TRAFODION-2829 > URL: https://issues.apache.org/jira/browse/TRAFODION-2829 > Project: Apache Trafodion > Issue Type: Bug >Reporter: liyuanyuan > > Traceback (innermost last): > File "./sampleDDL.py", line 26, in ? > File > "/home/liyuanyuan/incubator-trafodion/core/sqf/trafci/lib/python/Session.py", > line 26, in ? > ImportError: no module named trafodion > Traceback (innermost last): > File "./Session.py", line 26, in ? > ImportError: no module named trafodion -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2843) Internal error (or core) on full outer join on an aggregate
[ https://issues.apache.org/jira/browse/TRAFODION-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291215#comment-16291215 ] ASF GitHub Bot commented on TRAFODION-2843: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1340 > Internal error (or core) on full outer join on an aggregate > --- > > Key: TRAFODION-2843 > URL: https://issues.apache.org/jira/browse/TRAFODION-2843 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp >Affects Versions: 2.3-incubating > Environment: All >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > > The following sqlci script demonstrates the problem. The "prepare x1" fails > with an error 7000 (generator internal error) on release builds, and cores on > debug builds. > ?section setup > drop schema if exists mytest cascade; > create schema if not exists mytest; > set schema mytest; > Create table D03s > ( > pk int not null not droppable primary key > , val01 int > , val02 int > ); > Create table F01s > ( > pk int not null not droppable primary key > , fk_d01 int not null > , fk_d02 int not null > , fk_d03 int not null > , fk_d04 int not null > , fk_d05 int not null > , fk_d06 int not null > , fk_d07 int not null > , fk_d08 int not null > , fk_d09 int not null > , fk_d10 int not null > , val01 int > , val02 int > , val01_d01 int > , val02_d01 int > , val01_d02 int > , val02_d02 int > , val01_d03 int > , val02_d03 int > ) salt using 8 partitions; > insert into D03s > select c1+c2*10+c3*100, c1, c1+c2*10 > from (values(1)) T > transpose 0,1 as c1 > transpose 0,1 as c2 > transpose 0,1 as c3; > insert with no rollback into F01s > select c1+c2*10+c3*100+c4*1000+c5*1+c6*10 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,mod(c1+c2*100+c3*100,200) > ,mod(c1,3) > ,mod(c1,6) > ,mod(c1+c2*10,5) > ,c1 > ,c1 > ,c1+c2*10 > from (values(1)) T > transpose 0,1 as c1 > transpose 0,1 as c2 > transpose 0,1 as c3 > transpose 0,1 as c4 > transpose 0 as c5 > transpose 0 as c6 > ; > ?section testit > set schema mytest; > prepare x1 from > select F01s.val01, TD03.val01 > From F01s > full outer join > (select D03s.val01,count(D03s.pk) > from D03s > group by D03s.val01) as TD03(val01,pk) > on (TD03.pk=F01s.fk_d03 > AND TD03.pk>0 ); -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2844) dcsserver restart mxosrvr should have a time range
[ https://issues.apache.org/jira/browse/TRAFODION-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290697#comment-16290697 ] ASF GitHub Bot commented on TRAFODION-2844: --- GitHub user mashengchen opened a pull request: https://github.com/apache/incubator-trafodion/pull/1344 TRAFODION-2844 add strategy to dcsserver for restart moxsrvr when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of times in a period of time , there should reject the restart. if time between 6 times age(default setting) and this time are a very long time, dcsserver should allow the restart You can merge this pull request into a Git repository by running: $ git pull https://github.com/mashengchen/incubator-trafodion mxosrvrRestart Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1344.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1344 commit d41654fe70fd67740651da503e3c73e1b64e4168 Author: aven Date: 2017-12-14T10:35:54Z TRAFODION-2844 add strategy to dcsserver for restart moxsrvr > dcsserver restart mxosrvr should have a time range > -- > > Key: TRAFODION-2844 > URL: https://issues.apache.org/jira/browse/TRAFODION-2844 > Project: Apache Trafodion > Issue Type: Bug > Components: dcs >Reporter: mashengchen >Assignee: mashengchen > > when mxosrvr down ,dcsserver will restart it , and if mxosrvr down a lot of > times in a period of time , there should reject the restart. if time between > 6 times age(default setting) and this time are a very long time, dcsserver > should allow the restart -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2805) Add "or edition" to error info 4222
[ https://issues.apache.org/jira/browse/TRAFODION-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290290#comment-16290290 ] ASF GitHub Bot commented on TRAFODION-2805: --- GitHub user sumory opened a pull request: https://github.com/apache/incubator-trafodion/pull/1343 [TRAFODION-2805] Add "or edition" to error info 4222 You can merge this pull request into a Git repository by running: $ git pull https://github.com/sumory/incubator-trafodion fix-TRAFODION-2805 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1343.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1343 commit 6e4437ab82abbf60670d26d00d39fc96d9456a35 Author: sumory.wu Date: 2017-12-14T03:43:33Z [TRAFODION-2805] Add "or edition" to error info 4222 > Add "or edition" to error info 4222 > --- > > Key: TRAFODION-2805 > URL: https://issues.apache.org/jira/browse/TRAFODION-2805 > Project: Apache Trafodion > Issue Type: Improvement > Components: client-ci >Affects Versions: 2.2-incubating >Reporter: Wenjun Zhu >Priority: Minor > Fix For: 2.2-incubating > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2802) Prepare the build environment with one command
[ https://issues.apache.org/jira/browse/TRAFODION-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290284#comment-16290284 ] ASF GitHub Bot commented on TRAFODION-2802: --- GitHub user sumory opened a pull request: https://github.com/apache/incubator-trafodion/pull/1342 [TRAFODION-2802] Prepare the build environment with one command You can merge this pull request into a Git repository by running: $ git pull https://github.com/sumory/incubator-trafodion fix-TRAFODION-2802 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1342.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1342 commit 4b632272419a862c21012619155e3645cb99 Author: sumory.wu Date: 2017-12-14T03:32:38Z [TRAFODION-2802] Prepare the build environment with one command > Prepare the build environment with one command > -- > > Key: TRAFODION-2802 > URL: https://issues.apache.org/jira/browse/TRAFODION-2802 > Project: Apache Trafodion > Issue Type: New Feature > Components: Build Infrastructure >Affects Versions: any > Environment: Red Hat and CentOS first >Reporter: xiaozhong.wang > Fix For: any > > Original Estimate: 24h > Remaining Estimate: 24h > > Newbie cann't create build environment without a hitch. > Although has a script traf_tools_setup.sh, there are a lot of process needed > to prepare before that. > Give a script that can create build environment by one command, it's very > useful. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2733) Provide an improved memory quota assignment for big memory operators (BMO)
[ https://issues.apache.org/jira/browse/TRAFODION-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290193#comment-16290193 ] ASF GitHub Bot commented on TRAFODION-2733: --- GitHub user selvaganesang opened a pull request: https://github.com/apache/incubator-trafodion/pull/1341 [TRAFODION-2733] BMO quota changes To ensure BMO quota assignment works even when the estimates are way off. Introduced a CQD BMO_MEMORY_ESTIMATE_OUTLIER_FACTOR. When a BMO memory estimate exceeds BMO_MEMORY_LIMIT_PER_NODE_IN_MB by this factor, the BMO memory estimate for the operator is reset to BMO_MEMORY_LIMIT_PER_NODE_IN_MB * BMO_MEMORY_ESTIMATE_OUTLIER_FACTOR. Then BMO memory estimate and the quota is assigned based on the revised estimate. You can merge this pull request into a Git repository by running: $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-2733 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1341.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1341 commit 375eeeab7a178348c5d3ac6e89e40ee8a06cb0d2 Author: selvaganesang Date: 2017-12-06T19:50:04Z [TRAFODION-2733] BMO quota changes To ensure BMO quota assignment works even when the estimates are way off. Introduced a CQD BMO_MEMORY_ESTIMATE_OUTLIER_FACTOR. When a BMO memory estimate exceeds BMO_MEMORY_LIMIT_PER_NODE_IN_MB by this factor, the BMO memory estimate for the operator is reset to BMO_MEMORY_LIMIT_PER_NODE_IN_MB * BMO_MEMORY_ESTIMATE_OUTLIER_FACTOR. Then BMO memory estimate and the quota is assigned based on the revised estimate. > Provide an improved memory quota assignment for big memory operators (BMO) > -- > > Key: TRAFODION-2733 > URL: https://issues.apache.org/jira/browse/TRAFODION-2733 > Project: Apache Trafodion > Issue Type: Improvement > Components: sql-cmp, sql-exe >Affects Versions: 2.3-incubating >Reporter: Selvaganesan Govindarajan >Assignee: Selvaganesan Govindarajan > Fix For: 2.3-incubating > > > The big memory operators in Trafodion are HashJoin, HashGroupBy and Sort. > Trafodion deploys multiple executor server processes (ESPs) to execute a > query via its data flow architecture. Each ESPs can have an instance of this > BMO operator. Currently, each instance of this operator can potentially have > memory quota of 800 MB assigned to do its BMO operation. However, the memory > allocation is usually limited by the memory pressure when this BMO attempts > to allocate memory within the assigned quota. The assignment doesn't depend > upon the estimation of memory needed by this operation. > Improvement needed in BMO memory assignment are: > 1. Limit the memory quota assignment for these BMO operations per node > 2. Memory quota assigned taking into consideration estimated memory needed > at every operator. > 3. Ensure that the BMO gets the minimum memory needed at least to function > smoothly -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2803) new SQL statement support : COMMENT-ON
[ https://issues.apache.org/jira/browse/TRAFODION-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290177#comment-16290177 ] ASF GitHub Bot commented on TRAFODION-2803: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1327 > new SQL statement support : COMMENT-ON > -- > > Key: TRAFODION-2803 > URL: https://issues.apache.org/jira/browse/TRAFODION-2803 > Project: Apache Trafodion > Issue Type: New Feature > Components: sql-general >Reporter: Qilin Chen >Priority: Minor > Attachments: Trafodion_SQL_COMMENT_feature_design.171110.docx > > > Add support for COMMENT-ON statement. > This is a new requirement from customer, and below is design and > implementation for now: > 1. add new COMMENT-ON syntax, supported objects: SCHEMA, TABLE, VIEW, INDEX, > LIBRARY, FUCNTION(UDR), PROCEDURE, SEQUENCE, COLUMN > 2. new component privilege: SQL_OPERATIONS::COMMENT > 3. SHOWDDL changes: add COMMENT-ON output for each object > 4. new build-in views to look up comment: "MD".OBJECT_COMMENT_VIEW and > "MD".COLUMN_COMMENT_VIEW > Please see attachment for more detail. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2832) LOB: Insert hangs with a mutli-row insertion that requires internal stringtolob() conversion
[ https://issues.apache.org/jira/browse/TRAFODION-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290067#comment-16290067 ] ASF GitHub Bot commented on TRAFODION-2832: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1330 > LOB: Insert hangs with a mutli-row insertion that requires internal > stringtolob() conversion > > > Key: TRAFODION-2832 > URL: https://issues.apache.org/jira/browse/TRAFODION-2832 > Project: Apache Trafodion > Issue Type: Bug >Reporter: Sandhya Sundaresan >Assignee: Sandhya Sundaresan > > The LOB feature allows the user to specify a char string as the insert value. > EsgynDB will automatically convert it into a LOB datatype, just as if the > user has specified stringtolob() explicitly. The following execution output > shows that both insert..values('1') and insert..values(stringtolob('2')) work > fine. > The design has prohibited the user from using stringtolob() to insert > multiple rows at the same time. It's a 4483 error as shown by insert..values > (stringtolob('3')),(stringtolob('4')). However, if the user doesn't specify > stringtolob(), the multi-row insertion insert..values('5'),('6') doesn't > return such an error. It simply hangs, presumably because it tries to invoke > stringtolob() underneath and has run into the situation that the 4483 error > is designed to prevent. It probably needs to return the same error to avoid > such a hang problem. > >>cqd TRAF_BLOB_AS_VARCHAR 'OFF'; > --- SQL operation complete. > >>cqd TRAF_CLOB_AS_VARCHAR 'OFF'; > --- SQL operation complete. > >> > >>drop table if exists t cascade; > --- SQL operation complete. > >> > >>create table t (a clob); > --- SQL operation complete. > >>insert into t values ('1'); > --- 1 row(s) inserted. > >>insert into t values (stringtolob('2')); > --- 1 row(s) inserted. > >>select cast(lobtostring(a) as char(5)) from t; > (EXPR) > -- > 1 > 2 > --- 2 row(s) selected. > >>insert into t values (stringtolob('3')),(stringtolob('4')); > *** ERROR[4483] This LOB conversion function is not allowed in the VALUES > clause with multiple input value rows. Use it with a single value row. > *** ERROR[8822] The statement was not prepared. > >>insert into t values ('5'),('6'); > > To reproduce : > cqd TRAF_BLOB_AS_VARCHAR 'OFF'; > cqd TRAF_CLOB_AS_VARCHAR 'OFF'; > drop table if exists t cascade; > create table t (a clob); > insert into t values ('1'); > insert into t values (stringtolob('2')); > select cast(lobtostring(a) as char(5)) from t; > insert into t values (stringtolob('3')),(stringtolob('4')); > insert into t values ('5'),('6'); > drop table t cascade; -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2806) optimize 'hbase classpath' cmd in sqenvcom.sh
[ https://issues.apache.org/jira/browse/TRAFODION-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290057#comment-16290057 ] ASF GitHub Bot commented on TRAFODION-2806: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1315 > optimize 'hbase classpath' cmd in sqenvcom.sh > - > > Key: TRAFODION-2806 > URL: https://issues.apache.org/jira/browse/TRAFODION-2806 > Project: Apache Trafodion > Issue Type: Improvement > Components: foundation >Reporter: Eason Zhang >Assignee: Eason Zhang >Priority: Minor > > Currently, every time we login a new shell with trafodion user, it will > invoke 'hbase classpath' command to get all hbase libs info, this will slow > down the login session as well as any 'pdsh' commands. > An optimization is to cache the output of 'hbase classpath' to a file under > $TRAF_VAR/hbase_classpath, then sqenvcom.sh will get the hbase lib from this > file if exists. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2818) For Server 2008, function pow() in driver ODBC throws STATUS_ILLEGAL_INSTRUCTION
[ https://issues.apache.org/jira/browse/TRAFODION-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290049#comment-16290049 ] ASF GitHub Bot commented on TRAFODION-2818: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1311#discussion_r153246992 --- Diff: win-odbc64/odbcclient/drvr35/sqltocconv.cpp --- @@ -36,6 +36,34 @@ #define MAXCHARLEN 32768 //32K +// for server2008 when using function pow() then throws STATUS_ILLEGAL_INSTRUCTION +__int64 pow(int base, short scale) +{ + DWORD dwVersion = 0; + DWORD dwBuild = 0; + + dwVersion = GetVersion(); + + // Get the build number. + + if (dwVersion < 0x8000) + dwBuild = (DWORD)(HIWORD(dwVersion)); + + __int64 retValue = 1; + if (dwBuild == 7600) + { + scale = scale > 18 ? 18 : scale; + for (int i = 0; i < scale; i++) + retValue = retValue * 10; --- End diff -- So, if the scale was 19, we would return 10^18? Is this correct? Shouldn't there be some sort of overflow error instead? > For Server 2008, function pow() in driver ODBC throws > STATUS_ILLEGAL_INSTRUCTION > > > Key: TRAFODION-2818 > URL: https://issues.apache.org/jira/browse/TRAFODION-2818 > Project: Apache Trafodion > Issue Type: Bug > Components: client-odbc-windows >Affects Versions: any > Environment: Server 2008 R2 >Reporter: XuWeixin >Assignee: XuWeixin > Fix For: any > > > SQL_NUMERIC to SQL_C_CHAR > ***ERROR: SQLGetData: Expected: SQL_SUCCESS Actual: SQL_ERROR >State: HY000 >Native Error: 29 >Error: [TRAF][Trafodion ODBC Driver] General error.EXCEPTION: UNKNOWN - > Exception Code = c01d -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2823) some test case donot close connection
[ https://issues.apache.org/jira/browse/TRAFODION-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290015#comment-16290015 ] ASF GitHub Bot commented on TRAFODION-2823: --- Github user DaveBirdsall commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/1320#discussion_r156799988 --- Diff: dcs/src/test/jdbc_test/src/test/java/org/trafodion/jdbc_test/TestNetworkTimeout.java --- @@ -64,10 +72,19 @@ public void testGetNetworkTimeout() { Connection conn = null; try { System.out.println("Connecting to database..."); - conn = Utils.getUserConnection(); + conn = Utils.getUserConnection();S --- End diff -- The extra "S" at the end of the line appears to be causing the JDBC build failure > some test case donot close connection > - > > Key: TRAFODION-2823 > URL: https://issues.apache.org/jira/browse/TRAFODION-2823 > Project: Apache Trafodion > Issue Type: Bug >Reporter: Gong Pengju >Priority: Minor > > some classes in > incubator-trafodion/dcs/src/test/jdbc_test/src/test/java/org/trafodion/jdbc_test > do not close statement and connection, which will lead to no connection can > be use. > classes include : > PropTest.java > TestNetworkTimeout.java > TestWrap.java -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2843) Internal error (or core) on full outer join on an aggregate
[ https://issues.apache.org/jira/browse/TRAFODION-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289915#comment-16289915 ] ASF GitHub Bot commented on TRAFODION-2843: --- GitHub user DaveBirdsall opened a pull request: https://github.com/apache/incubator-trafodion/pull/1340 [TRAFODION-2843] Fix outer join on aggregate bug Formerly, the code was allowing an uncovered aggregate expression to be generated as a before join predicate. This lead to a Generator assert. The test for uncovered expressions in Join::preCodeGen has been tightened up so this does not happen. You can merge this pull request into a Git repository by running: $ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion2843 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/1340.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1340 commit ccb17c28e7fa74b5c58dbf37a02239316184bdd5 Author: Dave Birdsall Date: 2017-12-13T21:04:44Z [TRAFODION-2843] Fix outer join on aggregate bug > Internal error (or core) on full outer join on an aggregate > --- > > Key: TRAFODION-2843 > URL: https://issues.apache.org/jira/browse/TRAFODION-2843 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp >Affects Versions: 2.3-incubating > Environment: All >Reporter: David Wayne Birdsall >Assignee: David Wayne Birdsall > > The following sqlci script demonstrates the problem. The "prepare x1" fails > with an error 7000 (generator internal error) on release builds, and cores on > debug builds. > ?section setup > drop schema if exists mytest cascade; > create schema if not exists mytest; > set schema mytest; > Create table D03s > ( > pk int not null not droppable primary key > , val01 int > , val02 int > ); > Create table F01s > ( > pk int not null not droppable primary key > , fk_d01 int not null > , fk_d02 int not null > , fk_d03 int not null > , fk_d04 int not null > , fk_d05 int not null > , fk_d06 int not null > , fk_d07 int not null > , fk_d08 int not null > , fk_d09 int not null > , fk_d10 int not null > , val01 int > , val02 int > , val01_d01 int > , val02_d01 int > , val01_d02 int > , val02_d02 int > , val01_d03 int > , val02_d03 int > ) salt using 8 partitions; > insert into D03s > select c1+c2*10+c3*100, c1, c1+c2*10 > from (values(1)) T > transpose 0,1 as c1 > transpose 0,1 as c2 > transpose 0,1 as c3; > insert with no rollback into F01s > select c1+c2*10+c3*100+c4*1000+c5*1+c6*10 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,c1+c2*10+c3*100 > ,c1 > ,c1+c2*10 > ,mod(c1+c2*100+c3*100,200) > ,mod(c1,3) > ,mod(c1,6) > ,mod(c1+c2*10,5) > ,c1 > ,c1 > ,c1+c2*10 > from (values(1)) T > transpose 0,1 as c1 > transpose 0,1 as c2 > transpose 0,1 as c3 > transpose 0,1 as c4 > transpose 0 as c5 > transpose 0 as c6 > ; > ?section testit > set schema mytest; > prepare x1 from > select F01s.val01, TD03.val01 > From F01s > full outer join > (select D03s.val01,count(D03s.pk) > from D03s > group by D03s.val01) as TD03(val01,pk) > on (TD03.pk=F01s.fk_d03 > AND TD03.pk>0 ); -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (TRAFODION-2834) Streamline supported xn access modes
[ https://issues.apache.org/jira/browse/TRAFODION-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289729#comment-16289729 ] ASF GitHub Bot commented on TRAFODION-2834: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/1333 > Streamline supported xn access modes > > > Key: TRAFODION-2834 > URL: https://issues.apache.org/jira/browse/TRAFODION-2834 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: Anoop Sharma >Assignee: Anoop Sharma > > Current traf code allows for the following xn modes in select queries: > 1.for browse access > 2.for stable access > 3.for repeatable access > 4.repeatable read access > 5.for repeatable read access > 6.serializable access > 7.for serializable access > 8.read uncommitted access > 9.for read uncommitted access > 10. read committed access > 11. for read committed access > Internally, the only supported mode is ‘read committed+’ (slightly more than > true read committed). > In addition, ‘set transaction isolation level ’ currently allows for > #4, #6, #8, #10. > Proposal: > Remove #1, #2, #3 as these are leftover options from previous product. > Return syntax error. > Return unsupported option error if #4, #5, #6, #7 are specified > as traf currently does not support repeatable or serialization > functionality > treat ‘read uncommitted’ as ‘read committed’ > If no mode is specified, then treat it as ‘read committed’ > With this change, only those modes that are internally supported will be > allowed. > If we do support some modes in future (repeatable, serializable), then those > restrictions will be lifted. -- This message was sent by Atlassian JIRA (v6.4.14#64029)