[jira] [Updated] (TRAFODION-1786) Update T4 driver code to support TYPE_SCROLL requests
[ https://issues.apache.org/jira/browse/TRAFODION-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Jin updated TRAFODION-1786: Assignee: Kevin Xu (was: Jian Jin) > Update T4 driver code to support TYPE_SCROLL requests > - > > Key: TRAFODION-1786 > URL: https://issues.apache.org/jira/browse/TRAFODION-1786 > Project: Apache Trafodion > Issue Type: Improvement > Components: client-jdbc-t4 >Reporter: Roberta Marton >Assignee: Kevin Xu > > As part of releasing Apache Trafodion release 1.3.0, GPL licensed files were > removed to meet licensing requirements. However, removing these files caused > some features like scrollable cursors to no longer be supported. Therefore, > these features need to be supported. The following methods need to be > implemented as found in the TrafT4ResultSet.java file found in the T4 driver > directory: >cancelRowUpdates >moveToInsertRows >deleteRow >insertRow >updateRow >refreshRow >rowDeleted >rowInserted >rowUpdated -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (TRAFODION-1786) Update T4 driver code to support TYPE_SCROLL requests
[ https://issues.apache.org/jira/browse/TRAFODION-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on TRAFODION-1786 started by Jian Jin. --- > Update T4 driver code to support TYPE_SCROLL requests > - > > Key: TRAFODION-1786 > URL: https://issues.apache.org/jira/browse/TRAFODION-1786 > Project: Apache Trafodion > Issue Type: Improvement > Components: client-jdbc-t4 >Reporter: Roberta Marton >Assignee: Jian Jin > > As part of releasing Apache Trafodion release 1.3.0, GPL licensed files were > removed to meet licensing requirements. However, removing these files caused > some features like scrollable cursors to no longer be supported. Therefore, > these features need to be supported. The following methods need to be > implemented as found in the TrafT4ResultSet.java file found in the T4 driver > directory: >cancelRowUpdates >moveToInsertRows >deleteRow >insertRow >updateRow >refreshRow >rowDeleted >rowInserted >rowUpdated -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (TRAFODION-1668) Cannot upload customer SPJ JARs
[ https://issues.apache.org/jira/browse/TRAFODION-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Jin resolved TRAFODION-1668. - Resolution: Fixed Fix Version/s: 2.0-incubating > Cannot upload customer SPJ JARs > --- > > Key: TRAFODION-1668 > URL: https://issues.apache.org/jira/browse/TRAFODION-1668 > Project: Apache Trafodion > Issue Type: Improvement >Reporter: Kevin Xu >Assignee: Kevin Xu > Fix For: 2.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (TRAFODION-1023) LP Bug: 1425661 - Hang with hive scan and [FIRST N]
[ https://issues.apache.org/jira/browse/TRAFODION-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hans Zeller reopened TRAFODION-1023: Assignee: Hans Zeller (was: Apache Trafodion) Anu and Rao ran into this issue again this week and I am working on a fix, so I think this issue is not yet resolved. > LP Bug: 1425661 - Hang with hive scan and [FIRST N] > --- > > Key: TRAFODION-1023 > URL: https://issues.apache.org/jira/browse/TRAFODION-1023 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-exe >Reporter: Apache Trafodion >Assignee: Hans Zeller >Priority: Critical > > A SELECT statement using [FIRST n] can fail to cleanup and hang when the main > thread deallocates the statement. A reader thread can be observer to be > waiting on a new buffer: > (gdb) fr 2 > #2 0x730bd7c7 in ExLobGlobals::performRequest (this=0x217f7e0, > request=) at ../exp/ExpLOBaccess.cpp:1859 > 1859cursor->lock_.wait(); > (gdb) list > #0 0x003d60c0b43c in pthread_cond_wait@@GLIBC_2.3.2 () >from /lib64/libpthread.so.0 > #1 0x730b797d in ExLobLock::wait (this=0x217fef8) > at ../exp/ExpLOBaccess.cpp:2246 > #2 0x730bd7c7 in ExLobGlobals::performRequest (this=0x217f7e0, > request=) at ../exp/ExpLOBaccess.cpp:1859 > #3 0x730bd8b9 in ExLobGlobals::doWorkInThread (this=0x217f7e0) > at ../exp/ExpLOBaccess.cpp:2397 > #4 0x730bd909 in workerThreadMain (arg=) > at ../exp/ExpLOBaccess.cpp:2048 > #5 0x003d60c07851 in start_thread () from /lib64/libpthread.so.0 > #6 0x003d608e890d in clone () from /lib64/libc.so.6 > 1854 // there are no empty buffers. > 1855 // if prefetch list already has the max, wait for one to > freeup. > 1856 totalBufSize = cursor->prefetchBufList_.size() * > cursor->bufMaxSize_; > 1857 if (totalBufSize > LOB_CURSOR_PREFETCH_BYTES_MAX) { > 1858traceMessage("wait on condition cursor",__LINE__); > 1859cursor->lock_.wait(); > 1860continue; > 1861 } > The main thread's backtrace in the hang: > #0 0x003d60c080ad in pthread_join () from /lib64/libpthread.so.0 > #1 0x730b9d2c in ExLobGlobals::~ExLobGlobals (this=0x217f7e0, > __in_chrg=) at ../exp/ExpLOBaccess.cpp:1973 > #2 0x730be711 in ExLobsOper (lobName=0x7fff1780 "/h/temp", > handleIn=0x0, handleInLen=0, hdfsServer=0x0, hdfsPort=0, handleOut=0x0, > handleOutLen=@0x7fff17f0: 0, descNumIn=0, > descNumOut=@0x7fff17f0: 0, retOperLen=@0x7fff17f0: 0, > requestTagIn=0, requestTagOut=@0x7fff17f0: 0, > requestStatus=@0x7fff17fc: 32767, cliError=@0x7fff17e8: -1, > dir=0x7fff1780 "/h/temp", storage=Lob_HDFS_File, source=0x0, > sourceLen=0, cursorBytes=0, cursorId=0x0, operation=Lob_Cleanup, > subOperation=Lob_None, waited=1, globPtr=@0x7fffd6fd6ab8: 0x217f7e0, > transId=0, blackBox=0x0, blackBoxLen=0, bufferSize=0, replication=0, > blockSize=0) at ../exp/ExpLOBaccess.cpp:2732 > #3 0x730c0c86 in ExpLOBinterfaceCleanup (lobGlob=, > lobHeap=) at ../exp/ExpLOBinterface.cpp:100 > #4 0x74cd0b8d in ExHdfsScanTcb::~ExHdfsScanTcb (this=0x7fffd6fd69b0, > __in_chrg=) at ../executor/ExHdfsScan.cpp:178 > #5 0x74cd0ca1 in ExHdfsScanTcb::~ExHdfsScanTcb (this=0x7fffd6fd69b0, > __in_chrg=) at ../executor/ExHdfsScan.cpp:179 > #6 0x74b5ba20 in ex_globals::cleanupTcbs (this=0x7fffe96b5700) > at ../executor/ex_globals.cpp:192 > #7 0x74b5eefd in ex_globals::deleteMe (this=0x7fffe96b5700) > at ../executor/ex_globals.cpp:138 > #8 0x74b448c9 in ExExeStmtGlobals::deleteMe (this=0x7fffe96b5700) > at ../executor/ex_exe_stmt_globals.cpp:303 > #9 0x74b44bc9 in ExMasterStmtGlobals::deleteMe (this=0x7fffe96b5700) > at ../executor/ex_exe_stmt_globals.cpp:654 > #10 0x74b84b46 in ex_root_tcb::deallocAndDelete ( > this=, glob=0x7fffe96b5700, fragTable=) > at ../executor/ex_root.cpp:2430 > #11 0x75fa86b7 in CliStatement::releaseTcbs (this=, > closeAllOpens=) at ../cli/Statement.cpp:6056 > #12 0x75fa8843 in CliStatement::dealloc (this=0x7fffe96c1f90, > closeAllOpens=0) at ../cli/Statement.cpp:6104 > #13 0x75fa8f24 in CliStatement::~CliStatement (this=0x7fffe96c1f90, > __in_chrg=) at ../cli/Statement.cpp:571 > #14 0x75fa94f1 in CliStatement::~CliStatement (this=0x7fffe96c1f90, > __in_chrg=) at ../cli/Statement.cpp:741 > #15 0x75f73a28 in ContextCli::deallocStmt (this=, > statement_id=0x1f925d0, deallocStaticStmt=0) at ../cli/Context.cpp:2328 > #16 0x75f59ecf in SQLCLI_DeallocStmt (cliGlobals=, > statement_id=0x
[jira] [Commented] (TRAFODION-1617) Improvement in some scripts for startup
[ https://issues.apache.org/jira/browse/TRAFODION-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211276#comment-15211276 ] ASF GitHub Bot commented on TRAFODION-1617: --- GitHub user narendragoyal opened a pull request: https://github.com/apache/incubator-trafodion/pull/402 [TRAFODION-1617] Add a few convenience scripts (and associated helper scripts) Note: All the scripts with an "ilh_" prefix work if one has used install_local_hadoop ilh_trafinit: ckillall, restarts HBase(clobbers HBase data), sqstart and initializes trafodion ilh_traf_restart: ckillall, restarts HBase, sqstart trafnodestatus: Prints the trafodion-status (whether Trafodion is UP or DOWN on a node) of the nodes in the Trafodion cluster. Has a '-j' switch to print the output in JSON format. Note: There is another script 'sqnodestatus' with a similar output but that prints the status of the nodes from a Linux perspective. You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendragoyal/incubator-trafodion master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/402.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #402 commit 79670d0b2784618e38fdc750a4aec47fdf5a7047 Author: Narendra Goyal Date: 2016-03-25T01:39:46Z [TRAFODION-1617] Add a few convenience scripts (and associated helper scripts) Note: All the scripts with an "ilh_" prefix work if one has used install_local_hadoop ilh_trafinit: ckillall, restarts HBase(clobbers HBase data), sqstart and initializes trafodion ilh_traf_restart: ckillall, restarts HBase, sqstart trafnodestatus: Prints the trafodion-status (whether Trafodion is UP or DOWN on a node) of the nodes in the Trafodion cluster. Has a '-j' switch to print the output in JSON format. Note: There is another script 'sqnodestatus' with a similar output but that prints the status of the nodes from a Linux perspective. > Improvement in some scripts for startup > --- > > Key: TRAFODION-1617 > URL: https://issues.apache.org/jira/browse/TRAFODION-1617 > Project: Apache Trafodion > Issue Type: Improvement > Components: dev-environment >Affects Versions: 2.0-incubating >Reporter: Narendra >Priority: Minor > Original Estimate: 168h > Remaining Estimate: 168h > > Add scripts and supporting Java code to help with the startup and setup of a > dev env. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (TRAFODION-1563) Trafodion_installer should use the log file with the current date
[ https://issues.apache.org/jira/browse/TRAFODION-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weishiun Tsai closed TRAFODION-1563. > Trafodion_installer should use the log file with the current date > - > > Key: TRAFODION-1563 > URL: https://issues.apache.org/jira/browse/TRAFODION-1563 > Project: Apache Trafodion > Issue Type: Bug > Components: installer >Affects Versions: 1.2-incubating >Reporter: Weishiun Tsai >Assignee: Amanda Moran >Priority: Minor > > Trafodion_installer creates a log file > /var/log/trafodion/trafodion_installer_.log, where is the > current date. Currently, if the INSTALL_LOG variable already exists in > /etc/trafodion/trafodion_config, the installer seems to pick up this file > name for logging. However, after multiple installations, the INSTALL_LOG > variable might have a file name whose no longer matches the current > . The current behavior seems to be creating an empty log file with > the current date, but the logging still goes back to what INSTALL_LOG points > to. This variable should probably be updated to reflect the current date > every time when trafodion_installer runs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TRAFODION-1908) Errors when creating Trafodion user id
Amanda Moran created TRAFODION-1908: --- Summary: Errors when creating Trafodion user id Key: TRAFODION-1908 URL: https://issues.apache.org/jira/browse/TRAFODION-1908 Project: Apache Trafodion Issue Type: Bug Components: installer Reporter: Amanda Moran Assignee: Amanda Moran If there are errors during the creation of the trafodion user id, the installer is not find the error and exiting. The installer needs to find those errors and exit out. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TRAFODION-1907) Check for passwordless ssh
Amanda Moran created TRAFODION-1907: --- Summary: Check for passwordless ssh Key: TRAFODION-1907 URL: https://issues.apache.org/jira/browse/TRAFODION-1907 Project: Apache Trafodion Issue Type: Bug Components: installer Reporter: Amanda Moran Assignee: Amanda Moran Currently have a check for passwordless ssh but only fowards... not a "backwards" check. Check that node1 can get to node2 and node3 but not that node3 can get to node2 or node1. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (TRAFODION-807) LP Bug: 1400489 - Stats can have zero UEC when CQD USTAT_ESTIMATE_HBASE_ROW_COUNT is set to 'on'
[ https://issues.apache.org/jira/browse/TRAFODION-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Wayne Birdsall resolved TRAFODION-807. Resolution: Fixed > LP Bug: 1400489 - Stats can have zero UEC when CQD > USTAT_ESTIMATE_HBASE_ROW_COUNT is set to 'on' > > > Key: TRAFODION-807 > URL: https://issues.apache.org/jira/browse/TRAFODION-807 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp >Reporter: Qifan Chen >Assignee: David Wayne Birdsall >Priority: Critical > Fix For: 2.0-incubating > > > Here are several examples of stats with UEC being 0 (H_DATE, H_D_ID etc). > UEC for column h_w_id is reasonable after turning off the CQD and re-update > the stats. > >>showstats for table history on every column ; > Histogram data for Table TRAFODION.ORDERENTRY.HISTORY > Table ID: 60287988392838310 >Hist ID # IntsRowcount UEC Colname(s) > == == === === === > 964839257 50 1409094 0 H_DATE > 964839251 3 704547 3 H_W_ID > 964839247 10 1409094 0 H_D_ID > 964839240 3 1409094 0 H_C_W_ID > 964839237 10 1409094 0 H_C_D_ID > 964839230 48 1409094 0 H_C_ID > 964839227 1 1409094 0 H_AMOUNT > 964839220 62 1409094 1409094 H_DATA > 964839217 3 1409094 0 "_SALT_" > 964839260 50 1409094 1409094 "_SALT_", H_DATE, H_W_ID, H_D_ID, > H_C_W_ID, H_C_D_ID, H_C_ID -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-807) LP Bug: 1400489 - Stats can have zero UEC when CQD USTAT_ESTIMATE_HBASE_ROW_COUNT is set to 'on'
[ https://issues.apache.org/jira/browse/TRAFODION-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210890#comment-15210890 ] ASF GitHub Bot commented on TRAFODION-807: -- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/401 > LP Bug: 1400489 - Stats can have zero UEC when CQD > USTAT_ESTIMATE_HBASE_ROW_COUNT is set to 'on' > > > Key: TRAFODION-807 > URL: https://issues.apache.org/jira/browse/TRAFODION-807 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp >Reporter: Qifan Chen >Assignee: David Wayne Birdsall >Priority: Critical > Fix For: 2.0-incubating > > > Here are several examples of stats with UEC being 0 (H_DATE, H_D_ID etc). > UEC for column h_w_id is reasonable after turning off the CQD and re-update > the stats. > >>showstats for table history on every column ; > Histogram data for Table TRAFODION.ORDERENTRY.HISTORY > Table ID: 60287988392838310 >Hist ID # IntsRowcount UEC Colname(s) > == == === === === > 964839257 50 1409094 0 H_DATE > 964839251 3 704547 3 H_W_ID > 964839247 10 1409094 0 H_D_ID > 964839240 3 1409094 0 H_C_W_ID > 964839237 10 1409094 0 H_C_D_ID > 964839230 48 1409094 0 H_C_ID > 964839227 1 1409094 0 H_AMOUNT > 964839220 62 1409094 1409094 H_DATA > 964839217 3 1409094 0 "_SALT_" > 964839260 50 1409094 1409094 "_SALT_", H_DATE, H_W_ID, H_D_ID, > H_C_W_ID, H_C_D_ID, H_C_ID -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1720) add GBK support in SQL translate function
[ https://issues.apache.org/jira/browse/TRAFODION-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210440#comment-15210440 ] ASF GitHub Bot commented on TRAFODION-1720: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/400 > add GBK support in SQL translate function > - > > Key: TRAFODION-1720 > URL: https://issues.apache.org/jira/browse/TRAFODION-1720 > Project: Apache Trafodion > Issue Type: Improvement > Components: sql-exe >Reporter: liu ming >Assignee: liu ming > > Trafodion support TRANSLATE function now and support character set conversion > among ISO88591, SJIS, UCS2 and UTF8. It will be useful to support GBK and > later BIG5. > GBK is widely used in China. Without support, all source data need to be > converted before data loading. With built-in support, it will decrease the > overall data loading time. > External interface > Use the current SQL Function TRANSLATE, introduce new translation, keep the > original syntax. > > TRANSLATE(character-value-expression USING translation-name) > Translation-name Source charset Target charset Comments > == == = > GBKTOUTF8 GBK2312 UTF8When error occur during > translation, SQL Error > UTF8TOGBK UTF8GB2312 > Internal > Parser change > Let class Translate support new translation-name. > CodeGen change > Translate::codeGen > Executor change > convDoIt -- This message was sent by Atlassian JIRA (v6.3.4#6332)