[jira] [Created] (TRAFODION-1959) multiple data file in HDFS will cause bulkloader fail

2016-04-29 Thread liu ming (JIRA) 
liu ming created TRAFODION-1959:
---

 Summary: multiple data file in HDFS will cause bulkloader fail
 Key: TRAFODION-1959
 URL: https://issues.apache.org/jira/browse/TRAFODION-1959
 Project: Apache Trafodion
  Issue Type: Bug
Reporter: liu ming


reported by users several times, but I need to design a test. File a jira now 
just in case this issue will be out of track.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1955) JNI optimization in Trafodion

2016-04-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264995#comment-15264995
 ] 

ASF GitHub Bot commented on TRAFODION-1955:
---

Github user DaveBirdsall commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/459#discussion_r61659862
  
--- Diff: core/sql/executor/HBaseClient_JNI.cpp ---
@@ -5619,3 +5394,41 @@ int convertStringObjectArrayToList(NAHeap *heap, 
jarray j_objArray,
 return arrayLen;
 }
 
+
+jint convertByteArrayObjectArrayToNAArray(NAHeap *heap, jarray j_objArray, 
NAArray **retArray)
+{
--- End diff --

For safety, might be a good idea to set retArray = 0 first thing in the 
method. Otherwise a caller might ignore an error and use the uninitialized 
pointer, with unpredictable results.


> JNI optimization in Trafodion 
> --
>
> Key: TRAFODION-1955
> URL: https://issues.apache.org/jira/browse/TRAFODION-1955
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Selvaganesan Govindarajan
>Assignee: Selvaganesan Govindarajan
>
> ByteArrayList in Trafodion is an expensive class. Removing the use of this 
> class everywhere. Replace its usage with array of byte arrays.
> This class is mainly used in compiler. Hence it is expected to see some 
> improvement with compilation of queries when the tables involved in queries 
> have large number of regions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1955) JNI optimization in Trafodion

2016-04-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264987#comment-15264987
 ] 

ASF GitHub Bot commented on TRAFODION-1955:
---

Github user DaveBirdsall commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/459#discussion_r61659592
  
--- Diff: core/sql/executor/HBaseClient_JNI.cpp ---
@@ -1439,14 +1223,14 @@ ByteArrayList* 
HBaseClient_JNI::getRegionStats(const char* tblName)
   jstring js_tblName = jenv_->NewStringUTF(tblName);
   if (js_tblName == NULL) 
   {
-GetCliGlobals()->setJniErrorStr(getErrorText(HBC_ERROR_DROP_PARAM));
+GetCliGlobals()->setJniErrorStr(getErrorText(HBC_ERROR_REGION_STATS));
--- End diff --

Good catch


> JNI optimization in Trafodion 
> --
>
> Key: TRAFODION-1955
> URL: https://issues.apache.org/jira/browse/TRAFODION-1955
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Selvaganesan Govindarajan
>Assignee: Selvaganesan Govindarajan
>
> ByteArrayList in Trafodion is an expensive class. Removing the use of this 
> class everywhere. Replace its usage with array of byte arrays.
> This class is mainly used in compiler. Hence it is expected to see some 
> improvement with compilation of queries when the tables involved in queries 
> have large number of regions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1955) JNI optimization in Trafodion

2016-04-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264979#comment-15264979
 ] 

ASF GitHub Bot commented on TRAFODION-1955:
---

Github user DaveBirdsall commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/459#discussion_r61659355
  
--- Diff: core/sql/executor/ExExeUtilGet.cpp ---
@@ -3074,18 +3074,21 @@ short ExExeUtilGetHbaseObjectsTcb::work()
 
 case PROCESS_NEXT_ROW_:
   {
-if (currIndex_ == bal_->getSize())
+if (currIndex_ == hbaseTables_->entries())
   {
 step_ = DONE_;
 break;
   }
 
-Int32 len = 0;
-hbaseName_ = bal_->getEntry(currIndex_, hbaseNameBuf_, 
-
ComMAX_3_PART_EXTERNAL_UTF8_NAME_LEN_IN_BYTES+6, 
-len);
-hbaseName_[len] = 0;
-
+Int32 len = hbaseTables_->at(currIndex_).len;
+char *tmp  = hbaseTables_->at(currIndex_).val;
+len = hbaseTables_->at(currIndex_).len;
--- End diff --

I hope the C++ compiler does common subexpression elimination so we don't 
keep re-evaluating the "at".


> JNI optimization in Trafodion 
> --
>
> Key: TRAFODION-1955
> URL: https://issues.apache.org/jira/browse/TRAFODION-1955
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Selvaganesan Govindarajan
>Assignee: Selvaganesan Govindarajan
>
> ByteArrayList in Trafodion is an expensive class. Removing the use of this 
> class everywhere. Replace its usage with array of byte arrays.
> This class is mainly used in compiler. Hence it is expected to see some 
> improvement with compilation of queries when the tables involved in queries 
> have large number of regions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1955) JNI optimization in Trafodion

2016-04-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264970#comment-15264970
 ] 

ASF GitHub Bot commented on TRAFODION-1955:
---

GitHub user selvaganesang opened a pull request:

https://github.com/apache/incubator-trafodion/pull/459

[TRAFODION-1955] JNI optimization at the time of compilation

Removed ByteArrayList class and used array of byte array instead.
Only one JNI to java transistion is done to getRegionStartKeys
and getRegionEndKeys at the time of query compilation

Also fixed an issue with lib_mgmt Makefile.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/selvaganesang/incubator-trafodion 
trafodion-1955

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-trafodion/pull/459.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #459


commit 6ef6f7c70eeaac17cbc9b0f22c0ffa3d0bf509b0
Author: selvaganesang 
Date:   2016-04-29T23:50:35Z

[TRAFODION-1955] JNI optimization at the time of compilation

Removed ByteArrayList class and used array of byte array instead.
Only one JNI to java transistion is done to getRegionStartKeys
and getRegionEndKeys at the time of query compilation

Also fixed an issue with lib_mgmt Makefile.




> JNI optimization in Trafodion 
> --
>
> Key: TRAFODION-1955
> URL: https://issues.apache.org/jira/browse/TRAFODION-1955
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Selvaganesan Govindarajan
>Assignee: Selvaganesan Govindarajan
>
> ByteArrayList in Trafodion is an expensive class. Removing the use of this 
> class everywhere. Replace its usage with array of byte arrays.
> This class is mainly used in compiler. Hence it is expected to see some 
> improvement with compilation of queries when the tables involved in queries 
> have large number of regions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1958) sqps and sqcheck display wrong information after node reintegrated

2016-04-29 Thread Gonzalo E Correa (JIRA) 
Gonzalo E Correa created TRAFODION-1958:
---

 Summary: sqps and sqcheck display wrong information after node 
reintegrated
 Key: TRAFODION-1958
 URL: https://issues.apache.org/jira/browse/TRAFODION-1958
 Project: Apache Trafodion
  Issue Type: Bug
  Components: foundation
Affects Versions: 2.0-incubating
 Environment: all
Reporter: Gonzalo E Correa
 Fix For: 2.0-incubating


Looks like after a node failure/reintegration, we see this confusing behavior:
 
Processes with a ‘named’ parent process ‘may’ have incorrect info. When I did 
an sqps on ctsha-2, see these processes on nid 3 without the program file name 
(running sqps on nid 2, 3 or 4 gives the correct program name, which is 
‘tdm_arkcmp’):
[$Z0019TI] 003,00012563 001 GEN ES--A-- $Z030A8Y $Z0316UD 
[$Z0019TI] 003,00033477 001 GEN ES--A-- $Z030SBH $Z03171T 
[$Z0019TI] 003,00033776 001 GEN ES--A-- $Z030SK1 $Z030SBH 
 
Local monitor has correct info about processes on its own node



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1933) Migrate jdbcT4 and trafci build scripts from Ant to Maven

2016-04-29 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264275#comment-15264275
 ] 

ASF GitHub Bot commented on TRAFODION-1933:
---

GitHub user hegdean opened a pull request:

https://github.com/apache/incubator-trafodion/pull/458

[TRAFODION-1933] Migrate jdbcT4 and trafci build scripts from Ant to Maven

This PR only contains migration changes for jdbcT4.  TRAFCI migration to 
Maven will be done in a seperate JIRA.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/hegdean/incubator-trafodion wrkbrnch

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-trafodion/pull/458.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #458


commit 72e170198fa80baa9891fc40fc7b66da8cbb6a32
Author: Anuradha Hegde 
Date:   2016-04-18T16:11:06Z

TRAFODION-1933 JDBC TYpe4 driver build scripts migrated to use maven 
instead of ant

commit 5ac5a9f2ac17a45ff7b6c2f39254f26e550cb5e3
Author: Anuradha Hegde 
Date:   2016-04-18T16:32:11Z

Merge branch 'master' of github.com:apache/incubator-trafodion into wrkbrnch

commit 500d20767fad083cc0fda1c1ef9d895b295ed412
Author: Anuradha Hegde 
Date:   2016-04-18T16:35:58Z

including the missing files in previous commit

commit 90667eeab9a1dbb20982470eec320e84603f5baf
Author: Anuradha Hegde 
Date:   2016-04-19T15:33:06Z

Minor fixes

commit a0f21cde508487d96f62bcf4c930f015e9fa57b8
Author: Anuradha Hegde 
Date:   2016-04-19T18:07:06Z

Merge branch 'master' of github.com:apache/incubator-trafodion into wrkbrnch

Conflicts:
core/conn/jdbcT4/src/main/java/org/trafodion/jdbc/t4/BaseRow.java
core/conn/jdbcT4/src/main/java/org/trafodion/jdbc/t4/InsertRow.java
core/conn/jdbcT4/src/main/java/org/trafodion/jdbc/t4/Row.java

commit 3253e7231f7d01a444643069d2ac7fd7cd1912b2
Author: Anuradha Hegde 
Date:   2016-04-22T00:17:06Z

Additional jdbcT4 changes in other components

commit 8a8d2ad7bdf7fd36cf5c45adb2d3e5e57b662be5
Author: Anuradha Hegde 
Date:   2016-04-22T00:20:35Z

Merge branch 'master' of github.com:apache/incubator-trafodion into wrkbrnch

commit 842caed8b8c1616e22c0f49aa240994ce62b6b45
Author: Anuradha Hegde 
Date:   2016-04-22T03:46:45Z

fixed the dependency

commit e17dce614702af782db997db5bbca47c99b50aa6
Author: Anuradha Hegde 
Date:   2016-04-22T16:55:38Z

additional files

commit 9d450e992f4d8610f1caff99181fd232849b368a
Author: Anuradha Hegde 
Date:   2016-04-22T17:25:07Z

updated files

commit 5955e92b21961b2805149f9f02f11ce681a5026e
Author: Anuradha Hegde 
Date:   2016-04-22T22:47:01Z

fixed dcs/rest/udr to have the version infor for jdbcT4 jar file

commit 8ed58bf6389015275646f83298ca2bf067f817f9
Author: Anuradha Hegde 
Date:   2016-04-26T16:18:13Z

Minor T4 driver fix
Fixed duplicate copyright in dcs files

commit c4d50df102924d9bd5410d09309d3b5fa277cc89
Author: Anuradha Hegde 
Date:   2016-04-28T18:31:51Z

Merge branch 'master' of github.com:apache/incubator-trafodion into wrkbrnch

commit 1ca6f60806e2d76eb7b78c4c5bbd218410d7d8ec
Author: Anuradha Hegde 
Date:   2016-04-29T15:33:44Z

Updated the dependencies

commit b50829942facca522efc41fbece00720717a3cf1
Author: Anuradha Hegde 
Date:   2016-04-29T15:34:06Z

Merge branch 'master' of github.com:apache/incubator-trafodion into wrkbrnch

commit 780f976a6b3412f9f0bc8bb946fe25adf400dde3
Author: Anuradha Hegde 
Date:   2016-04-29T16:04:34Z

Included LICENSE and NOTICE in T4 zip file




> Migrate jdbcT4 and trafci build scripts from Ant to Maven
> -
>
> Key: TRAFODION-1933
> URL: https://issues.apache.org/jira/browse/TRAFODION-1933
> Project: Apache Trafodion
>  Issue Type: Improvement
>Reporter: Anuradha Hegde
>Assignee: Anuradha Hegde
>
> Currently jdbct4 and trafci uses Ant to build. We need to convert these build 
> scripts to use Maven



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1957) Have jdbc drivers available on Maven Repository

2016-04-29 Thread Pierre Smits (JIRA) 
Pierre Smits created TRAFODION-1957:
---

 Summary: Have jdbc drivers available on Maven Repository
 Key: TRAFODION-1957
 URL: https://issues.apache.org/jira/browse/TRAFODION-1957
 Project: Apache Trafodion
  Issue Type: Bug
  Components: client-jdbc-t2, client-jdbc-t4
Reporter: Pierre Smits
 Fix For: 2.0-incubating


In order to increase visibility and thus adoption the (built) drivers must be 
made available on 3rd party repositories as Maven Repository 
(http://mvnrepository.com/).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)