[jira] [Commented] (TRAFODION-532) LP Bug: 1355038 - SPJ w result set failed with ERROR[8841]

2016-05-04 Thread Kevin Xu (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271793#comment-15271793
 ] 

Kevin Xu commented on TRAFODION-532:


This issue is no long existing on latest code. Anyway, QA will confirm on it.
>>create table testtab(e_code int);

--- SQL operation complete.
>>Call RS292();

--- 0 row(s) selected.

--- SQL operation complete.
>>select * from(delete from testtab where e_code>2 return old.*) as t1;

--- 0 row(s) selected.

>>insert into testtab values(2),(2),(5),(3),(4);

--- 5 row(s) inserted.
>>select * from(delete from testtab where e_code>2 return old.*) as t1;

E_CODE 
---

  3
  4

--- 2 row(s) selected.
>>select * from testtab;

E_CODE 
---

  2
  2
  5

--- 3 row(s) selected.

> LP Bug: 1355038 - SPJ w result set failed with ERROR[8841]
> --
>
> Key: TRAFODION-532
> URL: https://issues.apache.org/jira/browse/TRAFODION-532
> Project: Apache Trafodion
>  Issue Type: Bug
>  Components: sql-exe
>Reporter: Chong Hsu
>Assignee: Kevin Xu
>Priority: Critical
> Fix For: 1.0 (pre-incubation)
>
>
> SPJ w result set failed with ERROR[8841] 
> Tested with Trafodion build, 20140801-0830.
> Calling a SPJ with result set:
>public static void RS292(ResultSet[] paramArrayOfResultSet) throws 
> Exception
>{
>  String str = "jdbc:default:connection";
>  
>  Connection localConnection = DriverManager.getConnection(str);
>  Statement localStatement = localConnection.createStatement();
>  paramArrayOfResultSet[0] = localStatement.executeQuery("select * 
> from(delete from testtab where e_code>2 return old.*) as t1");
>}
> it failed with ERROR[8841]:
> *** ERROR[8841] User application committed or aborted a transaction started 
> by SQL.  This transaction needs to be committed or aborted by calling SQL 
> COMMIT or ROLLBACK WORK. [2014-08-11 04:30:14]
> The SPJ Jar file is attached. Here are the steps to produce the error:
>   
> set schema testspj;
> create library spjrs file '//Testrs.jar';
> create procedure RS292()
>   language java  parameter style java
>   library spjrs
>   dynamic result sets 3
>   external name 'Testrs.RS292';
> Call RS292();
> *** ERROR[8841] User application committed or aborted a transaction started 
> by SQL.  This transaction needs to be committed or aborted by calling SQL 
> COMMIT or ROLLBACK WORK. [2014-08-11 04:30:14]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1973) traf_tools_setup - possible to download tar file to wrong directory

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271736#comment-15271736
 ] 

ASF GitHub Bot commented on TRAFODION-1973:
---

GitHub user svarnau opened a pull request:

https://github.com/apache/incubator-trafodion/pull/467

[TRAFODION-1973] Fix unpacking of hadoop dependencies

Issue found while testing build environment setup for release 2.0.
Simple fix.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/svarnau/incubator-trafodion rel1973

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-trafodion/pull/467.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #467


commit dee95868a932834ded7f07ad61cba2e767a4ae13
Author: Steve Varnau 
Date:   2016-05-05T00:58:43Z

[TRAFODION-1973] Fix unpacking of hadoop dependencies

Issue found while testing build environment setup for release 2.0.
Simple fix.




> traf_tools_setup - possible to download tar file to wrong directory
> ---
>
> Key: TRAFODION-1973
> URL: https://issues.apache.org/jira/browse/TRAFODION-1973
> Project: Apache Trafodion
>  Issue Type: Bug
>  Components: Build Infrastructure
>Affects Versions: 2.0-incubating
>Reporter: Steve Varnau
>Assignee: Steve Varnau
>
> traf_tools_setup script to set up build environment is missing a cd command.
> If previous tools are already installed, then hadoop tar file is downloaded 
> correctly, but if other tools are also downloaded, hadoop download is 
> misplaced and it cannot be found to extract the key files.
> This hinders setting up initial build environment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1973) traf_tools_setup - possible to download tar file to wrong directory

2016-05-04 Thread Steve Varnau (JIRA) 
Steve Varnau created TRAFODION-1973:
---

 Summary: traf_tools_setup - possible to download tar file to wrong 
directory
 Key: TRAFODION-1973
 URL: https://issues.apache.org/jira/browse/TRAFODION-1973
 Project: Apache Trafodion
  Issue Type: Bug
  Components: Build Infrastructure
Affects Versions: 2.0-incubating
Reporter: Steve Varnau
Assignee: Steve Varnau


traf_tools_setup script to set up build environment is missing a cd command.
If previous tools are already installed, then hadoop tar file is downloaded 
correctly, but if other tools are also downloaded, hadoop download is misplaced 
and it cannot be found to extract the key files.

This hinders setting up initial build environment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271701#comment-15271701
 ] 

ASF GitHub Bot commented on TRAFODION-1920:
---

Github user traflm commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/461#discussion_r62136601
  
--- Diff: core/sql/regress/hive/EXPECTED005 ---
@@ -534,4 +534,101 @@ C1   C2
 >>cqd HIVE_SCAN_SPECIAL_MODE reset;
 
 --- SQL operation complete.
+>>select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>select * from tbl_bad;
+
+C1   C2C3 C4   
C5  C6  C7  
   C8
+---    -  
---  --  --  -  
--
+
+  ? ?  c   
 ?   ?  ?   ?   
?
+  ? ?  c   
 ?   ?  2017-01-01 10:10:10.00   1.01000E+000   
1
+  ? ?  
 ?   ?  ?   ?   
?
+  1 1  averylongstring
-1.000E+000   0  2017-01-01 10:10:10.00   1.00010E+002  
 1
+  2 2  good
1.100E+000   2  2017-01-01 10:10:10.00   2.0E+002   
 1000
+  3 3  good
1.000E+000   2  2017-01-01 10:10:10.00   2.1E+002   
   10
+  ?4294967295  good
3.399E+038   ?  2017-01-01 10:10:10.00   1.69968E+308   
   10
+  099  bad 
 ?   ?  ?   ?   ?
+
+--- 8 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int,
++>c2 largeint,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6),
++>c7 float(54),
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+--- 8 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int not null,
++>c2 largeint not null,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6) not null,
++>c7 float(54) not null,
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
--- End diff --

Yes, the error message will depends on which node the expression get 
evaluated, so it is better to add converting error as warnings. I need to 
better understand details of DiagArea, I didn't remove errors during

[jira] [Commented] (TRAFODION-1972) Include docs in source package

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271628#comment-15271628
 ] 

ASF GitHub Bot commented on TRAFODION-1972:
---

GitHub user svarnau opened a pull request:

https://github.com/apache/incubator-trafodion/pull/466

[TRAFODION-1972] Remove docs directories from exclude list

This will allow these directories to be included in source package,
and hence in the official released code.

Note that it also includes the website pages, which provides a snapshot
in time of the project site, for whatever that is worth.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/svarnau/incubator-trafodion rel1972

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-trafodion/pull/466.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #466


commit d9890d6eda94d6e2f061e3e0794f28fbea4063b4
Author: Steve Varnau 
Date:   2016-05-04T23:22:50Z

[TRAFODION-1972] Remove docs directories from exclude list

This will allow these directories to be included in source package,
and hence in the official released code.

Note that it also includes the website pages, which provides a snapshot
in time of the project site, for whatever that is worth.




> Include docs in source package
> --
>
> Key: TRAFODION-1972
> URL: https://issues.apache.org/jira/browse/TRAFODION-1972
> Project: Apache Trafodion
>  Issue Type: Bug
>Affects Versions: 2.0-incubating
>Reporter: Steve Varnau
>Assignee: Steve Varnau
>
> .gitattributes file excludes some docs directories from released source code



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1972) Include docs in source package

2016-05-04 Thread Steve Varnau (JIRA) 
Steve Varnau created TRAFODION-1972:
---

 Summary: Include docs in source package
 Key: TRAFODION-1972
 URL: https://issues.apache.org/jira/browse/TRAFODION-1972
 Project: Apache Trafodion
  Issue Type: Bug
Affects Versions: 2.0-incubating
Reporter: Steve Varnau
Assignee: Steve Varnau


.gitattributes file excludes some docs directories from released source code



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1971) Redundant initialization slows down bulk load

2016-05-04 Thread Barry Fritchman (JIRA) 
Barry Fritchman created TRAFODION-1971:
--

 Summary: Redundant initialization slows down bulk load
 Key: TRAFODION-1971
 URL: https://issues.apache.org/jira/browse/TRAFODION-1971
 Project: Apache Trafodion
  Issue Type: Bug
  Components: sql-exe
Affects Versions: 2.0-incubating
Reporter: Barry Fritchman


During the preparation phase of bulk load, HFIle parameter initialization is 
performed redundantly following each flush. For a 52-million row table with 
fairly wide rows, a load takes 3.5 hours vs 35-40 minutes when the unnecessary 
re-initialization is avoided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (TRAFODION-1964) Cannot run SPJs after an trafodion upgrade

2016-05-04 Thread Hans Zeller (JIRA) 

 [ 
https://issues.apache.org/jira/browse/TRAFODION-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hans Zeller resolved TRAFODION-1964.

Resolution: Won't Fix

See previous comment.

For end-users, the recommendation is to create libraries with a fully qualified 
name, outside of the Trafodion install directory. This way, you can upgrade 
Trafodion without losing access to the library files.


> Cannot run SPJs after an trafodion upgrade 
> ---
>
> Key: TRAFODION-1964
> URL: https://issues.apache.org/jira/browse/TRAFODION-1964
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Venkat Muthuswamy
>Assignee: Hans Zeller
>
> The system and user SPJ jar files are now stored under 
> $MY_SQROOT/udr/lib/.
> The CREATE LIBRARY/ALTER LIBRARY commands use the fully qualified linux 
> directory paths (the environment variables are expanded). 
> For example, if current trafodion build is installed under 
> /home/trafodion/build1, the files are stored under 
> /home/trafodion/build1/udr/lib/user1
> When the user upgrades and installs a new build, let's say trafodion is 
> installed under /home/trafodion/build2. 
> If the user removes this old trafodion installation, the libraries and SPJs 
> defined using build1 no longer work, because the UDR tries to load the jar 
> file from /home/trafodion/build1/udr/lib/user1 folder because that's what is 
> stored in the metadata.
> Even if the folder exists, any system created library would be pointing to an 
> older version of the jar file even though the new install might include fixes 
> to the system library jar.
> 1. Can the CREATE and ALTER LIBRARY commands use relative paths to  something 
> like $MY_UDR_ROOT  and not required the fully qualified paths?
> 2. Can the UDR runtime be modified to look at the relative paths $MY_UDR_ROOT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1964) Cannot run SPJs after an trafodion upgrade

2016-05-04 Thread Hans Zeller (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271126#comment-15271126
 ] 

Hans Zeller commented on TRAFODION-1964:


It turns out that the fix I suggested above does not solve the problem. For 
now, we will need to copy the jar files from the old to the new install tree, 
manually or by using some script. Our longer term plan is to store the jars and 
DLLs of libraries in a BLOB, which will make the issue described in this JIRA 
go away. It may be a while, though, until that is going to happen.

> Cannot run SPJs after an trafodion upgrade 
> ---
>
> Key: TRAFODION-1964
> URL: https://issues.apache.org/jira/browse/TRAFODION-1964
> Project: Apache Trafodion
>  Issue Type: Bug
>Reporter: Venkat Muthuswamy
>Assignee: Hans Zeller
>
> The system and user SPJ jar files are now stored under 
> $MY_SQROOT/udr/lib/.
> The CREATE LIBRARY/ALTER LIBRARY commands use the fully qualified linux 
> directory paths (the environment variables are expanded). 
> For example, if current trafodion build is installed under 
> /home/trafodion/build1, the files are stored under 
> /home/trafodion/build1/udr/lib/user1
> When the user upgrades and installs a new build, let's say trafodion is 
> installed under /home/trafodion/build2. 
> If the user removes this old trafodion installation, the libraries and SPJs 
> defined using build1 no longer work, because the UDR tries to load the jar 
> file from /home/trafodion/build1/udr/lib/user1 folder because that's what is 
> stored in the metadata.
> Even if the folder exists, any system created library would be pointing to an 
> older version of the jar file even though the new install might include fixes 
> to the system library jar.
> 1. Can the CREATE and ALTER LIBRARY commands use relative paths to  something 
> like $MY_UDR_ROOT  and not required the fully qualified paths?
> 2. Can the UDR runtime be modified to look at the relative paths $MY_UDR_ROOT.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1970) UPDATE STATS CLEAR gets error 9243 on large tables

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271117#comment-15271117
 ] 

ASF GitHub Bot commented on TRAFODION-1970:
---

GitHub user DaveBirdsall opened a pull request:

https://github.com/apache/incubator-trafodion/pull/464

[TRAFODION-1970] UPDATE STATS CLEAR gets error 9243 on large tables



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/DaveBirdsall/incubator-trafodion Trafodion1970

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-trafodion/pull/464.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #464






> UPDATE STATS CLEAR gets error 9243 on large tables
> --
>
> Key: TRAFODION-1970
> URL: https://issues.apache.org/jira/browse/TRAFODION-1970
> Project: Apache Trafodion
>  Issue Type: Bug
>  Components: sql-cmp
>Affects Versions: 2.0-incubating
> Environment: All
>Reporter: David Wayne Birdsall
>Assignee: David Wayne Birdsall
>
> A table wssstats96 has about 8M rows. One of the operations done on it is: 
> UPDATE STATISTICS FOR TABLE wssstats96 ON ("_SALT_", "_DIVISION_1_") clear ;
> This command consistently fails with error: 
> >>UPDATE STATISTICS FOR TABLE wssstats96 ON ("_SALT_", "_DIVISION_1_") clear ;
> *** ERROR[9243] This UPDATE STATISTICS command may take too long. It is 
> recommended to use the SAMPLE clause instead. If you wish to do this without 
> a SAMPLE clause, specify NO SAMPLE explicitly.
> --- SQL operation failed with errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1970) UPDATE STATS CLEAR gets error 9243 on large tables

2016-05-04 Thread David Wayne Birdsall (JIRA) 
David Wayne Birdsall created TRAFODION-1970:
---

 Summary: UPDATE STATS CLEAR gets error 9243 on large tables
 Key: TRAFODION-1970
 URL: https://issues.apache.org/jira/browse/TRAFODION-1970
 Project: Apache Trafodion
  Issue Type: Bug
  Components: sql-cmp
Affects Versions: 2.0-incubating
 Environment: All
Reporter: David Wayne Birdsall
Assignee: David Wayne Birdsall


A table wssstats96 has about 8M rows. One of the operations done on it is: 
UPDATE STATISTICS FOR TABLE wssstats96 ON ("_SALT_", "_DIVISION_1_") clear ;

This command consistently fails with error: 
>>UPDATE STATISTICS FOR TABLE wssstats96 ON ("_SALT_", "_DIVISION_1_") clear ;

*** ERROR[9243] This UPDATE STATISTICS command may take too long. It is 
recommended to use the SAMPLE clause instead. If you wish to do this without a 
SAMPLE clause, specify NO SAMPLE explicitly.

--- SQL operation failed with errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1923) executor/TEST106 hangs at drop table at times

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270747#comment-15270747
 ] 

ASF GitHub Bot commented on TRAFODION-1923:
---

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-trafodion/pull/463


> executor/TEST106 hangs at drop table at times
> -
>
> Key: TRAFODION-1923
> URL: https://issues.apache.org/jira/browse/TRAFODION-1923
> Project: Apache Trafodion
>  Issue Type: Bug
>  Components: sql-exe
>Affects Versions: 2.0-incubating
>Reporter: Selvaganesan Govindarajan
>Assignee: Prashanth Vasudev
>Priority: Critical
> Fix For: 2.0-incubating
>
>
> executor/TEST106 hangs at
> drop table t106a 
> Currently executor/TEST106 test is not run as part of Daily regression build.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270673#comment-15270673
 ] 

ASF GitHub Bot commented on TRAFODION-1920:
---

Github user anoopsharma00 commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/461#discussion_r62044508
  
--- Diff: core/sql/regress/hive/EXPECTED005 ---
@@ -534,4 +534,101 @@ C1   C2
 >>cqd HIVE_SCAN_SPECIAL_MODE reset;
 
 --- SQL operation complete.
+>>select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>select * from tbl_bad;
+
+C1   C2C3 C4   
C5  C6  C7  
   C8
+---    -  
---  --  --  -  
--
+
+  ? ?  c   
 ?   ?  ?   ?   
?
+  ? ?  c   
 ?   ?  2017-01-01 10:10:10.00   1.01000E+000   
1
+  ? ?  
 ?   ?  ?   ?   
?
+  1 1  averylongstring
-1.000E+000   0  2017-01-01 10:10:10.00   1.00010E+002  
 1
+  2 2  good
1.100E+000   2  2017-01-01 10:10:10.00   2.0E+002   
 1000
+  3 3  good
1.000E+000   2  2017-01-01 10:10:10.00   2.1E+002   
   10
+  ?4294967295  good
3.399E+038   ?  2017-01-01 10:10:10.00   1.69968E+308   
   10
+  099  bad 
 ?   ?  ?   ?   ?
+
+--- 8 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int,
++>c2 largeint,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6),
++>c7 float(54),
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+--- 8 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int not null,
++>c2 largeint not null,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6) not null,
++>c7 float(54) not null,
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
--- End diff --

It might be helpful if the original conversion error is added as a warning. 
Maybe based on some setting(cqd), warnings could be added and returned. One can 
also check for max number of warnings instead of adding

[jira] [Commented] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270668#comment-15270668
 ] 

ASF GitHub Bot commented on TRAFODION-1920:
---

Github user anoopsharma00 commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/461#discussion_r62043077
  
--- Diff: core/sql/generator/GenRelScan.cpp ---
@@ -880,6 +884,12 @@ short FileScan::codeGenForHive(Generator * generator)
   } // for (ii = 0; ii < hdfsVals; ii++)
 
 
+  UInt32 hiveScanMode = CmpCommon::getDefaultLong(HIVE_SCAN_SPECIAL_MODE);
+  //enhance pCode to handle this mode in the future
+  //this is for JIRA 1920
+  if((hiveScanMode & 2 ) > 0)   //if HIVE_SCAN_SPECIAL_MODE is 2, disable 
pCode
+exp_gen->setPCodeMode(ex_expr::PCODE_NONE);
+
--- End diff --

This will disable pcode for the whole expression and all conversions.
Better place to disable it is in ex_conv_clause::pcodeGenererate in
file exp/ExpPCodeClauseGen.cpp.
That code should check for conv_to_null_when_error flag in ex_conv_clause
and disable pcode just for that clause.



> suppress SQL error during HIVE_SCAN when encounter invalid value, assign null 
> to the invalid value
> --
>
> Key: TRAFODION-1920
> URL: https://issues.apache.org/jira/browse/TRAFODION-1920
> Project: Apache Trafodion
>  Issue Type: Sub-task
>Reporter: liu ming
>Assignee: liu ming
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value

2016-05-04 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/TRAFODION-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270654#comment-15270654
 ] 

ASF GitHub Bot commented on TRAFODION-1920:
---

Github user selvaganesang commented on a diff in the pull request:

https://github.com/apache/incubator-trafodion/pull/461#discussion_r62041333
  
--- Diff: core/sql/regress/hive/EXPECTED005 ---
@@ -534,4 +534,101 @@ C1   C2
 >>cqd HIVE_SCAN_SPECIAL_MODE reset;
 
 --- SQL operation complete.
+>>select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>select * from tbl_bad;
+
+C1   C2C3 C4   
C5  C6  C7  
   C8
+---    -  
---  --  --  -  
--
+
+  ? ?  c   
 ?   ?  ?   ?   
?
+  ? ?  c   
 ?   ?  2017-01-01 10:10:10.00   1.01000E+000   
1
+  ? ?  
 ?   ?  ?   ?   
?
+  1 1  averylongstring
-1.000E+000   0  2017-01-01 10:10:10.00   1.00010E+002  
 1
+  2 2  good
1.100E+000   2  2017-01-01 10:10:10.00   2.0E+002   
 1000
+  3 3  good
1.000E+000   2  2017-01-01 10:10:10.00   2.1E+002   
   10
+  ?4294967295  good
3.399E+038   ?  2017-01-01 10:10:10.00   1.69968E+308   
   10
+  099  bad 
 ?   ?  ?   ?   ?
+
+--- 8 row(s) selected.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int,
++>c2 largeint,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6),
++>c7 float(54),
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+*** ERROR[8413] The string argument contains characters that cannot be 
converted.
+
+--- 0 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>load with no output into trafodion.seabase.traf_tbl_bad select * from 
tbl_bad;
+
+--- 8 row(s) loaded.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>upsert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
+--- 8 row(s) inserted.
+>>cqd HIVE_SCAN_SPECIAL_MODE reset;
+
+--- SQL operation complete.
+>>drop table if exists trafodion.seabase.traf_tbl_bad;
+
+--- SQL operation complete.
+>>create table trafodion.seabase.traf_tbl_bad (
++>c1 int not null,
++>c2 largeint not null,
++>c3 varchar(25),
++>c4 real,
++>c5 smallint,
++>c6 timestamp(6) not null,
++>c7 float(54) not null,
++>c8 smallint
++>);
+
+--- SQL operation complete.
+>>cqd HIVE_SCAN_SPECIAL_MODE '2';
+
+--- SQL operation complete.
+>>insert into trafodion.seabase.traf_tbl_bad select * from tbl_bad;
+
--- End diff --

Good that we are getting this error. Are we supposed to get the original 
error? Or what error will be seen is non-deterministic because it depends which 
node the expression gets evaluated?


> suppress SQL error

[jira] [Updated] (TRAFODION-1969) support Oracle's TRUNCATE TABLE syntax

2016-05-04 Thread liu ming (JIRA) 

 [ 
https://issues.apache.org/jira/browse/TRAFODION-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

liu ming updated TRAFODION-1969:

Assignee: taian.wei

> support Oracle's TRUNCATE TABLE syntax 
> ---
>
> Key: TRAFODION-1969
> URL: https://issues.apache.org/jira/browse/TRAFODION-1969
> Project: Apache Trafodion
>  Issue Type: Improvement
>Reporter: liu ming
>Assignee: taian.wei
>
> Oracle 'TRUNCATE TABLE' is used to delete all data for a given table.
> It should be the same command in Trafodion 'purgedata'.
> It will be convenient that Trafodion directly support this syntax.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (TRAFODION-1969) support Oracle's TRUNCATE TABLE syntax

2016-05-04 Thread liu ming (JIRA) 
liu ming created TRAFODION-1969:
---

 Summary: support Oracle's TRUNCATE TABLE syntax 
 Key: TRAFODION-1969
 URL: https://issues.apache.org/jira/browse/TRAFODION-1969
 Project: Apache Trafodion
  Issue Type: Improvement
Reporter: liu ming


Oracle 'TRUNCATE TABLE' is used to delete all data for a given table.
It should be the same command in Trafodion 'purgedata'.

It will be convenient that Trafodion directly support this syntax.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)