[jira] [Updated] (SPARK-29573) Spark should work as PostgreSQL when using + Operator

2019-10-28 Thread ABHISHEK KUMAR GUPTA (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ABHISHEK KUMAR GUPTA updated SPARK-29573:
-
Description: 
Spark and PostgreSQL result is different when concatenating as below :

{code}
Spark : Giving NULL result 
0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-+-+
| id | name |
+-+-+
| 20 | test |
| 10 | number |
+-+-+
2 rows selected (3.683 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.649 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.406 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
address from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
PostgreSQL: Saying throwing Error saying not supported
create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying
{code}




 

  was:
Spark and PostgreSQL result is different when concatenating as below :

Spark : Giving NULL result 

{code}
0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-+-+
| id | name |
+-+-+
| 20 | test |
| 10 | number |
+-+-+
2 rows selected (3.683 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.649 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.406 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
address from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
{code}

 

PostgreSQL: Saying throwing Error saying not supported

{code}
create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying
{code}

 

It should throw Error in Spark if it is not supported.

 


> Spark should work as PostgreSQL when using + Operator
> -
>
> Key: SPARK-29573
> URL: https://issues.apache.org/jira/browse/SPARK-29573
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.0.0
>Reporter: ABHISHEK KUMAR GUPTA
>Priority: Major
>
> Spark and PostgreSQL result is different when concatenating as below :
> {code}
> Spark : Giving NULL result 
> 0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
> +-+-+
> | id | name |
> +-+-+
> | 20 | test |
> | 10 | number |
> +-+-+
> 2 rows selected (3.683 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> 2 rows selected (0.649 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> 2 rows selected (0.406 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> PostgreSQL: Saying throwing Error saying not supported
> create table emp12(id int,name varchar(255));
> insert into emp12 values(10,'number');
> insert into emp12 values(20,'test');
> select id as ID, id+','+name as address from emp12;
> output: invalid input synta

[jira] [Updated] (SPARK-29573) Spark should work as PostgreSQL when using + Operator

2019-10-28 Thread Hyukjin Kwon (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-29573:
-
Description: 
Spark and PostgreSQL result is different when concatenating as below :

Spark : Giving NULL result 

{code}
0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-+-+
| id | name |
+-+-+
| 20 | test |
| 10 | number |
+-+-+
2 rows selected (3.683 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.649 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.406 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
address from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
{code}

 

PostgreSQL: Saying throwing Error saying not supported

{code}
create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying
{code}

 

It should throw Error in Spark if it is not supported.

 

  was:
Spark and PostgreSQL result is different when concatenating as below :

Spark : Giving NULL result 

0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-+-+
| id | name |
+-+-+
| 20 | test |
| 10 | number |
+-+-+
2 rows selected (3.683 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.649 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address 
from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+
2 rows selected (0.406 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
address from emp12;
+-+--+
| ID | address |
+-+--+
| 20 | NULL |
| 10 | NULL |
+-+--+

 

PostgreSQL: Saying throwing Error saying not supported

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying

 

It should throw Error in Spark if it is not supported.

 


> Spark should work as PostgreSQL when using + Operator
> -
>
> Key: SPARK-29573
> URL: https://issues.apache.org/jira/browse/SPARK-29573
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.0.0
>Reporter: ABHISHEK KUMAR GUPTA
>Priority: Major
>
> Spark and PostgreSQL result is different when concatenating as below :
> Spark : Giving NULL result 
> {code}
> 0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
> +-+-+
> | id | name |
> +-+-+
> | 20 | test |
> | 10 | number |
> +-+-+
> 2 rows selected (3.683 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> 2 rows selected (0.649 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> 2 rows selected (0.406 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as 
> address from emp12;
> +-+--+
> | ID | address |
> +-+--+
> | 20 | NULL |
> | 10 | NULL |
> +-+--+
> {code}
>  
> PostgreSQL: Saying throwing Error saying not supported
> {code}
> create table emp12(id int,name varchar(255));
> insert into emp12 values(10,'number');
> insert into emp12 values(20,'test');
> select id as ID, id+','+nam