[jira] [Created] (HIVE-24148) TestHiveStrictManagedMigration.testExternalMove failing for all new PR.

2020-09-10 Thread Pravin Sinha (Jira)
Pravin Sinha created HIVE-24148:
---

 Summary: TestHiveStrictManagedMigration.testExternalMove failing 
for all new PR.
 Key: HIVE-24148
 URL: https://issues.apache.org/jira/browse/HIVE-24148
 Project: Hive
  Issue Type: Bug
Reporter: Pravin Sinha






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24147) Table column names are not extracted correctly in Hive JDBC storage handler

2020-09-10 Thread Jesus Camacho Rodriguez (Jira)
Jesus Camacho Rodriguez created HIVE-24147:
--

 Summary: Table column names are not extracted correctly in Hive 
JDBC storage handler
 Key: HIVE-24147
 URL: https://issues.apache.org/jira/browse/HIVE-24147
 Project: Hive
  Issue Type: Bug
  Components: JDBC storage handler
Affects Versions: 4.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


It seems the `ResultSetMetaData` extracted from the query to retrieve the table 
columns names contains these columns as fully qualified names instead of 
possibly using the {{getTableName}} method. This ends up throwing the storage 
handler off and leading to exceptions, both in CBO path and non-CBO path.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24146) Cleanup TaskExecutionException in GenericUDTFExplode

2020-09-10 Thread Zhihua Deng (Jira)
Zhihua Deng created HIVE-24146:
--

 Summary: Cleanup TaskExecutionException in GenericUDTFExplode
 Key: HIVE-24146
 URL: https://issues.apache.org/jira/browse/HIVE-24146
 Project: Hive
  Issue Type: Improvement
  Components: UDF
Reporter: Zhihua Deng
Assignee: Zhihua Deng


- Remove TaskExecutionException, which may be not used anymore;
- Remove the default handling in GenericUDTFExplode#process, which has been 
verified during the function initializing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24145) Fix preemption issues in reducers and file sink operators

2020-09-10 Thread Ramesh Kumar Thangarajan (Jira)
Ramesh Kumar Thangarajan created HIVE-24145:
---

 Summary: Fix preemption issues in reducers and file sink operators
 Key: HIVE-24145
 URL: https://issues.apache.org/jira/browse/HIVE-24145
 Project: Hive
  Issue Type: Bug
Reporter: Ramesh Kumar Thangarajan
Assignee: Ramesh Kumar Thangarajan


There are two issues because of preemption:
 # Reducers are getting reordered as part of optimizations because of which 
more preemption happen
 # Preemption in the middle of writing can cause the file to not close and lead 
to errors when we read the file later



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24144) getIdentifierQuoteString in HiveDatabaseMetaData returns incorrect value

2020-09-10 Thread Jesus Camacho Rodriguez (Jira)
Jesus Camacho Rodriguez created HIVE-24144:
--

 Summary: getIdentifierQuoteString in HiveDatabaseMetaData returns 
incorrect value
 Key: HIVE-24144
 URL: https://issues.apache.org/jira/browse/HIVE-24144
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


{code}
  public String getIdentifierQuoteString() throws SQLException {
return " ";
  }
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24143) Include convention in JDBC converter operator in Calcite plan

2020-09-10 Thread Jesus Camacho Rodriguez (Jira)
Jesus Camacho Rodriguez created HIVE-24143:
--

 Summary: Include convention in JDBC converter operator in Calcite 
plan
 Key: HIVE-24143
 URL: https://issues.apache.org/jira/browse/HIVE-24143
 Project: Hive
  Issue Type: Improvement
  Components: CBO
Affects Versions: 4.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


Among others, it will be useful to debug the dialect being chosen for query 
generation. For instance:
{code}
 HiveProject(jdbc_type_conversion_table1.ikey=[$0], 
jdbc_type_conversion_table1.bkey=[$1], jdbc_type_conversion_table1.fkey=[$2], 
jdbc_type_conversion_table1.dkey=[$3], jdbc_type_conversion_table1.chkey=[$4], 
jdbc_type_conversion_table1.dekey=[$5], jdbc_type_conversion_table1.dtkey=[$6], 
jdbc_type_conversion_table1.tkey=[$7])
  HiveProject(ikey=[$0], bkey=[$1], fkey=[$2], dkey=[$3], chkey=[$4], 
dekey=[$5], dtkey=[$6], tkey=[$7])
->HiveJdbcConverter(convention=[JDBC.DERBY])
  JdbcHiveTableScan(table=[[default, jdbc_type_conversion_table1]], 
table:alias=[jdbc_type_conversion_table1])
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24142) Provide config to skip umask validation during scratch dir creation

2020-09-10 Thread Prasanth Jayachandran (Jira)
Prasanth Jayachandran created HIVE-24142:


 Summary: Provide config to skip umask validation during scratch 
dir creation
 Key: HIVE-24142
 URL: https://issues.apache.org/jira/browse/HIVE-24142
 Project: Hive
  Issue Type: Bug
Reporter: Prasanth Jayachandran


When HS2 sessions create scratch dirs, it performs umask validation and it is 
mainly specific to HDFS. There are environments where scratch dirs can be in a 
different fs with paths writable but with different umask. It will be good to 
have a config to skip umask validation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24141) Cannot retrieve results using a Select * on a given table

2020-09-10 Thread srinivas vemulapalli (Jira)
srinivas vemulapalli created HIVE-24141:
---

 Summary: Cannot retrieve results using a Select * on a given table
 Key: HIVE-24141
 URL: https://issues.apache.org/jira/browse/HIVE-24141
 Project: Hive
  Issue Type: Bug
  Components: Hive, Parquet
Reporter: srinivas vemulapalli


Receiving following error on querying select * on given table

 
 * Bad status for request TFetchResultsReq(fetchType=0, 
operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, 
operationType=0, 
operationId=THandleIdentifier(secret='\xaa\xd5d\x0e\xae\xd4E\x9e\xad\xc5w\x80Y\x0f\x07\xcd',
 guid='1\x80\xc1\xa0\x9cKM\xab\x85\x11\xaa\x95\x19\xcd8\xb4')), orientation=4, 
maxRows=100): TFetchResultsResp(status=TStatus(errorCode=0, 
errorMessage='java.io.IOException: 
org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.ClassCastException', sqlState=None, 
infoMessages=['*org.apache.hive.service.cli.HiveSQLException:java.io.IOException:
 org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.ClassCastException:25:24', 
'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:463',
 
'org.apache.hive.service.cli.operation.OperationManager:getOperationNextRowSet:OperationManager.java:294',
 
'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:769',
 'sun.reflect.GeneratedMethodAccessor59:invoke::-1', 
'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43',
 'java.lang.reflect.Method:invoke:Method.java:498', 
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:78',
 
'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:36',
 
'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:63',
 'java.security.AccessController:doPrivileged:AccessController.java:-2', 
'javax.security.auth.Subject:doAs:Subject.java:422', 
'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1924',
 
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:59',
 'com.sun.proxy.$Proxy23:fetchResults::-1', 
'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:462', 
'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:696',
 
'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553',
 
'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538',
 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 
'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 
'org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:747',
 
'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286',
 
'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1142',
 
'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:617',
 'java.lang.Thread:run:Thread.java:745', 
'*java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.ClassCastException:27:2', 
'org.apache.hadoop.hive.ql.exec.FetchTask:fetch:FetchTask.java:154', 
'org.apache.hadoop.hive.ql.Driver:getResults:Driver.java:2071', 
'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:458',
 
'*org.apache.hadoop.hive.ql.metadata.HiveException:java.lang.ClassCastException:34:7',
 
'org.apache.hadoop.hive.ql.exec.ListSinkOperator:processOp:ListSinkOperator.java:90',
 'org.apache.hadoop.hive.ql.exec.Operator:forward:Operator.java:815', 
'org.apache.hadoop.hive.ql.exec.SelectOperator:processOp:SelectOperator.java:84',
 'org.apache.hadoop.hive.ql.exec.Operator:forward:Operator.java:815', 
'org.apache.hadoop.hive.ql.exec.TableScanOperator:processOp:TableScanOperator.java:98',
 'org.apache.hadoop.hive.ql.exec.FetchOperator:pushRow:FetchOperator.java:425', 
'org.apache.hadoop.hive.ql.exec.FetchOperator:pushRow:FetchOperator.java:417', 
'org.apache.hadoop.hive.ql.exec.FetchTask:fetch:FetchTask.java:140', 
'*java.lang.ClassCastException:null:0:-1'], statusCode=3), results=None, 
hasMoreRows=None)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)