[
https://issues.apache.org/jira/browse/SPARK-35797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YuanGuanhu updated SPARK-35797:
-------------------------------
Description:
we are using hue to connect Spark JDBCServer with spark3.1.1, when we queru
this `select * from tb1` we got this exception:
{code:java}
// code placeholder
{code}
2021-06-09 19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
Closed a connection to metastore, current connections: 1 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Closed a
connection to metastore, current connections: 1 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
19:44:46,926 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Trying to
connect to metastore with URI thrift://xxxx:21088 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:583)2021-06-09
19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] | HMSC::open():
Found delegation token. Creating DIGEST-based thrift connection. |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:639)2021-06-09
19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Whether to use
hadoop rpc protection: true |
org.apache.hadoop.hive.metastore.utils.MetaStoreUtils.getMetaStoreSaslProperties(MetaStoreUtils.java:1119)2021-06-09
19:44:47,030 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Opened a
connection to metastore, current connections: 2 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:672)2021-06-09
19:44:47,031 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Connected to
metastore. |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:768)2021-06-09
19:44:47,032 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
RetryingMetaStoreClient proxy=class
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=admintest
(auth:PROXY) via spark2x/hadoop.hadoop....@hadoop.com (auth:KERBEROS) retries=1
delay=1 lifetime=0 |
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:99)2021-06-09
19:44:47,042 | ERROR | [HiveServer2-Handler-Pool: Thread-227] | Error
operating GET_SCHEMAS with 0d9c1722-508b-46c3-a61d-4bc8da2b8ce8 |
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.logError(Logging.scala:94)java.util.regex.PatternSyntaxException:
Dangling meta character '*' near index 0*^ at
java.util.regex.Pattern.error(Pattern.java:1969) at
java.util.regex.Pattern.sequence(Pattern.java:2137) at
java.util.regex.Pattern.expr(Pattern.java:2010) at
java.util.regex.Pattern.compile(Pattern.java:1702) at
java.util.regex.Pattern.<init>(Pattern.java:1352) at
java.util.regex.Pattern.compile(Pattern.java:1028) at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.runInternal(SparkGetSchemasOperation.scala:76)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:276) at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.org$apache$spark$sql$hive$thriftserver$SparkOperation$$super$run(SparkGetSchemasOperation.scala:39)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.$anonfun$run$1(SparkOperation.scala:44)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.withLocalProperties(SparkGetSchemasOperation.scala:39)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.run(SparkOperation.scala:44)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.run$(SparkOperation.scala:42)
at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.run(SparkGetSchemasOperation.scala:39)
at
org.apache.hive.service.cli.session.HiveSessionImpl.getSchemas(HiveSessionImpl.java:535)
was:
we are using hue to connect Spark JDBCServer with spark3.1.1, when we queru
this `select * from tb1` we got this exception:
{code:java}
// code placeholder
{code}
2021-06-09 19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
Closed a connection to metastore, current connections: 1 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Closed a
connection to metastore, current connections: 1 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
19:44:46,926 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Trying to
connect to metastore with URI thrift://8-5-248-4:21088 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:583)2021-06-09
19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] | HMSC::open():
Found delegation token. Creating DIGEST-based thrift connection. |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:639)2021-06-09
19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Whether to use
hadoop rpc protection: true |
org.apache.hadoop.hive.metastore.utils.MetaStoreUtils.getMetaStoreSaslProperties(MetaStoreUtils.java:1119)2021-06-09
19:44:47,030 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Opened a
connection to metastore, current connections: 2 |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:672)2021-06-09
19:44:47,031 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Connected to
metastore. |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:768)2021-06-09
19:44:47,032 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
RetryingMetaStoreClient proxy=class
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=admintest
(auth:PROXY) via spark2x/hadoop.hadoop....@hadoop.com (auth:KERBEROS) retries=1
delay=1 lifetime=0 |
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:99)2021-06-09
19:44:47,042 | ERROR | [HiveServer2-Handler-Pool: Thread-227] | Error
operating GET_SCHEMAS with 0d9c1722-508b-46c3-a61d-4bc8da2b8ce8 |
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.logError(Logging.scala:94)java.util.regex.PatternSyntaxException:
Dangling meta character '*' near index 0*^ at
java.util.regex.Pattern.error(Pattern.java:1969) at
java.util.regex.Pattern.sequence(Pattern.java:2137) at
java.util.regex.Pattern.expr(Pattern.java:2010) at
java.util.regex.Pattern.compile(Pattern.java:1702) at
java.util.regex.Pattern.<init>(Pattern.java:1352) at
java.util.regex.Pattern.compile(Pattern.java:1028) at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.runInternal(SparkGetSchemasOperation.scala:76)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:276) at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.org$apache$spark$sql$hive$thriftserver$SparkOperation$$super$run(SparkGetSchemasOperation.scala:39)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.$anonfun$run$1(SparkOperation.scala:44)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.withLocalProperties(SparkGetSchemasOperation.scala:39)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.run(SparkOperation.scala:44)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.run$(SparkOperation.scala:42)
at
org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.run(SparkGetSchemasOperation.scala:39)
at
org.apache.hive.service.cli.session.HiveSessionImpl.getSchemas(HiveSessionImpl.java:535)
> patternToRegex failed when pattern is star
> ------------------------------------------
>
> Key: SPARK-35797
> URL: https://issues.apache.org/jira/browse/SPARK-35797
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.1, 3.1.2
> Environment: Spark 3.1.1
> Reporter: YuanGuanhu
> Priority: Major
>
> we are using hue to connect Spark JDBCServer with spark3.1.1, when we queru
> this `select * from tb1` we got this exception:
> {code:java}
> // code placeholder
> {code}
> 2021-06-09 19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
> Closed a connection to metastore, current connections: 1 |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
> 19:44:46,918 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Closed a
> connection to metastore, current connections: 1 |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:804)2021-06-09
> 19:44:46,926 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Trying to
> connect to metastore with URI thrift://xxxx:21088 |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:583)2021-06-09
> 19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
> HMSC::open(): Found delegation token. Creating DIGEST-based thrift
> connection. |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:639)2021-06-09
> 19:44:46,927 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Whether to
> use hadoop rpc protection: true |
> org.apache.hadoop.hive.metastore.utils.MetaStoreUtils.getMetaStoreSaslProperties(MetaStoreUtils.java:1119)2021-06-09
> 19:44:47,030 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Opened a
> connection to metastore, current connections: 2 |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:672)2021-06-09
> 19:44:47,031 | INFO | [HiveServer2-Handler-Pool: Thread-227] | Connected to
> metastore. |
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:768)2021-06-09
> 19:44:47,032 | INFO | [HiveServer2-Handler-Pool: Thread-227] |
> RetryingMetaStoreClient proxy=class
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=admintest
> (auth:PROXY) via spark2x/hadoop.hadoop....@hadoop.com (auth:KERBEROS)
> retries=1 delay=1 lifetime=0 |
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:99)2021-06-09
> 19:44:47,042 | ERROR | [HiveServer2-Handler-Pool: Thread-227] | Error
> operating GET_SCHEMAS with 0d9c1722-508b-46c3-a61d-4bc8da2b8ce8 |
> org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.logError(Logging.scala:94)java.util.regex.PatternSyntaxException:
> Dangling meta character '*' near index 0*^ at
> java.util.regex.Pattern.error(Pattern.java:1969) at
> java.util.regex.Pattern.sequence(Pattern.java:2137) at
> java.util.regex.Pattern.expr(Pattern.java:2010) at
> java.util.regex.Pattern.compile(Pattern.java:1702) at
> java.util.regex.Pattern.<init>(Pattern.java:1352) at
> java.util.regex.Pattern.compile(Pattern.java:1028) at
> org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.runInternal(SparkGetSchemasOperation.scala:76)
> at org.apache.hive.service.cli.operation.Operation.run(Operation.java:276)
> at
> org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.org$apache$spark$sql$hive$thriftserver$SparkOperation$$super$run(SparkGetSchemasOperation.scala:39)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.$anonfun$run$1(SparkOperation.scala:44)
> at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
> at
> org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.withLocalProperties(SparkGetSchemasOperation.scala:39)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.run(SparkOperation.scala:44)
> at
> org.apache.spark.sql.hive.thriftserver.SparkOperation.run$(SparkOperation.scala:42)
> at
> org.apache.spark.sql.hive.thriftserver.SparkGetSchemasOperation.run(SparkGetSchemasOperation.scala:39)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.getSchemas(HiveSessionImpl.java:535)
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
