[jira] [Commented] (HIVE-14631) HiveServer2 regularly fails to connect to metastore
[ https://issues.apache.org/jira/browse/HIVE-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863871#comment-16863871 ] Advith Nagappa commented on HIVE-14631: --- I am facing the exact same issue.. > HiveServer2 regularly fails to connect to metastore > --- > > Key: HIVE-14631 > URL: https://issues.apache.org/jira/browse/HIVE-14631 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.2.1, 2.0.0, 2.1.0 > Environment: Hive 2.1.0, Hue 3.10.0, Hadoop 2.7.2, Tez 0.8.3 >Reporter: Alexandre Linte >Priority: Major > > I have a cluster secured with Kerberos and Hive is configured to work with > Tez by default. Everything works well through hive-cli and beeline; however, > I'm facing a strange behavior through Hue. > I can have a lot of client connections (these can reach 600) and after a day, > the client connections fail. But this is not the case for all clients > connection attempts. > When it fails, I have the following logs on the HiveServer2: > {noformat} > Aug 3 09:28:04 hiveserver2.bigdata.fr Executing > command(queryId=hiveserver2_20160803092803_a216edf1-bb51-43a7-81a6-f40f1574b112): > INSERT INTO TABLE shfs3453.camille_test VALUES ('coucou') > Aug 3 09:28:04 hiveserver2.bigdata.fr Query ID = > hiveserver2_20160803092803_a216edf1-bb51-43a7-81a6-f40f1574b112 > Aug 3 09:28:04 hiveserver2.bigdata.fr Total jobs = 1 > Aug 3 09:28:04 hiveserver2.bigdata.fr Launching Job 1 out of 1 > Aug 3 09:28:04 hiveserver2.bigdata.fr Starting task [Stage-1:MAPRED] in > parallel > Aug 3 09:28:04 hiveserver2.bigdata.fr Trying to connect to metastore with > URI thrift://metastore01.bigdata.fr:9083 > Aug 3 09:28:04 hiveserver2.bigdata.fr Failed to connect to the MetaStore > Server... > Aug 3 09:28:04 hiveserver2.bigdata.fr Waiting 1 seconds before next > connection attempt. > Aug 3 09:28:05 hiveserver2.bigdata.fr Trying to connect to metastore with > URI thrift://metastore01.bigdata.fr:9083 > Aug 3 09:28:05 hiveserver2.bigdata.fr Failed to connect to the MetaStore > Server... > Aug 3 09:28:05 hiveserver2.bigdata.fr Waiting 1 seconds before next > connection attempt. > Aug 3 09:28:06 hiveserver2.bigdata.fr Trying to connect to metastore with > URI thrift://metastore01.bigdata.fr:9083 > Aug 3 09:28:06 hiveserver2.bigdata.fr Failed to connect to the MetaStore > Server... > Aug 3 09:28:06 hiveserver2.bigdata.fr Waiting 1 seconds before next > connection attempt. > Aug 3 09:28:08 hiveserver2.bigdata.fr FAILED: Execution Error, return code > -1 from org.apache.hadoop.hive.ql.exec.tez.TezTask > Aug 3 09:28:08 hiveserver2.bigdata.fr Completed executing > command(queryId=hiveserver2_20160803092803_a216edf1-bb51-43a7-81a6-f40f1574b112); > Time taken: 4.002 seconds > {noformat} > At the same time I have the following logs on the Metastore are: > {noformat} > Aug 3 09:28:03 metastore01.bigdata.fr 180: get_table : db=shfs3453 > tbl=camille_test > Aug 3 09:28:03 metastore01.bigdata.fr > ugi=shfs3453#011ip=10.77.64.228#011cmd=get_table : db=shfs3453 > tbl=camille_test#011 > Aug 3 09:28:04 metastore01.bigdata.fr 180: get_table : db=shfs3453 > tbl=camille_test > Aug 3 09:28:04 metastore01.bigdata.fr > ugi=shfs3453#011ip=10.77.64.228#011cmd=get_table : db=shfs3453 > tbl=camille_test#011 > Aug 3 09:28:04 metastore01.bigdata.fr 180: get_table : db=shfs3453 > tbl=camille_test > Aug 3 09:28:04 metastore01.bigdata.fr > ugi=shfs3453#011ip=10.77.64.228#011cmd=get_table : db=shfs3453 > tbl=camille_test#011 > Aug 3 09:28:04 metastore01.bigdata.fr SASL negotiation failure > Aug 3 09:28:04 metastore01.bigdata.fr Error occurred during processing of > message. > Aug 3 09:28:05 metastore01.bigdata.fr SASL negotiation failure > Aug 3 09:28:05 metastore01.bigdata.fr Error occurred during processing of > message. > Aug 3 09:28:06 metastore01.bigdata.fr SASL negotiation failure > Aug 3 09:28:06 metastore01.bigdata.fr Error occurred during processing of > message. > {noformat} > To solve the connections issue, I have to restart the HiveServer2. > Note: I also created a JIRA for Hue: > https://issues.cloudera.org/browse/HUE-4748 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21845) Errors building hive-exec from rel/release-2.3.3
[ https://issues.apache.org/jira/browse/HIVE-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Advith Nagappa updated HIVE-21845: -- Component/s: Query Processor > Errors building hive-exec from rel/release-2.3.3 > > > Key: HIVE-21845 > URL: https://issues.apache.org/jira/browse/HIVE-21845 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 2.3.3 >Reporter: Advith Nagappa >Priority: Major > > I am trying to build the hive-exec jar from github source > ([https://github.com/apache/hive/tree/rel/release-2.3.3) > ] > {noformat} > mvn clean install -T 4 -q -Pitests{noformat} > I am not skipping the tests, and I run into these: > {code:java} > Tests in error: > > TestTxnCommands2.testNonAcidToAcidConversion02:413->runStatementOnDriver:1838 > Runtime > > TestTxnCommands2WithSplitUpdate>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > > TestTxnCommands2WithSplitUpdateAndVectorization>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > {code} > Appreciate inputs on why this could be happening and if it is safe to ignore > this? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21845) Errors building hive-exec from rel/release-2.3.3
[ https://issues.apache.org/jira/browse/HIVE-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Advith Nagappa updated HIVE-21845: -- Labels: build (was: ) > Errors building hive-exec from rel/release-2.3.3 > > > Key: HIVE-21845 > URL: https://issues.apache.org/jira/browse/HIVE-21845 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 2.3.3 >Reporter: Advith Nagappa >Priority: Major > Labels: build > > I am trying to build the hive-exec jar from github source > ([https://github.com/apache/hive/tree/rel/release-2.3.3) > ] > {noformat} > mvn clean install -T 4 -q -Pitests{noformat} > I am not skipping the tests, and I run into these: > {code:java} > Tests in error: > > TestTxnCommands2.testNonAcidToAcidConversion02:413->runStatementOnDriver:1838 > Runtime > > TestTxnCommands2WithSplitUpdate>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > > TestTxnCommands2WithSplitUpdateAndVectorization>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > {code} > Appreciate inputs on why this could be happening and if it is safe to ignore > this? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21845) Errors building hive-exec from rel/release-2.3.3
[ https://issues.apache.org/jira/browse/HIVE-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Advith Nagappa updated HIVE-21845: -- Affects Version/s: 2.3.3 > Errors building hive-exec from rel/release-2.3.3 > > > Key: HIVE-21845 > URL: https://issues.apache.org/jira/browse/HIVE-21845 > Project: Hive > Issue Type: Bug >Affects Versions: 2.3.3 >Reporter: Advith Nagappa >Priority: Major > > I am trying to build the hive-exec jar from github source > ([https://github.com/apache/hive/tree/rel/release-2.3.3) > ] > {noformat} > mvn clean install -T 4 -q -Pitests{noformat} > I am not skipping the tests, and I run into these: > {code:java} > Tests in error: > > TestTxnCommands2.testNonAcidToAcidConversion02:413->runStatementOnDriver:1838 > Runtime > > TestTxnCommands2WithSplitUpdate>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > > TestTxnCommands2WithSplitUpdateAndVectorization>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > {code} > Appreciate inputs on why this could be happening and if it is safe to ignore > this? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21845) Errors building hive-exec from rel/release-2.3.3
[ https://issues.apache.org/jira/browse/HIVE-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Advith Nagappa updated HIVE-21845: -- Issue Type: Bug (was: Test) > Errors building hive-exec from rel/release-2.3.3 > > > Key: HIVE-21845 > URL: https://issues.apache.org/jira/browse/HIVE-21845 > Project: Hive > Issue Type: Bug >Reporter: Advith Nagappa >Priority: Major > > I am trying to build the hive-exec jar from github source > ([https://github.com/apache/hive/tree/rel/release-2.3.3) > ] > {noformat} > mvn clean install -T 4 -q -Pitests{noformat} > I am not skipping the tests, and I run into these: > {code:java} > Tests in error: > > TestTxnCommands2.testNonAcidToAcidConversion02:413->runStatementOnDriver:1838 > Runtime > > TestTxnCommands2WithSplitUpdate>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > > TestTxnCommands2WithSplitUpdateAndVectorization>TestTxnCommands2.testNonAcidToAcidConversion02:413->TestTxnCommands2.runStatementOnDriver:1838 > » Runtime > {code} > Appreciate inputs on why this could be happening and if it is safe to ignore > this? -- This message was sent by Atlassian JIRA (v7.6.3#76005)