Thanks Junjie for checking! I was not able to repro the case you shown below, but I was able to repro the original case on my laptop for a while. I found the RC and created a fix for it, but after a night sleep I am not able to repro again even without any changes.
The pull request is here: https://github.com/apache/iceberg/pull/1620 <https://github.com/apache/iceberg/pull/1620> which will prevent the issue to appear again. Thanks, Peter > On Oct 14, 2020, at 12:40 PM, Junjie Chen <chenjunjied...@gmail.com> wrote: > > I built the master and encounterred following exception but disappearred > later: > > org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithCustomCatalog > > classMethod FAILED > > java.lang.RuntimeException: Cannot start TestHiveMetastore > > > > Caused by: > > java.sql.SQLTimeoutException: Login timeout exceeded. > > > > Caused by: > > ERROR XBDA0: Login timeout exceeded. > > > > org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithHadoopTables > > classMethod FAILED > > java.lang.RuntimeException: Cannot start TestHiveMetastore > > Caused by: > java.sql.SQLTimeoutException: Login timeout exceeded. > > Caused by: > ERROR XBDA0: Login timeout exceeded. > > > > On Wed, Oct 14, 2020 at 3:36 PM Peter Vary <pv...@cloudera.com.invalid> wrote: > Hi Team, > > Lately I have seen these flaky tests > (TestHiveIcebergStorageHandler*.testJoinTables* / > TestHiveIcebergStorageHandler*.testScanTable*): > >> org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithHiveCatalog > >> testJoinTablesParquet FAILED >> java.lang.IllegalArgumentException: Failed to executeQuery Hive query >> SHOW TABLES: Error while compiling statement: FAILED: SemanticException >> org.apache.thrift.transport.TTransportException: java.net.SocketException: >> Broken pipe (Write failed) >> Caused by: >> org.apache.hive.service.cli.HiveSQLException: Error while compiling >> statement: FAILED: SemanticException >> org.apache.thrift.transport.TTransportException: java.net.SocketException: >> Broken pipe (Write failed) >> Caused by: >> org.apache.hadoop.hive.ql.parse.SemanticException: >> org.apache.thrift.transport.TTransportException: java.net.SocketException: >> Broken pipe (Write failed) >> Caused by: >> org.apache.hadoop.hive.ql.metadata.HiveException: >> org.apache.thrift.transport.TTransportException: java.net.SocketException: >> Broken pipe (Write failed) >> Caused by: >> org.apache.thrift.transport.TTransportException: >> java.net.SocketException: Broken pipe (Write failed) >> Caused by: >> java.net.SocketException: Broken pipe (Write failed) > > > We increased the test Heap size, since I have seen that there were > OutOfMemoryException-s in the log. > https://github.com/apache/iceberg/blob/04d03bcf43d488acf2e98e4facf946e871a16719/build.gradle#L476 > > <https://github.com/apache/iceberg/blob/04d03bcf43d488acf2e98e4facf946e871a16719/build.gradle#L476> > > If you still see the problem appear please link here the failing tests, so we > can further investigate. > > Thanks, > Peter > > > -- > Best Regards
