[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241136#comment-16241136 ]
Hive QA commented on HIVE-17947: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12895378/HIVE-17947.3-branch-1.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 165 failed/errored test(s), 8123 tests executed *Failed tests:* {noformat} TestAcidOnTez - did not produce a TEST-*.xml file (likely timed out) (batchId=376) TestAdminUser - did not produce a TEST-*.xml file (likely timed out) (batchId=358) TestAuthorizationPreEventListener - did not produce a TEST-*.xml file (likely timed out) (batchId=391) TestAuthzApiEmbedAuthorizerInEmbed - did not produce a TEST-*.xml file (likely timed out) (batchId=368) TestAuthzApiEmbedAuthorizerInRemote - did not produce a TEST-*.xml file (likely timed out) (batchId=374) TestBeeLineWithArgs - did not produce a TEST-*.xml file (likely timed out) (batchId=398) TestCLIAuthzSessionContext - did not produce a TEST-*.xml file (likely timed out) (batchId=416) TestClearDanglingScratchDir - did not produce a TEST-*.xml file (likely timed out) (batchId=383) TestClientSideAuthorizationProvider - did not produce a TEST-*.xml file (likely timed out) (batchId=390) TestCompactor - did not produce a TEST-*.xml file (likely timed out) (batchId=379) TestCreateUdfEntities - did not produce a TEST-*.xml file (likely timed out) (batchId=378) TestCustomAuthentication - did not produce a TEST-*.xml file (likely timed out) (batchId=399) TestDBTokenStore - did not produce a TEST-*.xml file (likely timed out) (batchId=342) TestDDLWithRemoteMetastoreSecondNamenode - did not produce a TEST-*.xml file (likely timed out) (batchId=377) TestDynamicSerDe - did not produce a TEST-*.xml file (likely timed out) (batchId=345) TestEmbeddedHiveMetaStore - did not produce a TEST-*.xml file (likely timed out) (batchId=355) TestEmbeddedThriftBinaryCLIService - did not produce a TEST-*.xml file (likely timed out) (batchId=402) TestFilterHooks - did not produce a TEST-*.xml file (likely timed out) (batchId=350) TestFolderPermissions - did not produce a TEST-*.xml file (likely timed out) (batchId=385) TestHS2AuthzContext - did not produce a TEST-*.xml file (likely timed out) (batchId=419) TestHS2AuthzSessionContext - did not produce a TEST-*.xml file (likely timed out) (batchId=420) TestHS2ClearDanglingScratchDir - did not produce a TEST-*.xml file (likely timed out) (batchId=406) TestHS2ImpersonationWithRemoteMS - did not produce a TEST-*.xml file (likely timed out) (batchId=407) TestHiveAuthorizerCheckInvocation - did not produce a TEST-*.xml file (likely timed out) (batchId=394) TestHiveAuthorizerShowFilters - did not produce a TEST-*.xml file (likely timed out) (batchId=393) TestHiveHistory - did not produce a TEST-*.xml file (likely timed out) (batchId=396) TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out) (batchId=370) TestHiveMetaStoreWithEnvironmentContext - did not produce a TEST-*.xml file (likely timed out) (batchId=360) TestHiveMetaTool - did not produce a TEST-*.xml file (likely timed out) (batchId=373) TestHiveServer2 - did not produce a TEST-*.xml file (likely timed out) (batchId=422) TestHiveServer2SessionTimeout - did not produce a TEST-*.xml file (likely timed out) (batchId=423) TestHiveSessionImpl - did not produce a TEST-*.xml file (likely timed out) (batchId=403) TestHs2Hooks - did not produce a TEST-*.xml file (likely timed out) (batchId=375) TestHs2HooksWithMiniKdc - did not produce a TEST-*.xml file (likely timed out) (batchId=451) TestJdbcDriver2 - did not produce a TEST-*.xml file (likely timed out) (batchId=410) TestJdbcMetadataApiAuth - did not produce a TEST-*.xml file (likely timed out) (batchId=421) TestJdbcWithLocalClusterSpark - did not produce a TEST-*.xml file (likely timed out) (batchId=415) TestJdbcWithMiniHS2 - did not produce a TEST-*.xml file (likely timed out) (batchId=412) TestJdbcWithMiniKdc - did not produce a TEST-*.xml file (likely timed out) (batchId=448) TestJdbcWithMiniKdcCookie - did not produce a TEST-*.xml file (likely timed out) (batchId=447) TestJdbcWithMiniKdcSQLAuthBinary - did not produce a TEST-*.xml file (likely timed out) (batchId=445) TestJdbcWithMiniKdcSQLAuthHttp - did not produce a TEST-*.xml file (likely timed out) (batchId=450) TestJdbcWithMiniMr - did not produce a TEST-*.xml file (likely timed out) (batchId=411) TestJdbcWithSQLAuthUDFBlacklist - did not produce a TEST-*.xml file (likely timed out) (batchId=417) TestJdbcWithSQLAuthorization - did not produce a TEST-*.xml file (likely timed out) (batchId=418) TestLocationQueries - did not produce a TEST-*.xml file (likely timed out) (batchId=382) TestMTQueries - did not produce a TEST-*.xml file (likely timed out) (batchId=380) TestMarkPartition - did not produce a TEST-*.xml file (likely timed out) (batchId=367) TestMarkPartitionRemote - did not produce a TEST-*.xml file (likely timed out) (batchId=371) TestMetaStoreAuthorization - did not produce a TEST-*.xml file (likely timed out) (batchId=356) TestMetaStoreConnectionUrlHook - did not produce a TEST-*.xml file (likely timed out) (batchId=354) TestMetaStoreEndFunctionListener - did not produce a TEST-*.xml file (likely timed out) (batchId=353) TestMetaStoreEventListener - did not produce a TEST-*.xml file (likely timed out) (batchId=363) TestMetaStoreEventListenerOnlyOnCommit - did not produce a TEST-*.xml file (likely timed out) (batchId=366) TestMetaStoreInitListener - did not produce a TEST-*.xml file (likely timed out) (batchId=369) TestMetaStoreListenersError - did not produce a TEST-*.xml file (likely timed out) (batchId=365) TestMetaStoreMetrics - did not produce a TEST-*.xml file (likely timed out) (batchId=346) TestMetaStoreUtils - did not produce a TEST-*.xml file (likely timed out) (batchId=347) TestMetastoreAuthorizationProvider - did not produce a TEST-*.xml file (likely timed out) (batchId=387) TestMetastoreVersion - did not produce a TEST-*.xml file (likely timed out) (batchId=362) TestMiniHS2 - did not produce a TEST-*.xml file (likely timed out) (batchId=424) TestMiniSparkOnYarnCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=452) TestMultiAuthorizationPreEventListener - did not produce a TEST-*.xml file (likely timed out) (batchId=388) TestMultiSessionsHS2WithLocalClusterSpark - did not produce a TEST-*.xml file (likely timed out) (batchId=414) TestNoSaslAuth - did not produce a TEST-*.xml file (likely timed out) (batchId=413) TestOperationLoggingAPIWithMr - did not produce a TEST-*.xml file (likely timed out) (batchId=404) TestOperationLoggingAPIWithTez - did not produce a TEST-*.xml file (likely timed out) (batchId=405) TestPartitionNameWhitelistValidation - did not produce a TEST-*.xml file (likely timed out) (batchId=351) TestPasswordWithConfig - did not produce a TEST-*.xml file (likely timed out) (batchId=389) TestRemoteHiveMetaStore - did not produce a TEST-*.xml file (likely timed out) (batchId=359) TestRemoteHiveMetaStoreIpAddress - did not produce a TEST-*.xml file (likely timed out) (batchId=348) TestRemoteUGIHiveMetaStoreIpAddress - did not produce a TEST-*.xml file (likely timed out) (batchId=364) TestRetryingHMSHandler - did not produce a TEST-*.xml file (likely timed out) (batchId=357) TestSSL - did not produce a TEST-*.xml file (likely timed out) (batchId=408) TestSchemaTool - did not produce a TEST-*.xml file (likely timed out) (batchId=397) TestSemanticAnalyzerHookLoading - did not produce a TEST-*.xml file (likely timed out) (batchId=381) TestSerdeWithFieldComments - did not produce a TEST-*.xml file (likely timed out) (batchId=344) TestServerSpecificConfig - did not produce a TEST-*.xml file (likely timed out) (batchId=361) TestServiceDiscovery - did not produce a TEST-*.xml file (likely timed out) (batchId=409) TestSetUGIOnBothClientServer - did not produce a TEST-*.xml file (likely timed out) (batchId=352) TestSetUGIOnOnlyClient - did not produce a TEST-*.xml file (likely timed out) (batchId=349) TestSetUGIOnOnlyServer - did not produce a TEST-*.xml file (likely timed out) (batchId=372) TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=191) [bucketmapjoin4.q,bucket_map_join_spark2.q,bucket_map_join_spark4.q,union21.q,timestamp_2.q,date_join1.q,mergejoins.q,smb_mapjoin_11.q,auto_sortmerge_join_3.q,mapjoin_test_outer.q,vectorization_9.q,merge2.q,auto_join_without_localtask.q,bucketmapjoin2.q,multi_join_union.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=192) [parallel_join1.q,join_cond_pushdown_unqual4.q,union_remove_7.q,join13.q,join_vc.q,groupby_cube1.q,join_reorder4.q,sample3.q,smb_mapjoin_19.q,stats16.q,union23.q,union.q,union31.q,cbo_udf_udaf.q,ptf_decimal.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=193) [union27.q,mapjoin_subquery2.q,union12.q,groupby7_map_multi_single_reducer.q,varchar_join1.q,join7.q,mapjoin1.q,skewjoinopt2.q,bucketsortoptimize_insert_2.q,smb_mapjoin_17.q,script_env_var1.q,groupby7_map.q,groupby3.q,bucketsortoptimize_insert_8.q,union20.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=194) [ptf_general_queries.q,auto_join_reordering_values.q,sample2.q,join1.q,decimal_join.q,join32_lessSize.q,order2.q,skewjoinopt18.q,union_remove_18.q,join25.q,union_remove_4.q,smb_mapjoin_25.q,groupby9.q,bucketsortoptimize_insert_6.q,ctas.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=195) [skewjoinopt15.q,list_bucket_dml_2.q,groupby_map_ppr.q,join_rc.q,union14.q,load_dyn_part3.q,smb_mapjoin_12.q,vector_cast_constant.q,auto_sortmerge_join_15.q,union10.q,auto_join11.q,load_dyn_part7.q,vectorization_12.q,groupby_sort_skew_1_23.q,skewjoinopt12.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=196) [auto_join18.q,input1_limit.q,auto_join26.q,union_remove_14.q,auto_sortmerge_join_14.q,stats_counter_partitioned.q,union22.q,bucket_map_join_tez2.q,smb_mapjoin_22.q,join_reorder.q,stats15.q,transform_ppr1.q,sample1.q,bucketmapjoin8.q,union34.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=197) [avro_joins.q,skewjoinopt16.q,bucket3.q,skewjoinopt13.q,auto_join14.q,vectorization_14.q,stats1.q,cbo_stats.q,auto_sortmerge_join_6.q,auto_join15.q,union_remove_24.q,union_view.q,join22.q,join33.q,ptf_matchpath.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=198) [vector_decimal_aggregate.q,skewjoin_noskew.q,leftsemijoin_mr.q,auto_join23.q,bucketmapjoin9.q,input18.q,cbo_simple_select.q,ptf.q,vectorized_nested_mapjoin.q,sample4.q,union18.q,multi_insert_gby.q,groupby1.q,join_reorder2.q,join_cond_pushdown_unqual2.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=199) [order.q,ppd_join3.q,join10.q,union_remove_11.q,vectorized_math_funcs.q,union_ppr.q,skewjoinopt6.q,union_remove_19.q,join14.q,join32.q,groupby_multi_single_reducer2.q,stats3.q,parquet_join.q,outer_join_ppr.q,join26.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=200) [skewjoinopt3.q,skewjoinopt19.q,join_merge_multi_expressions.q,skewjoinopt10.q,union5.q,insert_into1.q,vectorization_4.q,stats_counter.q,vectorization_2.q,vector_left_outer_join.q,decimal_1_1.q,semijoin.q,skewjoinopt9.q,rcfile_bigdata.q,load_dyn_part10.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=201) [multi_insert_mixed.q,smb_mapjoin_4.q,timestamp_comparison.q,join_cond_pushdown_3.q,insert1.q,union_remove_10.q,mapreduce2.q,bucketmapjoin_negative.q,udf_in_file.q,skewjoinopt5.q,auto_join12.q,skewjoin.q,vector_count_distinct.q,smb_mapjoin_3.q,stats10.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=202) [bucketsortoptimize_insert_4.q,skewjoinopt8.q,vectorization_10.q,auto_join18_multi_distinct.q,custom_input_output_format.q,insert_into3.q,vectorization_part_project.q,vectorization_6.q,skewjoinopt4.q,count.q,stats9.q,auto_join7.q,parallel.q,union33.q,union_lateralview.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=203) [skewjoin_union_remove_2.q,avro_decimal_native.q,timestamp_null.q,bucketmapjoin_negative3.q,union32.q,groupby_ppr.q,vector_varchar_4.q,stats6.q,stats_only_null.q,join18_multi_distinct.q,cross_join.q,sample8.q,timestamp_1.q,join24.q,join_star.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=204) [auto_join30.q,union_remove_1.q,ppd_outer_join2.q,date_udf.q,join16.q,smb_mapjoin_13.q,bucketmapjoin7.q,smb_mapjoin_18.q,join19.q,metadata_only_queries.q,union6.q,cbo_subq_in.q,vectorization_part.q,groupby3_map_multi_distinct.q,vectorized_timestamp_funcs.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=205) [bucketmapjoin12.q,auto_join10.q,ptf_rcfile.q,join20.q,vector_elt.q,multi_insert.q,groupby_rollup1.q,ppd_join5.q,join_filters_overlap.q,vector_string_concat.q,join_empty.q,smb_mapjoin_6.q,auto_sortmerge_join_12.q,groupby_bigdata.q,innerjoin.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=206) [tez_joins_explain.q,input17.q,ppd_gby_join.q,vectorized_rcfile_columnar.q,ppd_join.q,join_cond_pushdown_1.q,union_remove_6_subq.q,timestamp_3.q,load_dyn_part6.q,load_dyn_part9.q,multi_insert_gby2.q,vectorization_11.q,avro_compression_enabled_native.q,stats_noscan_2.q,transform1.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=207) [smb_mapjoin_21.q,load_dyn_part15.q,transform2.q,subquery_exists.q,cbo_semijoin.q,bucketmapjoin13.q,join27.q,alter_merge_stats_orc.q,union_remove_2.q,groupby_position.q,join12.q,smb_mapjoin_8.q,join21.q,auto_join16.q,union9.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=208) [vectorization_16.q,enforce_order.q,join_casesensitive.q,ppd_join2.q,ppd_outer_join5.q,mapjoin_memcheck.q,create_merge_compressed.q,louter_join_ppr.q,sample9.q,smb_mapjoin_16.q,vectorization_not.q,having.q,ppd_outer_join1.q,vector_orderby_5.q,union_remove_12.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=209) [bucketmapjoin3.q,load_dyn_part5.q,transform_ppr2.q,join23.q,groupby7_map_skew.q,cbo_gby.q,auto_join31.q,auto_sortmerge_join_1.q,join_cond_pushdown_unqual1.q,bucket_map_join_spark3.q,union28.q,escape_sortby1.q,leftsemijoin.q,union_remove_6.q,join29.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=210) [escape_distributeby1.q,join9.q,groupby2.q,vectorization_pushdown.q,union_date.q,join_cond_pushdown_unqual3.q,join8.q,sample10.q,ppd_outer_join3.q,cross_product_check_1.q,statsfs.q,auto_sortmerge_join_2.q,auto_join_stats.q,input_part2.q,groupby_multi_single_reducer3.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=211) [groupby_map_ppr_multi_distinct.q,vectorization_13.q,mapjoin_mapjoin.q,union2.q,join41.q,groupby8_map.q,cbo_gby_empty.q,vectorization_short_regress.q,identity_project_remove_skip.q,stats5.q,groupby8_map_skew.q,mapjoin_subquery.q,bucket2.q,smb_mapjoin_1.q,union_remove_8.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=212) [join39.q,bucketsortoptimize_insert_7.q,vector_distinct_2.q,bucketmapjoin10.q,join11.q,cbo_subq_not_in.q,auto_sortmerge_join_16.q,windowing.q,join40.q,skewjoinopt7.q,stats7.q,annotate_stats_join.q,multi_insert_lateral_view.q,ptf_streaming.q,join_1to1.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=213) [timestamp_lazy.q,union29.q,runtime_skewjoin_mapjoin_spark.q,auto_join22.q,union8.q,union13.q,dynamic_rdd_cache.q,auto_join29.q,merge1.q,mapjoin_distinct.q,union_remove_3.q,vector_decimal_mapjoin.q,sample5.q,multi_insert_move_tasks_share_dependencies.q,join_array.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=214) [ppd_join4.q,load_dyn_part2.q,smb_mapjoin_7.q,vectorization_5.q,smb_mapjoin_2.q,ppd_join_filter.q,column_access_stats.q,stats0.q,vector_between_in.q,vectorized_string_funcs.q,vectorization_1.q,bucket_map_join_2.q,temp_table_join1.q,vectorized_case.q,stats_noscan_1.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=215) [stats2.q,groupby3_map_skew.q,join_cond_pushdown_2.q,union19.q,union24.q,union_remove_5.q,groupby7_noskew_multi_single_reducer.q,groupby_multi_single_reducer.q,index_auto_self_join.q,auto_smb_mapjoin_14.q,script_env_var2.q,pcr.q,auto_join_filters.q,join0.q,join37.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=216) [stats12.q,groupby4.q,union_top_level.q,groupby10.q,subquery_in.q,mapjoin_filter_on_outerjoin.q,stats14.q,auto_sortmerge_join_4.q,limit_partition_metadataonly.q,load_dyn_part4.q,union3.q,smb_mapjoin_14.q,groupby3_noskew_multi_distinct.q,stats18.q,union_remove_21.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=217) [auto_sortmerge_join_13.q,join4.q,join35.q,join_reorder3.q,auto_join19.q,sample7.q,vectorization_15.q,union7.q,vectorization_nested_udf.q,load_dyn_part8.q,vector_groupby_3.q,vectorized_ptf.q,auto_join2.q,alter_merge_orc.q,bucket_map_join_1.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=218) [groupby_complex_types.q,groupby3_map.q,union11.q,union26.q,mapreduce1.q,mapjoin_addjar.q,bucketmapjoin_negative2.q,bucket_map_join_spark1.q,udf_example_add.q,vectorization_div0.q,union_remove_17.q,auto_join_nulls.q,ppd_outer_join4.q,sample6.q,auto_sortmerge_join_9.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=219) [multigroupby_singlemr.q,auto_join4.q,mapjoin_decimal.q,groupby7.q,join34.q,join5.q,sort.q,join17.q,union_script.q,add_part_multiple.q,limit_pushdown.q,uniquejoin.q,metadata_only_queries_with_filters.q,union25.q,load_dyn_part13.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=220) [table_access_keys_stats.q,bucketmapjoin11.q,union_remove_9.q,mergejoins_mixed.q,join_nullsafe.q,stats8.q,auto_join28.q,skewjoinopt14.q,union17.q,vectorized_shufflejoin.q,groupby8_noskew.q,auto_sortmerge_join_10.q,groupby11.q,skewjoinopt11.q,load_dyn_part11.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=221) [script_pipe.q,auto_join24.q,ptf_seqfile.q,union_remove_23.q,filter_join_breaktask.q,parallel_join0.q,join_thrift.q,vectorized_mapjoin.q,groupby8.q,union4.q,auto_join5.q,smb_mapjoin_20.q,groupby_multi_insert_common_distinct.q,join6.q,union_remove_16.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=222) [ppd_transform.q,smb_mapjoin_15.q,auto_join9.q,vector_data_types.q,input13.q,bucket4.q,ppd_multi_insert.q,skewjoinopt20.q,input12.q,multi_insert_gby3.q,join_map_ppr.q,auto_sortmerge_join_8.q,escape_clusterby1.q,reduce_deduplicate_exclude_join.q,filter_join_breaktask2.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=223) [auto_join1.q,input14.q,union30.q,stats20.q,union_remove_22.q,vectorization_3.q,cbo_union.q,union_date_trim.q,disable_merge_for_bucketing.q,join3.q,skewjoinopt1.q,join_alt_syntax.q,join30.q,groupby_sort_1_23.q,timestamp_udf.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=224) [stats13.q,router_join_ppr.q,join15.q,auto_join13.q,join_hive_626.q,vector_mapjoin_reduce.q,auto_join21.q,ptf_register_tblfn.q,join_view.q,join_merging.q,groupby3_noskew.q,optimize_nullscan.q,join38.q,auto_join3.q,vectorization_decimal_date.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=225) [load_dyn_part12.q,scriptfile1.q,groupby7_noskew.q,bucketmapjoin1.q,auto_join17.q,subquery_multiinsert.q,lateral_view_explode2.q,tez_join_tests.q,join28.q,join_cond_pushdown_4.q,vectorization_0.q,load_dyn_part1.q,skewjoinopt17.q,union_null.q,bucketmapjoin5.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=226) [join36.q,union_remove_15.q,smb_mapjoin_10.q,bucket_map_join_tez1.q,temp_table.q,union_remove_13.q,auto_join8.q,auto_join6.q,auto_join0.q,vectorization_17.q,auto_join_stats2.q,skewjoin_union_remove_1.q,union16.q,auto_join32.q,union_remove_20.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=227) [join2.q,avro_joins_native.q,join18.q,auto_join20.q,smb_mapjoin_5.q,vector_char_4.q,auto_sortmerge_join_5.q,cross_product_check_2.q,union_remove_25.q,insert_into2.q,escape_orderby1.q,cbo_limit.q,stats_partscan_1_23.q,groupby_complex_types_multi_single_reducer.q,join_literals.q] TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=228) [union15.q,auto_sortmerge_join_7.q,join31.q,auto_join27.q,load_dyn_part14.q] TestSparkNegativeCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=453) TestStorageBasedClientSideAuthorizationProvider - did not produce a TEST-*.xml file (likely timed out) (batchId=395) TestStorageBasedMetastoreAuthorizationDrops - did not produce a TEST-*.xml file (likely timed out) (batchId=386) TestStorageBasedMetastoreAuthorizationProvider - did not produce a TEST-*.xml file (likely timed out) (batchId=384) TestStorageBasedMetastoreAuthorizationReads - did not produce a TEST-*.xml file (likely timed out) (batchId=392) TestThriftBinaryCLIService - did not produce a TEST-*.xml file (likely timed out) (batchId=400) TestThriftHttpCLIService - did not produce a TEST-*.xml file (likely timed out) (batchId=401) TestZooKeeperTokenStore - did not produce a TEST-*.xml file (likely timed out) (batchId=343) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit (batchId=45) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_mapjoin (batchId=16) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_table (batchId=32) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_drop_database_removes_partition_dirs (batchId=98) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_drop_table_removes_partition_dirs (batchId=132) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_optimization (batchId=81) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_optimization_acid (batchId=69) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency (batchId=64) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_dependency2 (batchId=109) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby10 (batchId=95) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby11 (batchId=111) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby8 (batchId=114) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_file_format (batchId=84) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ivyDownload (batchId=38) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_semijoin5 (batchId=23) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_temp_table_gb1 (batchId=50) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_fast_stats (batchId=78) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_string_decimal (batchId=4) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_windowing (batchId=82) org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_drop_partition (batchId=437) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning (batchId=175) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_groupby2 (batchId=180) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_stats_only_null (batchId=174) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_smb_empty (batchId=176) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_union_fast_stats (batchId=181) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_dynamic_partition_pruning (batchId=175) org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_groupby2 (batchId=143) org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap_auto (batchId=138) org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_2 (batchId=147) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import (batchId=153) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_right_side_join (batchId=153) org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testSplitGenFailure (batchId=594) org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation (batchId=269) org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler (batchId=431) org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForDBTokenStore (batchId=449) org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForMemoryTokenStore (batchId=449) org.apache.hive.minikdc.TestMiniHiveKdc.testLogin (batchId=446) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/7665/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/7665/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-7665/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 165 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12895378 - PreCommit-HIVE-Build > Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1 > ------------------------------------------------------------------------- > > Key: HIVE-17947 > URL: https://issues.apache.org/jira/browse/HIVE-17947 > Project: Hive > Issue Type: Bug > Components: Transactions > Affects Versions: 1.3.0 > Reporter: Daniel Voros > Assignee: Daniel Voros > Priority: Blocker > Attachments: HIVE-17947.1-branch-1.patch, > HIVE-17947.2-branch-1.patch, HIVE-17947.3-branch-1.patch > > > HIVE-17526 (only on branch-1) disabled conversion to ACID if there are > *_copy_N files under the table, but the filesystem checks introduced there > are running for every insert since the MoveTask in the end of the insert will > call alterTable eventually. > The filename checking also recurses into staging directories created by other > inserts. If those are removed while listing the files, it leads to the > following exception and failing insert: > {code} > java.io.FileNotFoundException: File > hdfs://mycluster/apps/hive/warehouse/dvoros.db/concurrent_insert/.hive-staging_hive_2017-10-30_13-23-35_056_2844419018556002410-2/-ext-10001 > does not exist. > at > org.apache.hadoop.hdfs.DistributedFileSystem$DirListingIterator.<init>(DistributedFileSystem.java:1081) > ~[hadoop-hdfs-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.hdfs.DistributedFileSystem$DirListingIterator.<init>(DistributedFileSystem.java:1059) > ~[hadoop-hdfs-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.hdfs.DistributedFileSystem$23.doCall(DistributedFileSystem.java:1004) > ~[hadoop-hdfs-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.hdfs.DistributedFileSystem$23.doCall(DistributedFileSystem.java:1000) > ~[hadoop-hdfs-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.hdfs.DistributedFileSystem.listLocatedStatus(DistributedFileSystem.java:1018) > ~[hadoop-hdfs-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1735) > ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.fs.FileSystem$6.handleFileStat(FileSystem.java:1864) > ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?] > at org.apache.hadoop.fs.FileSystem$6.hasNext(FileSystem.java:1841) > ~[hadoop-common-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hadoop.hive.metastore.TransactionalValidationListener.containsCopyNFiles(TransactionalValidationListener.java:226) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.TransactionalValidationListener.handleAlterTableTransactionalProp(TransactionalValidationListener.java:104) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.TransactionalValidationListener.handle(TransactionalValidationListener.java:63) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.TransactionalValidationListener.onEvent(TransactionalValidationListener.java:55) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2478) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_core(HiveMetaStore.java:4145) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_with_environment_context(HiveMetaStore.java:4117) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at sun.reflect.GeneratedMethodAccessor107.invoke(Unknown Source) > ~[?:?] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_144] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144] > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > com.sun.proxy.$Proxy32.alter_table_with_environment_context(Unknown Source) > [?:?] > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.alter_table_with_environmentContext(HiveMetaStoreClient.java:299) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.alter_table_with_environmentContext(SessionHiveMetaStoreClient.java:325) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) ~[?:?] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_144] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144] > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:173) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at com.sun.proxy.$Proxy33.alter_table_with_environmentContext(Unknown > Source) [?:?] > at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) ~[?:?] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_144] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144] > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2227) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at com.sun.proxy.$Proxy33.alter_table_with_environmentContext(Unknown > Source) [?:?] > at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:626) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:608) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:2020) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:380) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1987) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1667) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1414) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1211) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1204) > [hive-exec-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:242) > [hive-service-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) > [hive-service-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336) > [hive-service-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at java.security.AccessController.doPrivileged(Native Method) > ~[?:1.8.0_144] > at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_144] > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) > [hadoop-common-2.7.3.2.6.3.0-235.jar:?] > at > org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:350) > [hive-service-2.1.0.2.6.3.0-235.jar:2.1.0.2.6.3.0-235] > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [?:1.8.0_144] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [?:1.8.0_144] > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [?:1.8.0_144] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [?:1.8.0_144] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > [?:1.8.0_144] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [?:1.8.0_144] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_144] > {code} > We should: > - run checks only when converting to ACID and not on every alter (as we do > on master) > - skip hidden files to prevent recursing into staging directories -- This message was sent by Atlassian JIRA (v6.4.14#64029)