wk888 opened a new issue #2834:
URL: https://github.com/apache/hudi/issues/2834


   **_Tips before filing an issue_**
   
   - Have you gone through our 
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
   
   - Join the mailing list to engage in conversations and get faster support at 
dev-subscr...@hudi.apache.org.
   
   - If you have triaged this as a bug, then file an 
[issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   hive> set 
hive.input.format=org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat;
   hive> select * from test.hudu_test_1_rt where dt=2021-04-15;
   WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the 
future versions. Consider using a different execution engine (i.e. spark, tez) 
or using Hive 1.X releases.
   Query ID = root_20210416094020_2f0117b1-4007-4390-ab58-be9ca46a1915
   Total jobs = 1
   Launching Job 1 out of 1
   Number of reduce tasks is set to 0 since there's no reduce operator
   org.apache.hudi.exception.TableNotFoundException: Hoodie table not found in 
path 
ofs://qqqqqqq.myqcloud.com/tmp/hive/root/1c7ec12e-4953-4913-bf9f-a09372b51609/.hoodie
           at 
org.apache.hudi.exception.TableNotFoundException.checkTableValidity(TableNotFoundException.java:53)
           at 
org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:110)
           at 
org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:71)
           at 
org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:581)
           at 
org.apache.hudi.hadoop.utils.HoodieInputFormatUtils.getTableMetaClientForBasePath(HoodieInputFormatUtils.java:327)
           at 
org.apache.hudi.hadoop.utils.HoodieInputFormatUtils.lambda$getTableMetaClientByBasePath$3(HoodieInputFormatUtils.java:302)
           at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
           at 
java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
           at 
java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
           at 
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
           at 
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
           at 
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
           at 
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
           at 
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
           at 
org.apache.hudi.hadoop.utils.HoodieInputFormatUtils.getTableMetaClientByBasePath(HoodieInputFormatUtils.java:293)
           at 
org.apache.hudi.hadoop.utils.HoodieRealtimeInputFormatUtils.getRealtimeSplits(HoodieRealtimeInputFormatUtils.java:66)
           at 
org.apache.hudi.hadoop.realtime.HoodieParquetRealtimeInputFormat.getSplits(HoodieParquetRealtimeInputFormat.java:66)
           at 
org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat$HoodieCombineFileInputFormatShim.getSplits(HoodieCombineHiveInputFormat.java:922)
           at 
org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat.getCombineSplits(HoodieCombineHiveInputFormat.java:241)
           at 
org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat.getSplits(HoodieCombineHiveInputFormat.java:363)
           at 
org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:333)
           at 
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:324)
           at 
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200)
           at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
           at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1304)
           at java.security.AccessController.doPrivileged(Native Method)
           at javax.security.auth.Subject.doAs(Subject.java:422)
           at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
           at org.apache.hadoop.mapreduce.Job.submit(Job.java:1304)
           at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:578)
           at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:573)
           at java.security.AccessController.doPrivileged(Native Method)
           at javax.security.auth.Subject.doAs(Subject.java:422)
           at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
           at 
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:573)
           at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:564)
           at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:414)
           at 
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:151)
           at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199)
           at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
           at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:79)
   Job Submission failed with exception 
'org.apache.hudi.exception.TableNotFoundException(Hoodie table not found in 
path 
ofs://qqqqqqq.myqcloud.com/tmp/hive/root/1c7ec12e-4953-4913-bf9f-a09372b51609/.hoodie)'
   FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Hoodie table not found in path 
ofs://qqqqqqq.myqcloud.com/tmp/hive/root/1c7ec12e-4953-4913-bf9f-a09372b51609/.hoodie
   
   **Describe the problem you faced**
   
   A clear and concise description of the problem.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.flink  write to hudi
   2.use hive query hudi then throw exception
   
   **Expected behavior**
   
   A clear and concise description of what you expected to happen.
   
   **Environment Description**
   
   * Hudi version :0.8.0
   
   * Flink version :1.12.0
   
   * Hive version :2.3.6
   
   * Hadoop version : cdh2.6.0
   
   * Storage (HDFS/S3/GCS..) : ofs  (Tencent object storage)
   
   * Running on Docker? (yes/no) :no
   
   
   
![image](https://user-images.githubusercontent.com/16316415/114960297-54832d80-9e99-11eb-8303-c35264581c22.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to