kimberlyamandalu commented on issue #2696:
URL: https://github.com/apache/hudi/issues/2696#issuecomment-811249839


   > @kimberlyamandalu Can you try turning off the metadata table in hoodie to 
get your pipeline unblocked ?
   > 
   > ```
   > hoodie.metadata.enable=false
   > ```
   > 
   > This looks like an exception in the metadata table. Without any more logs, 
it's hard to debug what may be going on. If you are OK to deploy a custom 
build, we can work on adding more logs to help surface the underlying issue.
   > 
   > 
https://github.com/apache/hudi/blob/release-0.7.0/hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/FileSystemViewHandler.java#L378
 this is where the exception is coming from. If we can add more logs to this 
function to see why a runtime exception is being thrown, it may help to find 
the root cause.
   
   Hi @n3nash,
   Thanks for looking into this.
   I can try disabling metadata for my workload. Can we toggle metadata on and 
off for a data set? or does it need to be enabled from the time the data is 
bootstrapped? Is it something we can turn on after we have been ingesting for a 
bit and it will still work?
   
   I will be willing to deploy a custom build so we can get more details on 
this issue. I will need your help on it though as i'm not very familiar with 
how to do this.
   
   Thanks!!!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to