zkaoudi commented on issue #851:
URL: https://github.com/apache/wayang/issues/851#issuecomment-6452071554

   key distinctness could come from a metadata catalog together with other 
interesting statistics and it's something we are looking into.
   
   Another thing we have been asked about and it may be relevant here is 
whether Wayang could predict or tackle in some way the fact that a platform 
fails (eg., because of out of memory error in Java) and could thus choose 
another platform (eg Spark). In this way, Wayang could provide robust 
pipelines. But that requires a longer discussion I think.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to