Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?

Another thing you may want to be aware is, if the result is not idempotent, your query result is also not idempotent. For fault-tolerance there's a chance for record (row) to be replayed (recomputed). -Jungtaek Lim (HeartSaVioR) 2018년 4월 24일 (화) 오후 2:07, Jörn Franke 님이 작성:

Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?

What is your use case? > On 23. Apr 2018, at 23:27, kant kodali wrote: > > Hi All, > > Is it ok to make I/O calls in UDF? other words is it a standard practice? > > Thanks! - To unsubscribe e-mail:

Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?

yes for sure it works. I am just not sure if it is a good idea when getting a stream of messages from kafka? On Mon, Apr 23, 2018 at 2:54 PM, Sathish Kumaran Vairavelu < vsathishkuma...@gmail.com> wrote: > I have made simple rest call within UDF and it worked but not sure if it > can be applied

Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?

I have made simple rest call within UDF and it worked but not sure if it can be applied for large datasets but may be for small lookup files. Thanks On Mon, Apr 23, 2018 at 4:28 PM kant kodali wrote: > Hi All, > > Is it ok to make I/O calls in UDF? other words is it a