Re: Row compatible generated coders for custom classes

2023-12-03 Thread Steven van Rossum via dev
> Out of curiosity, did you add a warmup time before benchmarking? Schema and > row coder does codegen, so the first usage is very slow, but subsequent > usages should be much faster. I recommend running any test for a warmup > period before starting to measure. Yep, I poked at this using JMH w

Re: Row compatible generated coders for custom classes

2023-12-02 Thread Reuven Lax via dev
Out of curiosity, did you add a warmup time before benchmarking? Schema and row coder does codegen, so the first usage is very slow, but subsequent usages should be much faster. I recommend running any test for a warmup period before starting to measure. On Fri, Dec 1, 2023, 9:13 AM Steven van Ros

Re: Row compatible generated coders for custom classes

2023-12-01 Thread Steven van Rossum via dev
> Meaning BSON I presume? What do you mean by "tuple representation"? > (One downside of JSON is that the field names are redundantly stored > in each record, so even if you save on CPU it may hurt on the network > due to the greater data sizes). Yes, I meant BSON. Tuple or array representation fo

Re: Row compatible generated coders for custom classes

2023-12-01 Thread Robert Bradshaw via dev
On Fri, Dec 1, 2023 at 9:13 AM Steven van Rossum via dev wrote: > > Hi all, > > I was benchmarking the fastjson2 serialization library a few weeks back for a > Java pipeline I was working on and was asked by a colleague to benchmark > binary JSON serialization against Rows for fun. We didn't do

Row compatible generated coders for custom classes

2023-12-01 Thread Steven van Rossum via dev
Hi all, I was benchmarking the fastjson2 serialization library a few weeks back for a Java pipeline I was working on and was asked by a colleague to benchmark binary JSON serialization against Rows for fun. We didn't do any extensive analysis across different shapes and sizes, but the finding on t