Re: EVF Question: FULL BATCH?

2019-09-24 Thread Paul Rogers
Hi Charles, Looks like I forgot the extra newlines needed to make my e-mail provider work with Apache's mailer. Let me try again. In the "classic" readers, each reader picks some number of rows per batch, often 1K, 4K, 4000, etc. The idea is that, on average, this row count will give us a dece

Re: EVF Question: FULL BATCH?

2019-09-24 Thread Paul Rogers
So the usual pattern is: while (! rowWriter.isFull()) {  // Load the row  rowWriter.save();} Is it the case that PCAP is trying to force the row count to, say 4K or 8K or whatever? If so, ignore that count. The error is telling you that at least one vector has reached 16 MB in size (or you've rea

EVF Question: FULL BATCH?

2019-09-23 Thread Charles Givre
Ok... so I have yet another question relating to the EVF. I'm working on a project to improve (hopefully) the PCAP plugin with the ultimate goal being to include parsed PCAP packet data. In any event, I've run into a snag. In one unit test, I'm getting the error below when I call rowWriter.sa