[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645921#comment-13645921
]
Hudson commented on AVRO-1282:
--
Integrated in AvroJava #369 (See [https://builds.apache.org/jo
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645320#comment-13645320
]
Leo Romanoff commented on AVRO-1282:
As we discussed in this issue, I created a dedicat
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645224#comment-13645224
]
Doug Cutting commented on AVRO-1282:
+1 Patch looks good, tests pass, 'Perf -reflect' p
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645054#comment-13645054
]
Scott Carey commented on AVRO-1282:
---
I think I simply missed that. I changed it at some
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645051#comment-13645051
]
Doug Cutting commented on AVRO-1282:
Why is the singleton INSTANCE removed from Reflect
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13644920#comment-13644920
]
Scott Carey commented on AVRO-1282:
---
At this point, I believe we are ready for another co
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13644024#comment-13644024
]
Leo Romanoff commented on AVRO-1282:
Scott: I tested with your latest patch and confirm
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13643923#comment-13643923
]
Scott Carey commented on AVRO-1282:
---
Leo: Using a variation of your GenericRecordAccesso
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13643541#comment-13643541
]
Leo Romanoff commented on AVRO-1282:
Scott, this is great! Question: If you index index
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13643421#comment-13643421
]
Scott Carey commented on AVRO-1282:
---
I've got this back to using FieldAccessor[], doing a
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13642616#comment-13642616
]
Scott Carey commented on AVRO-1282:
---
Re: using schema or class as the key:
This still wi
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13642048#comment-13642048
]
Leo Romanoff commented on AVRO-1282:
> We probably should not cache any accessors for G
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641962#comment-13641962
]
Scott Carey commented on AVRO-1282:
---
I'll have a look at your more recent changes for Per
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641814#comment-13641814
]
Leo Romanoff commented on AVRO-1282:
> Perf.java is also not working for at least two r
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641792#comment-13641792
]
Leo Romanoff commented on AVRO-1282:
I meant this code in ReflectDatumReader:
for (lon
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641789#comment-13641789
]
Leo Romanoff commented on AVRO-1282:
> On the bug side, FieldAccessors are no longer ca
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641768#comment-13641768
]
Leo Romanoff commented on AVRO-1282:
I think I fixed the issues with IPC tests. They ar
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641696#comment-13641696
]
Leo Romanoff commented on AVRO-1282:
Scott, your Maven advice has helped! I can reprodu
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641569#comment-13641569
]
Scott Carey commented on AVRO-1282:
---
The below appears to be a bug that assumes every cla
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641568#comment-13641568
]
Scott Carey commented on AVRO-1282:
---
First try with the -U parameter to force it to re-re
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641555#comment-13641555
]
Leo Romanoff commented on AVRO-1282:
Hmm. At the moment we use UnsafeUtil only internal
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641520#comment-13641520
]
Scott Carey commented on AVRO-1282:
---
Perf.java is also not working for at least two reaso
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641473#comment-13641473
]
Scott Carey commented on AVRO-1282:
---
UnsafeUtils is a public class with public static con
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641387#comment-13641387
]
Leo Romanoff commented on AVRO-1282:
I don't know if you noticed it, but there is now a
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641197#comment-13641197
]
Scott Carey commented on AVRO-1282:
---
{code}
static Accessor getAccessor(Object o) {
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641154#comment-13641154
]
Scott Carey commented on AVRO-1282:
---
Lastly, in Java 9 Unsafe will likely be hidden behin
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641150#comment-13641150
]
Scott Carey commented on AVRO-1282:
---
In practice, nearly all JVMs have Unsafe these days
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640791#comment-13640791
]
Doug Cutting commented on AVRO-1282:
I can't find FieldAcessor in this. Are some files
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640712#comment-13640712
]
Leo Romanoff commented on AVRO-1282:
I attached a new patch, see description above.
Th
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640169#comment-13640169
]
Leo Romanoff commented on AVRO-1282:
Interestng. I thought that Systen.arraycopy uses U
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13640081#comment-13640081
]
Scott Carey commented on AVRO-1282:
---
Regarding copying of data into an array on read:
Man
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13639987#comment-13639987
]
Leo Romanoff commented on AVRO-1282:
>How much do those improvements help the Generic t
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13639339#comment-13639339
]
Scott Carey commented on AVRO-1282:
---
Yes, ResolvingDecoder is a bottleneck. I have sever
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638981#comment-13638981
]
Leo Romanoff commented on AVRO-1282:
I did some experiments with Unsafe IO, i.e. I've c
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638920#comment-13638920
]
Leo Romanoff commented on AVRO-1282:
@Scott: Coming back to your message about reading
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638860#comment-13638860
]
Scott Carey commented on AVRO-1282:
---
I agree, it is the same solution -- two instances of
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638830#comment-13638830
]
Leo Romanoff commented on AVRO-1282:
@Scott: I don't think that security manager relate
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638813#comment-13638813
]
Scott Carey commented on AVRO-1282:
---
A related issue is what happens when you run under a
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638792#comment-13638792
]
Leo Romanoff commented on AVRO-1282:
@Scott: Thanks for testing it on IBM's JDK and con
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638548#comment-13638548
]
Scott Carey commented on AVRO-1282:
---
After several runs in a row, the Generic performance
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638527#comment-13638527
]
Scott Carey commented on AVRO-1282:
---
Note, my measurements were with all tests active; re
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638523#comment-13638523
]
Scott Carey commented on AVRO-1282:
---
I am measuring a 2x to 7x performance increase (typi
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638507#comment-13638507
]
Scott Carey commented on AVRO-1282:
---
Newer IBM JDK's seem to have Unsafe support -- so pe
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638471#comment-13638471
]
Scott Carey commented on AVRO-1282:
---
-1
This appears to break some JVMs by assuming that
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638365#comment-13638365
]
Doug Cutting commented on AVRO-1282:
Unless there are objections, I'll commit this to t
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638355#comment-13638355
]
Leo Romanoff commented on AVRO-1282:
@Scott: Kryo was using ASM-based byte code instrum
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638255#comment-13638255
]
Scott Carey commented on AVRO-1282:
---
Other frameworks (e.g. Jackson) avoid field access r
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638232#comment-13638232
]
Scott Carey commented on AVRO-1282:
---
I think changing the binary format for primitives is
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13637508#comment-13637508
]
Leo Romanoff commented on AVRO-1282:
@Doug: Thanks that you confirmed my measurements!
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636985#comment-13636985
]
Doug Cutting commented on AVRO-1282:
There was a '==' in the patch that I had t
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636589#comment-13636589
]
Scott Carey commented on AVRO-1282:
---
I will have a look at this this weekend.
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635644#comment-13635644
]
Leo Romanoff commented on AVRO-1282:
I'll try to fix all stylistic things tomorrow and
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635603#comment-13635603
]
Doug Cutting commented on AVRO-1282:
A few minor issues with the latest patch.
- the n
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635198#comment-13635198
]
Leo Romanoff commented on AVRO-1282:
Doug, I just pulled the latest trunk and applied m
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635158#comment-13635158
]
Doug Cutting commented on AVRO-1282:
Leo, the patch seems to be based off an older vers
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634356#comment-13634356
]
Leo Romanoff commented on AVRO-1282:
@Doug: Sorry, I forgot that git needs "git diff HE
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634205#comment-13634205
]
Doug Cutting commented on AVRO-1282:
This is looking good. I think FieldAccess.java is
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13633920#comment-13633920
]
Leo Romanoff commented on AVRO-1282:
Doug, you are right! I haven't noticed the getReco
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13633048#comment-13633048
]
Doug Cutting commented on AVRO-1282:
I don't think we should add an 'accessor' field to
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612901#comment-13612901
]
Leo Romanoff commented on AVRO-1282:
I implemented the optimization that avoids boxing/
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612586#comment-13612586
]
Leo Romanoff commented on AVRO-1282:
I have implemented an initial version of the Unsaf
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611449#comment-13611449
]
Leo Romanoff commented on AVRO-1282:
> Avro uses little-endian for floats, longs and do
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611333#comment-13611333
]
Doug Cutting commented on AVRO-1282:
I can see adding a native byte order option that's
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611299#comment-13611299
]
Leo Romanoff commented on AVRO-1282:
> I'm hesitant to add native-byte-order serializat
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610988#comment-13610988
]
Doug Cutting commented on AVRO-1282:
I'm hesitant to add native-byte-order serializatio
[
https://issues.apache.org/jira/browse/AVRO-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13610942#comment-13610942
]
Leo Romanoff commented on AVRO-1282:
One thing I'd like to ask is the following:
I've
66 matches
Mail list logo