[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799738#comment-15799738 ] ASF subversion and git services commented on ASTERIXDB-1556: Commit

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672016#comment-15672016 ] Taewoo Kim commented on ASTERIXDB-1556: --- Discussion with [~dtabass] and [~che...@gmail.com]:

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649420#comment-15649420 ] Michael J. Carey commented on ASTERIXDB-1556: - Makes sense! > Hash Table used by

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648730#comment-15648730 ] Taewoo Kim commented on ASTERIXDB-1556: --- Talked this with [~che...@gmail.com]. Let me think how

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648355#comment-15648355 ] Taewoo Kim commented on ASTERIXDB-1556: --- I think pre-reserving the space for every tuple that

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646596#comment-15646596 ] Michael J. Carey commented on ASTERIXDB-1556: - Can we pre-reserve the space before doing

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645756#comment-15645756 ] Taewoo Kim commented on ASTERIXDB-1556: --- I'm now working on this idea: Let the D and H share the

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626898#comment-15626898 ] Taewoo Kim commented on ASTERIXDB-1556: --- Talked with [~buyingyi]: two options - 1) split M into

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626626#comment-15626626 ] Taewoo Kim commented on ASTERIXDB-1556: --- Talked with [~che...@gmail.com]: since Hash Table and

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624517#comment-15624517 ] Taewoo Kim commented on ASTERIXDB-1556: --- Yes. Sporadic test failure happens on the new code

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624437#comment-15624437 ] Chen Li commented on ASTERIXDB-1556: [~wangsaeu] since our offices are so close, let's talk F2F.

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624406#comment-15624406 ] Jianfeng Jia commented on ASTERIXDB-1556: - While, I think the previous sporadic test failure

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624229#comment-15624229 ] Taewoo Kim commented on ASTERIXDB-1556: --- Currently, this Deallocatable Frame Pool class is being

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624139#comment-15624139 ] Taewoo Kim commented on ASTERIXDB-1556: --- I am collecting the number for Sort-group by now. >

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623144#comment-15623144 ] Chen Li commented on ASTERIXDB-1556: The results look very good to me! > Hash Table used by

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623089#comment-15623089 ] Michael J. Carey commented on ASTERIXDB-1556: - Very cool! Thanks for checking that

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622822#comment-15622822 ] Taewoo Kim commented on ASTERIXDB-1556: --- The performance comparison between the master branch

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499768#comment-15499768 ] Taewoo Kim commented on ASTERIXDB-1556: --- @[~buyingyi]: If we assume that each field consists of

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475150#comment-15475150 ] Yingyi Bu commented on ASTERIXDB-1556: -- Just to add two things here: 1. The following formula is

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475100#comment-15475100 ] Taewoo Kim commented on ASTERIXDB-1556: --- Agreed. > Hash Table used by External hash group-by

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475098#comment-15475098 ] Taewoo Kim commented on ASTERIXDB-1556: --- Agreed. > Hash Table used by External hash group-by

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475096#comment-15475096 ] Taewoo Kim commented on ASTERIXDB-1556: --- Another discussion with [~buyingyi] regarding the hash

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474894#comment-15474894 ] Yingyi Bu commented on ASTERIXDB-1556: -- [~wangsaeu], GC can be done in a simpler way (to me),

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425608#comment-15425608 ] Taewoo Kim commented on ASTERIXDB-1556: --- [~dtabass] suggested an idea for garbage collection and

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422073#comment-15422073 ] Taewoo Kim commented on ASTERIXDB-1556: --- I like that idea. However, for the compatibility

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422056#comment-15422056 ] Chen Li commented on ASTERIXDB-1556: Cool. I mentioned this comment earlier: the name

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421927#comment-15421927 ] Taewoo Kim commented on ASTERIXDB-1556: --- I just uploaded a patch set that solves the priority #1

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420615#comment-15420615 ] Michael J. Carey commented on ASTERIXDB-1556: - :-) > Hash Table used by External hash

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420486#comment-15420486 ] Taewoo Kim commented on ASTERIXDB-1556: --- Agreed. "separate hash table" in the bucket list! >

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420388#comment-15420388 ] Jianfeng Jia commented on ASTERIXDB-1556: - Agreed. It would be the option iff the GC is very

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420386#comment-15420386 ] Jianfeng Jia commented on ASTERIXDB-1556: - Make perfect sense! > Hash Table used by External

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420368#comment-15420368 ] Michael J. Carey commented on ASTERIXDB-1556: - Two final thoughts: If we change the data

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420365#comment-15420365 ] Michael J. Carey commented on ASTERIXDB-1556: - I think we also need to remember that we

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420199#comment-15420199 ] Taewoo Kim commented on ASTERIXDB-1556: --- This is a good idea. But, the problem of generating

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420146#comment-15420146 ] Jianfeng Jia commented on ASTERIXDB-1556: - In the dataflow related algorithm implementations,

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420138#comment-15420138 ] Taewoo Kim commented on ASTERIXDB-1556: --- Regarding garbage collection of Hash Table, [~dtabass]

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417989#comment-15417989 ] Michael J. Carey commented on ASTERIXDB-1556: - +1 to both > Hash Table used by External

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418031#comment-15418031 ] Taewoo Kim commented on ASTERIXDB-1556: --- Actually, we can think of the garbage collection

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418016#comment-15418016 ] Michael J. Carey commented on ASTERIXDB-1556: - Semi-agreed - but - if this is a

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418007#comment-15418007 ] Taewoo Kim commented on ASTERIXDB-1556: --- I see. We can keep the current scheme (just setting the

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416284#comment-15416284 ] Chen Li commented on ASTERIXDB-1556: I had a discussion with [~dtabass] and [~wangsaeu] about the

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415637#comment-15415637 ] Michael J. Carey commented on ASTERIXDB-1556: - The details on the hash table cleanup

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415632#comment-15415632 ] Taewoo Kim commented on ASTERIXDB-1556: --- Sure. We can have a F2F discussion. The reasoning

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414598#comment-15414598 ] Taewoo Kim commented on ASTERIXDB-1556: --- The summary of a Skype call with [~dtabass], [~tillw],

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412348#comment-15412348 ] Taewoo Kim commented on ASTERIXDB-1556: --- The purpose of (4) is trying to prevent Hash Table

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412267#comment-15412267 ] Michael J. Carey commented on ASTERIXDB-1556: - I think it will be hard to get me to agree

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412262#comment-15412262 ] Chen Li commented on ASTERIXDB-1556: [~wangsaeu]: let's first make sure [~dtabass] agree with

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412200#comment-15412200 ] Taewoo Kim commented on ASTERIXDB-1556: --- One more thing regarding the hash table size (the

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411167#comment-15411167 ] Chen Li commented on ASTERIXDB-1556: [~wangsaeu] Thanks. Can you be more specific about what

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411087#comment-15411087 ] Taewoo Kim commented on ASTERIXDB-1556: --- The structure of SpillableTale used in external hash

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

[ https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410520#comment-15410520 ] Michael J. Carey commented on ASTERIXDB-1556: - Thanks! It's really all just data +