[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
Github user ramkrish86 commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35471151 Hmmm..Got it in this context. Should have thought of this myself.. Thanks James. --- If your project is set up for it, you can reply to this email and have

Re: [jira] [Updated] (PHOENIX-53) CSV loader fails on empty line

2014-02-18 Thread James Taylor
Thanks for the patch, James. I like the idea - looks like JIRA is down at the moment, so I can't take a look yet. Does the Apache commons-csv library support custom delimiters? Any reason why the scripts can't be adapted to the new library? Thanks, James On Tue, Feb 18, 2014 at 2:47 PM, James Vi

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35470690 We don't have any special cases for comparison of arrays. If we allow an array to be part of the row key (or allow an array to be part of a secondary index

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
Github user ramkrish86 commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35469802 Hmm, makes sense, but what i felt is in case of comparisons of such arrays, wont we specify the offset from where the comparison should happen? Leaving out t

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35469351 It's not the minor perf gain of comparing the header information that I'm talking about. It's the fact that it makes comparing the byte arrays directly impo

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
Github user ramkrish86 commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35469062 Okie, so you mean avoiding the comparison of the first few bytes like version, no of elements can be avoided. --- If your project is set up for it, you can

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854998 You'd have to have the exact length specified which is nearly impossible (especially for variable length). Just do the above and you'll prevent the copy in al

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854967 You do still need to do some of this work, but you do it up front at construction time. You just need to figure out the array element type first. It can be ba

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#issuecomment-35468254 By comparison being easier, I mean you can compare the byte array directly without deserializing it into objects, if the array type matches. The reason is t

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
Github user ramkrish86 commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854849 Okie, so here on the ptr you mean. I foudn that internally if we are able to specify a correct size for the TrustedByteStream then calling toByteArray does n

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
Github user ramkrish86 commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854798 this is where i have a question. Now this serialization format should comply with the one in the ParrayDataType where the normal array serialization occurs and

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854769 This make a copy of the byte array which is bad. Do this instead: ptr.get(byteStream.getBuffer(),0,byteStream.getSize()); --- If your project is

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854745 IOException --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-post your res

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854741 Should only catch IOException, which is impossible for TrustedByteArrayOutputStream --- If your project is set up for it, you can reply to this email and hav

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854730 This is what you want to avoid. Just serialize the bytes into the oStream and then write the offset information afterwards. --- If your project is set up for

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854712 In this loop, you want to keep the offset info for variable length arrays. Allocate a int array of size children.size() to put them in. You'll write them all

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854686 You don't need this copy. Just do oStream.write(ptr.get(), ptr.getOffset(), ptr.getLenth()); --- If your project is set up for it, you can reply to this emai

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854650 Change estimateSize to give a reasonable estimate for variable length types. I believe we have a PDataType.estimateSize() that you can use. --- If your proje

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread JamesRTaylor
Github user JamesRTaylor commented on the pull request: https://github.com/apache/incubator-phoenix/pull/8#discussion_r9854619 You should know already the type of the array and array element, so no need to loop over the children to figure that out in the evaluate. The child type is de

[jira] [Comment Edited] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904877#comment-13904877 ] Russell Jurney edited comment on PHOENIX-56 at 2/19/14 12:41 AM: ---

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904877#comment-13904877 ] Russell Jurney commented on PHOENIX-56: --- James: we ran your class. Here is what it d

[jira] [Commented] (PHOENIX-15) Allow forcing a memstore flush for a table

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904856#comment-13904856 ] James Taylor commented on PHOENIX-15: - Thanks for finding *another* bug. Given that no

[jira] [Updated] (PHOENIX-58) Client jars are missing phoenix code

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates updated PHOENIX-58: --- Attachment: phoenix-58-v0.patch client-without-hbase-jar.txt client-mi

[jira] [Created] (PHOENIX-58) Client jars are missing phoenix code

2014-02-18 Thread Jesse Yates (JIRA)
Jesse Yates created PHOENIX-58: -- Summary: Client jars are missing phoenix code Key: PHOENIX-58 URL: https://issues.apache.org/jira/browse/PHOENIX-58 Project: Phoenix Issue Type: Bug Affects

[jira] [Updated] (PHOENIX-53) CSV loader fails on empty line

2014-02-18 Thread James Violette (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Violette updated PHOENIX-53: -- Attachment: incubator-phoenix-csv-commons.patch This file incorporates the Apache commons-csv l

[jira] [Commented] (PHOENIX-53) CSV loader fails on empty line

2014-02-18 Thread James Violette (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-53?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904732#comment-13904732 ] James Violette commented on PHOENIX-53: --- We found that the apache commons-csv librar

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904723#comment-13904723 ] Russell Jurney commented on PHOENIX-56: --- James: Where does that class, PhoenixSqllin

[jira] [Updated] (PHOENIX-15) Allow forcing a memstore flush for a table

2014-02-18 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated PHOENIX-15: - Attachment: phoenix-15-v3.txt Updated patch. Note that there was a recent change to how the disab

[jira] [Updated] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PHOENIX-56: -- Attachment: hbase-site.xml hbase-site.xml is attached, its the same for client and server. > P

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904668#comment-13904668 ] Russell Jurney commented on PHOENIX-56: --- Zookeeper runs on the same nodes as HBase,

[jira] [Commented] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-57?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904632#comment-13904632 ] James Taylor commented on PHOENIX-57: - +1. Thanks for the fix, [~jesse_yates] > Clien

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904503#comment-13904503 ] Mujtaba Chohan commented on PHOENIX-56: --- @russell.jurney you said that you are speci

[jira] [Commented] (PHOENIX-38) Data load time with mutable index is 5X slower than Phoenix 2.2.2, 2.2.3

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904491#comment-13904491 ] Jesse Yates commented on PHOENIX-38: awesome, thanks Mujtaba! > Data load time with m

[jira] [Commented] (PHOENIX-38) Data load time with mutable index is 5X slower than Phoenix 2.2.2, 2.2.3

2014-02-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904485#comment-13904485 ] Mujtaba Chohan commented on PHOENIX-38: --- Verified. Immutable index data load perform

[jira] [Commented] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-57?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904479#comment-13904479 ] Jesse Yates commented on PHOENIX-57: [~giacomotaylor] mind taking a look? its a pretty

[jira] [Updated] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates updated PHOENIX-57: --- Attachment: phoenix-57-v0.patch > ClientKeyValue doesn't work in debug mode > ---

[jira] [Assigned] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates reassigned PHOENIX-57: -- Assignee: Jesse Yates > ClientKeyValue doesn't work in debug mode > ---

[jira] [Created] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread Jesse Yates (JIRA)
Jesse Yates created PHOENIX-57: -- Summary: ClientKeyValue doesn't work in debug mode Key: PHOENIX-57 URL: https://issues.apache.org/jira/browse/PHOENIX-57 Project: Phoenix Issue Type: Bug Aff

[jira] [Commented] (PHOENIX-57) ClientKeyValue doesn't work in debug mode

2014-02-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-57?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904476#comment-13904476 ] Jesse Yates commented on PHOENIX-57: Since this only occurs in debugging, we don't nee

[GitHub] incubator-phoenix pull request: Phoenix 37

2014-02-18 Thread ramkrish86
GitHub user ramkrish86 opened a pull request: https://github.com/apache/incubator-phoenix/pull/8 Phoenix 37 First cut pull request. Still not changed the format of serialization of variable length array in ArrayConstructorExpression. Moved the HEader information of the array'

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904380#comment-13904380 ] Mujtaba Chohan commented on PHOENIX-56: --- Sure [~jamestaylor] I'll try to repro as we

[jira] [Commented] (PHOENIX-56) Phoenix/JDBC becomes unresponsive

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904268#comment-13904268 ] James Taylor commented on PHOENIX-56: - [~mujtabachohan] - would you have time to try t

[jira] [Commented] (PHOENIX-37) Prevent deserialize and re-serialize all array elements in construction of array

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904240#comment-13904240 ] James Taylor commented on PHOENIX-37: - Use org.apache.phoenix.util.TrustedByteArrayOut

[jira] [Issue Comment Deleted] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread Eli Levine (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Levine updated PHOENIX-21: -- Comment: was deleted (was: I can envision an SFDC scenario with tenants having thousands of tenant-spe

[jira] [Commented] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread Eli Levine (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904225#comment-13904225 ] Eli Levine commented on PHOENIX-21: --- Looks good. Thanks! > Support indexes on multi-te

[jira] [Commented] (PHOENIX-37) Prevent deserialize and re-serialize all array elements in construction of array

2014-02-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904024#comment-13904024 ] ramkrishna.s.vasudevan commented on PHOENIX-37: --- So for the variable length

[jira] [Commented] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903959#comment-13903959 ] Hudson commented on PHOENIX-21: --- SUCCESS: Integrated in Apache Phoenix - Branch:master #55 (

[jira] [Updated] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor updated PHOENIX-21: Attachment: tenant-specific-index-2.patch > Support indexes on multi-tenant views > ---

[jira] [Updated] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor updated PHOENIX-21: Attachment: (was: 7b.patch) > Support indexes on multi-tenant views > -

[jira] [Commented] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903903#comment-13903903 ] James Taylor commented on PHOENIX-21: - I've made it so that non-tenant specific indexe

[jira] [Updated] (PHOENIX-21) Support indexes on multi-tenant views

2014-02-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor updated PHOENIX-21: Attachment: 7b.patch > Support indexes on multi-tenant views >