[jira] [Commented] (HIVE-3072) Hive List Bucketing - DDL support
[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13292987#comment-13292987 ] Gang Tim Liu commented on HIVE-3072: We rethink release approach. We can deliver DDL and DML as separate patches or a single patch. Either has pros and cons. not perfect. Separate patch approach can make release more manageable. A single patch makes release make more sense because with DDL but no DML you can't experience list bucketing. We have to pick up one. We choose a single patch approach. It reduces overhead of multiple-patch release, gives community more time to review proposal and reserves room for us to adjust according to proposal review. I will call proposal review again today. Hive List Bucketing - DDL support - Key: HIVE-3072 URL: https://issues.apache.org/jira/browse/HIVE-3072 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. It's for both single skewed column and multiple columns. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3072) Hive List Bucketing - DDL support
[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13293082#comment-13293082 ] Gang Tim Liu commented on HIVE-3072: Yes, we are heading to a single patch approach. Yes, this feature requires metastore change. Hive List Bucketing - DDL support - Key: HIVE-3072 URL: https://issues.apache.org/jira/browse/HIVE-3072 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. It's for both single skewed column and multiple columns. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3073) Hive List Bucketing - DML support (single column/manual load)
[ https://issues.apache.org/jira/browse/HIVE-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13287757#comment-13287757 ] Gang Tim Liu commented on HIVE-3073: Hi Carl, yes, i have sent out email to dev@. thank you very much for your reminder. thanks Tim Hive List Bucketing - DML support (single column/manual load) - Key: HIVE-3073 URL: https://issues.apache.org/jira/browse/HIVE-3073 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DML change for the feature: 1. single skewed column 2. manual load data -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-3072) Hive List Bucketing - DDL support
Gang Tim Liu created HIVE-3072: -- Summary: Hive List Bucketing - DDL support Key: HIVE-3072 URL: https://issues.apache.org/jira/browse/HIVE-3072 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3072) Hive List Bucketing - DDL support (single column)
[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3072: --- Description: If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. It's for single skewed column. was: If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. Summary: Hive List Bucketing - DDL support (single column) (was: Hive List Bucketing - DDL support) Hive List Bucketing - DDL support (single column) - Key: HIVE-3072 URL: https://issues.apache.org/jira/browse/HIVE-3072 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DDL change for the feature. It's for single skewed column. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-3073) Hive List Bucketing - DML support (single column/manual load)
Gang Tim Liu created HIVE-3073: -- Summary: Hive List Bucketing - DML support (single column/manual load) Key: HIVE-3073 URL: https://issues.apache.org/jira/browse/HIVE-3073 Project: Hive Issue Type: New Feature Components: SQL Reporter: Gang Tim Liu Assignee: Gang Tim Liu If a hive table column has skewed keys, query performance on non-skewed key is always impacted. Hive List Bucketing feature will address it: https://cwiki.apache.org/Hive/listbucketing.html This jira issue will track DML change for the feature: 1. single skewed column 2. manual load data -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13270662#comment-13270662
]
Gang Tim Liu commented on HIVE-2971:
Kevin, thank you. You lead me through the whole process. You are my hero last
week :) thanks again Gang
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Assignee: Gang Tim Liu
Priority: Minor
Attachments: Hive-2971-patch
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3003: --- Attachment: Hive-3003.png ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor Attachments: Hive-3003.png ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3003 started by Gang Tim Liu. ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor Attachments: Hive-3003.png ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13270730#comment-13270730 ] Gang Tim Liu commented on HIVE-3003: I update wiki https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup about it. Please look at attachment about change. thanks ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor Attachments: Hive-3003.png ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu resolved HIVE-3003. Resolution: Fixed Release Note: wiki has been updated. resolve the issue. ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor Attachments: Hive-3003.png ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13270740#comment-13270740 ] Gang Tim Liu commented on HIVE-3003: @Carl, I forgot to thank you again :) sorry. It works and I can update wiki. thanks again Tim ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor Attachments: Hive-3003.png ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gang Tim Liu updated HIVE-2971:
---
Attachment: Hive-2971-patch
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Assignee: Gang Tim Liu
Priority: Minor
Attachments: Hive-2971-patch
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13269010#comment-13269010 ] Gang Tim Liu commented on HIVE-3003: @Carl thanks a lot will let you know how it goes thanks again Tim Sent from my iPhone ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gang Tim Liu updated HIVE-2971:
---
Status: Patch Available (was: Open)
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Assignee: Gang Tim Liu
Priority: Minor
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268189#comment-13268189
]
Gang Tim Liu commented on HIVE-2971:
Patch is ready for review:
https://reviews.facebook.net/D3033
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Assignee: Gang Tim Liu
Priority: Minor
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-3003) ant gen-test fails in ./ql
Gang Tim Liu created HIVE-3003: -- Summary: ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Tests Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268545#comment-13268545 ] Gang Tim Liu commented on HIVE-3003: Root-cause == ant-contrib is not configured in ql/build.xml Solution Add it to it. Reference is here http://ant-contrib.sourceforge.net/ ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Tests Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268556#comment-13268556 ] Gang Tim Liu commented on HIVE-3003: Yes, please so that I can update it today. ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268560#comment-13268560 ] Gang Tim Liu commented on HIVE-3003: Hi Carl, I forgot to say thanks in previous comment. I am sorry. thank you for providing me information. thank you for quick reply. thanks again Tim ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3003) ant gen-test fails in ./ql
[ https://issues.apache.org/jira/browse/HIVE-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268576#comment-13268576 ] Gang Tim Liu commented on HIVE-3003: @Carl, thanks a lot. My wiki userid: gangtimliu . Thanks again ant gen-test fails in ./ql Key: HIVE-3003 URL: https://issues.apache.org/jira/browse/HIVE-3003 Project: Hive Issue Type: Bug Components: Documentation Reporter: Gang Tim Liu Assignee: Gang Tim Liu Priority: Minor ant gen-test fails in hive-root/ql. Expected behavior = BUILD SUCCESSFUL Actual behavior BUILD FAILED ./hive/ql/build.xml:85: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. How to reproduce it === 1. git clone git://github.com/facebook/arcanist.git 2. ant clean package eclipse-files 3. cd metastore/ 4. ant model-jar 5. cd ../ql 6. ant gen-test Details in https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13265938#comment-13265938
]
Gang Tim Liu commented on HIVE-2971:
Yes, removing space like the following works fine:
SELECT GET_JSON_OBJECT({\FormName\: 12345}, $.FormName) FROM
akramer_one_row;
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Priority: Minor
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2971) GET_JSON_OBJECT fails on some valid JSON keys
[
https://issues.apache.org/jira/browse/HIVE-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gang Tim Liu reassigned HIVE-2971:
--
Assignee: Gang Tim Liu
GET_JSON_OBJECT fails on some valid JSON keys
-
Key: HIVE-2971
URL: https://issues.apache.org/jira/browse/HIVE-2971
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Adam Kramer
Assignee: Gang Tim Liu
Priority: Minor
hive SELECT GET_JSON_OBJECT({\Form Name\: 12345}, $.Form\ Name) FROM
akramer_one_row;
Mapred Local Task Succeeded . Convert the Join into MapJoin
OK
NULL
...this also returns null for $.Form Name and $.Form\\ Name. It should
return the relevant key.
Removing the space works fine, however, spaces are allowed as JSON keys (see
spec at http://www.json.org/ ). As such, this is a bug.
Claiming that this is org.json's problem, or something similar, does not
solve this bug. It's Hive that claims this gets a JSON object, so it needs to
provide the JSON object.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [U-Boot] board/Marvell/DB64360
Hi,
I am new to the list, any info. Or help is appreciated!
I went through C code of Ethernet initialization of U-boot(version
u-boot-2010_09.tar.gz ) in the board of db64360 under the board name
Marvell and found that there maybe is an obvious coding error in the
function void mv64360_eth_initialize(bd_t *bis) located in mv_eth.c. The
line is underscored.
The line should be: port_private = calloc (sizeof (struct
mv64360_eth_priv), 1), because it make next line pointless:
ethernet_private-port_private = (void *)port_private;
ethernet_private-port_private should point to mv64360_eth_priv, but
actually point to (*ethernet_private)ETH_PORT_INFO in the code.
Thanks
Tim Liu
Code snippet from mv64360_eth_initialize:
ethernet_private = calloc (sizeof (*ethernet_private), 1);
dev-priv = (void *) ethernet_private;
if (!ethernet_private) {
printf (%s: %s allocation failure, %s\n,
__FUNCTION__, dev-name,
Private Device Structure);
free (dev);
return;
}
/* start with an zeroed ETH_PORT_INFO */
memset (ethernet_private, 0, sizeof (ETH_PORT_INFO));
memcpy (ethernet_private-port_mac_addr, dev-enetaddr, 6);
/* set pointer to memory for stats data structure etc... */
port_private = calloc (sizeof (*ethernet_private), 1);
//should be sizeof (struct mv64360_eth_priv)
ethernet_private-port_private = (void *)port_private;
if (!port_private) {
printf (%s: %s allocation failure, %s\n,
__FUNCTION__, dev-name,
Port Private Device Structure);
free (ethernet_private);
free (dev);
return;
}
port_private-stats =
calloc (sizeof (struct net_device_stats), 1);
if (!port_private-stats) {
printf (%s: %s allocation failure, %s\n,
__FUNCTION__, dev-name,
Net stat Structure);
free (port_private);
free (ethernet_private);
free (dev);
return;
}
memset (ethernet_private-port_private, 0,
sizeof (struct mv64360_eth_priv));
___
U-Boot mailing list
U-Boot@lists.denx.de
http://lists.denx.de/mailman/listinfo/u-boot
Re: Building mahout
Since mvn 3.0 is NOT fully tested yet, may we update it on documentation https://cwiki.apache.org/confluence/display/MAHOUT/BuildingMahout? Here is what there now: - Maven *2.0.9* or higher (http://maven.apache.org/) On Fri, Oct 15, 2010 at 11:12 AM, Drew Farris drew.far...@gmail.com wrote: -user +dev I haven't tried mvn 3.0 yet, is it something we want to support in 0.4? On Oct 15, 2010 10:20 AM, Jeff Eastman j...@windwardsolutions.com wrote: I'm also seeing these warnings with Maven 3.0 with the latest trunk, also some missing 'reporting.plugins.version' for maven-surfire-report-plugin, maven-checkstyle-plugin, maven-javadoc-plugin, maven-pmd-plugin; finally 'repositories.repository.layout' for java.net.legacy uses unsupported value 'legacy', artifact resolution might fail. @org.apache.mahout:mahout:-.4-SNAPSHOT. /home/dev/workspace/mahout/pom.xml, line 127, column 21. Again, Tim's patch fixed the compile error. On 10/15/10 12:38 AM, deneche abdelhakim wrote: I was using maven 2.2.1 and the build was successful (I had other issues though). But when I installed maven 3.0 I got a lot of warnings like this one: Some problems were encountered while building the effective model for org.apache.mahout:mahout-math:jar:0.4-SNAPSHOT [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-remote-resources-plugin @ org.apache.mahout:mahout:0.4-SNAPSHOT, /home/hakim/mahout-last/pom.xml, line 405, column 21 and the build failed with the following error: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.0:process (default) on project mahout: Error loading supplemental data models: Could not find resource 'supplemental-models.xml'. Making the change suggested by Tim fixes the problem of the build, although I'm still getting the warnings. --- En date de : Jeu 14.10.10, Tim Liutim.gang...@gmail.com a écrit : De: Tim Liutim.gang...@gmail.com Objet: Re: Building mahout Ą: u...@mahout.apache.org Date: Jeudi 14 octobre 2010, 21h10 The problem is gone after I modify top level's pom.xml (Line # 396) to have right path for the file supplemental-models.xml. I am wondering how it works w/o modification. new === appendedResourcesDirectory*.* /src/main/appended-resources/appendedResourcesDirectory old == appendedResourcesDirectory*..* /src/main/appended-resources/appendedResourcesDirectory thanks Tim On Thu, Oct 14, 2010 at 7:01 AM, Jeff Eastman j...@windwardsolutions.com wrote: I just did a clean checkout on my Mac and it built without issue. I'm going to look for a file system permission issue on the other box where building from the command line fails with the same symptoms as reported in this issue. On 10/13/10 9:45 PM, Chris Schilling wrote: Yeah, I see the same thing (eclipse helios, m2eclipse plugin). Ive been building from the command line and importing the maven project into eclipse. On Oct 13, 2010, at 8:38 PM, gabeweb wrote: If it helps, I get this problem with the trunk when building from within Eclipse 1.5 using the m2 plugin on OS X 10.6, but not when building from the command line. So I'm currently just building from the command line :) -- View this message in context: http://lucene.472066.n3.nabble.com/Building-mahout-tp1697626p1698594.html Sent from the Mahout User List mailing list archive at Nabble.com.
Re: Building mahout
where do you add? thanks On Fri, Oct 15, 2010 at 12:27 PM, Grant Ingersoll gsing...@apache.orgwrote: +1 On Oct 15, 2010, at 3:05 PM, Sean Owen wrote: At this point I think we should just say note there may be issues with 3.0 in the wiki and not worry about it in the next few days for 0.4. On Fri, Oct 15, 2010 at 8:02 PM, Tim Liu tim.gang...@gmail.com wrote: Since mvn 3.0 is NOT fully tested yet, may we update it on documentation https://cwiki.apache.org/confluence/display/MAHOUT/BuildingMahout? Here is what there now: - Maven *2.0.9* or higher (http://maven.apache.org/)
[android-developers] Multiple OpenGL Activities
Hi, I'm having a problem when I create a Sub-Activity to my main activity. Both activities have their own GLSurfaceViews. Nothing on Logcat. Basically It just opens up the new view and it's black and it never renders with the new opengl stuff. I've tried a bunch of stuff, just want to know if there's some special way I need to pause the first opengl activity to get the second to run, or if there's some toggle which I am missing, or if it just can't be done. When I open the second activity with a GLSurface View, the first activity stops drawing frames, but the second one, never initializes or starts to draw. Main Activity Creation: GLSurfaceView view = new GLSurfaceView(this); OpenGLRenderer renderer = new OpenGLRenderer(this); view.setRenderer(renderer); view.setOnTouchListener(renderer.tListener); setContentView(view); Sub Activity Invokation inside of OpenGLRenderer: intent = new Intent(); intent.setClass(context, PickAPlayerActivity.class); context.startActivity(intent); Sub Activity Creation: setContentView(R.layout.pickaplayerview); GLSurfaceView view = (GLSurfaceView) findViewById(R.id.jerseys); CoverFlowRenderer cover = new CoverFlowRenderer(this); view.setRenderer(cover); view.setOnTouchListener(cover.tListener); -- You received this message because you are subscribed to the Google Groups Android Developers group. To post to this group, send email to android-developers@googlegroups.com To unsubscribe from this group, send email to android-developers+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/android-developers?hl=en
[R] how to adding colors to data points in scatter plot in R?
Does anybody know how to adding colors to data points in scatter plot in R? I have the following R data frame - Voter_Name, Education_years, Income, Registered Ricky, 18, 4, Y Lisa, 20, 34000, N Jon, 10, 35000, Y ... I am doing a scatter plot in R for those data points - Income vs. EducationYears. I would also like to using different colors to differentiate whether that data point is a Registered Voter or not. Does anybody know how to adding colors to data points in scatter plot in R? Thanks in advance!! -- View this message in context: http://www.nabble.com/how-to-adding-colors-to-data-points-in-scatter-plot-in-R--tp23681471p23681471.html Sent from the R help mailing list archive at Nabble.com. __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
[R] How to do Naive Bayes in R?
I am wondering if anybody here have a simple example in R for Naive Bayes. For example, I can do k-means clustering on the iris data - data(iris) cl - kmeans(iris[,1:4], 3) cl$cluster cbind(1:150,iris$Species) === But how to do Naive Bayes classification in the same iris data? Many thanks! -- View this message in context: http://www.nabble.com/How-to-do-Naive-Bayes-in-R--tp23413794p23413794.html Sent from the R help mailing list archive at Nabble.com. __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
[R] Stochastic Gradient Ascent for logistic regression
Hi. guys,
I am trying to write my own Stochastic Gradient Ascent for logistic
regression in R. But it seems that I am having convergence problem.
Am I doing anything wrong, or just the data is off?
Here is my code in R -
lbw -
read.table(http://www.biostat.jhsph.edu/~ririzarr/Teaching/754/lbw.dat;
, header=TRUE)
attach(lbw)
lbw[1:2,]
low age lwt race smoke ptl ht ui ftv bwt
1 0 19 182 2 0 0 0 1 0 2523
2 0 33 155 3 0 0 0 0 3 2551
#-R implementation of logistic regression : gradient descent --
sigmoid-function(z)
{
1/(1 + exp(-1*z))
}
X-cbind(age,lwt, smoke, ht, ui)
#y-low
my_logistic-function(X,y)
{
alpha - 0.005
n-5
m-189
max_iters - 189 #number of obs
ll-0
X-cbind(1,X)
theta -rep(0,6) # intercept and 5 regerssors
#theta - c(1.39, -0.034, -0.01, 0.64, 1.89, 0.88) #glm estimates as
starting values
theta_all-theta
for (i in 1:max_iters)
{
dim(X)
length(theta)
hx - sigmoid(X %*% theta) # matrix
product
ix-i
for (j in 1:6)
{
theta[j] - theta[j] + alpha * ((y-hx)[ix]) * X[ix,j]
#stochastic gradient !
}
logl - sum( y * log(hx) + (1 - y) * log(1 - hx) ) #direct
multiplication
ll-rbind(ll, logl)
theta_all = cbind(theta_all,theta)
}
par(mfrow=c(4,2))
plot(na.omit(ll[,1]))
lines(ll[,1])
for (j in 1:6)
{
plot(theta_all[j,])
lines(theta_all[j,])
}
#theta_all
#ll
cbind(ll,t(theta_all))
}
my_logistic(X,low)
==
parameter estimates values jumped after 130+ iterations...
not converging even when I use parameter estimates as starting values
from glm (family=binomial)
help!
--
View this message in context:
http://www.nabble.com/Stochastic-Gradient-Ascent-for-logistic-regression-tp23239378p23239378.html
Sent from the R help mailing list archive at Nabble.com.
__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.
[EMAIL PROTECTED] Apache 2.0.59 Binary with /htdocs for red hat ent lnx 4
Folks,Can somebody share the link for Apache 2.0.59 Binary with /htdocs for red hat ent lnx 4? The link in the following doesn't have documents and apache can't start. thx a lot http://mirrors.isc.org/pub/apache/httpd/binaries/rpm/i386/thx Tim
[EMAIL PROTECTED] No htdocs directory in http://mirrors.isc.org/pub/apache/httpd/binaries/rpm/i386/httpd-2.0.59-1.i386.rpm
Folks,After installing Apache 2.0.59 in red hat ent lnx 4.0, i don't find htdocs directory which causes apache fail to start. Default vaule for DocumentRoot in httpd.conf is /var/www/htdocsI am using this binary distribution: http://mirrors.isc.org/pub/apache/httpd/binaries/rpm/i386/httpd-2.0.59-1.i386.rpmWhat else should i download to add document? Appreciate itTim
[EMAIL PROTECTED] config apache account
Folks,am newie to apache linux . google and read apache docu but don't find answer. thx in advance.What is apache account? After apache installation, i find the following account:[] id apache uid=48(apache) gid=48(apache) groups=1704(labtools),48(apache)Should i use it to lauch apache server? or use root account?thxTim
[EMAIL PROTECTED] mod_auth_ldap configuration
Folks,After configuring mod_auth_ldap in Apache 2.0.59, it fails to start in my windows 2000 SP4 with the following System Event Log (There is no Appication Event Log):The Apache2 service terminated with service-specific error 1. If I comment out the following line in conf\httpd.conf, Apache can start correctly:LoadModule auth_ldap_module modules/mod_auth_ldap.somodules/mod_auth_ldap.so exists in directory.Any ideas for the error? Thx Tim
RE: [rtl] about scheduling algorithm ?
thanks for reply , i want some papers that describe the EDF and RM where to find it ? -tim Hi, Tim. I'm not sure what you want to know? Do you want information about the EDF and RM scheduling algorithms or do want to have information about the edf-scheduler, implemented by Ismael Ripoll for version 1.0 of RTLinux, and the rm-scheduler, implemented by Oleg Subbotin also for veriosn 1.0? / Daniel Joachim PS. We have made ports of the above mentioned schedulers for version 3, which will be finished any day now DS. On Fri, 19 May 2000, [BIG5] N-Liu/Tim (? ? INC) wrote: Hi all . i want to get some information about the scheduling algorithm about EDF or RM . is there some guy can help me ? thanks in advance . tim -- [rtl] --- To unsubscribe: echo "unsubscribe rtl" | mail [EMAIL PROTECTED] OR echo "unsubscribe rtl Your_email" | mail [EMAIL PROTECTED] --- For more information on Real-Time Linux see: http://www.rtlinux.org/rtlinux/ -- Real-Time Linux Thesis Work - [EMAIL PROTECTED] http://www.vmlinux.org/rtl/ -- [rtl] --- To unsubscribe: echo "unsubscribe rtl" | mail [EMAIL PROTECTED] OR echo "unsubscribe rtl Your_email" | mail [EMAIL PROTECTED] --- For more information on Real-Time Linux see: http://www.rtlinux.org/rtlinux/
