[jira] [Commented] (HIVE-80) Add testcases for concurrent query execution
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13249465#comment-13249465 ] Carl Steinbach commented on HIVE-80: HiveServer can't support concurrent connections due to a limitation of the current HiveServer Thrift API. There's a proposal for a new HiveServer2 Thrift API which fixes these problems located here: https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Thrift+API Add testcases for concurrent query execution Key: HIVE-80 URL: https://issues.apache.org/jira/browse/HIVE-80 Project: Hive Issue Type: Test Components: Query Processor, Server Infrastructure Reporter: Raghotham Murthy Assignee: Carl Steinbach Priority: Critical Labels: concurrency Attachments: hive_input_format_race-2.patch Can use one driver object per query. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-80) Add testcases for concurrent query execution
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13062628#comment-13062628 ] Frank LoVecchio commented on HIVE-80: - Edit: I put up some test results for different scenarios, including multiple connections threaded, here: https://github.com/franklovecchio/hiveserver-loadtest . Multi-threaded jobs = wonky. Add testcases for concurrent query execution Key: HIVE-80 URL: https://issues.apache.org/jira/browse/HIVE-80 Project: Hive Issue Type: Test Components: Query Processor, Server Infrastructure Reporter: Raghotham Murthy Assignee: Arvind Prabhakar Priority: Critical Labels: concurrency Attachments: hive_input_format_race-2.patch Can use one driver object per query. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-80) Add testcases for concurrent query execution
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13062631#comment-13062631 ] Alex Kozlov commented on HIVE-80: - I will be out of office July 9-22, 2011. If you have anything urgent, please contact my manager Omer Trajman o...@cloudera.com. -- -- Alex Kozlov Solutions Architect Cloudera, Inc Hadoop World 2011 in New York Cityhttp://www.cloudera.com/company/events/hadoop-world-2011/ http://www.cloudera.com/company/press-center/hadoop-world-nyc/ Add testcases for concurrent query execution Key: HIVE-80 URL: https://issues.apache.org/jira/browse/HIVE-80 Project: Hive Issue Type: Test Components: Query Processor, Server Infrastructure Reporter: Raghotham Murthy Assignee: Arvind Prabhakar Priority: Critical Labels: concurrency Attachments: hive_input_format_race-2.patch Can use one driver object per query. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-80) Add testcases for concurrent query execution
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13057396#comment-13057396 ] Frank LoVecchio commented on HIVE-80: - We have tested multiple client connections submitting jobs rapidly to a single hiveserver (running on a Brisk implementation); I would not recommend doing this unless you have a que of some sort on your end. Otherwise, you will see this: ERROR in runJob org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused Has anyone used multiple hiveservers for managing multiple connections? (something like Amazon's cloud map/reduce, where they spin up a temporary instance?) Thanks Add testcases for concurrent query execution Key: HIVE-80 URL: https://issues.apache.org/jira/browse/HIVE-80 Project: Hive Issue Type: Test Components: Query Processor, Server Infrastructure Reporter: Raghotham Murthy Assignee: Arvind Prabhakar Priority: Critical Labels: concurrency Attachments: hive_input_format_race-2.patch Can use one driver object per query. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-80) Add testcases for concurrent query execution
[ https://issues.apache.org/jira/browse/HIVE-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987607#action_12987607 ] Florin Diaconeasa commented on HIVE-80: --- Hello, I'm thinking about writing a Hive client in order to handle some of the queries that i wish to run and the dependencies between them. From what i read on the Hive wiki ( http://wiki.apache.org/hadoop/Hive/HiveServer ) it appears that the hive server is single threaded. I might be mistaking, but this is what i understand from that text: if i launch 2 requests from my client towards the hive server, the hive server will not handle them in parallel and the hadoop requests done by hive itself will run one after another, not in parallel. Is this right? If (hopefully) not :) , could someone please clarify that for me, if possible? Thank you. Add testcases for concurrent query execution Key: HIVE-80 URL: https://issues.apache.org/jira/browse/HIVE-80 Project: Hive Issue Type: Test Components: Query Processor Reporter: Raghotham Murthy Assignee: Arvind Prabhakar Priority: Critical Attachments: hive_input_format_race-2.patch Can use one driver object per query. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.