Re: Communication between driver, cluster and HiveServer

2015-07-08 Thread Eric Pederson
,sshd,sudo. Thanks, -- Eric On Wed, Jul 8, 2015 at 2:27 PM, Eric Pederson eric...@gmail.com wrote: All: I recently ran into a scenario where spark-shell could communicate with Hive but another application of mine (Spark Notebook) could not. When I tried to get a reference to a table using

Re: Error when connecting to Spark SQL via Hive JDBC driver

2015-07-07 Thread Eric Pederson
Hi Ratio - You need more than just hive-jdbc jar. Here are all of the jars that I found were needed. I got this list from https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients#HiveServer2Clients-RunningtheJDBCSampleCode plus trial and error. [image: Inline image 1] -- Eric On

Re: Subsecond queries possible?

2015-07-01 Thread Eric Pederson
of integrating indexed rdd ideas to spark sql to build indices ? Is there a JIRA tracking it ? On Jun 30, 2015 7:29 PM, Eric Pederson eric...@gmail.com wrote: Hi Debasish: We have the same dataset running on SybaseIQ and after the caches are warm the queries come back in about 300ms. We're looking

Re: Subsecond queries possible?

2015-06-30 Thread Eric Pederson
Hi Debasish: We have the same dataset running on SybaseIQ and after the caches are warm the queries come back in about 300ms. We're looking at options to relieve overutilization and to bring down licensing costs. I realize that Spark may not be the best fit for this use case but I'm interested

Subsecond queries possible?

2015-06-30 Thread Eric Pederson
should read partitioned table... Could you please share your results with partitioned tables ? On Tue, Jun 30, 2015 at 5:24 AM, Eric Pederson eric...@gmail.com wrote: Hi Deb - One other consideration is that the filter will always contain two key columns (product and coupon) but will also