How to see Cassandra List / Set / Map values from Spark Hive Thrift JDBC?

2016-02-08 Thread Matthew Johnson
Hi all, I have asked this question here on StackOverflow: http://stackoverflow.com/questions/35222365/spark-sql-hivethriftserver2-get-liststring-from-cassandra-in-squirrelsql But hoping I get more luck from this group. When I write a Java SparkSQL application to query a

Re: Problem to persist Hibernate entity from Spark job

2015-09-06 Thread Matthew Johnson
I agree with Igor - I would either make sure session is ThreadLocal or, more simply, why not create the session at the start of the saveInBatch method and close it at the end? Creating a SessionFactory is an expensive operation but creating a Session is a relatively cheap one. On 6 Sep 2015 07:27,

RE: Code review - Spark SQL command-line client for Cassandra

2015-06-23 Thread Matthew Johnson
...@gmail.com] *Sent:* 22 June 2015 18:53 *To:* Matthew Johnson *Cc:* Silvio Fiorito; Mohammed Guller; shahid ashraf; user *Subject:* Re: Code review - Spark SQL command-line client for Cassandra Hi Matthew, you could add the dependencies yourself by using the %dep command in zeppelin ( https

RE: Code review - Spark SQL command-line client for Cassandra

2015-06-22 Thread Matthew Johnson
:* Mohammed Guller; Matthew Johnson; shahid ashraf; user@spark.apache.org *Subject:* Re: Code review - Spark SQL command-line client for Cassandra Hi, Zeppelin has a cassandra-spark-connector built into the build. I have not tried it yet may be you could let us know. https://github.com/apache

RE: Help optimising Spark SQL query

2015-06-22 Thread Matthew Johnson
Hi James, What version of Spark are you using? In Spark 1.2.2 I had an issue where Spark would report a job as complete but I couldn’t find my results anywhere – I just assumed it was me doing something wrong as I am still quite new to Spark. However, since upgrading to 1.4.0 I have not seen

RE: Code review - Spark SQL command-line client for Cassandra

2015-06-22 Thread Matthew Johnson
Guller [mailto:moham...@glassbeam.com] *Sent:* 20 June 2015 17:27 *To:* shahid ashraf *Cc:* Matthew Johnson; user@spark.apache.org *Subject:* RE: Code review - Spark SQL command-line client for Cassandra It is a simple Play-based web application. It exposes an URI for submitting a SQL query

Code review - Spark SQL command-line client for Cassandra

2015-06-19 Thread Matthew Johnson
Hi all, I have been struggling with Cassandra’s lack of adhoc query support (I know this is an anti-pattern of Cassandra, but sometimes management come over and ask me to run stuff and it’s impossible to explain that it will take me a while when it would take about 10 seconds in MySQL) so I

Spark on Cassandra

2015-04-29 Thread Matthew Johnson
Hi all, I am new to Spark, but excited to use it with our Cassandra cluster. I have read in a few places that Spark can interact directly with Cassandra now, so I decided to download it and have a play – I am happy to run it in standalone cluster mode initially. When I go to download it (