Re: [master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists)

Hi Jacek, We will try to create the default database if it does not exist. Hive actually relies on that AlreadyExistsException to determine if a db already exists and ignore the error to implement the logic of "CREATE DATABASE IF NOT EXISTS". So, that message does not mean any bad thing happened.

[master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists)

Hi, I'm working with today's build and am facing the issue: scala> Seq(A(4)).toDS 16/08/16 19:26:26 ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:891)

Re: GraphFrames 0.2.0 released

Hi Tim, AWESOME. Thanks a lot for releasing it. That makes me even more eager to see it in Spark's codebase (and replacing the current RDD-based API)! Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark Follow me at

Re: Welcoming Felix Cheung as a committer

Welcome Felix! On Mon, Aug 15, 2016 at 6:16 AM, mayur bhole wrote: > Congrats Felix! > > On Mon, Aug 15, 2016 at 2:57 PM, Paul Roy wrote: > >> Congrats Felix >> >> Paul Roy. >> >> On Mon, Aug 8, 2016 at 9:15 PM, Matei Zaharia

Re: GraphFrames 0.2.0 released

Hi Tim. Could you share link to the release docs as well? Thanks, Shagun https://twitter.com/shagunsodhani On Tue, Aug 16, 2016 at 10:02 PM, Tim Hunter wrote: > Hello all, > I have released version 0.2.0 of the GraphFrames package. Apart from a few > bug fixes, it is

GraphFrames 0.2.0 released

Hello all, I have released version 0.2.0 of the GraphFrames package. Apart from a few bug fixes, it is the first release published for Spark 2.0 and both scala 2.10 and 2.11. Please let us know if you have any comment or questions. It is available as a Spark package:

Executors go OOM when using JDBC relation provider

Hi, I have been using a standalone spark cluster (v1.4.x) with the following configurations. 2 nodes with 1 core each and 4g memory workers in each node. So I had 2 executors for my app with 2 cores and 8g memory in total. I have a table in a MySQL database which has around 10million rows. It

Re: Structured Streaming with Kafka sources/sinks

We (the team at Databricks) are working on one currently. On Mon, Aug 15, 2016 at 7:26 PM, Cody Koeninger wrote: > https://issues.apache.org/jira/browse/SPARK-15406 > > I'm not working on it (yet?), never got an answer to the question of > who was planning to work on it. >