RE: SchemaRDD - Parquet - insertInto makes many files

2014-09-08 Thread chutium
in context: http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-Parquet-insertInto-makes-many-files-tp13480p13740.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

SchemaRDD - Parquet - insertInto makes many files

2014-09-04 Thread DanteSama
.n3.nabble.com/SchemaRDD-Parquet-insertInto-makes-many-files-tp13480.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands

Re: SchemaRDD - Parquet - insertInto makes many files

2014-09-04 Thread DanteSama
Yep, that worked out. Does this solution have any performance implications past all the work being done on (probably) 1 node? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-Parquet-insertInto-makes-many-files-tp13480p13501.html Sent from

Re: SchemaRDD - Parquet - insertInto makes many files

2014-09-04 Thread Michael Armbrust
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-Parquet-insertInto-makes-many-files-tp13480p13501.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe

RE: SchemaRDD - Parquet - insertInto makes many files

2014-09-04 Thread Cheng, Hao
all the work being done on (probably) 1 node? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-Parquet-insertInto-makes-many-files-tp13480p13501.html Sent from the Apache Spark User List mailing list archive at Nabble.com