Re: Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-29 Thread Daniel Darabos
d. You >>> should also check the data from "take(10)" to rule out any issues with >>> printing. You could try the same "groupBy" trick after "take(10)". Or you >>> could print the lengths of the strings. >>> >>> Good luck! >>

Re: Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-28 Thread Jonathan Kelly
ues with >> printing. You could try the same "groupBy" trick after "take(10)". Or you >> could print the lengths of the strings. >> >> Good luck! >> >> On Tue, Jan 26, 2016 at 3:53 AM, awzurn <awz...@gmail.com> wrote: >> >>&

Re: Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-28 Thread Andrew Zurn
gs. > > Good luck! > > On Tue, Jan 26, 2016 at 3:53 AM, awzurn <awz...@gmail.com> wrote: > >> Sorry for the bump, but wondering if anyone else has seen this before. >> We're >> hoping to either resolve this soon, or move on with further steps to move >> this in

Re: Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-26 Thread Daniel Darabos
, Jan 26, 2016 at 3:53 AM, awzurn <awz...@gmail.com> wrote: > Sorry for the bump, but wondering if anyone else has seen this before. > We're > hoping to either resolve this soon, or move on with further steps to move > this into an issue. > > Thanks in advance, > > And

Re: Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-25 Thread awzurn
/Dataframe-Spark-SQL-Drops-First-8-Characters-of-String-on-Amazon-EMR-tp26022p26065.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

Dataframe, Spark SQL - Drops First 8 Characters of String on Amazon EMR

2016-01-20 Thread awzurn
e spark.serializerorg.apache.spark.serializer.KryoSerializer spark.executor.memory 34G -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Dataframe-Spark-SQL-Drops-First-8-Characters-of-String-on-Amazon-EMR-tp26022.html Sent from the Apache Spark User