RE: Issue with column named "count" in a DataFrame

2015-07-23 Thread Young, Matthew T
015 4:26 PM To: Young, Matthew T Cc: user@spark.apache.org Subject: Re: Issue with column named "count" in a DataFrame Additionally have you tried enclosing count in `backticks`? On Wed, Jul 22, 2015 at 4:25 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: I believe

Re: Issue with column named "count" in a DataFrame

2015-07-22 Thread Michael Armbrust
Additionally have you tried enclosing count in `backticks`? On Wed, Jul 22, 2015 at 4:25 PM, Michael Armbrust wrote: > I believe this will be fixed in Spark 1.5 > > https://github.com/apache/spark/pull/7237 > > On Wed, Jul 22, 2015 at 3:04 PM, Young, Matthew T < > matthew.t.yo...@intel.com> wrot

Re: Issue with column named "count" in a DataFrame

2015-07-22 Thread Michael Armbrust
I believe this will be fixed in Spark 1.5 https://github.com/apache/spark/pull/7237 On Wed, Jul 22, 2015 at 3:04 PM, Young, Matthew T wrote: > I'm trying to do some simple counting and aggregation in an IPython > notebook with Spark 1.4.0 and I have encountered behavior that looks like a > bug.

Issue with column named "count" in a DataFrame

2015-07-22 Thread Young, Matthew T
I'm trying to do some simple counting and aggregation in an IPython notebook with Spark 1.4.0 and I have encountered behavior that looks like a bug. When I try to filter rows out of an RDD with a column name of count I get a large error message. I would just avoid naming things count, except for