That's invalid syntax. I'm pretty sure pyspark is using a DSL to create a query here and not actually doing an equality operation.
On Mon, Jun 22, 2015 at 3:43 PM Ignacio Blasco <elnopin...@gmail.com> wrote: > Probably you should use === instead of == and !== instead of != > Can anyone explain why the dataframe API doesn't work as I expect it to > here? It seems like the column identifiers are getting confused. > > https://gist.github.com/dokipen/4b324a7365ae87b7b0e5 >
