Github user shearerp commented on the issue:
https://github.com/apache/spark/pull/15567
SPARK-14241 doesn't just occur with union and coalesce, it also occurs with
filter and probably other operations. Hopefully this PR will address all of
those situations. I strongly agree wit
Github user shearerp commented on the pull request:
https://github.com/apache/spark/pull/12528#issuecomment-215706060
@srowen done, sorry for the delay. I tried to do this a couple times before
but couldn't figure out where the docs were. Github search is actively
misleading;
Github user shearerp commented on the pull request:
https://github.com/apache/spark/pull/12528#issuecomment-215699051
@srowen I tried twice to figure out how I change the Spark documentation
and so far I've been unable to figure it out. Could I get a little help?
---
If your pr
Github user shearerp commented on the pull request:
https://github.com/apache/spark/pull/12528#issuecomment-212593947
The problem with IPYTHON and IPYTHON_OPTS is, it's not quite clear how to
get it to work as expected for both users of IPython shell and IPython
notebook. The l
GitHub user shearerp opened a pull request:
https://github.com/apache/spark/pull/12528
[SPARK-13973][PYSPARK] Make pyspark fail noisily if IPYTHON or IPYTHON_OPTS
are set
## What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/SPARK-13973
