GitHub user onursatici opened a pull request:
https://github.com/apache/spark/pull/21872
[WIP] merge upstream
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/palantir/spark os/merge-upstream
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21872.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21872
----
commit a4697f7d4d5cbe31934f04c788c58c3fd598e0d5
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T15:08:13Z
v2
commit 48ecf0b688d00cbf57495dec9c338d479d8f55f3
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T15:11:26Z
more changes
commit e7429d45e086fa82f5c214a74255232aedb727da
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T15:18:00Z
Propagate hadoop exclusions to additional hadoop deps
commit adeb886d94c0a018382f49340962500c1d3498c2
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T16:21:17Z
R tests
commit 50e7e92cb29fd914d32b002dc96303360427aff4
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T16:25:56Z
nesting
commit 2d3ef4a5199b401697d415520cf8aa9cd4a65862
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T16:28:05Z
Undo mistake
commit 62deec487f2c48680eb86148abc5d818da696a26
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T17:04:47Z
maybe
commit 9a4cf19c0070ce7d9bf7dfbde7f6646bb0fe2f1a
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T17:38:49Z
Try to add better logging for test_conda
commit 1b7a75835d3abcd7ba55504b56e269a3f061969a
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T17:39:39Z
Comment out saving the build-sbt-* cache
commit a10bdff90cae0fc593d9275dca6193b22e3a2c51
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T18:06:59Z
move r tests reporting
commit 0ece2d6dfa4a21c2bc05de5b545ba52d5193234a
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T18:19:32Z
Remove old cache restore
commit 570e0e6536fd34a22059e4758ef38144f12d3413
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T19:31:40Z
Limit python parallelism in an attempt to reduce flakes
commit 020adda18d642d27b3dd43b25260fb37ff6d4692
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T20:24:04Z
Make run_python_tests verbose so circle doesn't time it out
commit e970d355f66bbe6df3da45213ddf06b797364d30
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T21:25:38Z
Use circleci machinery to split test classes by timings
commit 87d3173a13c57d0f99bb1710c97e78db224e2ca2
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T22:00:53Z
Install unishark into python image
commit 7eaafedb755740d9019eda20f6796c203b84e6c7
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T22:01:06Z
Run python tests using unishark
commit ae3f14e11d7de4095174f09401e222659cf9e0ef
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-12T22:08:45Z
don't expect every project to have an entry in circleTestsForProject
commit 6e5b03c79a710159e883bcfcff42bad4cdd125b2
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T12:03:45Z
Also resolve the oldDeps project before saving ivy-dependency-cache
commit 45cec9d9e3f97848acea84631824a22d5cd59d0f
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T12:32:47Z
Revert "Also resolve the oldDeps project before saving ivy-dependency-cache"
This reverts commit 6e5b03c79a710159e883bcfcff42bad4cdd125b2.
commit 6c7809cec248bb778ad54117db85868222c38a3f
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T13:43:32Z
Pipe test output for python/run-tests.py
commit 487796d07e24cfa4534a243cbb7451e3397b7137
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T16:00:09Z
Try to set respectSessionTimeZone to fix python tests
commit bb2076d1b80820fc9280af27c9a63c8ca2bbefb4
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T18:46:46Z
Revert "Try to set respectSessionTimeZone to fix python tests"
This reverts commit 487796d
commit 52cbda2e67cf37346f0ca7f90a2f5a8659447d1d
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T18:50:28Z
Skip bad arrow tests for now - https://github.com/palantir/spark/issues/328
commit 51858bf187c53aefb123b4f56b7e63b63c544771
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T19:04:27Z
Make python tests output xml results in PYSPARK_PYTHON subdir
commit 26299990ab3fbd3d013a1070a5bd6b1c4250d5e4
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T19:05:15Z
Try to use unishark instead of xmlrunner in pyspark.streaming.tests too
commit 77eaa80b4f8de046b20f14456bb7c9b5cb223016
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T19:20:25Z
Only the basename of PYSPARK_PYTHON please...
commit 19abd29d2806842ccb1fba690e02fc06dfde2a5c
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-13T20:15:07Z
Revert "Use circleci machinery to split test classes by timings"
This reverts commit e970d35
commit 31b969fa610f82dc8ff747ab2f28b2f079171313
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-14T17:49:03Z
Needed to add a reason...
commit 817f28dbff295af4dcf1504b546ae8256c82f442
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-14T18:56:08Z
fix typo
commit 0b2b3a349141ca9990d6785f6158f1bde276cfdb
Author: Dan Sanduleac <dsanduleac@...>
Date: 2018-03-14T19:20:05Z
Add spark-dist-hadoop-palantir to sbt projects list!!
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
