[GitHub] spark issue #18494: [SPARK-21272] SortMergeJoin LeftAnti does not update num...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/18494 cc @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18444 I think you could push an empty commit to retrigger the Jenkins build as a workaround, for example, ` git commit --allow-empty -m "Retrigger the build"` if the test blocks what you are working

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 I'm not sure if Jenkins would listen to me :( --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125173526 --- Diff: python/pyspark/sql/tests.py --- @@ -2250,6 +2256,67 @@ def test_BinaryType_serialization(self): df =

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125173517 --- Diff: python/pyspark/sql/tests.py --- @@ -2250,6 +2256,67 @@ def test_BinaryType_serialization(self): df =

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125173508 --- Diff: python/pyspark/sql/types.py --- @@ -935,6 +936,86 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125173496 --- Diff: python/pyspark/sql/types.py --- @@ -935,6 +936,86 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125173449 --- Diff: python/pyspark/sql/types.py --- @@ -935,6 +936,86 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17096 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79038/ Test PASSed. ---

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17096 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17096 **[Test build #79038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79038/testReport)** for PR 17096 at commit

[GitHub] spark issue #18502: [SPARK-21278][PySpark] Upgrade to Py4J 0.10.5

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18502 **[Test build #79039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79039/testReport)** for PR 18502 at commit

[GitHub] spark pull request #18502: [SPARK-21278][PySpark] Upgrade to Py4J 0.10.5

GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/18502 [SPARK-21278][PySpark] Upgrade to Py4J 0.10.5 ## What changes were proposed in this pull request? This PR aims to bump Py4J in order to fix the following float/double bug. Py4J

[GitHub] spark issue #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes bef...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18139 One option, which wouldn't be super efficient at border cases, but would allow for general case is just falling back on `OverflowError` (on top of avoiding it in the known to cause error range

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17096 **[Test build #79038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79038/testReport)** for PR 17096 at commit

[GitHub] spark pull request #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing suppor...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17096#discussion_r125173260 --- Diff: python/pyspark/ml/tests.py --- @@ -319,6 +320,20 @@ def test_hasparam(self): testParams = TestParams()

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 nah, i got it. On Sat, Jul 1, 2017 at 7:19 PM, Holden Karau wrote: > @shaneknapp - I can do the update if you >

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79037/ Test PASSed. ---

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79037/testReport)** for PR 18498 at commit

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more user-...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17267 Hey @uncleGen anytime to add a test for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15113: [SPARK-17508][PYSPARK][ML] PySpark treat Param values No...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15113 So I think our current handling of `None` is confusing, but I'd really like to see what the other committers have to say on this. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #18501: [SPARK-20256][SQL] SessionState should be created more l...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18501 Hi, @cloud-fan . Could you review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18501: [SPARK-20256][SQL] SessionState should be created more l...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18501 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18501: [SPARK-20256][SQL] SessionState should be created more l...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18501 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79036/ Test PASSed. ---

[GitHub] spark issue #18501: [SPARK-20256][SQL] SessionState should be created more l...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18501 **[Test build #79036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79036/testReport)** for PR 18501 at commit

[GitHub] spark issue #18453: [SPARK-19852][PYSPARK][ML] Python StringIndexer supports...

Github user viirya commented on the issue: https://github.com/apache/spark/pull/18453 LGTM too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17096 @HyukjinKwon Pretty much, yes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17096 Do you mean a test case such as `self.assertEqual(testParams._resolveParam(u"아"), testParams.아) ` ? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18453: [SPARK-19852][PYSPARK][ML] Python StringIndexer supports...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18453 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #18453: [SPARK-19852][PYSPARK][ML] Python StringIndexer s...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18453#discussion_r125172564 --- Diff: python/pyspark/ml/feature.py --- @@ -2132,6 +2132,12 @@ class StringIndexer(JavaEstimator, HasInputCol, HasOutputCol, HasHandleInvalid,

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125172166 --- Diff: python/pyspark/sql/types.py --- @@ -935,6 +936,86 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125171058 --- Diff: python/pyspark/sql/tests.py --- @@ -2250,6 +2256,67 @@ def test_BinaryType_serialization(self): df = self.spark.createDataFrame(data,

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125171044 --- Diff: python/pyspark/sql/types.py --- @@ -935,6 +936,86 @@ def _parse_datatype_json_value(json_value): long: LongType, })

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r125170990 --- Diff: python/pyspark/sql/tests.py --- @@ -2250,6 +2256,67 @@ def test_BinaryType_serialization(self): df = self.spark.createDataFrame(data,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 @shaneknapp - I can do the update if you want next week? Let me know :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17096: [SPARK-15243][ML][SQL][PYTHON] Add missing support for u...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17096 I'd really like to see that further test I was talking about, @HyukjinKwon -- it shouldn't be too hard to do in this pr right? Just add a unicode string which doesn't make sense in down converted

[GitHub] spark issue #14830: [SPARK-16992][PYSPARK][DOCS] import sort and autopep8 on...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14830 Gentle follow up ping. I've got some bandwith next week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14579: [SPARK-16921][PYSPARK] RDD/DataFrame persist()/cache() s...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14579 @MLnick - or if you don't have a chance would it be ok for us to find someone (perhaps someone new to the project) to take this over and bring it to the finish line? --- If your project is set up

[GitHub] spark issue #18339: [SPARK-21094][PYTHON] Add popen_kwargs to launch_gateway

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18339 This is interesting, I've got a similar approach I've been working on in https://github.com/apache/spark/pull/17298 which has some issues inside of PyPI. Would that suit your needs if I extended it

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79037/testReport)** for PR 18498 at commit

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18498 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18498 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18501: [SPARK-20256][SQL] SessionState should be created lazily

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18501 **[Test build #79036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79036/testReport)** for PR 18501 at commit

[GitHub] spark pull request #18501: [SPARK-20256][SQL] SessionState should be created...

GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/18501 [SPARK-20256][SQL] SessionState should be created lazily ## What changes were proposed in this pull request? `SessionState` is designed to be created lazily. However, in reality, it

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

Github user keypointt commented on the issue: https://github.com/apache/spark/pull/17451 Oh now I got you, will do. Thank you :) Sent from my iPhone at Canada Place 🇨🇦 On Sat, Jul 1, 2017 at 4:39 PM Holden Karau wrote: >

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79033/ Test FAILed. ---

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79033 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79033/testReport)** for PR 18498 at commit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18444 @zasdfgbnm if the failures are unrelated you can ask jenkins to re-run the tests with "jenkins retest this please". One thing is even though github reports this merges jenkins report it has

[GitHub] spark pull request #17451: [SPARK-19866][ML][PySpark] Add local version of W...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/17451#discussion_r125170914 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Word2Vec.scala --- @@ -274,6 +274,29 @@ class Word2VecModel private[ml] (

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18500 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79034/ Test PASSed. ---

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18500 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18500 **[Test build #79034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79034/testReport)** for PR 18500 at commit

[GitHub] spark issue #18353: [SPARK-21142][SS] spark-streaming-kafka-0-10 should depe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18353 **[Test build #3825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3825/testReport)** for PR 18353 at commit

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79035/ Test FAILed. ---

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79035/testReport)** for PR 18498 at commit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 @ueshin @HyukjinKwon I think I'm done now. There are still fails in tests, but it doesn't looks to be something related to my change --- If your project is set up for it, you can reply to

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18464 Hi, @guoxiaolongzte . Could you add the logic? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-for...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18498#discussion_r125169040 --- Diff: python/pyspark/sql/functions.py --- @@ -1839,15 +1839,19 @@ def from_json(col, schema, options={}): string. :param

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79035/testReport)** for PR 18498 at commit

[GitHub] spark pull request #18500: [MINOR][DOC] Version related doc fix in functions...

Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/18500 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18500 Actually, let me pick this up to https://github.com/apache/spark/pull/18498. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-for...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18498#discussion_r125168993 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -3078,9 +3078,8 @@ object functions { * string. *

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18500 **[Test build #79034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79034/testReport)** for PR 18500 at commit

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18500 I tried to find the same instances in `functions.scala` and I believe these are all. Please pick this change up if anyone has a PR fixing some codes around this (rather than leaving it to make

[GitHub] spark issue #18500: [MINOR][DOC] Version related doc fix in functions.scala

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18500 I tried to find the same instances in `functions.scala` and I believe these are all. Please pick this change up if anyone has a PR fixing related this code path (rather than leaving it to make

[GitHub] spark pull request #18500: [MINOR][DOC] Version related doc fix in functions...

GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18500 [MINOR][DOC] Version related doc fix in functions.scala ## What changes were proposed in this pull request? This PR proposes to - remove description about behaviour change

[GitHub] spark pull request #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-for...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18498#discussion_r125168486 --- Diff: python/pyspark/sql/functions.py --- @@ -1839,7 +1839,8 @@ def from_json(col, schema, options={}): string. :param col:

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79033 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79033/testReport)** for PR 18498 at commit

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18464 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-for...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18498#discussion_r125168275 --- Diff: python/pyspark/sql/functions.py --- @@ -1839,15 +1839,19 @@ def from_json(col, schema, options={}): string. :param

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79032/ Test PASSed. ---

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18464 **[Test build #79032 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79032/testReport)** for PR 18464 at commit

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18498 Thank you @felixcheung for your guidance. I address the comments here for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18353: [SPARK-21142][SS] spark-streaming-kafka-0-10 should depe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18353 **[Test build #3825 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3825/testReport)** for PR 18353 at commit

[GitHub] spark pull request #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-for...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18498#discussion_r125167705 --- Diff: python/pyspark/sql/functions.py --- @@ -1839,7 +1839,8 @@ def from_json(col, schema, options={}): string. :param col:

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18498 cool, I will look more later today. about `structType.fromDDL` - the other methods in this group, such as `structType.structField`, the name after the `.` is actually a type name. This is

[GitHub] spark issue #18451: [SPARK-18004][SQL] Make sure the date or timestamp relat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18451 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79030/ Test PASSed. ---

[GitHub] spark issue #18451: [SPARK-18004][SQL] Make sure the date or timestamp relat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18451 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18451: [SPARK-18004][SQL] Make sure the date or timestamp relat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18451 **[Test build #79030 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79030/testReport)** for PR 18451 at commit

[GitHub] spark issue #14431: [SPARK-16258][SparkR] Automatically append the grouping ...

Github user NarineK commented on the issue: https://github.com/apache/spark/pull/14431 I think 'prepend' sounds better. What do you think ? Yes, the `key` in `function(key, x) { x }` can be useful for some use cases but I also think that the user could easily prepend it to the

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79026/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79026 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79026/testReport)** for PR 18444 at commit

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18498 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79031/ Test PASSed. ---

[GitHub] spark issue #18498: [SPARK-21266][R][PYTHON] Support schema a DDL-formatted ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18498 **[Test build #79031 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79031/testReport)** for PR 18498 at commit

[GitHub] spark issue #18496: [SparkR][SPARK-20307]:SparkR: pass on setHandleInvalid t...

Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/18496 I will fix it tonight. It is weird. In my local test, it passed. It seems that my new change doesn't apply to the test. Anyway, I will fix the failure first. --- If your project is set up

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18464 **[Test build #79032 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79032/testReport)** for PR 18464 at commit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79028/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79028 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79028/testReport)** for PR 18444 at commit

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18464 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79027/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   >