[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2016-12-31 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94280463 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -103,6 +103,10

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2016-12-31 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94280478 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -111,9 +115,15

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2016-12-31 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Thank you for review, @gatorsmile . Happy new year! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16426: [MINOR][TEST] Add `finally` clause for `sc.stop()`

2016-12-31 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16426 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16443: Remove query string from jar url for executor

2016-12-31 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16443 Hi, @hustfxj . If you add `[SPARK-19042]` into your title of this PR as a prefix, the Apache JIRA issue will be changed into `IN PROGRESS'. --- If your project is set up for it, yo

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2017-01-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94286661 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -111,9 +115,15

[GitHub] spark pull request #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on...

2017-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16320#discussion_r94358365 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -85,7 +85,9 @@ private[csv] object

[GitHub] spark pull request #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on...

2017-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16320#discussion_r94358461 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -85,7 +85,9 @@ private[csv] object

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Thank you again, @cloud-fan and @HyukjinKwon . I updated the fallback datatype. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 I assumed this one. Right? ```scala val path = "/tmp/test1" Seq(s"${Long.MaxValue}1", "2015-12-01 00:00:00", "1").toDF().coalesce(1

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Yep. I added the testcase, too. @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 I see, @gatorsmile . I will try to make a PR to improve the coverage. For this issue, the failure about the last commit (adding test case) was a R failure. So, it's irreleva

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Thank you, @cloud-fan ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Sure. I'll create a backpor PR for 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #16463: [SPARK-18877][SQL][BACKPORT-2.1] `CSVInferSchema....

2017-01-03 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16463 [SPARK-18877][SQL][BACKPORT-2.1] `CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar` ## What changes were proposed in this pull request? CSV type

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94495291 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -111,9 +115,15

[GitHub] spark issue #16463: [SPARK-18877][SQL][BACKPORT-2.1] `CSVInferSchema.inferFi...

2017-01-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16463 Hi, @gatorsmile . This is a backport of https://github.com/apache/spark/pull/16320 . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #16463: [SPARK-18877][SQL][BACKPORT-2.1] `CSVInferSchema.inferFi...

2017-01-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16463 Thank you for review, @jaceklaskowski . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16463: [SPARK-18877][SQL][BACKPORT-2.1] `CSVInferSchema....

2017-01-04 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/16463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16472: [SPARK-18877][SQL][BACKPORT-2.0] `CSVInferSchema....

2017-01-04 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16472 [SPARK-18877][SQL][BACKPORT-2.0] `CSVInferSchema.inferField` on DecimalType should find a common type with `typeSoFar` ## What changes were proposed in this pull request? CSV type

[GitHub] spark issue #16472: [SPARK-18877][SQL][BACKPORT-2.0] `CSVInferSchema.inferFi...

2017-01-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16472 Hi, @gatorsmile . This is a backport for `branch-2.0` of #16320 . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #12583: [SPARK-14819] [SQL] Improve SET / SET -v command

2017-01-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12583 Hi, @bomeng . I hit the same issue. Could you update the PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16472: [SPARK-18877][SQL][BACKPORT-2.0] `CSVInferSchema.inferFi...

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16472 Thank you for merging! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16472: [SPARK-18877][SQL][BACKPORT-2.0] `CSVInferSchema....

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/16472 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you again, @srowen . Hi, @alicegugu , @ericl , @rxin . Could you give me some opinion about this? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94838239 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -50,8 +50,8

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94839678 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala --- @@ -103,6 +103,10

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 The PR is updated like the followings. - Add `SQLConf.THRIFTSERVER_INCREMENTAL_COLLECT`. - Remove `private def useIncrementalCollect`. - Add description for `resultList` variable

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Hi, @ericl and @srowen . If there is something to do more, please let me know. Thank you always. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate`...

2017-01-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16440#discussion_r94989356 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -309,6 +309,12 @@ object SQLConf { .stringConf

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16400 Hi @gatorsmile . Could you review this when you have some time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you for approving, @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16400: [SPARK-18941][SQL][DOC] Add a new behavior docume...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16400#discussion_r95061882 --- Diff: docs/sql-programming-guide.md --- @@ -1362,6 +1362,13 @@ options. - Dataset and DataFrame API `explode` has been deprecated

[GitHub] spark pull request #16400: [SPARK-18941][SQL][DOC] Add a new behavior docume...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16400#discussion_r95061877 --- Diff: docs/sql-programming-guide.md --- @@ -1362,6 +1362,13 @@ options. - Dataset and DataFrame API `explode` has been deprecated

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16400 Thank you, @gatorsmile . I updated the commit and description of this PR. You can see the new image from generated doc. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16400 Thank you for merging, @gatorsmile ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16515: [SPARK-19134][EXAMPLE] Fix several sql, mllib and...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16515#discussion_r95222673 --- Diff: examples/src/main/python/mllib/binary_classification_metrics_example.py --- @@ -18,25 +18,20 @@ Binary Classification Metrics Example

[GitHub] spark pull request #16522: [SPARK-19137][SQL][SS] Garbage left in source tre...

2017-01-09 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16522 [SPARK-19137][SQL][SS] Garbage left in source tree after SQL tests ran ## What changes were proposed in this pull request? `DataStreamReaderWriterSuite` makes test files in source

[GitHub] spark issue #16522: [SPARK-19137][SQL][SS] Garbage left in source tree after...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 Oh, I see. Then, I'll look inside the `temp folder` generation code and fix that. Thank you for review, @vanzin and @zsxwing . --- If your project is set up for it, you can rep

[GitHub] spark issue #16522: [SPARK-19137][SQL][SS] Garbage left in source tree after...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 I found the root cause. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `OptionalC...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 Hi, @vanzin and @zsxwing . It was a bug of `withSQLConf`. I think this is correct fix, but we need to see the result of whole result because this is test utility issue. --- If your

[GitHub] spark pull request #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `Op...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16522#discussion_r95281973 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -94,7 +94,13 @@ private[sql] trait SQLTestUtils

[GitHub] spark issue #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `OptionalC...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 Thank you. I updated it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Hi, @srowen . Could you merge this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `OptionalC...

2017-01-09 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 Hi, @vanzin and @zsxwing . The PR passes the tests. Could you review this PR again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you for merging, @srowen ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `Op...

2017-01-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16522#discussion_r95417670 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -94,7 +94,13 @@ private[sql] trait SQLTestUtils

[GitHub] spark pull request #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `Op...

2017-01-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16522#discussion_r95418435 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -94,7 +94,13 @@ private[sql] trait SQLTestUtils

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Hi, @srowen . May I create a backport for 2.0 and 2.1 ? https://github.com/apache/spark/pull/14218 was merged into branch-2.0 and branch-2.1. --- If your project is set up for it, you

[GitHub] spark issue #16522: [SPARK-19137][SQL] Fix `withSQLConf` to reset `OptionalC...

2017-01-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16522 Thank you, @zsxwing and @vanzin ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you so much, @srowen ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #12583: [SPARK-14819] [SQL] Improve SET / SET -v command

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12583 Hmm. This PR seems to be stale. Actually, what I wanted was a **sorted** result of `SET` and `SET -v`. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #16579: [SPARK-19218][SQL] SET command should show a resu...

2017-01-13 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16579 [SPARK-19218][SQL] SET command should show a result sorted by key ## What changes were proposed in this pull request? Currently, `SET` command shows unsorted result. We had better

[GitHub] spark issue #12583: [SPARK-14819] [SQL] Improve SET / SET -v command

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/12583 I made another #16579 for `SET` for a sorted result. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16579: [SPARK-19218][SQL] SET command should show a resu...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16579#discussion_r96065519 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala --- @@ -79,7 +79,7 @@ case class SetCommand(kv: Option

[GitHub] spark issue #16579: [SPARK-19218][SQL] SET command should show a result sort...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16579 Thank you for approval, @srowen ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16579: [SPARK-19218][SQL] SET command should show a result sort...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16579 @gatorsmile Thank you for review and approval, too! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16579: [SPARK-19218][SQL] SET command should show a result sort...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16579 Interesting. The only failure was a new test case. ``` [info] - SET commands should return a list sorted by key *** FAILED *** (18 milliseconds) [info] java.lang.RuntimeException

[GitHub] spark issue #16579: [SPARK-19218][SQL] SET command should show a result sort...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16579 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16579: [SPARK-19218][SQL] SET command should show a result sort...

2017-01-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16579 The failure does not happen local pc, but it always happens in Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16605: [SPARK-18884][SQL] Support Array[_] in ScalaUDF

2017-01-16 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16605 Sure, @maropu . I'll do that tomorrow morning (PST). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 Thank you for review, @hvanhovell ! Do you mean SQL grammar or `listPartition`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 Recently, I've watched you improved those related function greatly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 I see. Then, how can evaluate the generic expression? Is it okay to use 'eval(null)'? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 Thank you for the direction. I'll proceed to improve in that way. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15336: [SPARK-17767][SQL] Support user-provided External...

2016-10-03 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15336 [SPARK-17767][SQL] Support user-provided ExternalCatalog ## What changes were proposed in this pull request? Currently, Spark supports ExternalCatalog, but the usage is limited to

[GitHub] spark pull request #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL ...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15318#discussion_r81647109 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/ExpressionSQLBuilderSuite.scala --- @@ -119,4 +121,18 @@ class

[GitHub] spark issue #15302: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15302 The only failure looks irrelevant. Anyway, I'm revising the PR. ```scala [info] *** 1 SUITE ABORTED *** [error] Error: Total 2604, Failed 0, Errors 1, Passed 2603, Ignor

[GitHub] spark pull request #15336: [SPARK-17767][SQL] Support user-provided External...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/15336 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15336: [SPARK-17767][SQL] Support user-provided ExternalCatalog

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15336 The issue is closed as 'Later'. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #15339: Branch 2.0

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15339 Hi, @yashbopardikar . Could you close this PR? It seems wrong. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15325: [SPARK-17112][SQL] "select null" via JDBC triggers Illeg...

2016-10-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15325 Thank You so much for review and merging, @rxin . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15351: [SPARK-17612][SQL] Support `DESCRIBE table PARTIT...

2016-10-04 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15351 [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQL syntax ## What changes were proposed in this pull request? This is a backport of SPARK-17612. This implements `DESCRIBE

[GitHub] spark issue #15351: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-10-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15351 Hi, @hvanhovell . This is the backport of https://github.com/apache/spark/pull/15168 . Is there any chance to be merged into branch-2.0? --- If your project is set up for it, you can

[GitHub] spark pull request #15357: [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE ...

2016-10-04 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15357 [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE TABLE ## What changes were proposed in this pull request? This PR fixes the following NPE scenario. **Reported Error

[GitHub] spark pull request #15357: [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE ...

2016-10-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15357#discussion_r81900796 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -265,7 +265,9 @@ class SparkSqlAstBuilder(conf: SQLConf

[GitHub] spark pull request #15357: [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE ...

2016-10-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15357#discussion_r81901737 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -265,7 +265,9 @@ class SparkSqlAstBuilder(conf: SQLConf

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Hi, @gatorsmile . Could you merge this PR? :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Thank you, @gatorsmile . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15357: [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE TABLE

2016-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15357 Thank you, @hvanhovell ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15351: [SPARK-17612][SQL][branch-2.0] Support `DESCRIBE table P...

2016-10-05 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15351 Hi, @hvanhovell . Could you give some optinion about this backport when you have sometime? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #15376: [SPARK-17796][SQL] Support wildcard character in ...

2016-10-06 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15376 [SPARK-17796][SQL] Support wildcard character in filename for LOAD DATA LOCAL INPATH ## What changes were proposed in this pull request? Currently, Spark 2.0 raises a `input path

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Thank you, @rxin and @gatorsmile . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15318: [SPARK-17750][SQL] Fix CREATE VIEW with INTERVAL arithme...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15318 Sure. I'll make abackport for this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15376: [SPARK-17796][SQL] Support wildcard character in filenam...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15376 The only test failure is irrelevant. Locally, it passed. ``` [info] - MAP append/extract *** FAILED *** (2 milliseconds) [info] java.lang.IllegalArgumentException

[GitHub] spark pull request #15383: [SPARK-17750][SQL][BACKPORT-2.0] Fix CREATE VIEW ...

2016-10-06 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/15383 [SPARK-17750][SQL][BACKPORT-2.0] Fix CREATE VIEW with INTERVAL arithmetic ## What changes were proposed in this pull request? Currently, Spark raises `RuntimeException` when creating

[GitHub] spark issue #15383: [SPARK-17750][SQL][BACKPORT-2.0] Fix CREATE VIEW with IN...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15383 Hi, @gatorsmile . This is a backport of https://github.com/apache/spark/commit/92b7e5728025b1bb6ed3aab5f1753c946a73568c . --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15383: [SPARK-17750][SQL][BACKPORT-2.0] Fix CREATE VIEW with IN...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15383 Thank you so much, @gatorsmile ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15383: [SPARK-17750][SQL][BACKPORT-2.0] Fix CREATE VIEW ...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/15383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15351: [SPARK-17612][SQL][branch-2.0] Support `DESCRIBE table P...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15351 Could you review this backport, @gatorsmile ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15351: [SPARK-17612][SQL][branch-2.0] Support `DESCRIBE ...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/15351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15351: [SPARK-17612][SQL][branch-2.0] Support `DESCRIBE table P...

2016-10-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15351 Thank you so much, @hvanhovell . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14426 Hi, @gatorsmile . Could you review this PR when you have some time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #15393: [HOTFIX][BUILD] Do not use contains in Option in ...

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15393#discussion_r82449361 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -70,7 +70,7 @@ class

[GitHub] spark pull request #15393: [HOTFIX][BUILD] Do not use contains in Option in ...

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15393#discussion_r82449290 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -70,7 +70,7 @@ class

[GitHub] spark pull request #15393: [HOTFIX][BUILD] Do not use contains in Option in ...

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15393#discussion_r82450501 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -70,7 +70,7 @@ class

[GitHub] spark issue #15393: [HOTFIX][BUILD] Do not use contains in Option in JdbcRel...

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15393 BTW, could you update the PR description, @HyukjinKwon ? Maybe, removing `exists` part? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15393: [HOTFIX][BUILD] Do not use contains in Option in JdbcRel...

2016-10-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15393 Yep. I knew. What I'm asking is we don't need to explain 'contains' usage here in this PR. I prefer not to advertise `contains` for `Option[Boolean]`. ```

<    1   2   3   4   5   6   7   8   9   10   >