[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-07 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-05 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-03 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen Yes. I agree with you! These places should be consistent, otherwise it is easy to be confused. I will try to modify log statements and docs. Should I modify it in this PR or a new one

[GitHub] spark pull request #22683: [SPARK-25696] The storage memory displayed on spa...

2018-12-03 Thread httfighter
Github user httfighter commented on a diff in the pull request: https://github.com/apache/spark/pull/22683#discussion_r238215152 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1164,17 +1164,17 @@ private[spark] object Utils extends Logging { } else

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-12-01 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-29 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen Sorry, I just saw your message. I am a little busy on weekdays. I will try to modify the test cases in recent days

[GitHub] spark pull request #22683: [SPARK-25696] The storage memory displayed on spa...

2018-11-24 Thread httfighter
GitHub user httfighter reopened a pull request: https://github.com/apache/spark/pull/22683 [SPARK-25696] The storage memory displayed on spark Application UI is… … incorrect. ## What changes were proposed in this pull request? In the reported heartbeat information

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-24 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen@ajbozarth I have added the changes, could you help me review the code? Thank you very much. --- - To unsubscribe, e

[GitHub] spark pull request #22683: [SPARK-25696] The storage memory displayed on spa...

2018-11-24 Thread httfighter
Github user httfighter closed the pull request at: https://github.com/apache/spark/pull/22683 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-23 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen OK. Thank you very much for your advice. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-23 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen @ajbozarth I am not sure about some things, can you give me some advice? In the process of modification, I have a question. In Spark, whether M and MB represent MiB. Spark does not use

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-20 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 @srowen Thank you for your review. I agree with you, and I will make changes in the near future. @wangyum Thank you for your help

[GitHub] spark issue #22683: [SPARK-25696] The storage memory displayed on spark Appl...

2018-11-05 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22683 It's ok. @ajbozarth --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark pull request #22683: [SPARK-25696] The storage memory displayed on spa...

2018-10-10 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/22683 [SPARK-25696] The storage memory displayed on spark Application UI is… … incorrect. ## What changes were proposed in this pull request? Change the cardinality of the unit

[GitHub] spark issue #22487: [SPARK-25477] “INSERT OVERWRITE LOCAL DIRECTORY”, ...

2018-10-09 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/22487 @wangyum In Hive, the INSERT OVERWRITE LOCAL DIRECTORY It does not use a local staging directory but uses a distributed staging directory. It does not have this problem in Hive

[GitHub] spark pull request #22487: [SPARK-25477] “INSERT OVERWRITE LOCAL DIRECTORY...

2018-09-20 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/22487 [SPARK-25477] “INSERT OVERWRITE LOCAL DIRECTORY”, the data files allo… …cated on the non-driver node will not be written to the specified output directory ## What changes

[GitHub] spark issue #21826: [SPARK-24872] Replace the symbol '||' of Or operator wit...

2018-08-08 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 It failed again. I don't know what the problem is. Could you help me trigger it again?@viirya --- - To unsubscribe, e-mail

[GitHub] spark issue #21826: [SPARK-24872] Replace the symbol '||' of Or operator wit...

2018-07-29 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 Thank you very much! @viirya --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e

[GitHub] spark issue #21826: [SPARK-24872] Replace the symbol '||' of Or operator wit...

2018-07-29 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 The last test bulid failed, but all the test cases passed. I don't know what the problem is. Could you help me trigger it again? @HyukjinKwon

[GitHub] spark pull request #21826: [SPARK-24872] Replace the symbol '||' of Or opera...

2018-07-28 Thread httfighter
Github user httfighter commented on a diff in the pull request: https://github.com/apache/spark/pull/21826#discussion_r205934501 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/PredicateSuite.scala --- @@ -455,4 +456,10 @@ class PredicateSuite

[GitHub] spark issue #21826: [SPARK-24872] Replace the symbol '||' of Or operator wit...

2018-07-26 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 I have submitted a new code. Could you help me review the code? Thank you! @HyukjinKwon @viirya @gatorsmile @rxin @hvanhovell In Hive, "||" performs the function of STRING concat,

[GitHub] spark issue #21826: [SPARK-24872] Remove the symbol “||” of the “OR”...

2018-07-22 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 I have a suggestion that I don't know if it is reasonable. In our spark, since we already support “||” as a string concatenation function, I don't know if we can make such an improvement

[GitHub] spark issue #21826: [SPARK-24872] Remove the symbol “||” of the “OR”...

2018-07-22 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21826 I did the following tests in mysql. mysql> select "abc" || "def"; ++ | "abc" || "def" | +

[GitHub] spark pull request #21826: [SPARK-24872] Remove the symbol “||” of the �...

2018-07-22 Thread httfighter
Github user httfighter commented on a diff in the pull request: https://github.com/apache/spark/pull/21826#discussion_r204274497 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -442,8 +442,6 @@ case class Or(left: Expression

[GitHub] spark pull request #21826: [SPARK-24872] Remove the symbol “||” of the �...

2018-07-22 Thread httfighter
Github user httfighter commented on a diff in the pull request: https://github.com/apache/spark/pull/21826#discussion_r204274481 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -442,8 +442,6 @@ case class Or(left: Expression

[GitHub] spark pull request #21826: [SPARK-24872] Remove the symbol “||” of the �...

2018-07-20 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/21826 [SPARK-24872] Remove the symbol “||” of the “OR” operation ## What changes were proposed in this pull request? “||” will perform the function of STRING concat, and it is also

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the test title ...

2018-07-19 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21767 Thank you for your comments, @srowen @HyukjinKwon @wangyum. I will try to contribute more valuable issues

[GitHub] spark pull request #21767: SPARK-24804 There are duplicate words in the titl...

2018-07-14 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/21767 SPARK-24804 There are duplicate words in the title in the DatasetSuite ## What changes were proposed in this pull request? In DatasetSuite.scala, in the 1299 line, test("SPARK-

[GitHub] spark issue #21023: [SPARK-23949] makes && supports the function of predicat...

2018-04-10 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/21023 @gatorsmile Thank you very much!Can you help me see this pr ? --- - To unsubscribe, e-mail: reviews-unsubscr

[GitHub] spark pull request #21023: [SPARK-23949] makes && supports the function of p...

2018-04-10 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/21023 [SPARK-23949] makes && supports the function of predicate operator and [https://issues.apache.org/jira/browse/SPARK-23949](https://issues.apache.org/jira/browse/SPARK-23949) [SPA

[GitHub] spark issue #19380: [SPARK-22157] [SQL] The uniux_timestamp method handles t...

2017-09-29 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/19380 I understand everyone's worries.But i hava few thoughts. Firstly, the native unix_timestamp itself supports the "-MM-dd HH:mm:ss.SSS" form of the date, but the resu

[GitHub] spark issue #19380: [SPARK-22157] [SQL] The uniux_timestamp method handles t...

2017-09-28 Thread httfighter
Github user httfighter commented on the issue: https://github.com/apache/spark/pull/19380 In RDMS , unix_timestamp method can keep the milliseconds. For example, execute the command as follows select unix_timestamp("2017-10-10 10:10:20.111") from test; y

[GitHub] spark pull request #19380: [SPARK-22157] [SQL] The uniux_timestamp method ha...

2017-09-28 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/19380 [SPARK-22157] [SQL] The uniux_timestamp method handles the time field that is lost in mill ## What changes were proposed in this pull request? keep the the mill part of the time field