[GitHub] spark issue #19709: [SPARK-22483][CORE]. Exposing java.nio bufferedPool memo...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19709 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19709: [SPARK-22483][CORE]. Exposing java.nio bufferedPool memo...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19709 **[Test build #83649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83649/testReport)** for PR 19709 at commit

[GitHub] spark issue #19709: [SPARK-22483][CORE]. Exposing java.nio bufferedPool memo...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19709 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19709: [SPARK-22483][CORE]. Exposing java.nio bufferedPool memo...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19709 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19709: [SPARK-22483][CORE]. Exposing java.nio bufferedPo...

GitHub user vundela opened a pull request: https://github.com/apache/spark/pull/19709 [SPARK-22483][CORE]. Exposing java.nio bufferedPool memory metrics to Metric System ## What changes were proposed in this pull request? Adds java.nio bufferedPool memory metrics to

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19700#discussion_r150041775 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLListener.scala --- @@ -101,6 +101,8 @@ class SQLListener(conf: SparkConf)

[GitHub] spark pull request #19700: [SPARK-22471][SQL] SQLListener consumes much memo...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19700#discussion_r150041314 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLListener.scala --- @@ -101,6 +101,8 @@ class SQLListener(conf: SparkConf)

[GitHub] spark issue #19701: [SPARK-22211][SQL][FOLLOWUP] Fix bad merge for tests

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19701 thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19699: [MINOR][Core] Fix nits in MetricsSystemSuite

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19699 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19515: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by ...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19515 @pmackles perhaps you could email this to d...@spark.apache.org to get some visibility to this and hopefully someone else on the mesos side can review? ---

[GitHub] spark issue #19699: [MINOR][Core] Fix nits in MetricsSystemSuite

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19699 Merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19515: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19515 **[Test build #83648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83648/testReport)** for PR 19515 at commit

[GitHub] spark issue #19515: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by ...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19515 @susanxhuynh or anyone from the mesos side would you please review? --- - To unsubscribe, e-mail:

[GitHub] spark issue #19543: [SPARK-19606][MESOS] Support constraints in spark-dispat...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19543 @susanxhuynh or anyone from the mesos side would you please review? --- - To unsubscribe, e-mail:

[GitHub] spark issue #19515: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by ...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19515 Jenkins, test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #19657: [SPARK-22344][SPARKR] clean up install dir if run...

GitHub user felixcheung reopened a pull request: https://github.com/apache/spark/pull/19657 [SPARK-22344][SPARKR] clean up install dir if running test as source package ## What changes were proposed in this pull request? remove spark if spark downloaded & installed

[GitHub] spark pull request #19657: [SPARK-22344][SPARKR] clean up install dir if run...

Github user felixcheung closed the pull request at: https://github.com/apache/spark/pull/19657 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19459: [SPARK-20791][PYSPARK] Use Arrow to create Spark DataFra...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19459 **[Test build #83647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83647/testReport)** for PR 19459 at commit

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19703 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19703 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83646/ Test PASSed. ---

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19703 **[Test build #83646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83646/testReport)** for PR 19703 at commit

[GitHub] spark pull request #19701: [SPARK-22211][SQL][FOLLOWUP] Fix bad merge for te...

Github user henryr closed the pull request at: https://github.com/apache/spark/pull/19701 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19704: [SPARK-22417][PYTHON][FOLLOWUP][BRANCH-2.2] Fix for crea...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19704 Thank you, @ueshin ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19703: [SPARK-22403][SS] Add optional checkpointLocation...

Github user wypoon commented on a diff in the pull request: https://github.com/apache/spark/pull/19703#discussion_r150030572 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredKafkaWordCount.scala --- @@ -46,11 +51,13 @@ object

[GitHub] spark issue #19479: [SPARK-17074] [SQL] Generate equi-height histogram in co...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19479 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83645/ Test PASSed. ---

[GitHub] spark issue #19479: [SPARK-17074] [SQL] Generate equi-height histogram in co...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19479 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19479: [SPARK-17074] [SQL] Generate equi-height histogram in co...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19479 **[Test build #83645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83645/testReport)** for PR 19479 at commit

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19703 **[Test build #83646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83646/testReport)** for PR 19703 at commit

[GitHub] spark pull request #19703: [SPARK-22403][SS] Add optional checkpointLocation...

Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/19703#discussion_r150029549 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredKafkaWordCount.scala --- @@ -46,11 +51,13 @@ object

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user squito commented on the issue: https://github.com/apache/spark/pull/19703 Jenkins, add to whitelist --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19707: [SPARK-22472][SQL] add null check for top-level p...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19707#discussion_r150027756 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -1408,6 +1409,23 @@ class DatasetSuite extends QueryTest with

[GitHub] spark issue #19703: [SPARK-22403][SS] Add optional checkpointLocation argume...

Github user wypoon commented on the issue: https://github.com/apache/spark/pull/19703 @srowen This change is indeed just a workaround for an underlying problem, as explained in the JIRA. @zsxwing suggested improving the StructuredKafkaWordCount example as a workaround. He did not

[GitHub] spark pull request #19707: [SPARK-22472][SQL] add null check for top-level p...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19707#discussion_r150026840 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -134,7 +134,13 @@ object ScalaReflection extends

[GitHub] spark pull request #19707: [SPARK-22472][SQL] add null check for top-level p...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19707#discussion_r150024246 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -1408,6 +1409,23 @@ class DatasetSuite extends QueryTest with

[GitHub] spark issue #19651: [SPARK-20682][SPARK-15474][SPARK-21791] Add new ORCFileF...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19651 Hi, @cloud-fan and @gatorsmile . Could you review this PR? --- - To unsubscribe, e-mail:

[GitHub] spark issue #19697: [SPARK-22222][CORE][TEST][FOLLOW-UP] Remove redundant an...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19697 Thank you, @HyukjinKwon , @srowen , and @jiangxb1987 . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19250 ok @squito can we send a new PR to do it? basically in parquet read task, get the writer info from the footer. If the writer is impala, and a config is set, we treat the seconds as seconds from

[GitHub] spark issue #19701: [SPARK-22211][SQL][FOLLOWUP] Fix bad merge for tests

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19701 Please close this PR, @henryr . `branch-2.2` PR is not closed automatically. --- - To unsubscribe, e-mail:

[GitHub] spark issue #19701: [SPARK-22211][SQL][FOLLOWUP] Fix bad merge for tests

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19701 Thank you, @gatorsmile and @henryr ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19707 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19707 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83644/ Test PASSed. ---

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19707 **[Test build #83644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83644/testReport)** for PR 19707 at commit

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19222 ping @cloud-fan for review --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19707 LGTM except one minor comment --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19707: [SPARK-22472][SQL] add null check for top-level p...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/19707#discussion_r150015018 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala --- @@ -1408,6 +1409,23 @@ class DatasetSuite extends QueryTest with

[GitHub] spark pull request #19479: [SPARK-17074] [SQL] Generate equi-height histogra...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19479#discussion_r150011624 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -1034,11 +1034,18 @@ private[spark] class

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19702 Is it available in parquet 1.8.2? that's the version Spark currently use. --- - To unsubscribe, e-mail:

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user squito commented on the issue: https://github.com/apache/spark/pull/19702 hey thanks for doing this @cloud-fan but I have a small request -- can we get another day to review how this works, especially in connection with somewhat recent changes in parquet to include a

[GitHub] spark issue #19705: [SPARK-22308][test-maven] Support alternative unit testi...

Github user nkronenfeld commented on the issue: https://github.com/apache/spark/pull/19705 ok, now I question my own testing... does maven not run scalastyle tests? Or did I not run the tests properly somehow? I just ran mvn test from root, and it all seemed to work on my machine

[GitHub] spark issue #19666: [SPARK-22451][ML] Reduce decision tree aggregate size fo...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/19666 @facaiy Your idea looks also reasonable. So we can use the condition "exclude the first bin" to do the pruning (filter out the other half symmetric splits). This condition looks simpler than

[GitHub] spark issue #19708: [SPARK-22479][SQL] Exclude credentials from SaveintoData...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19708 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19702 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83643/ Test PASSed. ---

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19702 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19702 **[Test build #83643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83643/testReport)** for PR 19702 at commit

[GitHub] spark pull request #19708: [SPARK-22479][SQL] Exclude credentials from Savei...

GitHub user onursatici opened a pull request: https://github.com/apache/spark/pull/19708 [SPARK-22479][SQL] Exclude credentials from SaveintoDataSourceCommand.simpleString ## What changes were proposed in this pull request? Do not include jdbc properties which may contain

[GitHub] spark pull request #17819: [SPARK-20542][ML][SQL] Add an API to Bucketizer t...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17819 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add an API to Bucketizer that can...

Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17819 Merged to master. Thanks @viirya and all the reviewers! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #19479: [SPARK-17074] [SQL] Generate equi-height histogram in co...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19479 **[Test build #83645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83645/testReport)** for PR 19479 at commit

[GitHub] spark issue #19661: [SPARK-22450][Core][Mllib]safely register class for mlli...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19661 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19661: [SPARK-22450][Core][Mllib]safely register class for mlli...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19661 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83642/ Test PASSed. ---

[GitHub] spark issue #19661: [SPARK-22450][Core][Mllib]safely register class for mlli...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19661 **[Test build #83642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83642/testReport)** for PR 19661 at commit

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19707 **[Test build #83644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83644/testReport)** for PR 19707 at commit

[GitHub] spark issue #19707: [SPARK-22472][SQL] add null check for top-level primitiv...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19707 cc @gatorsmile @kiszk @srowen --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #19707: [SPARK-22472][SQL] add null check for top-level p...

GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/19707 [SPARK-22472][SQL] add null check for top-level primitive values ## What changes were proposed in this pull request? One powerful feature of `Dataset` is, we can easily map SQL rows to

[GitHub] spark issue #19666: [SPARK-22451][ML] Reduce decision tree aggregate size fo...

Github user facaiy commented on the issue: https://github.com/apache/spark/pull/19666 In fact, I'm not sure whether the idea is right, so no hesitate to correct me. I assume the algorithm requires O(N^2) complexity. ---

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19702 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19702 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83641/ Test PASSed. ---

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19702 **[Test build #83641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83641/testReport)** for PR 19702 at commit

[GitHub] spark issue #19543: [SPARK-19606][MESOS] Support constraints in spark-dispat...

Github user pmackles commented on the issue: https://github.com/apache/spark/pull/19543 @felixcheung - any chance of getting this merged into the upcoming 2.2.1 release? I cleaned up the merge conflict --- - To

[GitHub] spark issue #19666: [SPARK-22451][ML] Reduce decision tree aggregate size fo...

Github user facaiy commented on the issue: https://github.com/apache/spark/pull/19666 Hi, I write a demo with python. I'll be happy if it could be useful. For N bins, say `[x_1, x_2, ..., x_N]`, since all its splits contain either `x_1` or not, so we can choose the half

[GitHub] spark pull request #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interfa...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19156#discussion_r149956415 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -527,27 +570,28 @@ private[ml] object SummaryBuilderImpl extends

[GitHub] spark issue #19515: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by ...

Github user pmackles commented on the issue: https://github.com/apache/spark/pull/19515 @felixcheung - any chance of getting this tiny change merged and included in the upcoming 2.2.1 release? --- - To unsubscribe,

[GitHub] spark issue #19250: [SPARK-12297] Table timezone correction for Timestamps

Github user zivanfi commented on the issue: https://github.com/apache/spark/pull/19250 Yes, that is correct. We introduced the table property to address the 2nd problem I mentioned above: "The adjustment depends on the local timezone." (details in my [previous

[GitHub] spark issue #19687: [SPARK-19644][SQL]Clean up Scala reflection garbage afte...

Github user ManchesterUnited16 commented on the issue: https://github.com/apache/spark/pull/19687 can you show me you maven dependency when you ran the program,thank you very much! At 2017-11-09 13:37:46, "Shixiong Zhu"

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19702 **[Test build #83643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83643/testReport)** for PR 19702 at commit

[GitHub] spark pull request #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interfa...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19156#discussion_r149943555 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -94,46 +98,87 @@ object Summarizer extends Logging { * - min: the

[GitHub] spark issue #19695: [SPARK-22377][BUILD] Use /usr/sbin/lsof if lsof does not...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83638/ Test PASSed. ---

[GitHub] spark issue #19695: [SPARK-22377][BUILD] Use /usr/sbin/lsof if lsof does not...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19695 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19695: [SPARK-22377][BUILD] Use /usr/sbin/lsof if lsof does not...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19695 **[Test build #83638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83638/testReport)** for PR 19695 at commit

[GitHub] spark pull request #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interfa...

Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19156#discussion_r149941345 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -94,46 +98,87 @@ object Summarizer extends Logging { * - min:

[GitHub] spark pull request #19702: [SPARK-10365][SQL] Support Parquet logical type T...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/19702#discussion_r149940418 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala --- @@ -982,7 +941,7 @@ class

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19702 LGTM pending tests. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19649: [SPARK-22405][SQL] Add new alter table and alter ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19649 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19649: [SPARK-22405][SQL] Add new alter table and alter databas...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19649 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19664: [SPARK-22442][SQL] ScalaReflection should produce...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19664 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19664: [SPARK-22442][SQL] ScalaReflection should produce correc...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19664 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19661: [SPARK-22450][Core][Mllib]safely register class for mlli...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19661 **[Test build #83642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83642/testReport)** for PR 19661 at commit

[GitHub] spark pull request #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interfa...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19156#discussion_r149928022 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -94,46 +98,87 @@ object Summarizer extends Logging { * - min: the

[GitHub] spark pull request #19661: [SPARK-22450][Core][Mllib]safely register class f...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19661#discussion_r149927241 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -178,6 +179,28 @@ class KryoSerializer(conf: SparkConf)

[GitHub] spark pull request #19532: [DOC]update the API doc and modify the stage API ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19532 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19661: [SPARK-22450][Core][Mllib]safely register class for mlli...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19661 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #15332: [SPARK-10364][SQL] Support Parquet logical type TIMESTAM...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15332 great, thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19532: [DOC]update the API doc and modify the stage API descrip...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19532 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19706: [SPARK-22476][R] Add dayofweek function to R

GitHub user HyukjinKwon reopened a pull request: https://github.com/apache/spark/pull/19706 [SPARK-22476][R] Add dayofweek function to R ## What changes were proposed in this pull request? This PR adds `dayofweek` to R API: ```r data <- list(list(d =

[GitHub] spark pull request #19706: [SPARK-22476][R] Add dayofweek function to R

Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/19706 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19702: [SPARK-10365][SQL] Support Parquet logical type TIMESTAM...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19702 **[Test build #83641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83641/testReport)** for PR 19702 at commit

[GitHub] spark pull request #19702: [SPARK-10365][SQL] Support Parquet logical type T...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19702#discussion_r149924096 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -428,15 +417,9 @@ object

[GitHub] spark issue #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interface of d...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19156 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83640/ Test PASSed. ---

[GitHub] spark issue #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interface of d...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19156 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19156: [SPARK-19634][SQL][ML][FOLLOW-UP] Improve interface of d...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19156 **[Test build #83640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83640/testReport)** for PR 19156 at commit

<    1   2   3   4   >