[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965411#comment-15965411 ] Saisai Shao commented on SPARK-20286: - bq. Maybe the best approach is to change from

[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965408#comment-15965408 ] Miguel Pérez commented on SPARK-20286: -- Yes. I suppose this is only checked when an executors passes

[jira] [Commented] (SPARK-20303) Rename createTempFunction to registerFunction

[ https://issues.apache.org/jira/browse/SPARK-20303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965405#comment-15965405 ] Apache Spark commented on SPARK-20303: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20303) Rename createTempFunction to registerFunction

[ https://issues.apache.org/jira/browse/SPARK-20303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20303: Assignee: Xiao Li (was: Apache Spark) > Rename createTempFunction to registerFunction >

[jira] [Assigned] (SPARK-20303) Rename createTempFunction to registerFunction

[ https://issues.apache.org/jira/browse/SPARK-20303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20303: Assignee: Apache Spark (was: Xiao Li) > Rename createTempFunction to registerFunction >

[jira] [Updated] (SPARK-20303) Rename createTempFunction to registerFunction

[ https://issues.apache.org/jira/browse/SPARK-20303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20303: Summary: Rename createTempFunction to registerFunction (was: Replace createTempFunction by

[jira] [Created] (SPARK-20303) Replace createTempFunction by registerFunction

Xiao Li created SPARK-20303: --- Summary: Replace createTempFunction by registerFunction Key: SPARK-20303 URL: https://issues.apache.org/jira/browse/SPARK-20303 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20302) Short circuit cast when from and to types are structurally the same

[ https://issues.apache.org/jira/browse/SPARK-20302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965354#comment-15965354 ] Apache Spark commented on SPARK-20302: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20302) Short circuit cast when from and to types are structurally the same

[ https://issues.apache.org/jira/browse/SPARK-20302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20302: Assignee: Apache Spark (was: Reynold Xin) > Short circuit cast when from and to types

[jira] [Assigned] (SPARK-20302) Short circuit cast when from and to types are structurally the same

[ https://issues.apache.org/jira/browse/SPARK-20302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20302: Assignee: Reynold Xin (was: Apache Spark) > Short circuit cast when from and to types

[jira] [Updated] (SPARK-20302) Short circuit cast when from and to types are structurally the same

[ https://issues.apache.org/jira/browse/SPARK-20302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20302: Summary: Short circuit cast when from and to types are structurally the same (was: Optimize cast

[jira] [Created] (SPARK-20302) Optimize cast when from and to types are structurally the same

Reynold Xin created SPARK-20302: --- Summary: Optimize cast when from and to types are structurally the same Key: SPARK-20302 URL: https://issues.apache.org/jira/browse/SPARK-20302 Project: Spark

[jira] [Resolved] (SPARK-19993) Caching logical plans containing subquery expressions does not work.

[ https://issues.apache.org/jira/browse/SPARK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19993. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17330

[jira] [Assigned] (SPARK-19993) Caching logical plans containing subquery expressions does not work.

[ https://issues.apache.org/jira/browse/SPARK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19993: --- Assignee: Dilip Biswal > Caching logical plans containing subquery expressions does not

[jira] [Resolved] (SPARK-20291) NaNvl(FloatType, NullType) should not be cast to NaNvl(DoubleType, DoubleType)

[ https://issues.apache.org/jira/browse/SPARK-20291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20291. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17606

[jira] [Commented] (SPARK-20184) performance regression for complex/long sql when enable whole stage codegen

[ https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965308#comment-15965308 ] Fei Wang commented on SPARK-20184: -- Tested with a smaller table 100,000 rows. Codegen on: 2.6s Codegen

[jira] [Commented] (SPARK-20286) dynamicAllocation.executorIdleTimeout is ignored after unpersist

[ https://issues.apache.org/jira/browse/SPARK-20286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965306#comment-15965306 ] Saisai Shao commented on SPARK-20286: - So the fix is that if there's no RDD get persisted, executors

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965302#comment-15965302 ] Wenchen Fan commented on SPARK-19659: - Seems your model is, all shuffle blocks should be fetched into

[jira] [Commented] (SPARK-20301) Flakiness in StreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-20301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965297#comment-15965297 ] Apache Spark commented on SPARK-20301: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20301) Flakiness in StreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-20301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20301: Assignee: Burak Yavuz (was: Apache Spark) > Flakiness in StreamingAggregationSuite >

[jira] [Assigned] (SPARK-20301) Flakiness in StreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-20301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20301: Assignee: Apache Spark (was: Burak Yavuz) > Flakiness in StreamingAggregationSuite >

[jira] [Commented] (SPARK-20199) GradientBoostedTreesModel doesn't have Column Sampling Rate Paramenter

[ https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965296#comment-15965296 ] Yan Facai (颜发才) commented on SPARK-20199: - Yes, as [~pralabhkumar] said, DecisionTree hardcodes

[jira] [Created] (SPARK-20301) Flakiness in StreamingAggregationSuite

Burak Yavuz created SPARK-20301: --- Summary: Flakiness in StreamingAggregationSuite Key: SPARK-20301 URL: https://issues.apache.org/jira/browse/SPARK-20301 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-20301) Flakiness in StreamingAggregationSuite

[ https://issues.apache.org/jira/browse/SPARK-20301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-20301: Labels: flaky-test (was: ) > Flakiness in StreamingAggregationSuite >

[jira] [Comment Edited] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965273#comment-15965273 ] Hyukjin Kwon edited comment on SPARK-20297 at 4/12/17 2:24 AM: --- Let me

[jira] [Comment Edited] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965273#comment-15965273 ] Hyukjin Kwon edited comment on SPARK-20297 at 4/12/17 2:23 AM: --- Let me

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965273#comment-15965273 ] Hyukjin Kwon commented on SPARK-20297: -- Let me leave some pointers about related PRs -

[jira] [Comment Edited] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965265#comment-15965265 ] Hyukjin Kwon edited comment on SPARK-20297 at 4/12/17 2:21 AM: --- Thank you

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965268#comment-15965268 ] Hyukjin Kwon commented on SPARK-20297: -- Oh wait, I am sorry. It does follow the newer standard -

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965265#comment-15965265 ] Hyukjin Kwon commented on SPARK-20297: -- Thank you so much for trying out [~mmokhtar]. Do you maybe

[jira] [Commented] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965264#comment-15965264 ] Hyukjin Kwon commented on SPARK-20294: -- Also, it infers schema from the first row if sampling ratio

[jira] [Comment Edited] (SPARK-3383) DecisionTree aggregate size could be smaller

[ https://issues.apache.org/jira/browse/SPARK-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963741#comment-15963741 ] Yan Facai (颜发才) edited comment on SPARK-3383 at 4/12/17 2:02 AM: - I think

[jira] [Commented] (SPARK-3383) DecisionTree aggregate size could be smaller

[ https://issues.apache.org/jira/browse/SPARK-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965263#comment-15965263 ] Yan Facai (颜发才) commented on SPARK-3383: How about the idea? 1. We use `bin` to represent value,

[jira] [Comment Edited] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965259#comment-15965259 ] Hyukjin Kwon edited comment on SPARK-20294 at 4/12/17 2:00 AM: --- I am

[jira] [Resolved] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20294. -- Resolution: Invalid I am resolving this because this does not look a problem. I guess we are

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965255#comment-15965255 ] Mostafa Mokhtar commented on SPARK-20297: - [~hyukjin.kwon] Data written by Spark is readable by

[jira] [Commented] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965257#comment-15965257 ] Hyukjin Kwon commented on SPARK-20294: -- Just for other guys, {code} >>> small_rdd =

[jira] [Updated] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20297: - Priority: Major (was: Critical) > Parquet Decimal(12,2) written by Spark is unreadable by Hive

[jira] [Updated] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20297: - Component/s: (was: Spark Core) SQL > Parquet Decimal(12,2) written by Spark

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965245#comment-15965245 ] Hyukjin Kwon commented on SPARK-20297: -- For me, it sounds like related with

[jira] [Comment Edited] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965244#comment-15965244 ] Yan Facai (颜发才) edited comment on SPARK-10788 at 4/12/17 1:35 AM: --

[jira] [Commented] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965244#comment-15965244 ] Yan Facai (颜发才) commented on SPARK-10788: - [~josephkb] As categories A, B and C are independent,

[jira] [Updated] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruhui Wang updated SPARK-20295: --- Description: when run tpcds-q95, and set spark.sql.adaptive.enabled = true the physical plan

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965220#comment-15965220 ] Reynold Xin commented on SPARK-20202: - There are no currently targeted version, are there? > Remove

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965218#comment-15965218 ] holdenk commented on SPARK-20202: - Would it possible make sense to untarget this from the maintenance

[jira] [Commented] (SPARK-7128) Add generic bagging algorithm to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965121#comment-15965121 ] yuhao yang commented on SPARK-7128: --- I would vote for adding this now. This is quite helpful in

[jira] [Created] (SPARK-20300) Python API for ALSModel.recommendForAllUsers,Items

Joseph K. Bradley created SPARK-20300: - Summary: Python API for ALSModel.recommendForAllUsers,Items Key: SPARK-20300 URL: https://issues.apache.org/jira/browse/SPARK-20300 Project: Spark

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964969#comment-15964969 ] Xin Wu commented on SPARK-20256: Yes. I am working on it. My proposal is to revert the SPARK-18050

[jira] [Created] (SPARK-20299) NullPointerException when null and string are in a tuple while encoding Dataset

Jacek Laskowski created SPARK-20299: --- Summary: NullPointerException when null and string are in a tuple while encoding Dataset Key: SPARK-20299 URL: https://issues.apache.org/jira/browse/SPARK-20299

[jira] [Commented] (SPARK-20256) Fail to start SparkContext/SparkSession with Hive support enabled when user does not have read/write privilege to Hive metastore warehouse dir

[ https://issues.apache.org/jira/browse/SPARK-20256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964945#comment-15964945 ] Dongjoon Hyun commented on SPARK-20256: --- Hi, [~xwu0226]. Is there any progress? > Fail to start

[jira] [Assigned] (SPARK-20298) Spelling mistake: charactor

[ https://issues.apache.org/jira/browse/SPARK-20298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20298: Assignee: Apache Spark > Spelling mistake: charactor > --- > >

[jira] [Assigned] (SPARK-20298) Spelling mistake: charactor

[ https://issues.apache.org/jira/browse/SPARK-20298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20298: Assignee: (was: Apache Spark) > Spelling mistake: charactor >

[jira] [Commented] (SPARK-20298) Spelling mistake: charactor

[ https://issues.apache.org/jira/browse/SPARK-20298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964921#comment-15964921 ] Apache Spark commented on SPARK-20298: -- User 'bdwyer2' has created a pull request for this issue:

[jira] [Commented] (SPARK-20298) Spelling mistake: charactor

[ https://issues.apache.org/jira/browse/SPARK-20298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964889#comment-15964889 ] Sean Owen commented on SPARK-20298: --- Go ahead, though this is not generally worth a JIRA > Spelling

[jira] [Assigned] (SPARK-19505) AttributeError on Exception.message in Python3; hides true exceptions in cloudpickle.py and broadcast.py

[ https://issues.apache.org/jira/browse/SPARK-19505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-19505: --- Assignee: David Gingrich > AttributeError on Exception.message in Python3; hides true exceptions in

[jira] [Resolved] (SPARK-19505) AttributeError on Exception.message in Python3; hides true exceptions in cloudpickle.py and broadcast.py

[ https://issues.apache.org/jira/browse/SPARK-19505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-19505. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16845

[jira] [Commented] (SPARK-20131) Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-20131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964811#comment-15964811 ] Apache Spark commented on SPARK-20131: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-20131) Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialized properly

[ https://issues.apache.org/jira/browse/SPARK-20131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20131: - Summary: Flaky Test: o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be

[jira] [Commented] (SPARK-20296) UnsupportedOperationChecker text on distinct aggregations differs from docs

[ https://issues.apache.org/jira/browse/SPARK-20296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964756#comment-15964756 ] Apache Spark commented on SPARK-20296: -- User 'jtoka' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20296) UnsupportedOperationChecker text on distinct aggregations differs from docs

[ https://issues.apache.org/jira/browse/SPARK-20296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20296: Assignee: Apache Spark > UnsupportedOperationChecker text on distinct aggregations

[jira] [Assigned] (SPARK-20296) UnsupportedOperationChecker text on distinct aggregations differs from docs

[ https://issues.apache.org/jira/browse/SPARK-20296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20296: Assignee: (was: Apache Spark) > UnsupportedOperationChecker text on distinct

[jira] [Resolved] (SPARK-20289) Use StaticInvoke rather than NewInstance for boxing primitive types

[ https://issues.apache.org/jira/browse/SPARK-20289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-20289. - Resolution: Fixed Fix Version/s: 2.2.0 > Use StaticInvoke rather than NewInstance for

[jira] [Commented] (SPARK-20298) Spelling mistake: charactor

[ https://issues.apache.org/jira/browse/SPARK-20298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964741#comment-15964741 ] Brendan Dwyer commented on SPARK-20298: --- I can work on this > Spelling mistake: charactor >

[jira] [Created] (SPARK-20298) Spelling mistake: charactor

Brendan Dwyer created SPARK-20298: - Summary: Spelling mistake: charactor Key: SPARK-20298 URL: https://issues.apache.org/jira/browse/SPARK-20298 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

Mostafa Mokhtar created SPARK-20297: --- Summary: Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala Key: SPARK-20297 URL: https://issues.apache.org/jira/browse/SPARK-20297

[jira] [Updated] (SPARK-20296) UnsupportedOperationChecker text on distinct aggregations differs from docs

[ https://issues.apache.org/jira/browse/SPARK-20296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20296: -- Priority: Trivial (was: Minor) Sounds fine, you can submit a PR to make the messages consistent. >

[jira] [Created] (SPARK-20296) UnsupportedOperationChecker text on distinct aggregations differs from docs

Jason Tokayer created SPARK-20296: - Summary: UnsupportedOperationChecker text on distinct aggregations differs from docs Key: SPARK-20296 URL: https://issues.apache.org/jira/browse/SPARK-20296

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964596#comment-15964596 ] jin xing commented on SPARK-19659: -- *bytesShuffleToMemory* is different from *bytesInFlight*.

[jira] [Comment Edited] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964554#comment-15964554 ] Dan Dutrow edited comment on SPARK-6305 at 4/11/17 4:18 PM: Any update on the

[jira] [Comment Edited] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964587#comment-15964587 ] jin xing edited comment on SPARK-19659 at 4/11/17 4:13 PM: --- [~cloud_fan] Thanks

[jira] [Comment Edited] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964587#comment-15964587 ] jin xing edited comment on SPARK-19659 at 4/11/17 4:11 PM: --- [~cloud_fan] Thanks

[jira] [Comment Edited] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964587#comment-15964587 ] jin xing edited comment on SPARK-19659 at 4/11/17 4:11 PM: --- [~cloud_fan] Thanks

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964587#comment-15964587 ] jin xing commented on SPARK-19659: -- [~cloud_fan] Thanks a lot for taking look into this and sorry for

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964554#comment-15964554 ] Dan Dutrow commented on SPARK-6305: --- Please provide an update on the current status of this ticket? It

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964548#comment-15964548 ] Wenchen Fan commented on SPARK-19659: - [~jinxing6...@126.com] can you say more about fetching shuffle

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964508#comment-15964508 ] jin xing commented on SPARK-19659: -- [~irashid] Tracking memory used by Netty by swapping in our own

[jira] [Commented] (SPARK-19659) Fetch big blocks to disk when shuffle-read

[ https://issues.apache.org/jira/browse/SPARK-19659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964476#comment-15964476 ] Imran Rashid commented on SPARK-19659: -- currently the smallest unit is an entire block. That

[jira] [Commented] (SPARK-16784) Configurable log4j settings

[ https://issues.apache.org/jira/browse/SPARK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964471#comment-15964471 ] Josh Bacon commented on SPARK-16784: [~tscholak] I have not created a follow up issue for this. For

[jira] [Commented] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964463#comment-15964463 ] Sergei Lebedev commented on SPARK-20284: Yes, Scala is a bad citizen in the JVM land and comes

[jira] [Comment Edited] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964438#comment-15964438 ] Björn-Elmar Macek edited comment on SPARK-11788 at 4/11/17 2:39 PM: I

[jira] [Comment Edited] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964438#comment-15964438 ] Björn-Elmar Macek edited comment on SPARK-11788 at 4/11/17 2:34 PM: I

[jira] [Comment Edited] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964438#comment-15964438 ] Björn-Elmar Macek edited comment on SPARK-11788 at 4/11/17 2:28 PM: I

[jira] [Commented] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964438#comment-15964438 ] Björn-Elmar Macek commented on SPARK-11788: --- I have an issue which maybe related and occurs in

[jira] [Commented] (SPARK-20244) Incorrect input size in UI with pyspark

[ https://issues.apache.org/jira/browse/SPARK-20244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964422#comment-15964422 ] Saisai Shao commented on SPARK-20244: - This actually is not a UI problem, it is FileSystem thread

[jira] [Updated] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruhui Wang updated SPARK-20295: --- Description: when spark.sql.exchange.reuse is opened, then run a query with self join(such as

[jira] [Created] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

Ruhui Wang created SPARK-20295: -- Summary: when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue Key: SPARK-20295 URL: https://issues.apache.org/jira/browse/SPARK-20295 Project:

[jira] [Updated] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Pedro Jericó updated SPARK-20294: -- Description: Currently the _inferSchema function on

[jira] [Updated] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

[ https://issues.apache.org/jira/browse/SPARK-20294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Pedro Jericó updated SPARK-20294: -- Description: Currently the _inferSchema function on

[jira] [Created] (SPARK-20294) _inferSchema for RDDs fails if sample returns empty RDD

João Pedro Jericó created SPARK-20294: - Summary: _inferSchema for RDDs fails if sample returns empty RDD Key: SPARK-20294 URL: https://issues.apache.org/jira/browse/SPARK-20294 Project: Spark

[jira] [Assigned] (SPARK-20175) Exists should not be evaluated in Join operator and can be converted to ScalarSubquery if no correlated reference

[ https://issues.apache.org/jira/browse/SPARK-20175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20175: --- Assignee: Liang-Chi Hsieh > Exists should not be evaluated in Join operator and can be

[jira] [Resolved] (SPARK-20175) Exists should not be evaluated in Join operator and can be converted to ScalarSubquery if no correlated reference

[ https://issues.apache.org/jira/browse/SPARK-20175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20175. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17491

[jira] [Resolved] (SPARK-20274) support compatible array element type in encoder

[ https://issues.apache.org/jira/browse/SPARK-20274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20274. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17587

[jira] [Commented] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964263#comment-15964263 ] Sean Owen commented on SPARK-20284: --- It's a developer API, so dont' think callers will generally be

[jira] [Comment Edited] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964257#comment-15964257 ] Sergei Lebedev edited comment on SPARK-20284 at 4/11/17 11:57 AM: -- It

[jira] [Commented] (SPARK-20284) Make SerializationStream and DeserializationStream extend Closeable

[ https://issues.apache.org/jira/browse/SPARK-20284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964257#comment-15964257 ] Sergei Lebedev commented on SPARK-20284: It makes the stream well-behaved for any JVM user, e.g.

[jira] [Assigned] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20293: Assignee: (was: Apache Spark) > In the page of 'jobs' or 'stages' of history server

[jira] [Commented] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964184#comment-15964184 ] Apache Spark commented on SPARK-20293: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20293: Assignee: Apache Spark > In the page of 'jobs' or 'stages' of history server web

[jira] [Updated] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20293: --- Attachment: stages.png jobs.png error2.png

[jira] [Updated] (SPARK-20293) In the page of 'jobs' or 'stages' of history server web ui,,click the 'Go' button, query paging data, the page error

[ https://issues.apache.org/jira/browse/SPARK-20293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20293: --- Description: In the page of 'jobs' or 'stages' of history server web ui, Click on the 'Go'

  1   2   >