[jira] [Comment Edited] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332698#comment-16332698 ] Bryan Cutler edited comment on SPARK-23109 at 1/20/18 3:17 AM:

[jira] [Commented] (SPARK-23163) Sync Python ML API docs with Scala

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16333154#comment-16333154 ] Bryan Cutler commented on SPARK-23163: -- I'll do this, just a few minor things > Syn

[jira] [Created] (SPARK-23163) Sync Python ML API docs with Scala

2018-01-19 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23163: Summary: Sync Python ML API docs with Scala Key: SPARK-23163 URL: https://issues.apache.org/jira/browse/SPARK-23163 Project: Spark Issue Type: Documentation

[jira] [Comment Edited] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332698#comment-16332698 ] Bryan Cutler edited comment on SPARK-23109 at 1/20/18 3:06 AM:

[jira] [Comment Edited] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332698#comment-16332698 ] Bryan Cutler edited comment on SPARK-23109 at 1/20/18 3:05 AM:

[jira] [Updated] (SPARK-23161) Add missing APIs to Python GBTClassifier

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-23161: - Labels: starter (was: ) > Add missing APIs to Python GBTClassifier > ---

[jira] [Created] (SPARK-23162) PySpark ML LinearRegressionSummary missing r2adj

2018-01-19 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23162: Summary: PySpark ML LinearRegressionSummary missing r2adj Key: SPARK-23162 URL: https://issues.apache.org/jira/browse/SPARK-23162 Project: Spark Issue Type:

[jira] [Updated] (SPARK-23161) Add missing APIs to Python GBTClassifier

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-23161: - Priority: Minor (was: Major) > Add missing APIs to Python GBTClassifier > --

[jira] [Comment Edited] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332698#comment-16332698 ] Bryan Cutler edited comment on SPARK-23109 at 1/20/18 3:00 AM:

[jira] [Created] (SPARK-23161) Add missing APIs to Python GBTClassifier

2018-01-19 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23161: Summary: Add missing APIs to Python GBTClassifier Key: SPARK-23161 URL: https://issues.apache.org/jira/browse/SPARK-23161 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be a

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23121: --- Affects Version/s: (was: 2.4.0) 2.3.0 > When the Spark Streaming a

[jira] [Updated] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be a

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-23121: --- Target Version/s: 2.3.0 > When the Spark Streaming app is running for a period of time, the p

[jira] [Updated] (SPARK-23091) Incorrect unit test for approxQuantile

2018-01-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23091: Component/s: SQL > Incorrect unit test for approxQuantile > -- > >

[jira] [Resolved] (SPARK-21771) SparkSQLEnv creates a useless meta hive client

2018-01-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21771. - Resolution: Fixed Assignee: Kent Yao Fix Version/s: 2.3.0 > SparkSQLEnv creates a useless

[jira] [Commented] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332999#comment-16332999 ] Henry Robinson commented on SPARK-23148: It seems like the problem is that {{Cod

[jira] [Comment Edited] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332999#comment-16332999 ] Henry Robinson edited comment on SPARK-23148 at 1/19/18 11:25 PM: -

[jira] [Assigned] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23087: Assignee: (was: Apache Spark) > CheckCartesianProduct too restrictive when condition i

[jira] [Assigned] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23087: Assignee: Apache Spark > CheckCartesianProduct too restrictive when condition is constant

[jira] [Commented] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332907#comment-16332907 ] Apache Spark commented on SPARK-23087: -- User 'mgaido91' has created a pull request f

[jira] [Resolved] (SPARK-23135) Accumulators don't show up properly in the Stages page anymore

2018-01-19 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23135. Resolution: Fixed > Accumulators don't show up properly in the Stages page anymore > --

[jira] [Updated] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-19 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-23087: Priority: Minor (was: Major) > CheckCartesianProduct too restrictive when condition is constant fo

[jira] [Assigned] (SPARK-23135) Accumulators don't show up properly in the Stages page anymore

2018-01-19 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23135: -- Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18085. Resolution: Fixed Fix Version/s: 2.3.0 All of the sub-tasks of the SPIP are committe

[jira] [Updated] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2018-01-19 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-12963: -- Shepherd: Sean Owen > In cluster mode,spark_local_ip will cause driver exception:Service 'Drive

[jira] [Updated] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-21994: --- Attachment: (was: Srinivasa Reddy Vundela.url) > Spark 2.2 can not read Parquet table cre

[jira] [Updated] (SPARK-21994) Spark 2.2 can not read Parquet table created by itself

2018-01-19 Thread Zikun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-21994: -- Attachment: Srinivasa Reddy Vundela.url > Spark 2.2 can not read Parquet table created by itself >

[jira] [Commented] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2018-01-19 Thread paul mackles (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332811#comment-16332811 ] paul mackles commented on SPARK-11499: -- We ran into this issue running the spark-his

[jira] [Resolved] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

2018-01-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-23103. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20284 [https://git

[jira] [Assigned] (SPARK-23103) LevelDB store not iterating correctly when indexed value has negative value

2018-01-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-23103: Assignee: Marcelo Vanzin > LevelDB store not iterating correctly when indexed value has ne

[jira] [Resolved] (SPARK-20664) Remove stale applications from SHS listing

2018-01-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20664. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20138 [https://git

[jira] [Assigned] (SPARK-20664) Remove stale applications from SHS listing

2018-01-19 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-20664: Assignee: Marcelo Vanzin > Remove stale applications from SHS listing > --

[jira] [Commented] (SPARK-22360) Add unit test for Window Specifications

2018-01-19 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332773#comment-16332773 ] Jiang Xingbo commented on SPARK-22360: -- Created https://issues.apache.org/jira/brows

[jira] [Created] (SPARK-23160) Add more window sql tests

2018-01-19 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-23160: Summary: Add more window sql tests Key: SPARK-23160 URL: https://issues.apache.org/jira/browse/SPARK-23160 Project: Spark Issue Type: Sub-task Comp

[jira] [Commented] (SPARK-22360) Add unit test for Window Specifications

2018-01-19 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332762#comment-16332762 ] Jiang Xingbo commented on SPARK-22360: -- Sorry for late response. It's great that we

[jira] [Commented] (SPARK-23138) Add user guide example for multiclass logistic regression summary

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332754#comment-16332754 ] Apache Spark commented on SPARK-23138: -- User 'sethah' has created a pull request for

[jira] [Assigned] (SPARK-23138) Add user guide example for multiclass logistic regression summary

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23138: Assignee: (was: Apache Spark) > Add user guide example for multiclass logistic regress

[jira] [Assigned] (SPARK-23138) Add user guide example for multiclass logistic regression summary

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23138: Assignee: Apache Spark > Add user guide example for multiclass logistic regression summary

[jira] [Commented] (SPARK-23159) Update Cloudpickle to match version 0.4.2

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332752#comment-16332752 ] Bryan Cutler commented on SPARK-23159: -- I can work on this > Update Cloudpickle to

[jira] [Created] (SPARK-23159) Update Cloudpickle to match version 0.4.2

2018-01-19 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-23159: Summary: Update Cloudpickle to match version 0.4.2 Key: SPARK-23159 URL: https://issues.apache.org/jira/browse/SPARK-23159 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332703#comment-16332703 ] Bryan Cutler commented on SPARK-23109: -- [~josephkb] the image module is missing many

[jira] [Commented] (SPARK-23109) ML 2.3 QA: API: Python API coverage

2018-01-19 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332698#comment-16332698 ] Bryan Cutler commented on SPARK-23109: -- I did the following: generated HTML doc and

[jira] [Resolved] (SPARK-23137) spark.kubernetes.executor.podNamePrefix is ignored

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23137. Resolution: Fixed Assignee: Anirudh Ramanathan Fix Version/s: 2.3.0 > spark

[jira] [Resolved] (SPARK-23104) Document that kubernetes is still "experimental"

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23104. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20314 [https:/

[jira] [Assigned] (SPARK-16617) Upgrade to Avro 1.8.x

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-16617: -- Assignee: (was: Marcelo Vanzin) > Upgrade to Avro 1.8.x > - >

[jira] [Assigned] (SPARK-16617) Upgrade to Avro 1.8.x

2018-01-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-16617: -- Assignee: Marcelo Vanzin > Upgrade to Avro 1.8.x > - > >

[jira] [Assigned] (SPARK-23158) Move HadoopFsRelationTest test suites to from sql/hive to sql/core

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23158: Assignee: Xiao Li (was: Apache Spark) > Move HadoopFsRelationTest test suites to from sql

[jira] [Commented] (SPARK-23158) Move HadoopFsRelationTest test suites to from sql/hive to sql/core

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332570#comment-16332570 ] Apache Spark commented on SPARK-23158: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-23158) Move HadoopFsRelationTest test suites to from sql/hive to sql/core

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23158: Assignee: Apache Spark (was: Xiao Li) > Move HadoopFsRelationTest test suites to from sql

[jira] [Created] (SPARK-23158) Move HadoopFsRelationTest test suites to from sql/hive to sql/core

2018-01-19 Thread Xiao Li (JIRA)
Xiao Li created SPARK-23158: --- Summary: Move HadoopFsRelationTest test suites to from sql/hive to sql/core Key: SPARK-23158 URL: https://issues.apache.org/jira/browse/SPARK-23158 Project: Spark Iss

[jira] [Resolved] (SPARK-23149) polish ColumnarBatch

2018-01-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23149. - Resolution: Fixed Fix Version/s: 2.3.0 > polish ColumnarBatch > > >

[jira] [Created] (SPARK-23157) withColumn fails for a column that is a result of mapped DataSet

2018-01-19 Thread Tomasz Bartczak (JIRA)
Tomasz Bartczak created SPARK-23157: --- Summary: withColumn fails for a column that is a result of mapped DataSet Key: SPARK-23157 URL: https://issues.apache.org/jira/browse/SPARK-23157 Project: Spark

[jira] [Commented] (SPARK-23156) Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

2018-01-19 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332434#comment-16332434 ] Marco Gaido commented on SPARK-23156: - [~kzawisto] a lot of work on this has been don

[jira] [Resolved] (SPARK-23085) API parity for mllib.linalg.Vectors.sparse

2018-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23085. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20275 [https://github.co

[jira] [Assigned] (SPARK-23085) API parity for mllib.linalg.Vectors.sparse

2018-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23085: - Assignee: zhengruifeng > API parity for mllib.linalg.Vectors.sparse > -

[jira] [Updated] (SPARK-23156) Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

2018-01-19 Thread Krystian Zawistowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krystian Zawistowski updated SPARK-23156: - Description: I am getting this trying to generate a random DataFrame  (300 column

[jira] [Updated] (SPARK-23156) Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

2018-01-19 Thread Krystian Zawistowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krystian Zawistowski updated SPARK-23156: - Description: I am getting this trying to generate a random DataFrame  (300 column

[jira] [Updated] (SPARK-23156) Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

2018-01-19 Thread Krystian Zawistowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krystian Zawistowski updated SPARK-23156: - Description: I am getting this trying to generate a random DataFrame  (300 column

[jira] [Created] (SPARK-23156) Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

2018-01-19 Thread Krystian Zawistowski (JIRA)
Krystian Zawistowski created SPARK-23156: Summary: Code of method "initialize(I)V" of class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB Key: SPARK-23156

[jira] [Updated] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2018-01-19 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-22577: --- Attachment: node_blacklisting_for_stage.png > executor page blacklist status should u

[jira] [Assigned] (SPARK-23024) Spark ui about the contents of the form need to have hidden and show features, when the table records very much.

2018-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23024: - Assignee: guoxiaolongzte > Spark ui about the contents of the form need to have hidden and show

[jira] [Resolved] (SPARK-23024) Spark ui about the contents of the form need to have hidden and show features, when the table records very much.

2018-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23024. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20216 [https://github.co

[jira] [Commented] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be

2018-01-19 Thread Sandor Murakozi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332300#comment-16332300 ] Sandor Murakozi commented on SPARK-23121: - One issue is with displaying old jobs.

[jira] [Commented] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be

2018-01-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332294#comment-16332294 ] Sean Owen commented on SPARK-23121: --- Yes that sounds right. But doesn't it just cause a

[jira] [Commented] (SPARK-23154) Document backwards compatibility guarantees for ML persistence

2018-01-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332252#comment-16332252 ] Nick Pentreath commented on SPARK-23154: SGTM > Document backwards compatibility

[jira] [Commented] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be

2018-01-19 Thread Sandor Murakozi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332249#comment-16332249 ] Sandor Murakozi commented on SPARK-23121: - [~guoxiaolongzte] found two separate p

[jira] [Commented] (SPARK-23121) When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332215#comment-16332215 ] Apache Spark commented on SPARK-23121: -- User 'smurakozi' has created a pull request

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

2018-01-19 Thread Artem Kalchenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332211#comment-16332211 ] Artem Kalchenko commented on SPARK-15467: - I guess I'm still experiencing this is

[jira] [Assigned] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

2018-01-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23089: --- Assignee: Marco Gaido > "Unable to create operation log session directory" when parent direc

[jira] [Resolved] (SPARK-23089) "Unable to create operation log session directory" when parent directory not present

2018-01-19 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23089. - Resolution: Fixed Fix Version/s: 2.3.0 > "Unable to create operation log session directory

[jira] [Commented] (SPARK-7146) Should ML sharedParams be a public API?

2018-01-19 Thread Lucas Partridge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332135#comment-16332135 ] Lucas Partridge commented on SPARK-7146: What's the semantic difference between Ha

[jira] [Commented] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread ANDY GUAN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332133#comment-16332133 ] ANDY GUAN commented on SPARK-23148: --- Looks like the same problem with  [SPARK-21996|htt

[jira] [Assigned] (SPARK-23048) Update mllib docs to replace OneHotEncoder with OneHotEncoderEstimator

2018-01-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-23048: -- Assignee: Liang-Chi Hsieh > Update mllib docs to replace OneHotEncoder with OneHotEnco

[jira] [Resolved] (SPARK-23048) Update mllib docs to replace OneHotEncoder with OneHotEncoderEstimator

2018-01-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-23048. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20257 [https:/

[jira] [Resolved] (SPARK-23127) Update FeatureHasher user guide for catCols parameter

2018-01-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-23127. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20293 [https:/

[jira] [Assigned] (SPARK-23127) Update FeatureHasher user guide for catCols parameter

2018-01-19 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-23127: -- Assignee: Nick Pentreath > Update FeatureHasher user guide for catCols parameter > ---

[jira] [Comment Edited] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332041#comment-16332041 ] Bogdan Raducanu edited comment on SPARK-23148 at 1/19/18 10:18 AM:

[jira] [Updated] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated SPARK-23148: Description: Repro code: {code:java} spark.range(10).write.csv("/tmp/a b c/a.csv") spark.re

[jira] [Commented] (SPARK-23148) spark.read.csv with multiline=true gives FileNotFoundException if path contains spaces

2018-01-19 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16332041#comment-16332041 ] Bogdan Raducanu commented on SPARK-23148: - What do you mean? > spark.read.csv wi

[jira] [Commented] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

2018-01-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16331870#comment-16331870 ] Apache Spark commented on SPARK-23000: -- User 'gatorsmile' has created a pull request