[jira] [Updated] (SPARK-22891) NullPointerException when use udf

2017-12-22 Thread gaoyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyang updated SPARK-22891: Description: In my application,i use multi threads. Each thread has a SparkSession and use

[jira] [Created] (SPARK-22891) NullPointerException when use udf

2017-12-22 Thread gaoyang (JIRA)
gaoyang created SPARK-22891: --- Summary: NullPointerException when use udf Key: SPARK-22891 URL: https://issues.apache.org/jira/browse/SPARK-22891 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22789) Add ContinuousExecution for continuous processing queries

2017-12-22 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22789. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19984

[jira] [Assigned] (SPARK-22789) Add ContinuousExecution for continuous processing queries

2017-12-22 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-22789: Assignee: Jose Torres > Add ContinuousExecution for continuous processing queries >

[jira] [Assigned] (SPARK-22890) Basic tests for DateTimeOperations

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22890: Assignee: (was: Apache Spark) > Basic tests for DateTimeOperations >

[jira] [Commented] (SPARK-22890) Basic tests for DateTimeOperations

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302174#comment-16302174 ] Apache Spark commented on SPARK-22890: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22890) Basic tests for DateTimeOperations

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22890: Assignee: Apache Spark > Basic tests for DateTimeOperations >

[jira] [Created] (SPARK-22890) Basic tests for DateTimeOperations

2017-12-22 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22890: --- Summary: Basic tests for DateTimeOperations Key: SPARK-22890 URL: https://issues.apache.org/jira/browse/SPARK-22890 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22881: Assignee: Weichen Xu (was: Apache Spark) > ML test for StructuredStreaming:

[jira] [Commented] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302166#comment-16302166 ] Apache Spark commented on SPARK-22881: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22881: Assignee: Apache Spark (was: Weichen Xu) > ML test for StructuredStreaming:

[jira] [Assigned] (SPARK-22889) CRAN checks can fail if older Spark install exists

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22889: Assignee: (was: Apache Spark) > CRAN checks can fail if older Spark install exists >

[jira] [Assigned] (SPARK-22889) CRAN checks can fail if older Spark install exists

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22889: Assignee: Apache Spark > CRAN checks can fail if older Spark install exists >

[jira] [Commented] (SPARK-22889) CRAN checks can fail if older Spark install exists

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302139#comment-16302139 ] Apache Spark commented on SPARK-22889: -- User 'shivaram' has created a pull request for this issue:

[jira] [Created] (SPARK-22889) CRAN checks can fail if older Spark install exists

2017-12-22 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-22889: - Summary: CRAN checks can fail if older Spark install exists Key: SPARK-22889 URL: https://issues.apache.org/jira/browse/SPARK-22889 Project: Spark

[jira] [Assigned] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

2017-12-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22881: - Assignee: Weichen Xu > ML test for StructuredStreaming: spark.ml.regression >

[jira] [Comment Edited] (SPARK-21926) Compatibility between ML Transformers and Structured Streaming

2017-12-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212962#comment-16212962 ] Joseph K. Bradley edited comment on SPARK-21926 at 12/22/17 10:40 PM:

[jira] [Created] (SPARK-22888) OneVsRestModel does not work with Structured Streaming

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22888: - Summary: OneVsRestModel does not work with Structured Streaming Key: SPARK-22888 URL: https://issues.apache.org/jira/browse/SPARK-22888 Project: Spark

[jira] [Created] (SPARK-22886) ML test for StructuredStreaming: spark.ml.recommendation

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22886: - Summary: ML test for StructuredStreaming: spark.ml.recommendation Key: SPARK-22886 URL: https://issues.apache.org/jira/browse/SPARK-22886 Project: Spark

[jira] [Created] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22887: - Summary: ML test for StructuredStreaming: spark.ml.fpm Key: SPARK-22887 URL: https://issues.apache.org/jira/browse/SPARK-22887 Project: Spark

[jira] [Created] (SPARK-22885) ML test for StructuredStreaming: spark.ml.tuning

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22885: - Summary: ML test for StructuredStreaming: spark.ml.tuning Key: SPARK-22885 URL: https://issues.apache.org/jira/browse/SPARK-22885 Project: Spark

[jira] [Created] (SPARK-22884) ML test for StructuredStreaming: spark.ml.clustering

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22884: - Summary: ML test for StructuredStreaming: spark.ml.clustering Key: SPARK-22884 URL: https://issues.apache.org/jira/browse/SPARK-22884 Project: Spark

[jira] [Created] (SPARK-22883) ML test for StructuredStreaming: spark.ml.feature

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22883: - Summary: ML test for StructuredStreaming: spark.ml.feature Key: SPARK-22883 URL: https://issues.apache.org/jira/browse/SPARK-22883 Project: Spark

[jira] [Created] (SPARK-22882) ML test for StructuredStreaming: spark.ml.classification

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22882: - Summary: ML test for StructuredStreaming: spark.ml.classification Key: SPARK-22882 URL: https://issues.apache.org/jira/browse/SPARK-22882 Project: Spark

[jira] [Created] (SPARK-22881) ML test for StructuredStreaming: spark.ml.regression

2017-12-22 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-22881: - Summary: ML test for StructuredStreaming: spark.ml.regression Key: SPARK-22881 URL: https://issues.apache.org/jira/browse/SPARK-22881 Project: Spark

[jira] [Commented] (SPARK-22648) Documentation for Kubernetes Scheduler Backend

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302006#comment-16302006 ] Apache Spark commented on SPARK-22648: -- User 'liyinan926' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22346) Update VectorAssembler to work with Structured Streaming

2017-12-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-22346. --- Resolution: Fixed Fix Version/s: 2.3.0 Resolved via

[jira] [Assigned] (SPARK-22346) Update VectorAssembler to work with Structured Streaming

2017-12-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-22346: - Assignee: Bago Amirbekian > Update VectorAssembler to work with Structured

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301986#comment-16301986 ] Apache Spark commented on SPARK-22126: -- User 'MrBago' has created a pull request for this issue:

[jira] [Commented] (SPARK-22879) LogisticRegression inconsistent prediction when proba == threshold

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301801#comment-16301801 ] Sean Owen commented on SPARK-22879: --- Yes these are algebraically the same but not exactly the same due

[jira] [Comment Edited] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Daniel van der Ende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301772#comment-16301772 ] Daniel van der Ende edited comment on SPARK-22880 at 12/22/17 6:31 PM:

[jira] [Commented] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Daniel van der Ende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301772#comment-16301772 ] Daniel van der Ende commented on SPARK-22880: - It's different in the sense that

[jira] [Commented] (SPARK-22766) Install R linter package in spark lib directory

2017-12-22 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301751#comment-16301751 ] Hossein Falaki commented on SPARK-22766: [~felixcheung] This just makes installation of whatever

[jira] [Commented] (SPARK-22879) LogisticRegression inconsistent prediction when proba == threshold

2017-12-22 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301724#comment-16301724 ] Adrien Lavoillotte commented on SPARK-22879: In my case, the threshold was

[jira] [Commented] (SPARK-22879) LogisticRegression inconsistent prediction when proba == threshold

2017-12-22 Thread Adrien Lavoillotte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301718#comment-16301718 ] Adrien Lavoillotte commented on SPARK-22879: I'm saying that, given a threshold {{t}}, the

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

2017-12-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301717#comment-16301717 ] Felix Cheung commented on SPARK-22683: -- I think the challenge here is the ability to determine

[jira] [Resolved] (SPARK-22809) pyspark is sensitive to imports with dots

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22809. --- Resolution: Not A Problem It's still not clear this isn't some other error swallowed by

[jira] [Comment Edited] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

2017-12-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301709#comment-16301709 ] Felix Cheung edited comment on SPARK-22683 at 12/22/17 5:35 PM: I

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

2017-12-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301709#comment-16301709 ] Felix Cheung commented on SPARK-22683: -- I couldn't find the exact source line, but from running

[jira] [Commented] (SPARK-22870) Dynamic allocation should allow 0 idle time

2017-12-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301701#comment-16301701 ] Felix Cheung commented on SPARK-22870: -- +1 yes there is more than the check for the value 0 as the

[jira] [Updated] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22880: -- Priority: Minor (was: Major) How is this different from SPARK-22717? > Add option to cascade jdbc

[jira] [Resolved] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22872. --- Resolution: Invalid Questions to the mailing list please > Spark ML Pipeline Model Persistent

[jira] [Commented] (SPARK-22879) LogisticRegression inconsistent prediction when proba == threshold

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301681#comment-16301681 ] Sean Owen commented on SPARK-22879: --- I'm not quite following here. In both cases the rule is "1 if >

[jira] [Updated] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22875: -- Shepherd: (was: Steve Loughran) Flags: (was: Patch) Priority: Minor (was: Major) >

[jira] [Commented] (SPARK-22870) Dynamic allocation should allow 0 idle time

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301667#comment-16301667 ] Sean Owen commented on SPARK-22870: --- Seems reasonable to me. > Dynamic allocation should allow 0 idle

[jira] [Assigned] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22880: Assignee: (was: Apache Spark) > Add option to cascade jdbc truncate if database

[jira] [Commented] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301591#comment-16301591 ] Apache Spark commented on SPARK-22880: -- User 'danielvdende' has created a pull request for this

[jira] [Assigned] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22880: Assignee: Apache Spark > Add option to cascade jdbc truncate if database supports this

[jira] [Created] (SPARK-22880) Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle)

2017-12-22 Thread Daniel van der Ende (JIRA)
Daniel van der Ende created SPARK-22880: --- Summary: Add option to cascade jdbc truncate if database supports this (PostgreSQL and Oracle) Key: SPARK-22880 URL:

[jira] [Commented] (SPARK-22867) Add Isolation Forest algorithm to MLlib

2017-12-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301498#comment-16301498 ] Sean Owen commented on SPARK-22867: --- The problem is that this goes for a hundred things. I don't think

[jira] [Created] (SPARK-22879) LogisticRegression inconsistent prediction when proba == threshold

2017-12-22 Thread Adrien Lavoillotte (JIRA)
Adrien Lavoillotte created SPARK-22879: -- Summary: LogisticRegression inconsistent prediction when proba == threshold Key: SPARK-22879 URL: https://issues.apache.org/jira/browse/SPARK-22879

[jira] [Assigned] (SPARK-22878) Count totalDroppedEvents for LiveListenerBus

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22878: Assignee: (was: Apache Spark) > Count totalDroppedEvents for LiveListenerBus >

[jira] [Commented] (SPARK-22878) Count totalDroppedEvents for LiveListenerBus

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301341#comment-16301341 ] Apache Spark commented on SPARK-22878: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22878) Count totalDroppedEvents for LiveListenerBus

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22878: Assignee: Apache Spark > Count totalDroppedEvents for LiveListenerBus >

[jira] [Created] (SPARK-22878) Count totalDroppedEvents for LiveListenerBus

2017-12-22 Thread wuyi (JIRA)
wuyi created SPARK-22878: Summary: Count totalDroppedEvents for LiveListenerBus Key: SPARK-22878 URL: https://issues.apache.org/jira/browse/SPARK-22878 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22874. -- Resolution: Fixed Fix Version/s: 2.3.0 Fixed in

[jira] [Assigned] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22874: Assignee: Takuya Ueshin > Modify checking pandas version to use LooseVersion. >

[jira] [Closed] (SPARK-22877) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2017-12-22 Thread Jinhan Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhan Zhong closed SPARK-22877. > spark.yarn.am.attemptFailuresValidityInterval does not work correctly >

[jira] [Resolved] (SPARK-22877) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2017-12-22 Thread Jinhan Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhan Zhong resolved SPARK-22877. -- Resolution: Duplicate > spark.yarn.am.attemptFailuresValidityInterval does not work correctly

[jira] [Updated] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2017-12-22 Thread Jinhan Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhan Zhong updated SPARK-22876: - Description: I assume we can use spark.yarn.maxAppAttempts together with

[jira] [Updated] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-22875: -- Flags: Patch > Assembly build fails for a high user id >

[jira] [Created] (SPARK-22877) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2017-12-22 Thread Jinhan Zhong (JIRA)
Jinhan Zhong created SPARK-22877: Summary: spark.yarn.am.attemptFailuresValidityInterval does not work correctly Key: SPARK-22877 URL: https://issues.apache.org/jira/browse/SPARK-22877 Project: Spark

[jira] [Updated] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-22875: -- Shepherd: Steve Loughran > Assembly build fails for a high user id >

[jira] [Created] (SPARK-22876) spark.yarn.am.attemptFailuresValidityInterval does not work correctly

2017-12-22 Thread Jinhan Zhong (JIRA)
Jinhan Zhong created SPARK-22876: Summary: spark.yarn.am.attemptFailuresValidityInterval does not work correctly Key: SPARK-22876 URL: https://issues.apache.org/jira/browse/SPARK-22876 Project: Spark

[jira] [Assigned] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22875: Assignee: (was: Apache Spark) > Assembly build fails for a high user id >

[jira] [Assigned] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22875: Assignee: Apache Spark > Assembly build fails for a high user id >

[jira] [Commented] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301148#comment-16301148 ] Apache Spark commented on SPARK-22875: -- User 'gerashegalov' has created a pull request for this

[jira] [Created] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-22875: - Summary: Assembly build fails for a high user id Key: SPARK-22875 URL: https://issues.apache.org/jira/browse/SPARK-22875 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

2017-12-22 Thread Cyanny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I have a project about model transformation with PMML, it needs to transform models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

2017-12-22 Thread Cyanny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I have a project about model transformation with PMML, it needs to transform models

[jira] [Assigned] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22874: Assignee: Apache Spark > Modify checking pandas version to use LooseVersion. >

[jira] [Assigned] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22874: Assignee: (was: Apache Spark) > Modify checking pandas version to use LooseVersion. >

[jira] [Commented] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301101#comment-16301101 ] Apache Spark commented on SPARK-22874: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-22874) Modify checking pandas version to use LooseVersion.

2017-12-22 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-22874: - Summary: Modify checking pandas version to use LooseVersion. Key: SPARK-22874 URL: https://issues.apache.org/jira/browse/SPARK-22874 Project: Spark Issue

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

2017-12-22 Thread Cyanny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and our project needs to transform many models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

2017-12-22 Thread Cyanny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and our project needs to transform many models