[jira] [Commented] (SPARK-22943) OneHotEncoder supports manual specification of categorySizes

2018-01-05 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314412#comment-16314412 ] yuhao yang commented on SPARK-22943: Feel free to work on this but I would suggest to get green light

[jira] [Commented] (SPARK-22967) VersionSuite failed on Windows caused by unescapeSQLString()

2018-01-05 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314380#comment-16314380 ] wuyi commented on SPARK-22967: -- I'd like to open a PR, but I'm not 100% sure how to fix this bug yet. As you

[jira] [Comment Edited] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2018-01-05 Thread Michael Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314369#comment-16314369 ] Michael Huang edited comment on SPARK-12945 at 1/6/18 4:52 AM: --- We started

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2018-01-05 Thread Michael Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314369#comment-16314369 ] Michael Huang commented on SPARK-12945: --- We started seeing these exceptions after dialing down

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When CreateHiveTableAsSelectCommand or InsertIntoHiveTable, SQL tab don't show

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When CreateHiveTableAsSelectCommand or InsertIntoHiveTable, !before.png! !after.png!

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: after.png before.png > DataFrameWriter operations do not show details

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Description: When create !before.png! !after.png! > DataFrameWriter operations do not show

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: (was: after.png) > DataFrameWriter operations do not show details in SQL tab >

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: (was: before.png) > DataFrameWriter operations do not show details in SQL tab >

[jira] [Updated] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22977: Attachment: after.png before.png > DataFrameWriter operations do not show details

[jira] [Created] (SPARK-22977) DataFrameWriter operations do not show details in SQL tab

2018-01-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22977: --- Summary: DataFrameWriter operations do not show details in SQL tab Key: SPARK-22977 URL: https://issues.apache.org/jira/browse/SPARK-22977 Project: Spark

[jira] [Commented] (SPARK-22809) pyspark is sensitive to imports with dots

2018-01-05 Thread Cricket Temple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314318#comment-16314318 ] Cricket Temple commented on SPARK-22809: Much shorter version {code:python} import cloudpickle

[jira] [Commented] (SPARK-22809) pyspark is sensitive to imports with dots

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314308#comment-16314308 ] holdenk commented on SPARK-22809: - Note we used a simple {code:python} def foo(x): return

[jira] [Updated] (SPARK-22809) pyspark is sensitive to imports with dots

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22809: Affects Version/s: 2.2.1 Target Version/s: 2.3.0 > pyspark is sensitive to imports with dots >

[jira] [Reopened] (SPARK-22809) pyspark is sensitive to imports with dots

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-22809: - Assignee: holdenk After further investigation this turns out to be an issue maye have been fixed

[jira] [Resolved] (SPARK-22937) SQL elt for binary inputs

2018-01-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22937. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > SQL elt for binary

[jira] [Resolved] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22914. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20098

[jira] [Assigned] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22914: -- Assignee: Gera Shegalov > Subbing for spark.history.ui.port does not resolve by

[jira] [Updated] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22914: --- Priority: Minor (was: Major) > Subbing for spark.history.ui.port does not resolve by

[jira] [Updated] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22914: --- Issue Type: Improvement (was: Bug) > Subbing for spark.history.ui.port does not resolve by

[jira] [Updated] (SPARK-22406) pyspark version tag is wrong on PyPi

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22406: Fix Version/s: 2.1.2 2.2.1 > pyspark version tag is wrong on PyPi >

[jira] [Resolved] (SPARK-22406) pyspark version tag is wrong on PyPi

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22406. - Resolution: Fixed We've posted 2.2.1 & 2.1.2 to PyPi with out the post issue. > pyspark version tag is

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2018-01-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314233#comment-16314233 ] holdenk commented on SPARK-22406: - Yes. I'll close this. > pyspark version tag is wrong on PyPi >

[jira] [Updated] (SPARK-22976) Worker cleanup can remove running driver directories

2018-01-05 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Spitzer updated SPARK-22976: Description: Spark Standalone worker cleanup finds directories to remove with a listFiles

[jira] [Created] (SPARK-22976) Workerer cleanup can remove running driver directories

2018-01-05 Thread Russell Spitzer (JIRA)
Russell Spitzer created SPARK-22976: --- Summary: Workerer cleanup can remove running driver directories Key: SPARK-22976 URL: https://issues.apache.org/jira/browse/SPARK-22976 Project: Spark

[jira] [Updated] (SPARK-22976) Worker cleanup can remove running driver directories

2018-01-05 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Spitzer updated SPARK-22976: Summary: Worker cleanup can remove running driver directories (was: Workerer cleanup can

[jira] [Updated] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22914: -- Shepherd: (was: Sean Owen) > Subbing for spark.history.ui.port does not resolve by default >

[jira] [Updated] (SPARK-22967) VersionSuite failed on Windows caused by unescapeSQLString()

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22967: -- Shepherd: (was: Sean Owen) > VersionSuite failed on Windows caused by unescapeSQLString() >

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314106#comment-16314106 ] Sean Owen commented on SPARK-22406: --- [~holden.ka...@gmail.com] [~felixcheung] is this bit actually done

[jira] [Updated] (SPARK-22913) Hive Partition Pruning, Fractional and Timestamp types

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22913: -- Fix Version/s: (was: 2.3.0) > Hive Partition Pruning, Fractional and Timestamp types >

[jira] [Updated] (SPARK-22952) Deprecate stageAttemptId in favour of stageAttemptNumber

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22952: -- Fix Version/s: (was: 2.3.0) > Deprecate stageAttemptId in favour of stageAttemptNumber >

[jira] [Updated] (SPARK-19241) remove hive generated table properties if they are not useful in Spark

2018-01-05 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-19241: --- Target Version/s: 2.4.0 (was: 2.3.0) > remove hive generated table properties if they are

[jira] [Commented] (SPARK-19241) remove hive generated table properties if they are not useful in Spark

2018-01-05 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314081#comment-16314081 ] Sameer Agarwal commented on SPARK-19241: re-targeting this for 2.4.0 > remove hive generated

[jira] [Updated] (SPARK-19489) Stable serialization format for external & native code integration

2018-01-05 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-19489: --- Target Version/s: 2.4.0 (was: 2.3.0) > Stable serialization format for external & native

[jira] [Commented] (SPARK-22960) Make build-push-docker-images.sh more dev-friendly

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314061#comment-16314061 ] Apache Spark commented on SPARK-22960: -- User 'liyinan926' has created a pull request for this issue:

[jira] [Commented] (SPARK-17088) IsolatedClientLoader fails to load Hive client when sharesHadoopClasses is false

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314029#comment-16314029 ] Apache Spark commented on SPARK-17088: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17088) IsolatedClientLoader fails to load Hive client when sharesHadoopClasses is false

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17088: Assignee: (was: Apache Spark) > IsolatedClientLoader fails to load Hive client when

[jira] [Assigned] (SPARK-17088) IsolatedClientLoader fails to load Hive client when sharesHadoopClasses is false

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17088: Assignee: Apache Spark > IsolatedClientLoader fails to load Hive client when

[jira] [Comment Edited] (SPARK-22126) Fix model-specific optimization support for ML tuning

2018-01-05 Thread Bago Amirbekian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313958#comment-16313958 ] Bago Amirbekian edited comment on SPARK-22126 at 1/5/18 9:48 PM: - > Do

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

2018-01-05 Thread Bago Amirbekian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313958#comment-16313958 ] Bago Amirbekian commented on SPARK-22126: - > Do you think it's possible to put this kind of

[jira] [Commented] (SPARK-22954) ANALYZE TABLE fails with NoSuchTableException for temporary tables (but should have reported "not supported on views")

2018-01-05 Thread Suchith J N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313956#comment-16313956 ] Suchith J N commented on SPARK-22954: - I found another method in

[jira] [Commented] (SPARK-22954) ANALYZE TABLE fails with NoSuchTableException for temporary tables (but should have reported "not supported on views")

2018-01-05 Thread Suchith J N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313915#comment-16313915 ] Suchith J N commented on SPARK-22954: - I run the commands you mentioned. Actually, there are two

[jira] [Commented] (SPARK-22126) Fix model-specific optimization support for ML tuning

2018-01-05 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313833#comment-16313833 ] Bryan Cutler commented on SPARK-22126: -- Hi [~bago.amirbekian], I was looking into similar pipeline

[jira] [Commented] (SPARK-7755) MetadataCache.refresh does not take into account _SUCCESS

2018-01-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313803#comment-16313803 ] Steve Loughran commented on SPARK-7755: --- I concur with [~hyukjin.kwon] here: if incomplete files are

[jira] [Commented] (SPARK-13030) Change OneHotEncoder to Estimator

2018-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313760#comment-16313760 ] Joseph K. Bradley commented on SPARK-13030: --- Merged https://github.com/apache/spark/pull/20132

[jira] [Created] (SPARK-22975) MetricsReporter producing NullPointerException when there was no progress reported

2018-01-05 Thread Yuriy Bondaruk (JIRA)
Yuriy Bondaruk created SPARK-22975: -- Summary: MetricsReporter producing NullPointerException when there was no progress reported Key: SPARK-22975 URL: https://issues.apache.org/jira/browse/SPARK-22975

[jira] [Created] (SPARK-22974) CountVectorModel does not attach attributes to output column

2018-01-05 Thread William Zhang (JIRA)
William Zhang created SPARK-22974: - Summary: CountVectorModel does not attach attributes to output column Key: SPARK-22974 URL: https://issues.apache.org/jira/browse/SPARK-22974 Project: Spark

[jira] [Updated] (SPARK-22974) CountVectorModel does not attach attributes to output column

2018-01-05 Thread William Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zhang updated SPARK-22974: -- Description: If CountVectorModel transforms columns, the output column will not have

[jira] [Assigned] (SPARK-22730) Add support for non-integer image formats

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22730: Assignee: (was: Apache Spark) > Add support for non-integer image formats >

[jira] [Commented] (SPARK-22730) Add support for non-integer image formats

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313615#comment-16313615 ] Apache Spark commented on SPARK-22730: -- User 'tomasatdatabricks' has created a pull request for this

[jira] [Assigned] (SPARK-22730) Add support for non-integer image formats

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22730: Assignee: Apache Spark > Add support for non-integer image formats >

[jira] [Resolved] (SPARK-22940) Test suite HiveExternalCatalogVersionsSuite fails on platforms that don't have wget installed

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22940. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20147

[jira] [Assigned] (SPARK-22940) Test suite HiveExternalCatalogVersionsSuite fails on platforms that don't have wget installed

2018-01-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22940: -- Assignee: Bruce Robbins > Test suite HiveExternalCatalogVersionsSuite fails on

[jira] [Assigned] (SPARK-16501) spark.mesos.secret exposed on UI and command line

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16501: Assignee: Apache Spark > spark.mesos.secret exposed on UI and command line >

[jira] [Commented] (SPARK-16501) spark.mesos.secret exposed on UI and command line

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313500#comment-16313500 ] Apache Spark commented on SPARK-16501: -- User 'rvesse' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16501) spark.mesos.secret exposed on UI and command line

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16501: Assignee: (was: Apache Spark) > spark.mesos.secret exposed on UI and command line >

[jira] [Issue Comment Deleted] (SPARK-22943) OneHotEncoder supports manual specification of categorySizes

2018-01-05 Thread Suchith J N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suchith J N updated SPARK-22943: Comment: was deleted (was: I would like to work on this. Could someone tell me if they have

[jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL

2018-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313419#comment-16313419 ] Reynold Xin commented on SPARK-22947: - Yes you convinced me. This seems too annoying to express in

[jira] [Assigned] (SPARK-22973) Incorrect results of casting Map to String

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22973: Assignee: (was: Apache Spark) > Incorrect results of casting Map to String >

[jira] [Commented] (SPARK-22973) Incorrect results of casting Map to String

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313335#comment-16313335 ] Apache Spark commented on SPARK-22973: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22973) Incorrect results of casting Map to String

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22973: Assignee: Apache Spark > Incorrect results of casting Map to String >

[jira] [Created] (SPARK-22973) Incorrect results of casting Map to String

2018-01-05 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-22973: Summary: Incorrect results of casting Map to String Key: SPARK-22973 URL: https://issues.apache.org/jira/browse/SPARK-22973 Project: Spark Issue

[jira] [Commented] (SPARK-22970) Getting Application ID from Submission ID

2018-01-05 Thread Mehmet Uluer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313265#comment-16313265 ] Mehmet Uluer commented on SPARK-22970: -- Sorry for mistake, definitely not, > Getting Application ID

[jira] [Commented] (SPARK-22967) VersionSuite failed on Windows caused by unescapeSQLString()

2018-01-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313254#comment-16313254 ] Hyukjin Kwon commented on SPARK-22967: -- Yup, it's a known issue. I have been fixing the tests in

[jira] [Commented] (SPARK-22943) OneHotEncoder supports manual specification of categorySizes

2018-01-05 Thread Suchith J N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313241#comment-16313241 ] Suchith J N commented on SPARK-22943: - I would like to work on this. Could someone tell me if they

[jira] [Updated] (SPARK-22970) Getting Application ID from Submission ID

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22970: -- Priority: Minor (was: Blocker) [~mehmet.uluer] please read http://spark.apache.org/contributing.html

[jira] [Updated] (SPARK-22968) java.lang.IllegalStateException: No current assignment for partition kssh-2

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22968: -- External issue ID: (was: https://issues.apache.org/jira/browse/SPARK-19547) Component/s:

[jira] [Commented] (SPARK-22969) aggregateByKey with aggregator compression

2018-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313160#comment-16313160 ] Sean Owen commented on SPARK-22969: --- Should this start as a discussion on the mailing list? doesn't

[jira] [Resolved] (SPARK-22961) Constant columns no longer picked as constraints in 2.3

2018-01-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22961. - Resolution: Fixed Assignee: Adrian Ionescu Fix Version/s: 2.3.0 > Constant columns no

[jira] [Updated] (SPARK-22961) Constant columns no longer picked as constraints in 2.3

2018-01-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22961: Affects Version/s: (was: 3.0.0) > Constant columns no longer picked as constraints in 2.3 >

[jira] [Assigned] (SPARK-22972) Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc.

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22972: Assignee: (was: Apache Spark) > Couldn't find corresponding Hive SerDe for data

[jira] [Assigned] (SPARK-22972) Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc.

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22972: Assignee: Apache Spark > Couldn't find corresponding Hive SerDe for data source provider

[jira] [Commented] (SPARK-22972) Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc.

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313098#comment-16313098 ] Apache Spark commented on SPARK-22972: -- User 'xubo245' has created a pull request for this issue:

[jira] [Created] (SPARK-22972) Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc.

2018-01-05 Thread xubo245 (JIRA)
xubo245 created SPARK-22972: --- Summary: Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc. Key: SPARK-22972 URL: https://issues.apache.org/jira/browse/SPARK-22972

[jira] [Commented] (SPARK-19743) Exception when creating more than one implicit Encoder in REPL

2018-01-05 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313018#comment-16313018 ] Mark Petruska commented on SPARK-19743: --- Could not reproduce the problem on the current master

[jira] [Assigned] (SPARK-22971) OneVsRestModel should use temporary RawPredictionCol

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22971: Assignee: (was: Apache Spark) > OneVsRestModel should use temporary RawPredictionCol

[jira] [Commented] (SPARK-22971) OneVsRestModel should use temporary RawPredictionCol

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312888#comment-16312888 ] Apache Spark commented on SPARK-22971: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-22971) OneVsRestModel should use temporary RawPredictionCol

2018-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22971: Assignee: Apache Spark > OneVsRestModel should use temporary RawPredictionCol >

[jira] [Created] (SPARK-22971) OneVsRestModel should use temporary RawPredictionCol

2018-01-05 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-22971: Summary: OneVsRestModel should use temporary RawPredictionCol Key: SPARK-22971 URL: https://issues.apache.org/jira/browse/SPARK-22971 Project: Spark Issue

[jira] [Commented] (SPARK-22714) Spark API Not responding when Fatal exception occurred in event loop

2018-01-05 Thread todesking (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312872#comment-16312872 ] todesking commented on SPARK-22714: --- > is this reproducible outside of Spark REPL? Yes. Reproduction

[jira] [Commented] (SPARK-22970) Getting Application ID from Submission ID

2018-01-05 Thread Mehmet Uluer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312786#comment-16312786 ] Mehmet Uluer commented on SPARK-22970: -- details @ stackoverflow;

[jira] [Created] (SPARK-22970) Getting Application ID from Submission ID

2018-01-05 Thread Mehmet Uluer (JIRA)
Mehmet Uluer created SPARK-22970: Summary: Getting Application ID from Submission ID Key: SPARK-22970 URL: https://issues.apache.org/jira/browse/SPARK-22970 Project: Spark Issue Type: New

[jira] [Created] (SPARK-22969) aggregateByKey with aggregator compression

2018-01-05 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-22969: Summary: aggregateByKey with aggregator compression Key: SPARK-22969 URL: https://issues.apache.org/jira/browse/SPARK-22969 Project: Spark Issue Type: