[jira] [Assigned] (SPARK-17580) Assign random App name while creating spark context

[ https://issues.apache.org/jira/browse/SPARK-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17580: Assignee: (was: Apache Spark) > Assign random App name while creating spark context >

[jira] [Commented] (SPARK-17580) Assign random App name while creating spark context

[ https://issues.apache.org/jira/browse/SPARK-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500299#comment-15500299 ] Apache Spark commented on SPARK-17580: -- User 'phalodi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17580) Assign random App name while creating spark context

[ https://issues.apache.org/jira/browse/SPARK-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17580: Assignee: Apache Spark > Assign random App name while creating spark context >

[jira] [Created] (SPARK-17580) Assign random App name while creating spark context

sandeep purohit created SPARK-17580: --- Summary: Assign random App name while creating spark context Key: SPARK-17580 URL: https://issues.apache.org/jira/browse/SPARK-17580 Project: Spark

[jira] [Commented] (SPARK-17512) Specifying remote files for Python based Spark jobs in Yarn cluster mode not working

[ https://issues.apache.org/jira/browse/SPARK-17512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500178#comment-15500178 ] Saisai Shao commented on SPARK-17512: - This is due to some behavior changes during submitting spark

[jira] [Created] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

Jianfei Wang created SPARK-17579: Summary: Exception When the Main object extends Encoder in cluster mode but ok in local mode Key: SPARK-17579 URL: https://issues.apache.org/jira/browse/SPARK-17579

[jira] [Closed] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-17566. --- Resolution: Duplicate > "--master yarn --deploy-mode cluster" gives "Launching Python applications

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500145#comment-15500145 ] Saisai Shao commented on SPARK-17566: - Sorry I misunderstood your point, looks like it should be

[jira] [Commented] (SPARK-17566) "--master yarn --deploy-mode cluster" gives "Launching Python applications through spark-submit is currently only supported for local files"

[ https://issues.apache.org/jira/browse/SPARK-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500109#comment-15500109 ] Saisai Shao commented on SPARK-17566: - Can you confirm the above command you mentioned can be run on

[jira] [Closed] (SPARK-4449) specify port range in spark

[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian closed SPARK-4449. -- Resolution: Won't Fix > specify port range in spark >

[jira] [Commented] (SPARK-17522) [MESOS] More even distribution of executors on Mesos cluster

[ https://issues.apache.org/jira/browse/SPARK-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500078#comment-15500078 ] Sun Rui commented on SPARK-17522: - yes. It can be tuned by a config option according to the wordload.

[jira] [Commented] (SPARK-17565) Janino exception when calculating metrics for large generated class

[ https://issues.apache.org/jira/browse/SPARK-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500064#comment-15500064 ] Liwei Lin commented on SPARK-17565: --- I haven't looked into it, but this might relates to

[jira] [Comment Edited] (SPARK-17565) Janino exception when calculating metrics for large generated class

[ https://issues.apache.org/jira/browse/SPARK-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500064#comment-15500064 ] Liwei Lin edited comment on SPARK-17565 at 9/18/16 2:14 AM: I haven't looked

[jira] [Commented] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500059#comment-15500059 ] Jianfei Wang commented on SPARK-17562: -- [~joshrosen] please check this. thank you very much! > I

[jira] [Resolved] (SPARK-17491) MemoryStore.putIteratorAsBytes() may silently lose values when KryoSerializer is used

[ https://issues.apache.org/jira/browse/SPARK-17491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17491. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Commented] (SPARK-13640) Synchronize ScalaReflection.mirror method.

[ https://issues.apache.org/jira/browse/SPARK-13640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499471#comment-15499471 ] Charles Allen commented on SPARK-13640: --- These failed on first attempt: {code}

[jira] [Commented] (SPARK-13640) Synchronize ScalaReflection.mirror method.

[ https://issues.apache.org/jira/browse/SPARK-13640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499457#comment-15499457 ] Charles Allen commented on SPARK-13640: --- I keep having scala 2.10 test failures in tests for this

[jira] [Assigned] (SPARK-17578) Modify default value of spark.app.name in configuration for spark session

[ https://issues.apache.org/jira/browse/SPARK-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17578: Assignee: (was: Apache Spark) > Modify default value of spark.app.name in

[jira] [Commented] (SPARK-17578) Modify default value of spark.app.name in configuration for spark session

[ https://issues.apache.org/jira/browse/SPARK-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499406#comment-15499406 ] Apache Spark commented on SPARK-17578: -- User 'phalodi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17578) Modify default value of spark.app.name in configuration for spark session

[ https://issues.apache.org/jira/browse/SPARK-17578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17578: Assignee: Apache Spark > Modify default value of spark.app.name in configuration for

[jira] [Created] (SPARK-17578) Modify default value of spark.app.name in configuration for spark session

sandeep purohit created SPARK-17578: --- Summary: Modify default value of spark.app.name in configuration for spark session Key: SPARK-17578 URL: https://issues.apache.org/jira/browse/SPARK-17578

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499344#comment-15499344 ] Sankar Mittapally commented on SPARK-17572: --- I believe there is no issue with NFS. @Felix : we

[jira] [Commented] (SPARK-17510) Set Streaming MaxRate Independently For Multiple Streams

[ https://issues.apache.org/jira/browse/SPARK-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499334#comment-15499334 ] Cody Koeninger commented on SPARK-17510: [~jnadler] See the pull request here

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499332#comment-15499332 ] Felix Cheung commented on SPARK-17572: -- does it work when you run the hadoop command equivalent as

[jira] [Assigned] (SPARK-17510) Set Streaming MaxRate Independently For Multiple Streams

[ https://issues.apache.org/jira/browse/SPARK-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17510: Assignee: (was: Apache Spark) > Set Streaming MaxRate Independently For Multiple

[jira] [Commented] (SPARK-17510) Set Streaming MaxRate Independently For Multiple Streams

[ https://issues.apache.org/jira/browse/SPARK-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499329#comment-15499329 ] Apache Spark commented on SPARK-17510: -- User 'koeninger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17510) Set Streaming MaxRate Independently For Multiple Streams

[ https://issues.apache.org/jira/browse/SPARK-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17510: Assignee: Apache Spark > Set Streaming MaxRate Independently For Multiple Streams >

[jira] [Assigned] (SPARK-17577) SparkR support add files to Spark job and get by executors

[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17577: Assignee: (was: Apache Spark) > SparkR support add files to Spark job and get by

[jira] [Commented] (SPARK-17577) SparkR support add files to Spark job and get by executors

[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499241#comment-15499241 ] Apache Spark commented on SPARK-17577: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17577) SparkR support add files to Spark job and get by executors

[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17577: Assignee: Apache Spark > SparkR support add files to Spark job and get by executors >

[jira] [Created] (SPARK-17577) SparkR support add files to Spark job and get by executors

Yanbo Liang created SPARK-17577: --- Summary: SparkR support add files to Spark job and get by executors Key: SPARK-17577 URL: https://issues.apache.org/jira/browse/SPARK-17577 Project: Spark

[jira] [Resolved] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17573. --- Resolution: Not A Problem No, this is covered by {{context.addTaskCompletionListener(context =>

[jira] [Resolved] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17575. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17575: -- Assignee: sandeep purohit Priority: Trivial (was: Minor) > Make correction in configuration

[jira] [Updated] (SPARK-17529) On highly skewed data, outer join merges are slow

[ https://issues.apache.org/jira/browse/SPARK-17529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17529: -- Assignee: David C. Navas > On highly skewed data, outer join merges are slow >

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499201#comment-15499201 ] Sean Owen commented on SPARK-17572: --- I don't know the cause; it may not have to do with permissions.

[jira] [Resolved] (SPARK-17529) On highly skewed data, outer join merges are slow

[ https://issues.apache.org/jira/browse/SPARK-17529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17529. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15084

[jira] [Comment Edited] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499175#comment-15499175 ] Hyukjin Kwon edited comment on SPARK-17545 at 9/17/16 3:07 PM: --- I took

[jira] [Comment Edited] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499175#comment-15499175 ] Hyukjin Kwon edited comment on SPARK-17545 at 9/17/16 3:06 PM: --- I took

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499175#comment-15499175 ] Hyukjin Kwon commented on SPARK-17545: -- I took another look. This might be solved by changing the

[jira] [Closed] (SPARK-17576) As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt

[ https://issues.apache.org/jira/browse/SPARK-17576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R closed SPARK-17576. -- Resolution: Invalid > As LongType.simpleString in spark is "bigint", Carbon will convert Long to >

[jira] [Updated] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Component/s: (was: SQL) Spark Core > The FileInputStream may be uncloseed

[jira] [Created] (SPARK-17576) As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt

Naresh P R created SPARK-17576: -- Summary: As LongType.simpleString in spark is "bigint", Carbon will convert Long to BigInt Key: SPARK-17576 URL: https://issues.apache.org/jira/browse/SPARK-17576

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498997#comment-15498997 ] Sankar Mittapally commented on SPARK-17572: --- I gave 777 permissions to every user on NFS

[jira] [Commented] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498996#comment-15498996 ] Jianfei Wang commented on SPARK-17573: -- fileStream may never be closed when some exceptions

[jira] [Commented] (SPARK-17527) mergeSchema with `_OPTIONAL_` metadata fails

[ https://issues.apache.org/jira/browse/SPARK-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498980#comment-15498980 ] Liang-Chi Hsieh commented on SPARK-17527: - Can you provide more hints about how to reproduce

[jira] [Issue Comment Deleted] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Comment: was deleted (was: if some exceptions happen the fileStream may never be closed in

[jira] [Comment Edited] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498958#comment-15498958 ] Jianfei Wang edited comment on SPARK-17573 at 9/17/16 12:50 PM: if some

[jira] [Commented] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498958#comment-15498958 ] Jianfei Wang commented on SPARK-17573: -- if some exceptions happen the fileStream may never be closed

[jira] [Updated] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep purohit updated SPARK-17575: Shepherd: Sean Owen > Make correction in configuration documentation table tags >

[jira] [Assigned] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17575: Assignee: Apache Spark > Make correction in configuration documentation table tags >

[jira] [Commented] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498946#comment-15498946 ] Apache Spark commented on SPARK-17575: -- User 'phalodi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17575) Make correction in configuration documentation table tags

[ https://issues.apache.org/jira/browse/SPARK-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17575: Assignee: (was: Apache Spark) > Make correction in configuration documentation table

[jira] [Created] (SPARK-17575) Make correction in configuration documentation table tags

sandeep purohit created SPARK-17575: --- Summary: Make correction in configuration documentation table tags Key: SPARK-17575 URL: https://issues.apache.org/jira/browse/SPARK-17575 Project: Spark

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498932#comment-15498932 ] Sean Owen commented on SPARK-17572: --- This looks like an error from NFS, possibly permissions related.

[jira] [Commented] (SPARK-17546) start-* scripts should use hostname -f

[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498927#comment-15498927 ] Apache Spark commented on SPARK-17546: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17546) start-* scripts should use hostname -f

[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17546: Assignee: Apache Spark > start-* scripts should use hostname -f >

[jira] [Updated] (SPARK-17546) start-* scripts should use hostname -f

[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17546: -- Priority: Minor (was: Major) Summary: start-* scripts should use hostname -f (was: start-*

[jira] [Assigned] (SPARK-17546) start-* scripts should use hostname -f

[ https://issues.apache.org/jira/browse/SPARK-17546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17546: Assignee: (was: Apache Spark) > start-* scripts should use hostname -f >

[jira] [Commented] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498916#comment-15498916 ] Sean Owen commented on SPARK-17573: --- It won't matter in test code, although yes it's good form to close

[jira] [Updated] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Description: I think that the InputStream may never be closed when some exceptions occur, we

[jira] [Updated] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Priority: Trivial (was: Major) > The FileInputStream may be uncloseed when some exceptions

[jira] [Reopened] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang reopened SPARK-17573: -- the issue has been changed > The FileInputStream may be uncloseed when some exceptions occurs >

[jira] [Updated] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Description: I think that the InputStream may never be closed when some exceptions occur, we

[jira] [Updated] (SPARK-17573) The FileInputStream may be uncloseed when some exceptions occurs

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Summary: The FileInputStream may be uncloseed when some exceptions occurs (was: Why don't we

[jira] [Resolved] (SPARK-17422) Verify that Ganglia, Kinesis (non-assembly) artifacts can be distributed.

[ https://issues.apache.org/jira/browse/SPARK-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17422. --- Resolution: Not A Problem Target Version/s: (was: 2.0.1) For the moment, given the

[jira] [Updated] (SPARK-17548) Word2VecModel.findSynonyms can spuriously reject the best match when invoked with a vector

[ https://issues.apache.org/jira/browse/SPARK-17548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17548: -- Assignee: William Benton > Word2VecModel.findSynonyms can spuriously reject the best match when

[jira] [Resolved] (SPARK-17548) Word2VecModel.findSynonyms can spuriously reject the best match when invoked with a vector

[ https://issues.apache.org/jira/browse/SPARK-17548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17548. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Commented] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498871#comment-15498871 ] Jianfei Wang commented on SPARK-17573: -- Thank you sir! I've learned much from you,i will be careful

[jira] [Closed] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang closed SPARK-17573. Resolution: Invalid > Why don't we close the input/output Streams >

[jira] [Updated] (SPARK-17561) DataFrameWriter documentation formatting problems

[ https://issues.apache.org/jira/browse/SPARK-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17561: -- Fix Version/s: 2.0.1 > DataFrameWriter documentation formatting problems >

[jira] [Closed] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

[ https://issues.apache.org/jira/browse/SPARK-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-17574. --- Resolution: Won't Fix > Cache ShuffleExchange RDD when the exchange is reused >

[jira] [Commented] (SPARK-17568) Add spark-submit option for user to override ivy settings used to resolve packages/artifacts

[ https://issues.apache.org/jira/browse/SPARK-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498847#comment-15498847 ] Sean Owen commented on SPARK-17568: --- I think this is well beyond the intended purpose of {{--packages}}

[jira] [Commented] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498842#comment-15498842 ] Sean Owen commented on SPARK-17573: --- These are byte array streams, and have no resources to close.

[jira] [Resolved] (SPARK-17567) Broken link to Spark paper

[ https://issues.apache.org/jira/browse/SPARK-17567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17567. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-17567) Broken link to Spark paper

[ https://issues.apache.org/jira/browse/SPARK-17567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17567: -- Assignee: Xin Ren Priority: Trivial (was: Major) > Broken link to Spark paper >

[jira] [Assigned] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

[ https://issues.apache.org/jira/browse/SPARK-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17574: Assignee: Apache Spark > Cache ShuffleExchange RDD when the exchange is reused >

[jira] [Commented] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

[ https://issues.apache.org/jira/browse/SPARK-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498659#comment-15498659 ] Apache Spark commented on SPARK-17574: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

[ https://issues.apache.org/jira/browse/SPARK-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17574: Assignee: (was: Apache Spark) > Cache ShuffleExchange RDD when the exchange is reused

[jira] [Updated] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

[ https://issues.apache.org/jira/browse/SPARK-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17574: Component/s: (was: SQL) Spark Core > Cache ShuffleExchange RDD when

[jira] [Created] (SPARK-17574) Cache ShuffleExchange RDD when the exchange is reused

Liang-Chi Hsieh created SPARK-17574: --- Summary: Cache ShuffleExchange RDD when the exchange is reused Key: SPARK-17574 URL: https://issues.apache.org/jira/browse/SPARK-17574 Project: Spark

[jira] [Updated] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Mittapally updated SPARK-17572: -- Component/s: SparkR > Write.df is failing on spark cluster >

[jira] [Updated] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Mittapally updated SPARK-17572: -- Affects Version/s: 2.0.0 > Write.df is failing on spark cluster >

[jira] [Updated] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Description: I find that there are many places in spark that we don't close the input/output

[jira] [Updated] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Description: I find that there are many places in spark that we don't close the input/output

[jira] [Updated] (SPARK-17573) Why don't we close the input/output Streams

[ https://issues.apache.org/jira/browse/SPARK-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Wang updated SPARK-17573: - Description: I find that there are many places in spark that we don't close the input/output

[jira] [Created] (SPARK-17573) Why don't we close the input/output Streams

Jianfei Wang created SPARK-17573: Summary: Why don't we close the input/output Streams Key: SPARK-17573 URL: https://issues.apache.org/jira/browse/SPARK-17573 Project: Spark Issue Type:

[jira] [Created] (SPARK-17572) Write.df is failing on spark cluster

Sankar Mittapally created SPARK-17572: - Summary: Write.df is failing on spark cluster Key: SPARK-17572 URL: https://issues.apache.org/jira/browse/SPARK-17572 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

[ https://issues.apache.org/jira/browse/SPARK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17571: Assignee: Apache Spark > AssertOnQuery.condition should be consistent in requiring

[jira] [Assigned] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

[ https://issues.apache.org/jira/browse/SPARK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17571: Assignee: (was: Apache Spark) > AssertOnQuery.condition should be consistent in

[jira] [Commented] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

[ https://issues.apache.org/jira/browse/SPARK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498465#comment-15498465 ] Apache Spark commented on SPARK-17571: -- User 'petermaxlee' has created a pull request for this

[jira] [Updated] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

[ https://issues.apache.org/jira/browse/SPARK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated SPARK-17571: -- Description: AssertOnQuery has two apply constructor: one that accepts a closure that returns boolean,

[jira] [Created] (SPARK-17571) AssertOnQuery.condition should be consistent in requiring Boolean return type

Peter Lee created SPARK-17571: - Summary: AssertOnQuery.condition should be consistent in requiring Boolean return type Key: SPARK-17571 URL: https://issues.apache.org/jira/browse/SPARK-17571 Project:

[jira] [Commented] (SPARK-17513) StreamExecution should discard unneeded metadata

[ https://issues.apache.org/jira/browse/SPARK-17513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498425#comment-15498425 ] Apache Spark commented on SPARK-17513: -- User 'petermaxlee' has created a pull request for this

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498394#comment-15498394 ] holdenk commented on SPARK-16407: - I'm not sure I understand - this really isn't exposing a new sink

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498389#comment-15498389 ] holdenk commented on SPARK-16407: - The current sink interface output depends on DataFrames - although