[jira] [Commented] (SPARK-11148) Unable to create views

[ https://issues.apache.org/jira/browse/SPARK-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063721#comment-15063721 ] Cheng Lian commented on SPARK-11148: Did you mean the Windows ODBC driver provided by Simba? AFAIK

[jira] [Created] (SPARK-12421) Fix copy() method of GenericRow

Burkard Doepfner created SPARK-12421: Summary: Fix copy() method of GenericRow Key: SPARK-12421 URL: https://issues.apache.org/jira/browse/SPARK-12421 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12420) Have a built-in CSV data source implementation

[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12420: Target Version/s: 2.0.0 > Have a built-in CSV data source implementation >

[jira] [Created] (SPARK-12420) Have a built-in CSV data source implementation

Reynold Xin created SPARK-12420: --- Summary: Have a built-in CSV data source implementation Key: SPARK-12420 URL: https://issues.apache.org/jira/browse/SPARK-12420 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lunen updated SPARK-12403: -- Affects Version/s: 1.5.0 Fix Version/s: 1.4.1 > "Simba Spark ODBC Driver 1.0" not working with 1.5.2

[jira] [Commented] (SPARK-12421) Fix copy() method of GenericRow

[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063730#comment-15063730 ] Apache Spark commented on SPARK-12421: -- User 'Apo1' has created a pull request for this issue:

[jira] [Commented] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark

[ https://issues.apache.org/jira/browse/SPARK-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063778#comment-15063778 ] Apache Spark commented on SPARK-12417: -- User 'rajeshbalamohan' has created a pull request for this

[jira] [Assigned] (SPARK-12417) Orc bloom filter options are not propagated during file write in spark

[ https://issues.apache.org/jira/browse/SPARK-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12417: Assignee: Apache Spark > Orc bloom filter options are not propagated during file write in

[jira] [Updated] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gobinathan SP updated SPARK-12313: -- Description: When enabled spark.sql.hive.metastorePartitionPruning, the getPartitionsByFilter

[jira] [Commented] (SPARK-12420) Have a built-in CSV data source implementation

[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063736#comment-15063736 ] Jeff Zhang commented on SPARK-12420: +1, this is very common use data format. Not sure why it is not

[jira] [Comment Edited] (SPARK-12420) Have a built-in CSV data source implementation

[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063736#comment-15063736 ] Jeff Zhang edited comment on SPARK-12420 at 12/18/15 9:15 AM: -- +1, this is

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063708#comment-15063708 ] Apache Spark commented on SPARK-12409: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12421) Fix copy() method of GenericRow

[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12421: Assignee: (was: Apache Spark) > Fix copy() method of GenericRow >

[jira] [Assigned] (SPARK-12421) Fix copy() method of GenericRow

[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12421: Assignee: Apache Spark > Fix copy() method of GenericRow >

[jira] [Assigned] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12400: Assignee: Apache Spark > Avoid writing a shuffle file if a partition has no output

[jira] [Assigned] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12400: Assignee: (was: Apache Spark) > Avoid writing a shuffle file if a partition has no

[jira] [Commented] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063845#comment-15063845 ] Kousuke Saruta commented on SPARK-12413: Memorandum: If 1.6.0-RC4 is not cut, we should modify

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR >

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12413: --- Assignee: Michael Gummelt > Mesos ZK persistence throws a NotSerializableException >

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12413: --- Fix Version/s: 2.0.0 1.6.0 > Mesos ZK persistence throws a

[jira] [Resolved] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-12413. Resolution: Fixed > Mesos ZK persistence throws a NotSerializableException >

[jira] [Commented] (SPARK-12400) Avoid writing a shuffle file if a partition has no output (empty)

[ https://issues.apache.org/jira/browse/SPARK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063891#comment-15063891 ] Apache Spark commented on SPARK-12400: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Created] (SPARK-12422) Binding Spark Standalone Master to public IP fails

Bennet Jeutter created SPARK-12422: -- Summary: Binding Spark Standalone Master to public IP fails Key: SPARK-12422 URL: https://issues.apache.org/jira/browse/SPARK-12422 Project: Spark Issue

[jira] [Updated] (SPARK-9057) Add Scala, Java and Python example to show DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9057: - Assignee: Jeff Lam > Add Scala, Java and Python example to show DStream.transform >

[jira] [Created] (SPARK-12423) Mesos executor home should not be resolved on the driver's file system

Iulian Dragos created SPARK-12423: - Summary: Mesos executor home should not be resolved on the driver's file system Key: SPARK-12423 URL: https://issues.apache.org/jira/browse/SPARK-12423 Project:

[jira] [Updated] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12403: -- Fix Version/s: (was: 1.4.1) (was: 1.3.1) [~lunendl] please read

[jira] [Resolved] (SPARK-12418) spark shuffle FAILED_TO_UNCOMPRESS

[ https://issues.apache.org/jira/browse/SPARK-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12418. --- Resolution: Duplicate Target Version/s: (was: 1.5.1) Please search JIRA first > spark

[jira] [Assigned] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12369: Assignee: (was: Apache Spark) > DataFrameReader fails on globbing parquet paths >

[jira] [Resolved] (SPARK-8318) Spark Streaming Starter JIRAs

[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8318. -- Resolution: Implemented > Spark Streaming Starter JIRAs > - > >

[jira] [Resolved] (SPARK-9057) Add Scala, Java and Python example to show DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9057. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 8431

[jira] [Assigned] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12369: Assignee: Apache Spark > DataFrameReader fails on globbing parquet paths >

[jira] [Updated] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12387: -- Fix Version/s: (was: 1.6.0) > JDBC IN operator push down > --- > >

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems apparent on BE, LE could be impacted too (was: Problems are evident on

[jira] [Commented] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064113#comment-15064113 ] Apache Spark commented on SPARK-12424: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-12401) Add support for enums in postgres

[ https://issues.apache.org/jira/browse/SPARK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12401: -- Priority: Minor (was: Major) Component/s: SQL > Add support for enums in postgres >

[jira] [Updated] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12346: -- Component/s: SparkR > GLM summary crashes with NoSuchElementException if attributes are missing >

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems are evident on BE (was: BE platforms) > Address endian specific problems

[jira] [Commented] (SPARK-12369) DataFrameReader fails on globbing parquet paths

[ https://issues.apache.org/jira/browse/SPARK-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064059#comment-15064059 ] Apache Spark commented on SPARK-12369: -- User 'yanakad' has created a pull request for this issue:

[jira] [Updated] (SPARK-12370) Documentation should link to examples from its own release version

[ https://issues.apache.org/jira/browse/SPARK-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12370: -- Priority: Minor (was: Major) Component/s: Documentation > Documentation should link to

[jira] [Created] (SPARK-12424) The implementation of ParamMap#filter is wrong.

Kousuke Saruta created SPARK-12424: -- Summary: The implementation of ParamMap#filter is wrong. Key: SPARK-12424 URL: https://issues.apache.org/jira/browse/SPARK-12424 Project: Spark Issue

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: Apache Spark > JDBC AND operator push down > > >

[jira] [Commented] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064376#comment-15064376 ] Apache Spark commented on SPARK-12425: -- User 'gpoulin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12054) Consider nullable in codegen

[ https://issues.apache.org/jira/browse/SPARK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12054. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10333

[jira] [Resolved] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12341. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > The

[jira] [Resolved] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12342. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Corr

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064200#comment-15064200 ] Thomas Graves commented on SPARK-11701: --- I ran into another instance of this and its when the job

[jira] [Updated] (SPARK-12391) JDBC OR operator push down

[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12391: - Target Version/s: (was: 1.6.0) > JDBC OR operator push down > -- > >

[jira] [Resolved] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11619. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9981

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: Apache Spark > wrong output for countByValue and countByValueAndWindow >

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: (was: Apache Spark) > wrong output for countByValue and

[jira] [Commented] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064266#comment-15064266 ] Sean Owen commented on SPARK-10291: --- My POV is that this isn't likely worth adding a method for. I

[jira] [Created] (SPARK-12425) DStream union optimisation

Guillaume Poulin created SPARK-12425: Summary: DStream union optimisation Key: SPARK-12425 URL: https://issues.apache.org/jira/browse/SPARK-12425 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12336. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 > Outer

[jira] [Assigned] (SPARK-12342) Corr (Pearson correlation) should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12342: -- Assignee: Davies Liu (was: Cheng Lian) > Corr (Pearson correlation) should be nullable >

[jira] [Assigned] (SPARK-12341) The "comment" field of DESCRIBE result set should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12341: -- Assignee: Davies Liu (was: Apache Spark) > The "comment" field of DESCRIBE result set should

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: Apache Spark > The implementation of ParamMap#filter is wrong. >

[jira] [Resolved] (SPARK-12350) VectorAssembler#transform() initially throws an exception

[ https://issues.apache.org/jira/browse/SPARK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12350. Resolution: Fixed Assignee: Marcelo Vanzin (was: Apache Spark) Fix

[jira] [Updated] (SPARK-11619) cannot use UDTF in DataFrame.selectExpr

[ https://issues.apache.org/jira/browse/SPARK-11619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11619: - Assignee: Dilip Biswal > cannot use UDTF in DataFrame.selectExpr >

[jira] [Assigned] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12335: -- Assignee: Davies Liu (was: Apache Spark) > CentralMomentAgg should be nullable >

[jira] [Resolved] (SPARK-12335) CentralMomentAgg should be nullable

[ https://issues.apache.org/jira/browse/SPARK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12335. Resolution: Fixed Fix Version/s: 2.0.0 https://github.com/apache/spark/pull/10333 >

[jira] [Assigned] (SPARK-12336) Outer join using multiple columns results in wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12336: -- Assignee: Davies Liu (was: Cheng Lian) > Outer join using multiple columns results in wrong

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: (was: Apache Spark) > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12424) The implementation of ParamMap#filter is wrong.

[ https://issues.apache.org/jira/browse/SPARK-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12424: Assignee: Apache Spark > The implementation of ParamMap#filter is wrong. >

[jira] [Assigned] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12409: Assignee: (was: Apache Spark) > JDBC AND operator push down >

[jira] [Updated] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12409: - Target Version/s: (was: 1.6.0) > JDBC AND operator push down > > >

[jira] [Created] (SPARK-12426) Docker JDBC integration tests are failing again

Mark Grover created SPARK-12426: --- Summary: Docker JDBC integration tests are failing again Key: SPARK-12426 URL: https://issues.apache.org/jira/browse/SPARK-12426 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12218. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 2.0.0 Issue

[jira] [Assigned] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-12218: Assignee: Yin Huai > Invalid splitting of nested AND expressions in Data Source filter API >

[jira] [Updated] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-12427: Attachment: graph.png disk usage over the past year, for lols. > spark builds filling up jenkins'

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064568#comment-15064568 ] Sean Owen commented on SPARK-12427: --- I doubt we really need build history for more than a week or two.

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064572#comment-15064572 ] shane knapp commented on SPARK-12427: - [~joshrosen] > spark builds filling up jenkins' disk >

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Shixiong Zhu (was: Apache Spark) > Update documentation to show how to use

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use

[jira] [Created] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

Fede Bar created SPARK-12430: Summary: Temporary folders do not get deleted after Task completes causing problems with disk space. Key: SPARK-12430 URL: https://issues.apache.org/jira/browse/SPARK-12430

[jira] [Updated] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-12427: Attachment: jenkins_disk_usage.txt > spark builds filling up jenkins' disk >

[jira] [Created] (SPARK-12428) Write a script to run all PySpark MLlib examples for testing

holdenk created SPARK-12428: --- Summary: Write a script to run all PySpark MLlib examples for testing Key: SPARK-12428 URL: https://issues.apache.org/jira/browse/SPARK-12428 Project: Spark Issue

[jira] [Commented] (SPARK-12428) Write a script to run all PySpark MLlib examples for testing

[ https://issues.apache.org/jira/browse/SPARK-12428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064610#comment-15064610 ] holdenk commented on SPARK-12428: - I can start working on this a bit over the holidays :) > Write a

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064664#comment-15064664 ] Matt Pollock commented on SPARK-6817: - Will this only support UDFs that operate on a full DataFrame? A

[jira] [Created] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

Shixiong Zhu created SPARK-12429: Summary: Update documentation to show how to use accumulators and broadcasts with Spark Streaming Key: SPARK-12429 URL: https://issues.apache.org/jira/browse/SPARK-12429

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064628#comment-15064628 ] shane knapp commented on SPARK-12427: - if we NEED to store for longer than 2 weeks, we can absolutely

[jira] [Commented] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064447#comment-15064447 ] Apache Spark commented on SPARK-7142: - User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-12372) Document limitations of MLlib local linear algebra

[ https://issues.apache.org/jira/browse/SPARK-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064476#comment-15064476 ] Christos Iraklis Tsatsoulis commented on SPARK-12372: - You are very welcome >

[jira] [Created] (SPARK-12427) spark builds filling up jenkins' disk

shane knapp created SPARK-12427: --- Summary: spark builds filling up jenkins' disk Key: SPARK-12427 URL: https://issues.apache.org/jira/browse/SPARK-12427 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12432) Make parts of the Spark testing API public to assist developers making their own tests.

holdenk created SPARK-12432: --- Summary: Make parts of the Spark testing API public to assist developers making their own tests. Key: SPARK-12432 URL: https://issues.apache.org/jira/browse/SPARK-12432

[jira] [Created] (SPARK-12435) Installing Spark

Amit created SPARK-12435: Summary: Installing Spark Key: SPARK-12435 URL: https://issues.apache.org/jira/browse/SPARK-12435 Project: Spark Issue Type: Bug Components: Build Affects

[jira] [Resolved] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11097. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add connection established callback to lower level

[jira] [Resolved] (SPARK-12435) Installing Spark

[ https://issues.apache.org/jira/browse/SPARK-12435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12435. Resolution: Duplicate See if the workaround works for you:

[jira] [Created] (SPARK-12437) Reserved words (like table) throws error when writing a data frame to JDBC

Reynold Xin created SPARK-12437: --- Summary: Reserved words (like table) throws error when writing a data frame to JDBC Key: SPARK-12437 URL: https://issues.apache.org/jira/browse/SPARK-12437 Project:

[jira] [Updated] (SPARK-12437) Reserved words (like table) throws error when writing a data frame to JDBC

[ https://issues.apache.org/jira/browse/SPARK-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12437: Labels: starter (was: ) > Reserved words (like table) throws error when writing a data frame to

[jira] [Updated] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11097: -- Assignee: Shixiong Zhu (was: Apache Spark) > Add connection established callback to lower level RPC

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use

[jira] [Resolved] (SPARK-12411) Reconsider executor heartbeats rpc timeout

[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12411. --- Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 Target

[jira] [Commented] (SPARK-7301) Issue with duplicated fields in interpreted json schemas

[ https://issues.apache.org/jira/browse/SPARK-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065021#comment-15065021 ] Simeon Simeonov commented on SPARK-7301: It would be nice if using backticks to refer to the

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12413: -- Fix Version/s: (was: 2.0.0) > Mesos ZK persistence throws a NotSerializableException >

[jira] [Resolved] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-11985. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > Update Spark

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065047#comment-15065047 ] Andrew Or commented on SPARK-12345: --- For those who are following: There are 4 patches related to this

[jira] [Created] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

Reynold Xin created SPARK-12436: --- Summary: If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType Key: SPARK-12436 URL:

  1   2   >