[jira] [Commented] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196376#comment-15196376 ] Apache Spark commented on SPARK-13918: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13918: Assignee: Apache Spark (was: Davies Liu) > merge SortMergeJoin and SortMergeOuterJoin >

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu commented on SPARK-13832: Trying this query in Spark 2.0 and I needed to change grouping__id to

[jira] [Assigned] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13918: Assignee: Davies Liu (was: Apache Spark) > merge SortMergeJoin and SortMergeOuterJoin >

[jira] [Assigned] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13873: Assignee: Apache Spark (was: Davies Liu) > Avoid the copy in whole stage codegen when

[jira] [Commented] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196108#comment-15196108 ] Apache Spark commented on SPARK-13873: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13873: Assignee: Davies Liu (was: Apache Spark) > Avoid the copy in whole stage codegen when

[jira] [Assigned] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13916: Assignee: Apache Spark > For whole stage codegen, measure and add the execution duration

[jira] [Resolved] (SPARK-13895) DataFrameReader.text should return Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13895. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11739

[jira] [Updated] (SPARK-13895) DataFrameReader.text should return Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13895: - Assignee: Reynold Xin > DataFrameReader.text should return Dataset[String] >

[jira] [Issue Comment Deleted] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-13832: --- Comment: was deleted (was: Hi Roy, I will validate and look into this one. ) > TPC-DS Query 36 fails with

[jira] [Updated] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13912: - Target Version/s: 2.0.0 > spark.hadoop.* configurations are not applied for Parquet Data Frame Readers >

[jira] [Commented] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196366#comment-15196366 ] Matt Cheah commented on SPARK-13912: Yup workarounds for me have been putting all spark.hadoop.*

[jira] [Created] (SPARK-13917) Generate code for broadcast left semi join

Davies Liu created SPARK-13917: -- Summary: Generate code for broadcast left semi join Key: SPARK-13917 URL: https://issues.apache.org/jira/browse/SPARK-13917 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13917: Assignee: Davies Liu (was: Apache Spark) > Generate code for broadcast left semi join >

[jira] [Assigned] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13917: Assignee: Apache Spark (was: Davies Liu) > Generate code for broadcast left semi join >

[jira] [Commented] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196338#comment-15196338 ] Apache Spark commented on SPARK-13917: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-13914) Add functionality to back up spark event logs

[ https://issues.apache.org/jira/browse/SPARK-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196117#comment-15196117 ] Sean Owen commented on SPARK-13914: --- This is just a problem because you have an ephemeral FS, but you

[jira] [Created] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

Davies Liu created SPARK-13918: -- Summary: merge SortMergeJoin and SortMergeOuterJoin Key: SPARK-13918 URL: https://issues.apache.org/jira/browse/SPARK-13918 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

[ https://issues.apache.org/jira/browse/SPARK-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196113#comment-15196113 ] Sean Owen commented on SPARK-13915: --- I'm not clear if you're suggesting a change to the spark-submit as

[jira] [Created] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

Nong Li created SPARK-13916: --- Summary: For whole stage codegen, measure and add the execution duration as a metric Key: SPARK-13916 URL: https://issues.apache.org/jira/browse/SPARK-13916 Project: Spark

[jira] [Assigned] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13916: Assignee: (was: Apache Spark) > For whole stage codegen, measure and add the

[jira] [Commented] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196151#comment-15196151 ] Apache Spark commented on SPARK-13916: -- User 'nongli' has created a pull request for this issue:

[jira] [Commented] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196361#comment-15196361 ] Yin Huai commented on SPARK-13912: -- [~mcheah] Let's target this for 2.0. This behavior is confusing.

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:41 PM: -- Trying this query in

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196419#comment-15196419 ] Suresh Thalamati commented on SPARK-13820: -- This query contains correlated subquery, it is not

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196427#comment-15196427 ] Reynold Xin commented on SPARK-13118: - I'm moving this out to its own ticket. I think there is

[jira] [Assigned] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13919: Assignee: (was: Apache Spark) > Resolving the Conflicts of ColumnPruning and

[jira] [Commented] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196535#comment-15196535 ] Apache Spark commented on SPARK-13919: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13919: Assignee: Apache Spark > Resolving the Conflicts of ColumnPruning and

[jira] [Commented] (SPARK-13872) Memory leak in SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196561#comment-15196561 ] Mark Hamstra commented on SPARK-13872: -- [~joshrosen] > Memory leak in SortMergeOuterJoin >

[jira] [Commented] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

[ https://issues.apache.org/jira/browse/SPARK-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196590#comment-15196590 ] Saisai Shao commented on SPARK-13915: - I suppose it should be worked if you set {{SPARK_HOME}} in

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196048#comment-15196048 ] Steve Loughran commented on SPARK-8819: --- lets see ... nope. setting {{ false}} in the errant

[jira] [Commented] (SPARK-13895) DataFrameReader.text should return Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196062#comment-15196062 ] Apache Spark commented on SPARK-13895: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

Rafael Pecin Ferreira created SPARK-13915: - Summary: Allow bin/spark-submit to be called via symbolic link Key: SPARK-13915 URL: https://issues.apache.org/jira/browse/SPARK-13915 Project:

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196430#comment-15196430 ] Davies Liu commented on SPARK-13820: Unfortunately, subquery is not target for 2.0. > TPC-DS Query

[jira] [Assigned] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13602: Assignee: (was: Apache Spark) > o.a.s.deploy.worker.DriverRunner may leak the driver

[jira] [Assigned] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13602: Assignee: Apache Spark > o.a.s.deploy.worker.DriverRunner may leak the driver processes >

[jira] [Commented] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196537#comment-15196537 ] Apache Spark commented on SPARK-13602: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196548#comment-15196548 ] Josh Rosen commented on SPARK-13920: I am not planning to work on this, so this task is up for grabs.

[jira] [Resolved] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-. Resolution: Fixed Fix Version/s: 2.0.0 > Dataset API on top of Catalyst/DataFrame >

[jira] [Updated] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13118: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-) > Support for

[jira] [Commented] (SPARK-8489) Add regression tests for SPARK-8470

[ https://issues.apache.org/jira/browse/SPARK-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196517#comment-15196517 ] Apache Spark commented on SPARK-8489: - User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196516#comment-15196516 ] Apache Spark commented on SPARK-12653: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196556#comment-15196556 ] Apache Spark commented on SPARK-2208: - User 'joan38' has created a pull request for this issue:

[jira] [Assigned] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2208: --- Assignee: (was: Apache Spark) > local metrics tests can fail on fast machines >

[jira] [Assigned] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2208: --- Assignee: Apache Spark > local metrics tests can fail on fast machines >

[jira] [Created] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

Josh Rosen created SPARK-13921: -- Summary: Store serialized blocks as multiple chunks in MemoryStore Key: SPARK-13921 URL: https://issues.apache.org/jira/browse/SPARK-13921 Project: Spark Issue

[jira] [Created] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

Sameer Agarwal created SPARK-13922: -- Summary: Filter rows with null attributes in parquet vectorized reader Key: SPARK-13922 URL: https://issues.apache.org/jira/browse/SPARK-13922 Project: Spark

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:43 PM: -- Trying this query in

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:44 PM: -- Trying this query in

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196464#comment-15196464 ] Dilip Biswal commented on SPARK-13821: -- [~roycecil] Just tried the original query no. 20 against

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196463#comment-15196463 ] Jakob Odersky commented on SPARK-13118: --- Should I remove the JIRA ID from my existing PR? >

[jira] [Reopened] (SPARK-13804) Spark SQL's DataFrame.count() Major Divergent (Non-Linear) Performance Slowdown going from 4million rows to 16+ million rows

[ https://issues.apache.org/jira/browse/SPARK-13804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Nguyen reopened SPARK-13804: I posted this issue to user@ at

[jira] [Commented] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196567#comment-15196567 ] Apache Spark commented on SPARK-13921: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13921: Assignee: Apache Spark (was: Josh Rosen) > Store serialized blocks as multiple chunks in

[jira] [Assigned] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13921: Assignee: Josh Rosen (was: Apache Spark) > Store serialized blocks as multiple chunks in

[jira] [Commented] (SPARK-13872) Memory leak in SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196585#comment-15196585 ] Yin Huai commented on SPARK-13872: -- Also cc [~davies] > Memory leak in SortMergeOuterJoin >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196487#comment-15196487 ] Reynold Xin commented on SPARK-13118: - The JIRA is the same. > Support for classes defined in

[jira] [Updated] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13919: Description: Now, {{ColumnPruning}} and {{PushPredicateThroughProject}} reverse each other's effect.

[jira] [Created] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

Xiao Li created SPARK-13919: --- Summary: Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject Key: SPARK-13919 URL: https://issues.apache.org/jira/browse/SPARK-13919 Project: Spark

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/16/16 12:39 AM: -- Trying this query in

[jira] [Commented] (SPARK-13914) Add functionality to back up spark event logs

[ https://issues.apache.org/jira/browse/SPARK-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196580#comment-15196580 ] Saisai Shao commented on SPARK-13914: - Agree with [~srowen], this feature is quite user specific,

[jira] [Created] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

Josh Rosen created SPARK-13920: -- Summary: MIMA checks should apply to @Experimental and @DeveloperAPI APIs Key: SPARK-13920 URL: https://issues.apache.org/jira/browse/SPARK-13920 Project: Spark

[jira] [Commented] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196577#comment-15196577 ] Apache Spark commented on SPARK-13922: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13922: Assignee: (was: Apache Spark) > Filter rows with null attributes in parquet

[jira] [Assigned] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13922: Assignee: Apache Spark > Filter rows with null attributes in parquet vectorized reader >

[jira] [Resolved] (SPARK-13890) Remove some internal classes' dependency on SQLContext

[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13890. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove some internal classes' dependency on

[jira] [Assigned] (SPARK-13893) Remove SQLContext.catalog (internal method)

[ https://issues.apache.org/jira/browse/SPARK-13893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13893: Assignee: Apache Spark (was: Reynold Xin) > Remove SQLContext.catalog (internal method)

[jira] [Updated] (SPARK-13893) Remove SQLContext.catalog (internal method)

[ https://issues.apache.org/jira/browse/SPARK-13893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13893: Description: Our code can go through SessionState.catalog. This brings two small benefits: 1.

[jira] [Created] (SPARK-13894) SQLContext.range should return Dataset[Long]

Reynold Xin created SPARK-13894: --- Summary: SQLContext.range should return Dataset[Long] Key: SPARK-13894 URL: https://issues.apache.org/jira/browse/SPARK-13894 Project: Spark Issue Type:

[jira] [Created] (SPARK-13895) DataFrameReader.text should return Dataset[String]

Reynold Xin created SPARK-13895: --- Summary: DataFrameReader.text should return Dataset[String] Key: SPARK-13895 URL: https://issues.apache.org/jira/browse/SPARK-13895 Project: Spark Issue Type:

[jira] [Created] (SPARK-13899) Produce InternalRow instead of external Row

Hyukjin Kwon created SPARK-13899: Summary: Produce InternalRow instead of external Row Key: SPARK-13899 URL: https://issues.apache.org/jira/browse/SPARK-13899 Project: Spark Issue Type:

[jira] [Created] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

yaoyin created SPARK-13901: -- Summary: We get wrong logdebug information when jump to the next locality level. Key: SPARK-13901 URL: https://issues.apache.org/jira/browse/SPARK-13901 Project: Spark

[jira] [Assigned] (SPARK-13904) Add support for pluggable cluster manager

[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13904: Assignee: Apache Spark > Add support for pluggable cluster manager >

[jira] [Commented] (SPARK-13904) Add support for pluggable cluster manager

[ https://issues.apache.org/jira/browse/SPARK-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195007#comment-15195007 ] Apache Spark commented on SPARK-13904: -- User 'hbhanawat' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13866) Handle decimal type in CSV inference

[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13866: Assignee: Apache Spark > Handle decimal type in CSV inference >

[jira] [Commented] (SPARK-13866) Handle decimal type in CSV inference

[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195032#comment-15195032 ] Apache Spark commented on SPARK-13866: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-13866) Handle decimal type in CSV inference

[ https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13866: Assignee: (was: Apache Spark) > Handle decimal type in CSV inference >

[jira] [Created] (SPARK-13905) Change implementation of as.data.frame() to avoid conflict with the ones in the R base package

Sun Rui created SPARK-13905: --- Summary: Change implementation of as.data.frame() to avoid conflict with the ones in the R base package Key: SPARK-13905 URL: https://issues.apache.org/jira/browse/SPARK-13905

[jira] [Created] (SPARK-13906) Spark driver hangs when slave is started or stopped (org.apache.spark.rpc.RpcTimeoutException).

Yonathan Randolph created SPARK-13906: - Summary: Spark driver hangs when slave is started or stopped (org.apache.spark.rpc.RpcTimeoutException). Key: SPARK-13906 URL:

[jira] [Commented] (SPARK-13397) Cleanup transient annotations which aren't being applied

[ https://issues.apache.org/jira/browse/SPARK-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195070#comment-15195070 ] Sean Owen commented on SPARK-13397: --- FWIW I think I just cleaned up the rest of the build warnings that

[jira] [Commented] (SPARK-13893) Remove SQLContext.catalog (internal method)

[ https://issues.apache.org/jira/browse/SPARK-13893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194846#comment-15194846 ] Apache Spark commented on SPARK-13893: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13893) Remove SQLContext.catalog (internal method)

[ https://issues.apache.org/jira/browse/SPARK-13893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13893: Assignee: Reynold Xin (was: Apache Spark) > Remove SQLContext.catalog (internal method)

[jira] [Resolved] (SPARK-13840) Disable Project Push Down Through Filter

[ https://issues.apache.org/jira/browse/SPARK-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13840. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Disable Project Push

[jira] [Assigned] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

[ https://issues.apache.org/jira/browse/SPARK-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13901: Assignee: (was: Apache Spark) > We get wrong logdebug information when jump to the

[jira] [Commented] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

[ https://issues.apache.org/jira/browse/SPARK-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194933#comment-15194933 ] Apache Spark commented on SPARK-13901: -- User 'trueyao' has created a pull request for this issue:

[jira] [Created] (SPARK-13904) Add support for pluggable cluster manager

Hemant Bhanawat created SPARK-13904: --- Summary: Add support for pluggable cluster manager Key: SPARK-13904 URL: https://issues.apache.org/jira/browse/SPARK-13904 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

[ https://issues.apache.org/jira/browse/SPARK-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13901: -- Assignee: yaoyin Target Version/s: (was: 1.6.1) Priority: Trivial (was:

[jira] [Commented] (SPARK-13397) Cleanup transient annotations which aren't being applied

[ https://issues.apache.org/jira/browse/SPARK-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195067#comment-15195067 ] Wesley Tang commented on SPARK-13397: - If you don't mind, i want to try to create a PR for this. >

[jira] [Resolved] (SPARK-13660) ContinuousQuerySuite floods the logs with garbage

[ https://issues.apache.org/jira/browse/SPARK-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13660. - Resolution: Fixed Assignee: Xin Ren Fix Version/s: 2.0.0 > ContinuousQuerySuite

[jira] [Updated] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

[ https://issues.apache.org/jira/browse/SPARK-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yaoyin updated SPARK-13901: --- Component/s: Spark Core > We get wrong logdebug information when jump to the next locality level. >

[jira] [Created] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

Takuya Ueshin created SPARK-13902: - Summary: Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first. Key: SPARK-13902 URL:

[jira] [Assigned] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13902: Assignee: (was: Apache Spark) > Make DAGScheduler.getAncestorShuffleDependencies()

[jira] [Commented] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194946#comment-15194946 ] Apache Spark commented on SPARK-13902: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13902) Make DAGScheduler.getAncestorShuffleDependencies() return in topological order to ensure building ancestor stages first.

[ https://issues.apache.org/jira/browse/SPARK-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13902: Assignee: Apache Spark > Make DAGScheduler.getAncestorShuffleDependencies() return in

[jira] [Resolved] (SPARK-12379) Copy GBT implementation to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-12379. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10607

[jira] [Commented] (SPARK-13823) Always specify Charset in String <-> byte[] conversions (and remaining Coverity items)

[ https://issues.apache.org/jira/browse/SPARK-13823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195036#comment-15195036 ] Apache Spark commented on SPARK-13823: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13803) Standalone master does not balance cluster-mode drivers across workers

[ https://issues.apache.org/jira/browse/SPARK-13803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13803. --- Resolution: Fixed Fix Version/s: 1.6.2 1.4.2 1.5.3

[jira] [Updated] (SPARK-13894) SQLContext.range should return Dataset[Long]

[ https://issues.apache.org/jira/browse/SPARK-13894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13894: Priority: Blocker (was: Major) > SQLContext.range should return Dataset[Long] >

  1   2   3   >