[jira] [Assigned] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9735: --- Assignee: Apache Spark > Auto infer partition schema of HadoopFsRelation should should respec

[jira] [Commented] (SPARK-9613) Ban use of JavaConversions and migrate all existing uses to JavaConverters

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661415#comment-14661415 ] Reynold Xin commented on SPARK-9613: +1 on this. > Ban use of JavaConversions and mig

[jira] [Assigned] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9735: --- Assignee: (was: Apache Spark) > Auto infer partition schema of HadoopFsRelation should sh

[jira] [Commented] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661414#comment-14661414 ] Apache Spark commented on SPARK-9735: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-06 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9735: Summary: Auto infer partition schema of HadoopFsRelation should should respected the user specified one Key: SPARK-9735 URL: https://issues.apache.org/jira/browse/SPARK-9735

[jira] [Updated] (SPARK-9683) copy UTF8String when convert unsafe array/map to safe

2015-08-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9683: --- Summary: copy UTF8String when convert unsafe array/map to safe (was: deep copy UTF8String when conver

[jira] [Resolved] (SPARK-9412) Support records larger than a page size

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9412. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.6.0) > Supp

[jira] [Commented] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661406#comment-14661406 ] Davies Liu commented on SPARK-9714: --- The failure seems not related to Python, should als

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9714: -- Assignee: Yin Huai > Cannot insert into a table using pySpark >

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9714: -- Component/s: SQL > Cannot insert into a table using pySpark > >

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9714: -- Target Version/s: 1.5.0 Priority: Blocker (was: Critical) > Cannot insert into a table usin

[jira] [Resolved] (SPARK-9453) Support records larger than default page size in UnsafeShuffleExternalSorter

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9453. Resolution: Fixed Fix Version/s: 1.5.0 > Support records larger than default page size in Uns

[jira] [Comment Edited] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661389#comment-14661389 ] Fei Wang edited comment on SPARK-9725 at 8/7/15 6:21 AM: - i try th

[jira] [Comment Edited] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661389#comment-14661389 ] Fei Wang edited comment on SPARK-9725 at 8/7/15 6:21 AM: - i try th

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661389#comment-14661389 ] Fei Wang commented on SPARK-9725: - i try the master again and reproduce this issue: M151:

[jira] [Issue Comment Deleted] (SPARK-7075) Project Tungsten (Spark 1.5 Phase 1)

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7075: --- Comment: was deleted (was: User 'davies' has created a pull request for this issue: https://github.com

[jira] [Resolved] (SPARK-9700) Pick default page size more intelligently

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9700. Resolution: Fixed Fix Version/s: 1.5.0 > Pick default page size more intelligently >

[jira] [Commented] (SPARK-9734) java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661384#comment-14661384 ] Davies Liu commented on SPARK-9734: --- This is fixed in master and 1.5. Because there many

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661383#comment-14661383 ] Fei Wang commented on SPARK-9725: - how much memory you set to executor? > spark sql query

[jira] [Commented] (SPARK-8382) Improve Analysis Unit test framework

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661379#comment-14661379 ] Apache Spark commented on SPARK-8382: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8382) Improve Analysis Unit test framework

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8382: --- Assignee: Apache Spark > Improve Analysis Unit test framework > -

[jira] [Assigned] (SPARK-8382) Improve Analysis Unit test framework

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8382: --- Assignee: (was: Apache Spark) > Improve Analysis Unit test framework > --

[jira] [Commented] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661376#comment-14661376 ] Davies Liu commented on SPARK-9614: --- I had visited all the use of toRdd in our codebase,

[jira] [Updated] (SPARK-9734) java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC

2015-08-06 Thread Greg Rahn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Rahn updated SPARK-9734: - Description: When using a basic example of reading the EMP table from Redshift via spark-redshift, and wr

[jira] [Created] (SPARK-9734) java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC

2015-08-06 Thread Greg Rahn (JIRA)
Greg Rahn created SPARK-9734: Summary: java.lang.IllegalArgumentException: Don't know how to save StructField(sal,DecimalType(7,2),true) to JDBC Key: SPARK-9734 URL: https://issues.apache.org/jira/browse/SPARK-9734

[jira] [Assigned] (SPARK-9733) Improve explain message for data source scan node

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9733: --- Assignee: Apache Spark (was: Reynold Xin) > Improve explain message for data source scan nod

[jira] [Commented] (SPARK-9733) Improve explain message for data source scan node

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661371#comment-14661371 ] Apache Spark commented on SPARK-9733: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9733) Improve explain message for data source scan node

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9733: --- Assignee: Reynold Xin (was: Apache Spark) > Improve explain message for data source scan nod

[jira] [Assigned] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9689: --- Assignee: Apache Spark > Cache doesn't refresh for HadoopFsRelation based table > ---

[jira] [Assigned] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9689: --- Assignee: (was: Apache Spark) > Cache doesn't refresh for HadoopFsRelation based table >

[jira] [Updated] (SPARK-9733) Improve explain message for data source scan node

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9733: --- Description: All data sources show up as "PhysicalRDD" in physical plan explain. It'd be better if we

[jira] [Commented] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661369#comment-14661369 ] Apache Spark commented on SPARK-9689: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-9733) Improve explain message for data source scan node

2015-08-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9733: -- Summary: Improve explain message for data source scan node Key: SPARK-9733 URL: https://issues.apache.org/jira/browse/SPARK-9733 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661359#comment-14661359 ] Cheng Hao commented on SPARK-9689: -- After investigation, the root cause for the failure,

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661333#comment-14661333 ] Davies Liu commented on SPARK-9725: --- I tried with latest master in standalone mode : {co

[jira] [Assigned] (SPARK-4980) Add decay factors to streaming linear methods

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4980: --- Assignee: Apache Spark > Add decay factors to streaming linear methods >

[jira] [Assigned] (SPARK-4980) Add decay factors to streaming linear methods

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4980: --- Assignee: (was: Apache Spark) > Add decay factors to streaming linear methods > -

[jira] [Commented] (SPARK-4980) Add decay factors to streaming linear methods

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661326#comment-14661326 ] Apache Spark commented on SPARK-4980: - User 'rotationsymmetry' has created a pull requ

[jira] [Resolved] (SPARK-8633) List missing model methods in Python Pipeline API

2015-08-06 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar resolved SPARK-8633. Resolution: Fixed > List missing model methods in Python Pipeline API >

[jira] [Commented] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-06 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661309#comment-14661309 ] Burak Yavuz commented on SPARK-9614: It used to work in Spark 1.4, without Tungsten. I

[jira] [Commented] (SPARK-7550) Support setting the right schema & serde when writing to Hive metastore

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661305#comment-14661305 ] Apache Spark commented on SPARK-7550: - User 'liancheng' has created a pull request for

[jira] [Resolved] (SPARK-8057) Call TaskAttemptContext.getTaskAttemptID using Reflection

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8057. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 > Call TaskAttemptCont

[jira] [Updated] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9182: --- Assignee: Cheng Lian > filter and groupBy on DataFrames are not passed through to jdbc source > --

[jira] [Commented] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661276#comment-14661276 ] Yin Huai commented on SPARK-9614: - Does it work with 1.4? > InternalRow representation du

[jira] [Assigned] (SPARK-9732) remove the unsafe -> safe conversion

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9732: --- Assignee: Apache Spark > remove the unsafe -> safe conversion > -

[jira] [Assigned] (SPARK-9732) remove the unsafe -> safe conversion

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9732: --- Assignee: (was: Apache Spark) > remove the unsafe -> safe conversion > --

[jira] [Commented] (SPARK-9732) remove the unsafe -> safe conversion

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661272#comment-14661272 ] Apache Spark commented on SPARK-9732: - User 'cloud-fan' has created a pull request for

[jira] [Created] (SPARK-9732) remove the unsafe -> safe conversion

2015-08-06 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9732: -- Summary: remove the unsafe -> safe conversion Key: SPARK-9732 URL: https://issues.apache.org/jira/browse/SPARK-9732 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9614) InternalRow representation during executionPlan.toRdd.aggregete possibly problematic

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661268#comment-14661268 ] Davies Liu commented on SPARK-9614: --- How to reproduce this issue? > InternalRow represe

[jira] [Updated] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9725: --- Labels: (was: 1.5.0) > spark sql query string field return empty/garbled string > --

[jira] [Updated] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9725: --- Target Version/s: 1.5.0 > spark sql query string field return empty/garbled string > -

[jira] [Commented] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661263#comment-14661263 ] Apache Spark commented on SPARK-9303: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-9642) LinearRegression should supported weighted data

2015-08-06 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9642: --- Labels: 1.6 (was: ) > LinearRegression should supported weighted data > -

[jira] [Assigned] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9725: - Assignee: Davies Liu > spark sql query string field return empty/garbled string > ---

[jira] [Updated] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9725: -- Labels: 1.5.0 (was: ) > spark sql query string field return empty/garbled string >

[jira] [Updated] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-06 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9689: - Description: {code:title=example|borderStyle=solid} // create a HadoopFsRelation based table sql(s

[jira] [Commented] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-06 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661221#comment-14661221 ] Carson Wang commented on SPARK-9731: This is related to SPARK-8881 and SPARK-9353 > S

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661218#comment-14661218 ] Joseph K. Bradley commented on SPARK-9720: -- Say you have a big Pipeline, run it,

[jira] [Commented] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661212#comment-14661212 ] Apache Spark commented on SPARK-9731: - User 'carsonwang' has created a pull request fo

[jira] [Assigned] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9731: --- Assignee: (was: Apache Spark) > Standalone scheduling incorrect cores if spark.executor.c

[jira] [Assigned] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9731: --- Assignee: Apache Spark > Standalone scheduling incorrect cores if spark.executor.cores is not

[jira] [Commented] (SPARK-9629) Client session timed out, have not heard from server in

2015-08-06 Thread zengqiuyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661211#comment-14661211 ] zengqiuyang commented on SPARK-9629: May be , i'm not sure because the error log is n

[jira] [Created] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

2015-08-06 Thread Carson Wang (JIRA)
Carson Wang created SPARK-9731: -- Summary: Standalone scheduling incorrect cores if spark.executor.cores is not set Key: SPARK-9731 URL: https://issues.apache.org/jira/browse/SPARK-9731 Project: Spark

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-08-06 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661207#comment-14661207 ] DjvuLee commented on SPARK-4105: Is there any progress on this bug? I have the same erro

[jira] [Updated] (SPARK-7165) Sort Merge Join for outer joins

2015-08-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7165: -- Issue Type: Story (was: New Feature) > Sort Merge Join for outer joins > --

[jira] [Assigned] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-9730: - Assignee: Josh Rosen > Sort Merge Join for Full Outer Join > ---

[jira] [Assigned] (SPARK-9729) Sort Merge Join for Left and Right Outer Join

2015-08-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-9729: - Assignee: Josh Rosen > Sort Merge Join for Left and Right Outer Join > --

[jira] [Commented] (SPARK-7165) Sort Merge Join for outer joins

2015-08-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661201#comment-14661201 ] Josh Rosen commented on SPARK-7165: --- To pipeline review, I decided to split this into tw

[jira] [Assigned] (SPARK-9729) Sort Merge Join for Left and Right Outer Join

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9729: --- Assignee: (was: Apache Spark) > Sort Merge Join for Left and Right Outer Join > -

[jira] [Commented] (SPARK-9729) Sort Merge Join for Left and Right Outer Join

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661200#comment-14661200 ] Apache Spark commented on SPARK-9729: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9729) Sort Merge Join for Left and Right Outer Join

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9729: --- Assignee: Apache Spark > Sort Merge Join for Left and Right Outer Join >

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8930: --- Assignee: Yijie Shen > Throw a AnalysisException with meaningful messages if DataFrame#explode takes

[jira] [Commented] (SPARK-9728) Support CalendarIntervalType in HiveQL

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661198#comment-14661198 ] Reynold Xin commented on SPARK-9728: [~marmbrus] I'm assigning this to [~yijieshen].

[jira] [Created] (SPARK-9730) Sort Merge Join for Full Outer Join

2015-08-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9730: - Summary: Sort Merge Join for Full Outer Join Key: SPARK-9730 URL: https://issues.apache.org/jira/browse/SPARK-9730 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9728) Support CalendarIntervalType in HiveQL

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9728: --- Priority: Critical (was: Major) > Support CalendarIntervalType in HiveQL > --

[jira] [Updated] (SPARK-9728) Support CalendarIntervalType in HiveQL

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9728: --- Description: We need to convert an interval term into CalendarIntervalType in Hive QL. > Support Cal

[jira] [Created] (SPARK-9729) Sort Merge Join for Left and Right Outer Join

2015-08-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9729: - Summary: Sort Merge Join for Left and Right Outer Join Key: SPARK-9729 URL: https://issues.apache.org/jira/browse/SPARK-9729 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9728) Support CalendarIntervalType in HiveQL

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9728: --- Assignee: Yijie Shen (was: Michael Armbrust) > Support CalendarIntervalType in HiveQL > -

[jira] [Commented] (SPARK-9680) Update programming guide section for ml.feature.StopWordsRemover

2015-08-06 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661196#comment-14661196 ] yuhao yang commented on SPARK-9680: --- Thanks for changing it. Yes this is for the program

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-06 Thread Sean Cho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661195#comment-14661195 ] Sean Cho commented on SPARK-9720: - Can I ask why this is required and if it is a good idea

[jira] [Resolved] (SPARK-9709) Avoid starving an unsafe operator in a sort

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9709. Resolution: Fixed Fix Version/s: 1.5.0 > Avoid starving an unsafe operator in a sort > --

[jira] [Assigned] (SPARK-9726) PySpark Regression: DataFrame join no longer accepts None as join expression

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9726: --- Assignee: Apache Spark > PySpark Regression: DataFrame join no longer accepts None as join ex

[jira] [Assigned] (SPARK-9726) PySpark Regression: DataFrame join no longer accepts None as join expression

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9726: --- Assignee: (was: Apache Spark) > PySpark Regression: DataFrame join no longer accepts None

[jira] [Commented] (SPARK-9726) PySpark Regression: DataFrame join no longer accepts None as join expression

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661187#comment-14661187 ] Apache Spark commented on SPARK-9726: - User 'btashton' has created a pull request for

[jira] [Created] (SPARK-9728) Support CalendarIntervalType in HiveQL

2015-08-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9728: -- Summary: Support CalendarIntervalType in HiveQL Key: SPARK-9728 URL: https://issues.apache.org/jira/browse/SPARK-9728 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9727: --- Assignee: Apache Spark (was: Tathagata Das) > Make the Kinesis project SBT name and consiste

[jira] [Assigned] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9727: --- Assignee: Tathagata Das (was: Apache Spark) > Make the Kinesis project SBT name and consiste

[jira] [Commented] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661178#comment-14661178 ] Apache Spark commented on SPARK-9727: - User 'tdas' has created a pull request for this

[jira] [Created] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9727: Summary: Make the Kinesis project SBT name and consistent with other streaming projects Key: SPARK-9727 URL: https://issues.apache.org/jira/browse/SPARK-9727 Project:

[jira] [Created] (SPARK-9726) PySpark Regression: DataFrame join no longer accepts None as join expression

2015-08-06 Thread Brennan Ashton (JIRA)
Brennan Ashton created SPARK-9726: - Summary: PySpark Regression: DataFrame join no longer accepts None as join expression Key: SPARK-9726 URL: https://issues.apache.org/jira/browse/SPARK-9726 Project:

[jira] [Updated] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9727: - Priority: Minor (was: Major) > Make the Kinesis project SBT name and consistent with other stream

[jira] [Updated] (SPARK-9727) Make the Kinesis project SBT name and consistent with other streaming projects

2015-08-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9727: - Issue Type: Improvement (was: Bug) > Make the Kinesis project SBT name and consistent with other

[jira] [Commented] (SPARK-9674) Remove GeneratedAggregate

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661170#comment-14661170 ] Apache Spark commented on SPARK-9674: - User 'andrewor14' has created a pull request fo

[jira] [Resolved] (SPARK-9692) Remove SqlNewHadoopRDD's generated Tuple2 and InterruptibleIterator

2015-08-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9692. Resolution: Fixed Fix Version/s: 1.5.0 > Remove SqlNewHadoopRDD's generated Tuple2 and Interr

[jira] [Created] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-06 Thread Fei Wang (JIRA)
Fei Wang created SPARK-9725: --- Summary: spark sql query string field return empty/garbled string Key: SPARK-9725 URL: https://issues.apache.org/jira/browse/SPARK-9725 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9711) spark-submit fails after restarting cluster with spark-ec2

2015-08-06 Thread Guangyang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangyang Li updated SPARK-9711: Description: With Spark 1.4.1 and YARN client mode, my application works at the first time the clus

[jira] [Updated] (SPARK-9711) spark-submit fails after restarting cluster with spark-ec2

2015-08-06 Thread Guangyang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangyang Li updated SPARK-9711: Description: With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is b

[jira] [Updated] (SPARK-9711) spark-submit fails after restarting cluster with spark-ec2

2015-08-06 Thread Guangyang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangyang Li updated SPARK-9711: Description: With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is b

[jira] [Updated] (SPARK-9711) spark-submit fails after restarting cluster with spark-ec2

2015-08-06 Thread Guangyang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangyang Li updated SPARK-9711: Description: With Spark 1.4.1 and YARN client mode. My job works at the first time the cluster is b

[jira] [Commented] (SPARK-9724) Avoid unnecessary redirects in the Spark Web UI

2015-08-06 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661146#comment-14661146 ] Rohit Agarwal commented on SPARK-9724: -- With the above changes: {code} vagrant@localh

  1   2   3   4   5   >