[jira] [Assigned] (SPARK-16639) query fails if having condition contains grouping column

[ https://issues.apache.org/jira/browse/SPARK-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16639: Assignee: Apache Spark > query fails if having condition contains grouping column >

[jira] [Assigned] (SPARK-16639) query fails if having condition contains grouping column

[ https://issues.apache.org/jira/browse/SPARK-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16639: Assignee: (was: Apache Spark) > query fails if having condition contains grouping

[jira] [Commented] (SPARK-16639) query fails if having condition contains grouping column

[ https://issues.apache.org/jira/browse/SPARK-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387176#comment-15387176 ] Apache Spark commented on SPARK-16639: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387172#comment-15387172 ] Cheng Lian commented on SPARK-16646: Thanks for the help! I'm not working on this. > LEAST doesn't

[jira] [Updated] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16646: --- Reporter: Cheng Lian (was: liancheng) > LEAST doesn't accept numeric arguments with different data

[jira] [Updated] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16646: --- Assignee: Hyukjin Kwon > LEAST doesn't accept numeric arguments with different data types >

[jira] [Updated] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16648: --- Reporter: Cheng Lian (was: liancheng) > LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[jira] [Updated] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16648: Assignee: Cheng Lian > LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException >

[jira] [Assigned] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16648: Assignee: Apache Spark > LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException >

[jira] [Commented] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387162#comment-15387162 ] Apache Spark commented on SPARK-16648: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16648: Assignee: (was: Apache Spark) > LAST_VALUE(FALSE) OVER () throws

[jira] [Comment Edited] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387145#comment-15387145 ] Lianhui Wang edited comment on SPARK-2666 at 7/21/16 4:38 AM: -- Thanks. I

[jira] [Commented] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387145#comment-15387145 ] Lianhui Wang commented on SPARK-2666: - I think what [~irashid] said is more about non-external

[jira] [Commented] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387067#comment-15387067 ] Hyukjin Kwon commented on SPARK-16646: -- Maybe I had to ask if you are working on this. I will close

[jira] [Assigned] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16646: Assignee: Apache Spark > LEAST doesn't accept numeric arguments with different data types

[jira] [Commented] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387025#comment-15387025 ] Apache Spark commented on SPARK-16646: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-16646) LEAST doesn't accept numeric arguments with different data types

[ https://issues.apache.org/jira/browse/SPARK-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16646: Assignee: (was: Apache Spark) > LEAST doesn't accept numeric arguments with different

[jira] [Created] (SPARK-16659) use Maven project to submit spark application via yarn-client

Jack Jiang created SPARK-16659: -- Summary: use Maven project to submit spark application via yarn-client Key: SPARK-16659 URL: https://issues.apache.org/jira/browse/SPARK-16659 Project: Spark

[jira] [Commented] (SPARK-16643) When doing Shuffle, report "java.io.FileNotFoundException"

[ https://issues.apache.org/jira/browse/SPARK-16643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387012#comment-15387012 ] Deng Changchun commented on SPARK-16643: Thank you for response. I think this problem is totally

[jira] [Updated] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16644: - Fix Version/s: (was: 2.0.0) 2.1.0 2.0.1 > constraints

[jira] [Updated] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16644: - Assignee: Wenchen Fan > constraints propagation may fail the query >

[jira] [Resolved] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16644. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14281

[jira] [Resolved] (SPARK-16272) Allow configs to reference other configs, env and system properties

[ https://issues.apache.org/jira/browse/SPARK-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16272. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > Allow

[jira] [Resolved] (SPARK-16344) Array of struct with a single field name "element" can't be decoded from Parquet files written by Spark 1.6+

[ https://issues.apache.org/jira/browse/SPARK-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16344. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14014

[jira] [Assigned] (SPARK-16658) Add EdgePartition.withVertexAttributes

[ https://issues.apache.org/jira/browse/SPARK-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16658: Assignee: (was: Apache Spark) > Add EdgePartition.withVertexAttributes >

[jira] [Commented] (SPARK-16658) Add EdgePartition.withVertexAttributes

[ https://issues.apache.org/jira/browse/SPARK-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386796#comment-15386796 ] Apache Spark commented on SPARK-16658: -- User 'benmccann' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16658) Add EdgePartition.withVertexAttributes

[ https://issues.apache.org/jira/browse/SPARK-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16658: Assignee: Apache Spark > Add EdgePartition.withVertexAttributes >

[jira] [Created] (SPARK-16658) Add EdgePartition.withVertexAttributes

Ben McCann created SPARK-16658: -- Summary: Add EdgePartition.withVertexAttributes Key: SPARK-16658 URL: https://issues.apache.org/jira/browse/SPARK-16658 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-16280) Implement histogram_numeric SQL function

[ https://issues.apache.org/jira/browse/SPARK-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386787#comment-15386787 ] MIN-FU YANG commented on SPARK-16280: - I implemented histogram_numeric according to the Algorithm I &

[jira] [Commented] (SPARK-16657) Replace children by innerChildren in InsertIntoHadoopFsRelationCommand and CreateHiveTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386765#comment-15386765 ] Apache Spark commented on SPARK-16657: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16657) Replace children by innerChildren in InsertIntoHadoopFsRelationCommand and CreateHiveTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16657: Assignee: (was: Apache Spark) > Replace children by innerChildren in

[jira] [Assigned] (SPARK-16657) Replace children by innerChildren in InsertIntoHadoopFsRelationCommand and CreateHiveTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16657: Assignee: Apache Spark > Replace children by innerChildren in

[jira] [Created] (SPARK-16657) Replace children by innerChildren in InsertIntoHadoopFsRelationCommand and CreateHiveTableAsSelectCommand

Xiao Li created SPARK-16657: --- Summary: Replace children by innerChildren in InsertIntoHadoopFsRelationCommand and CreateHiveTableAsSelectCommand Key: SPARK-16657 URL: https://issues.apache.org/jira/browse/SPARK-16657

[jira] [Commented] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386764#comment-15386764 ] Yin Huai commented on SPARK-16644: -- oh, I think this problem only happens if an aggregate expression

[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386759#comment-15386759 ] Emma Tang commented on SPARK-12675: --- This issue is happening in 1.6.2. I'm on a 32 node cluster. This

[jira] [Commented] (SPARK-16656) CreateTableAsSelectSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386750#comment-15386750 ] Apache Spark commented on SPARK-16656: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16656) CreateTableAsSelectSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16656: Assignee: Yin Huai (was: Apache Spark) > CreateTableAsSelectSuite is flaky >

[jira] [Assigned] (SPARK-16656) CreateTableAsSelectSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16656: Assignee: Apache Spark (was: Yin Huai) > CreateTableAsSelectSuite is flaky >

[jira] [Created] (SPARK-16656) CreateTableAsSelectSuite is flaky

Yin Huai created SPARK-16656: Summary: CreateTableAsSelectSuite is flaky Key: SPARK-16656 URL: https://issues.apache.org/jira/browse/SPARK-16656 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Updated] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16320: --- Description: I did some test on parquet file with many nested columns (about 30G in 400

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386586#comment-15386586 ] Michael Allman commented on SPARK-16320: Okay, so the metastore is not a factor. > Spark 2.0

[jira] [Comment Edited] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386564#comment-15386564 ] Sam Fishman edited comment on SPARK-13301 at 7/20/16 8:27 PM: -- I am having

[jira] [Commented] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386561#comment-15386561 ] Thomas Graves commented on SPARK-2666: -- thanks for the explanation. I guess we would have to look

[jira] [Commented] (SPARK-13301) PySpark Dataframe return wrong results with custom UDF

[ https://issues.apache.org/jira/browse/SPARK-13301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386564#comment-15386564 ] Sam Fishman commented on SPARK-13301: - I am having the same issue when applying a udf to a DataFrame.

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386552#comment-15386552 ] Maciej Bryński commented on SPARK-16320: [~michael] Could you check SPARK-16321 ? I attached

[jira] [Commented] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386524#comment-15386524 ] Imran Rashid commented on SPARK-2666: - [~tgraves] [~lianhuiwang]. When there is a fetch failure,

[jira] [Updated] (SPARK-16507) Add CRAN checks to SparkR

[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16507: - Target Version/s: 2.0.0, 2.1.0 (was: 2.1.0) > Add CRAN checks to SparkR >

[jira] [Commented] (SPARK-16632) Vectorized parquet reader fails to read certain fields from Hive tables

[ https://issues.apache.org/jira/browse/SPARK-16632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386409#comment-15386409 ] Marcelo Vanzin commented on SPARK-16632: Yes, that's the right stack trace. It's a CTAS query

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386395#comment-15386395 ] Michael Allman commented on SPARK-16320: The code path for reading data from parquet files has

[jira] [Commented] (SPARK-14887) Generated SpecificUnsafeProjection Exceeds JVM Code Size Limits

[ https://issues.apache.org/jira/browse/SPARK-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386393#comment-15386393 ] Hayri Volkan Agun commented on SPARK-14887: --- Same issue in 1.6.2 can repeated with around 300

[jira] [Updated] (SPARK-15425) Disallow cartesian joins by default

[ https://issues.apache.org/jira/browse/SPARK-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15425: - Labels: release_notes releasenotes (was: ) > Disallow cartesian joins by default >

[jira] [Updated] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16644: - Component/s: SQL > constraints propagation may fail the query >

[jira] [Updated] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16644: - Target Version/s: 2.0.1 (was: 2.0.0) > constraints propagation may fail the query >

[jira] [Updated] (SPARK-16633) lag/lead does not return the default value when the offset row does not exist

[ https://issues.apache.org/jira/browse/SPARK-16633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16633: - Target Version/s: 2.0.1 (was: 2.0.0) > lag/lead does not return the default value when the offset row

[jira] [Updated] (SPARK-16642) ResolveWindowFrame should not be triggered on UnresolvedFunctions.

[ https://issues.apache.org/jira/browse/SPARK-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16642: - Target Version/s: 2.0.1 (was: 2.0.0) > ResolveWindowFrame should not be triggered on

[jira] [Updated] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16648: - Target Version/s: 2.0.1 (was: 2.0.0) > LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException >

[jira] [Updated] (SPARK-16644) constraints propagation may fail the query

[ https://issues.apache.org/jira/browse/SPARK-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16644: - Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > constraints propagation may fail the query >

[jira] [Commented] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386360#comment-15386360 ] Dongjoon Hyun commented on SPARK-16651: --- I made a PR for you and other people, but I'm not sure

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386338#comment-15386338 ] Alex Bozarth commented on SPARK-16654: -- Perhaps we can change the status column to "Blacklisted" or

[jira] [Commented] (SPARK-16320) Spark 2.0 slower than 1.6 when querying nested columns

[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386333#comment-15386333 ] Michael Allman commented on SPARK-16320: [~maver1ck] Would it be possible for you to share your

[jira] [Updated] (SPARK-16642) ResolveWindowFrame should not be triggered on UnresolvedFunctions.

[ https://issues.apache.org/jira/browse/SPARK-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16642: - Target Version/s: 2.0.0 > ResolveWindowFrame should not be triggered on UnresolvedFunctions. >

[jira] [Created] (SPARK-16655) Spark thrift server application is not stopped if its in ACCEPTED stage

Yesha Vora created SPARK-16655: -- Summary: Spark thrift server application is not stopped if its in ACCEPTED stage Key: SPARK-16655 URL: https://issues.apache.org/jira/browse/SPARK-16655 Project: Spark

[jira] [Assigned] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16651: Assignee: (was: Apache Spark) > No exception using DataFrame.withColumnRenamed when

[jira] [Commented] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386317#comment-15386317 ] Apache Spark commented on SPARK-16651: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16651: Assignee: Apache Spark > No exception using DataFrame.withColumnRenamed when existing

[jira] [Assigned] (SPARK-16650) Improve documentation of spark.task.maxFailures

[ https://issues.apache.org/jira/browse/SPARK-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16650: Assignee: Apache Spark > Improve documentation of spark.task.maxFailures >

[jira] [Commented] (SPARK-16650) Improve documentation of spark.task.maxFailures

[ https://issues.apache.org/jira/browse/SPARK-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386311#comment-15386311 ] Apache Spark commented on SPARK-16650: -- User 'tgravescs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16650) Improve documentation of spark.task.maxFailures

[ https://issues.apache.org/jira/browse/SPARK-16650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16650: Assignee: (was: Apache Spark) > Improve documentation of spark.task.maxFailures

[jira] [Comment Edited] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386295#comment-15386295 ] Dongjoon Hyun edited comment on SPARK-16651 at 7/20/16 5:55 PM: Also, in

[jira] [Commented] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386295#comment-15386295 ] Dongjoon Hyun commented on SPARK-16651: --- Also, in Spark 2.0 RC, Dataframe is merged into Dataset

[jira] [Commented] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386286#comment-15386286 ] Dongjoon Hyun commented on SPARK-16651: --- Hi, [~tomwphillips]. It's a documented behavior in Scala

[jira] [Resolved] (SPARK-16634) GenericArrayData can't be loaded in certain JVMs

[ https://issues.apache.org/jira/browse/SPARK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16634. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386242#comment-15386242 ] Imran Rashid commented on SPARK-16654: -- cc [~tgraves] > UI Should show blacklisted executors &

[jira] [Created] (SPARK-16654) UI Should show blacklisted executors & nodes

Imran Rashid created SPARK-16654: Summary: UI Should show blacklisted executors & nodes Key: SPARK-16654 URL: https://issues.apache.org/jira/browse/SPARK-16654 Project: Spark Issue Type:

[jira] [Updated] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-15951: -- Assignee: Kishor Patil > Change Executors Page to use datatables to support sorting columns

[jira] [Resolved] (SPARK-15951) Change Executors Page to use datatables to support sorting columns and searching

[ https://issues.apache.org/jira/browse/SPARK-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-15951. --- Resolution: Fixed Fix Version/s: 2.1.0 > Change Executors Page to use datatables to

[jira] [Commented] (SPARK-2666) Always try to cancel running tasks when a stage is marked as zombie

[ https://issues.apache.org/jira/browse/SPARK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386235#comment-15386235 ] Thomas Graves commented on SPARK-2666: -- I think eventually adding prestart (MapReduce slowstart type

[jira] [Commented] (SPARK-15918) unionAll returns wrong result when two dataframes has schema in different order

[ https://issues.apache.org/jira/browse/SPARK-15918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386225#comment-15386225 ] Wade Salazar commented on SPARK-15918: -- Is the stance on this issue that since other SQL

[jira] [Updated] (SPARK-15968) HiveMetastoreCatalog does not correctly validate partitioned metastore relation when searching the internal table cache

[ https://issues.apache.org/jira/browse/SPARK-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-15968: --- Fix Version/s: 2.0.0 > HiveMetastoreCatalog does not correctly validate partitioned

[jira] [Commented] (SPARK-13767) py4j.protocol.Py4JNetworkError: An error occurred while trying to connect to the Java server

[ https://issues.apache.org/jira/browse/SPARK-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386192#comment-15386192 ] Rahul Bhatia commented on SPARK-13767: -- I'm seeing the error that Venkata showed as well, if anyone

[jira] [Resolved] (SPARK-16613) RDD.pipe returns values for empty partitions

[ https://issues.apache.org/jira/browse/SPARK-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16613. - Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-15968) HiveMetastoreCatalog does not correctly validate partitioned metastore relation when searching the internal table cache

[ https://issues.apache.org/jira/browse/SPARK-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15968: Fix Version/s: (was: 2.1.0) > HiveMetastoreCatalog does not correctly validate partitioned

[jira] [Assigned] (SPARK-16653) Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS

[ https://issues.apache.org/jira/browse/SPARK-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16653: Assignee: Apache Spark > Make convergence tolerance param in ANN default value consistent

[jira] [Commented] (SPARK-16653) Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS

[ https://issues.apache.org/jira/browse/SPARK-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386028#comment-15386028 ] Apache Spark commented on SPARK-16653: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-16653) Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS

[ https://issues.apache.org/jira/browse/SPARK-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16653: Assignee: (was: Apache Spark) > Make convergence tolerance param in ANN default value

[jira] [Updated] (SPARK-16653) Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS

[ https://issues.apache.org/jira/browse/SPARK-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16653: --- Component/s: Optimizer ML > Make convergence tolerance param in ANN default value

[jira] [Created] (SPARK-16653) Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS

Weichen Xu created SPARK-16653: -- Summary: Make convergence tolerance param in ANN default value consistent with other algorithm using LBFGS Key: SPARK-16653 URL: https://issues.apache.org/jira/browse/SPARK-16653

[jira] [Commented] (SPARK-3210) Flume Polling Receiver must be more tolerant to connection failures.

[ https://issues.apache.org/jira/browse/SPARK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386002#comment-15386002 ] Ian Brooks commented on SPARK-3210: --- Hi, I have also noticed an issue with resiliency for the flume

[jira] [Commented] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

[ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385984#comment-15385984 ] Daniel Barclay commented on SPARK-16652: More info.: Having the {{String}} member isn't

[jira] [Updated] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

[ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Barclay updated SPARK-16652: --- Description: Generating and writing out a {{Dataset}} of a class that has a {{List}} (at

[jira] [Commented] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

[ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385966#comment-15385966 ] Daniel Barclay commented on SPARK-16652: SPARK-3947 reports the same InternalError message that I

[jira] [Updated] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

[ https://issues.apache.org/jira/browse/SPARK-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Barclay updated SPARK-16652: --- Attachment: UnsafeAccessCrashBugTest.scala > JVM crash from unsafe memory access for Dataset

[jira] [Created] (SPARK-16652) JVM crash from unsafe memory access for Dataset of class with List[Long]

Daniel Barclay created SPARK-16652: -- Summary: JVM crash from unsafe memory access for Dataset of class with List[Long] Key: SPARK-16652 URL: https://issues.apache.org/jira/browse/SPARK-16652

[jira] [Created] (SPARK-16651) No exception using DataFrame.withColumnRenamed when existing column doesn't exist

Tom Phillips created SPARK-16651: Summary: No exception using DataFrame.withColumnRenamed when existing column doesn't exist Key: SPARK-16651 URL: https://issues.apache.org/jira/browse/SPARK-16651

[jira] [Created] (SPARK-16650) Improve documentation of spark.task.maxFailures

Thomas Graves created SPARK-16650: - Summary: Improve documentation of spark.task.maxFailures Key: SPARK-16650 URL: https://issues.apache.org/jira/browse/SPARK-16650 Project: Spark Issue

[jira] [Updated] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liancheng updated SPARK-16648: -- Description: The following simple SQL query reproduces this issue: {code:sql} SELECT

[jira] [Commented] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385886#comment-15385886 ] liancheng commented on SPARK-16648: --- The problematic code is the newly introduced

[jira] [Assigned] (SPARK-16629) UDTs can not be compared to DataTypes in dataframes.

[ https://issues.apache.org/jira/browse/SPARK-16629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16629: Assignee: (was: Apache Spark) > UDTs can not be compared to DataTypes in dataframes.

  1   2   >