[jira] [Assigned] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

[ https://issues.apache.org/jira/browse/SPARK-17783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17783: Assignee: (was: Apache Spark) > Hide Credentials in CREATE and DESC

[jira] [Commented] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

[ https://issues.apache.org/jira/browse/SPARK-17783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547664#comment-15547664 ] Apache Spark commented on SPARK-17783: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

[ https://issues.apache.org/jira/browse/SPARK-17783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17783: Assignee: Apache Spark > Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a

[jira] [Created] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

Xiao Li created SPARK-17783: --- Summary: Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC Key: SPARK-17783 URL: https://issues.apache.org/jira/browse/SPARK-17783

[jira] [Updated] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

[ https://issues.apache.org/jira/browse/SPARK-17783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17783: Description: We should never expose the Credentials in the EXPLAIN and DESC FORMATTED/EXTENDED command.

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547617#comment-15547617 ] Dongjoon Hyun commented on SPARK-17328: --- Thank you, [~hvanhovell]. Sorry for missing your comment.

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547587#comment-15547587 ] Apache Spark commented on SPARK-17328: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17328: Assignee: Apache Spark > NPE with EXPLAIN DESCRIBE TABLE >

[jira] [Assigned] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17328: Assignee: (was: Apache Spark) > NPE with EXPLAIN DESCRIBE TABLE >

[jira] [Assigned] (SPARK-17782) Kafka 010 test is flaky

[ https://issues.apache.org/jira/browse/SPARK-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17782: Assignee: Apache Spark > Kafka 010 test is flaky > --- > >

[jira] [Assigned] (SPARK-17782) Kafka 010 test is flaky

[ https://issues.apache.org/jira/browse/SPARK-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17782: Assignee: (was: Apache Spark) > Kafka 010 test is flaky > --- > >

[jira] [Commented] (SPARK-17782) Kafka 010 test is flaky

[ https://issues.apache.org/jira/browse/SPARK-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547466#comment-15547466 ] Apache Spark commented on SPARK-17782: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Created] (SPARK-17782) Kafka 010 test is flaky

Herman van Hovell created SPARK-17782: - Summary: Kafka 010 test is flaky Key: SPARK-17782 URL: https://issues.apache.org/jira/browse/SPARK-17782 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17764) to_json function for parsing Structs to json Strings

[ https://issues.apache.org/jira/browse/SPARK-17764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547434#comment-15547434 ] Apache Spark commented on SPARK-17764: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17764) to_json function for parsing Structs to json Strings

[ https://issues.apache.org/jira/browse/SPARK-17764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17764: Assignee: (was: Apache Spark) > to_json function for parsing Structs to json Strings

[jira] [Assigned] (SPARK-17764) to_json function for parsing Structs to json Strings

[ https://issues.apache.org/jira/browse/SPARK-17764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17764: Assignee: Apache Spark > to_json function for parsing Structs to json Strings >

[jira] [Commented] (SPARK-17774) Add support for head on DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-17774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547429#comment-15547429 ] Oscar D. Lara Yejas commented on SPARK-17774: - [~shivaram]: I concur with Shivaram. Besides,

[jira] [Comment Edited] (SPARK-17774) Add support for head on DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-17774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547429#comment-15547429 ] Oscar D. Lara Yejas edited comment on SPARK-17774 at 10/5/16 2:48 AM:

[jira] [Updated] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17495: -- Issue Type: Improvement (was: Bug) > Hive hash implementation >

[jira] [Resolved] (SPARK-17495) Hive hash implementation

[ https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17495. --- Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 > Hive

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547358#comment-15547358 ] Herman van Hovell commented on SPARK-17728: --- The second one does not trigger the behavior

[jira] [Comment Edited] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547358#comment-15547358 ] Herman van Hovell edited comment on SPARK-17728 at 10/5/16 1:56 AM:

[jira] [Commented] (SPARK-17728) UDFs are run too many times

[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547352#comment-15547352 ] Herman van Hovell commented on SPARK-17728: --- There are different evaluation paths in Spark SQL:

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547300#comment-15547300 ] Herman van Hovell commented on SPARK-17758: --- That is correct. First keeps track of the fact

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547292#comment-15547292 ] Franck Tago commented on SPARK-17758: - My first impression after taking a look at First.scala leads

[jira] [Updated] (SPARK-17781) datetime is serialized as double inside dapply()

[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17781: --- Description: When we ship a SparkDataFrame to workers for dapply family functions, inside

[jira] [Updated] (SPARK-17781) datetime is serialized as double inside dapply()

[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17781: --- Affects Version/s: 2.0.0 > datetime is serialized as double inside dapply() >

[jira] [Updated] (SPARK-17781) datetime is serialized as double inside dapply()

[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17781: --- Affects Version/s: (was: 2.0.1) > datetime is serialized as double inside dapply() >

[jira] [Updated] (SPARK-17781) datetime is serialized as double inside dapply()

[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17781: --- Description: When we ship a SparkDataFrame to workers for dapply family functions, inside

[jira] [Updated] (SPARK-17781) datetime is serialized as double inside dapply()

[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-17781: --- Description: When we ship a SparkDataFrame to workers for dapply family functions, inside

[jira] [Commented] (SPARK-17775) pyspark: take(num) failed, but collect() worked for big dataset

[ https://issues.apache.org/jira/browse/SPARK-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547257#comment-15547257 ] Rick Lin commented on SPARK-17775: -- Yes, i will try a new version > pyspark: take(num) failed, but

[jira] [Commented] (SPARK-17774) Add support for head on DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-17774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547232#comment-15547232 ] Hossein Falaki commented on SPARK-17774: Putting implementation aside, throwing an error for

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547216#comment-15547216 ] Yin Huai commented on SPARK-10063: -- [~ste...@apache.org] I took a quick look at hadoop 1

[jira] [Assigned] (SPARK-17724) Unevaluated new lines in tooltip in DAG Visualization of a job

[ https://issues.apache.org/jira/browse/SPARK-17724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17724: Assignee: (was: Apache Spark) > Unevaluated new lines in tooltip in DAG Visualization

[jira] [Assigned] (SPARK-17724) Unevaluated new lines in tooltip in DAG Visualization of a job

[ https://issues.apache.org/jira/browse/SPARK-17724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17724: Assignee: Apache Spark > Unevaluated new lines in tooltip in DAG Visualization of a job >

[jira] [Commented] (SPARK-17724) Unevaluated new lines in tooltip in DAG Visualization of a job

[ https://issues.apache.org/jira/browse/SPARK-17724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547204#comment-15547204 ] Apache Spark commented on SPARK-17724: -- User 'keypointt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10367) Support Parquet logical type INTERVAL

[ https://issues.apache.org/jira/browse/SPARK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10367: Assignee: Apache Spark > Support Parquet logical type INTERVAL >

[jira] [Commented] (SPARK-10367) Support Parquet logical type INTERVAL

[ https://issues.apache.org/jira/browse/SPARK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547193#comment-15547193 ] Apache Spark commented on SPARK-10367: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-10367) Support Parquet logical type INTERVAL

[ https://issues.apache.org/jira/browse/SPARK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10367: Assignee: (was: Apache Spark) > Support Parquet logical type INTERVAL >

[jira] [Assigned] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

[ https://issues.apache.org/jira/browse/SPARK-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10364: Assignee: (was: Apache Spark) > Support Parquet logical type TIMESTAMP_MILLIS >

[jira] [Commented] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

[ https://issues.apache.org/jira/browse/SPARK-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547189#comment-15547189 ] Apache Spark commented on SPARK-10364: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

[ https://issues.apache.org/jira/browse/SPARK-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10364: Assignee: Apache Spark > Support Parquet logical type TIMESTAMP_MILLIS >

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547107#comment-15547107 ] Herman van Hovell commented on SPARK-17328: --- Go ahead. The actual fix is a one liner. just add

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547102#comment-15547102 ] Dongjoon Hyun commented on SPARK-17328: --- Thank YOU, [~ja...@japila.pl]! > NPE with EXPLAIN

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547096#comment-15547096 ] Jacek Laskowski commented on SPARK-17328: - Sure! Go for it! Thanks. > NPE with EXPLAIN DESCRIBE

[jira] [Commented] (SPARK-17064) Reconsider spark.job.interruptOnCancel

[ https://issues.apache.org/jira/browse/SPARK-17064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547073#comment-15547073 ] Mridul Muralidharan commented on SPARK-17064: - I agree, interrupt'ing a thread can (and

[jira] [Commented] (SPARK-17328) NPE with EXPLAIN DESCRIBE TABLE

[ https://issues.apache.org/jira/browse/SPARK-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547065#comment-15547065 ] Dongjoon Hyun commented on SPARK-17328: --- Hi, [~ja...@japila.pl] and [~hvanhovell]. May I create a

[jira] [Closed] (SPARK-17452) Spark 2.0.0 is not supporting the "partition" keyword on a "describe" statement when using Hive Support

[ https://issues.apache.org/jira/browse/SPARK-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-17452. - Resolution: Duplicate Hi, [~hvivani]. This was resolved in SPARK-17612. > Spark 2.0.0 is not

[jira] [Created] (SPARK-17781) datetime is serialized as double inside dapply()

Hossein Falaki created SPARK-17781: -- Summary: datetime is serialized as double inside dapply() Key: SPARK-17781 URL: https://issues.apache.org/jira/browse/SPARK-17781 Project: Spark Issue

[jira] [Commented] (SPARK-17775) pyspark: take(num) failed, but collect() worked for big dataset

[ https://issues.apache.org/jira/browse/SPARK-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15547004#comment-15547004 ] Dongjoon Hyun commented on SPARK-17775: --- Hi, [~Ricklin]. I'm not sure about what is the problem,

[jira] [Updated] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-17780: - Component/s: SQL > Report NoClassDefFoundError in StreamExecution >

[jira] [Commented] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546959#comment-15546959 ] Apache Spark commented on SPARK-17780: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17780: Assignee: (was: Apache Spark) > Report NoClassDefFoundError in StreamExecution >

[jira] [Commented] (SPARK-17779) starting dse start-spark-sql-thriftserver

[ https://issues.apache.org/jira/browse/SPARK-17779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546977#comment-15546977 ] Dongjoon Hyun commented on SPARK-17779: --- Hi, [~epedregosa]. Do you try the following in the

[jira] [Assigned] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17780: Assignee: Apache Spark > Report NoClassDefFoundError in StreamExecution >

[jira] [Created] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

Shixiong Zhu created SPARK-17780: Summary: Report NoClassDefFoundError in StreamExecution Key: SPARK-17780 URL: https://issues.apache.org/jira/browse/SPARK-17780 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-17780: - Issue Type: Improvement (was: Test) > Report NoClassDefFoundError in StreamExecution >

[jira] [Updated] (SPARK-17780) Report NoClassDefFoundError in StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-17780: - Affects Version/s: 2.0.1 > Report NoClassDefFoundError in StreamExecution >

[jira] [Commented] (SPARK-17074) generate histogram information for column

[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546911#comment-15546911 ] Herman van Hovell commented on SPARK-17074: --- I would prefer modifying (extending)

[jira] [Commented] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546904#comment-15546904 ] Apache Spark commented on SPARK-17612: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546889#comment-15546889 ] Shivaram Venkataraman commented on SPARK-17608: --- I think the loss of precision is

[jira] [Commented] (SPARK-17634) Spark job hangs when using dapply

[ https://issues.apache.org/jira/browse/SPARK-17634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546871#comment-15546871 ] Shivaram Venkataraman commented on SPARK-17634: --- [~iamthomaspowell] Thanks for the

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546799#comment-15546799 ] Ameen Tayyebi commented on SPARK-1: --- Thanks for the comment. Can you please clarify why you

[jira] [Commented] (SPARK-17417) Fix # of partitions for RDD while checkpointing - Currently limited by 10000(%05d)

[ https://issues.apache.org/jira/browse/SPARK-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546792#comment-15546792 ] Dhruve Ashar commented on SPARK-17417: -- [~srowen] AFAIU the checkpointing mechanism in spark core,

[jira] [Resolved] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-15390. Resolution: Fixed > Memory management issue in complex DataFrame join and filter >

[jira] [Updated] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15390: --- Fix Version/s: 2.0.1 > Memory management issue in complex DataFrame join and filter >

[jira] [Comment Edited] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546675#comment-15546675 ] Davies Liu edited comment on SPARK-15390 at 10/4/16 9:11 PM: - @lulian Dragos

[jira] [Updated] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15390: --- Fix Version/s: (was: 2.0.0) > Memory management issue in complex DataFrame join and filter >

[jira] [Commented] (SPARK-15390) Memory management issue in complex DataFrame join and filter

[ https://issues.apache.org/jira/browse/SPARK-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546675#comment-15546675 ] Davies Liu commented on SPARK-15390: @lulian Dragos I think this is a different issue, fixed by

[jira] [Created] (SPARK-17779) starting dse start-spark-sql-thriftserver

Eric Pedregosa created SPARK-17779: -- Summary: starting dse start-spark-sql-thriftserver Key: SPARK-17779 URL: https://issues.apache.org/jira/browse/SPARK-17779 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17778) Mock SparkContext to reduce memory usage of BlockManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-17778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546618#comment-15546618 ] Apache Spark commented on SPARK-17778: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17778) Mock SparkContext to reduce memory usage of BlockManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-17778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17778: Assignee: Shixiong Zhu (was: Apache Spark) > Mock SparkContext to reduce memory usage of

[jira] [Assigned] (SPARK-17778) Mock SparkContext to reduce memory usage of BlockManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-17778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17778: Assignee: Apache Spark (was: Shixiong Zhu) > Mock SparkContext to reduce memory usage of

[jira] [Created] (SPARK-17778) Mock SparkContext to reduce memory usage of BlockManagerSuite

Shixiong Zhu created SPARK-17778: Summary: Mock SparkContext to reduce memory usage of BlockManagerSuite Key: SPARK-17778 URL: https://issues.apache.org/jira/browse/SPARK-17778 Project: Spark

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546365#comment-15546365 ] Brian Cho commented on SPARK-16827: --- Sure, having the actual spill metrics is something we're

[jira] [Commented] (SPARK-17239) User guide for multiclass logistic regression in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546331#comment-15546331 ] Apache Spark commented on SPARK-17239: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17239) User guide for multiclass logistic regression in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17239: Assignee: Apache Spark (was: Seth Hendrickson) > User guide for multiclass logistic

[jira] [Assigned] (SPARK-17239) User guide for multiclass logistic regression in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17239: Assignee: Seth Hendrickson (was: Apache Spark) > User guide for multiclass logistic

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546330#comment-15546330 ] Reynold Xin commented on SPARK-16827: - We should probably separate the on-disk spill from the shuffle

[jira] [Updated] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17758: -- Labels: correctness (was: ) > Spark Aggregate function LAST returns null on an empty

[jira] [Commented] (SPARK-17734) inner equi-join shorthand that returns Datasets, like DataFrame already has

[ https://issues.apache.org/jira/browse/SPARK-17734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546303#comment-15546303 ] Leif Warner commented on SPARK-17734: - That works, I was just hoping for a helper method that does

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546284#comment-15546284 ] Sean Owen commented on SPARK-1: --- I think you've demonstrated that this doesn't work, and I wouldn't

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Description: We've identified a problem with Spark scheduling. The issue manifests itself

[jira] [Commented] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546215#comment-15546215 ] Apache Spark commented on SPARK-17758: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17758: Assignee: (was: Apache Spark) > Spark Aggregate function LAST returns null on an

[jira] [Assigned] (SPARK-17758) Spark Aggregate function LAST returns null on an empty partition

[ https://issues.apache.org/jira/browse/SPARK-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17758: Assignee: Apache Spark > Spark Aggregate function LAST returns null on an empty

[jira] [Updated] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Attachment: repro.scala > Spark Scheduler Hangs Indefinitely >

[jira] [Issue Comment Deleted] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameen Tayyebi updated SPARK-1: -- Comment: was deleted (was: Here's repro code: import org.apache.spark.{Partition,

[jira] [Commented] (SPARK-17777) Spark Scheduler Hangs Indefinitely

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546204#comment-15546204 ] Ameen Tayyebi commented on SPARK-1: --- Here's repro code: import org.apache.spark.{Partition,

[jira] [Created] (SPARK-17777) Spark Scheduler Hangs Indefinitely

Ameen Tayyebi created SPARK-1: - Summary: Spark Scheduler Hangs Indefinitely Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546160#comment-15546160 ] Apache Spark commented on SPARK-16827: -- User 'dafrista' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16827: Assignee: Apache Spark > Query with Join produces excessive amount of shuffle data >

[jira] [Assigned] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16827: Assignee: (was: Apache Spark) > Query with Join produces excessive amount of shuffle

[jira] [Commented] (SPARK-16827) Query with Join produces excessive amount of shuffle data

[ https://issues.apache.org/jira/browse/SPARK-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546142#comment-15546142 ] Brian Cho commented on SPARK-16827: --- We found that the "shuffle write" metric was also including writes

[jira] [Closed] (SPARK-7313) Allow for configuring max_samples in range partitioner.

[ https://issues.apache.org/jira/browse/SPARK-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan closed SPARK-7313. -- Resolution: Won't Fix Not sure if still relevant, I opened it for an earlier project

[jira] [Assigned] (SPARK-17741) Grammar to parse top level and nested data fields separately

[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17741: Assignee: (was: Apache Spark) > Grammar to parse top level and nested data fields

[jira] [Commented] (SPARK-17741) Grammar to parse top level and nested data fields separately

[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546030#comment-15546030 ] Apache Spark commented on SPARK-17741: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-17741) Grammar to parse top level and nested data fields separately

[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17741: Assignee: Apache Spark > Grammar to parse top level and nested data fields separately >

[jira] [Commented] (SPARK-17773) HiveInspector wrapper for JavaVoidObjectInspector is missing

[ https://issues.apache.org/jira/browse/SPARK-17773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546003#comment-15546003 ] Apache Spark commented on SPARK-17773: -- User 'seyfe' has created a pull request for this issue:

[jira] [Commented] (SPARK-17559) PeriodicGraphCheckpointer did not persist edges as expected in some cases

[ https://issues.apache.org/jira/browse/SPARK-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15545991#comment-15545991 ] ding commented on SPARK-17559: -- Yes, it's the correct username. Thank you for your reviewing. >

  1   2   >