[jira] [Commented] (SPARK-6483) Spark SQL udf(ScalaUdf) is very slow

2015-03-24 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377746#comment-14377746 ] zzc commented on SPARK-6483: I test it later. Spark SQL udf(ScalaUdf) is very slow

[jira] [Created] (SPARK-6483) Spark SQL udf(ScalaUdf) is very slow

2015-03-23 Thread zzc (JIRA)
zzc created SPARK-6483: -- Summary: Spark SQL udf(ScalaUdf) is very slow Key: SPARK-6483 URL: https://issues.apache.org/jira/browse/SPARK-6483 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-23 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377139#comment-14377139 ] zzc commented on SPARK-6430: what's wrong with this? Cannot resolve column correctlly when

[jira] [Commented] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-22 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375283#comment-14375283 ] zzc commented on SPARK-6430: Thanks, [~marmbrus] Cannot resolve column correctlly when using

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371053#comment-14371053 ] zzc commented on SPARK-6432: [~liancheng], My data schema has the following columns: root |--

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371075#comment-14371075 ] zzc commented on SPARK-6432: Thanks, [~liancheng], [~huangjs] Cannot load parquet data with

[jira] [Created] (SPARK-6430) Cannot resolve column correctlly when using left semi join

2015-03-20 Thread zzc (JIRA)
zzc created SPARK-6430: -- Summary: Cannot resolve column correctlly when using left semi join Key: SPARK-6430 URL: https://issues.apache.org/jira/browse/SPARK-6430 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371035#comment-14371035 ] zzc commented on SPARK-6432: [~huangjs], I have some parquet files in partitions path, as

[jira] [Commented] (SPARK-6432) Cannot load parquet data with partitions if not all partition columns match data columns

2015-03-20 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371052#comment-14371052 ] zzc commented on SPARK-6432: [~liancheng], My data schema has the following columns: root |--

[jira] [Commented] (SPARK-6279) Miss expressions flag s at logging string

2015-03-13 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360013#comment-14360013 ] zzc commented on SPARK-6279: [~srowen], I am new to Spark and JIRA, Sorry for this Miss

[jira] [Commented] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

2015-03-13 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360012#comment-14360012 ] zzc commented on SPARK-6275: [~srowen], I am new to Spark and JIRA, Sorry for this Miss

[jira] [Created] (SPARK-6314) Failed to load application log data from FileStatus

2015-03-13 Thread zzc (JIRA)
zzc created SPARK-6314: -- Summary: Failed to load application log data from FileStatus Key: SPARK-6314 URL: https://issues.apache.org/jira/browse/SPARK-6314 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread zzc (JIRA)
zzc created SPARK-6279: -- Summary: Miss expressions flag s at logging string Key: SPARK-6279 URL: https://issues.apache.org/jira/browse/SPARK-6279 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-6279) Miss expressions flag s at logging string

2015-03-11 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc updated SPARK-6279: --- Description: In KafkaRDD.scala, Miss expressions flag s at logging string In logging file, it print `Beginning

[jira] [Created] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

2015-03-10 Thread zzc (JIRA)
zzc created SPARK-6275: -- Summary: Miss toDF() function in docs/sql-programming-guide.md Key: SPARK-6275 URL: https://issues.apache.org/jira/browse/SPARK-6275 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-5271) PySpark History Web UI issues

2015-03-04 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348067#comment-14348067 ] zzc commented on SPARK-5271: hi, [~sowen], [~ZEMUSHKA], SPARK-3898 occured with Spark

[jira] [Comment Edited] (SPARK-5271) PySpark History Web UI issues

2015-03-04 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348067#comment-14348067 ] zzc edited comment on SPARK-5271 at 3/5/15 3:35 AM: hi, [~sowen],

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-02-27 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341343#comment-14341343 ] zzc commented on SPARK-5206: I have same problem, [~vincentye38], how to resolve this?

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-26 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225960#comment-14225960 ] zzc commented on SPARK-2468: AH, Aaron Davidson, With patch #3465, I can run successful

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-25 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225790#comment-14225790 ] zzc commented on SPARK-2468: Great. I will test it later. Netty-based block server / client

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-14 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212064#comment-14212064 ] zzc commented on SPARK-2468: Hi, Aaron Davidson, I send a email to you about shuffle data

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-13 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209477#comment-14209477 ] zzc commented on SPARK-2468: Aaron Davidson, thank you for your reply. I will try it again.

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-13 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209489#comment-14209489 ] zzc commented on SPARK-2468: Aaron Davidson, I find that #3155 has merged into master, but

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-12 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207826#comment-14207826 ] zzc commented on SPARK-2468: Hi, Aaron Davidson, I am sure that I ran my last test with the

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-12 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207839#comment-14207839 ] zzc commented on SPARK-2468: Hi, Aaron Davidson, can you describe your test, including the

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-09 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204222#comment-14204222 ] zzc commented on SPARK-2468: @Aaron Davidson, Thank you for the suggestion. The configuration

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-07 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201765#comment-14201765 ] zzc commented on SPARK-2468: @Lianhui Wang, How to view the associated logs with yarn still

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-07 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201772#comment-14201772 ] zzc commented on SPARK-2468: aa...@databricks.com? Netty-based block server / client module

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-07 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201844#comment-14201844 ] zzc commented on SPARK-2468: By the way, My test code: val mapR = textFile.map(line = {

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-07 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201865#comment-14201865 ] zzc commented on SPARK-2468: Hi, Aaron Davidson, what do you mean that Is it really the case

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-07 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202136#comment-14202136 ] zzc commented on SPARK-2468: The performance of Netty is worse than NIO in my test. Why?@Aaron

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-06 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200037#comment-14200037 ] zzc commented on SPARK-2468: Hi, Aaron Davidson, I set

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-06 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201378#comment-14201378 ] zzc commented on SPARK-2468: @Aaron Davidson, Thank you for your recommendation. By the way,

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-06 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201482#comment-14201482 ] zzc commented on SPARK-2468: Thank you. Netty-based block server / client module

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-06 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201487#comment-14201487 ] zzc commented on SPARK-2468: YES, I see it, and start to compile and test. Netty-based block

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-06 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201684#comment-14201684 ] zzc commented on SPARK-2468: @Aaron Davidson, error still occur by setting the spark config

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-05 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199945#comment-14199945 ] zzc commented on SPARK-2468: Thank you for your reply. I will focus on it. Netty-based block

[jira] [Comment Edited] (SPARK-2468) Netty-based block server / client module

2014-11-04 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189825#comment-14189825 ] zzc edited comment on SPARK-2468 at 11/4/14 8:37 AM: - Hi, Reynold Xin,

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-04 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195952#comment-14195952 ] zzc commented on SPARK-2468: Yes, running on yarn client mode, but application is running, not

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-11-04 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196251#comment-14196251 ] zzc commented on SPARK-2468: If I use less data, it can run successfully, such as 24G snappy

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-30 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189825#comment-14189825 ] zzc commented on SPARK-2468: Hi, Reynold Xin, [SPARK-3453] Netty-based BlockTransferService,

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186910#comment-14186910 ] zzc commented on SPARK-2468: Hi,Reynold Xin, What time does this issue can be solved? I need

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187832#comment-14187832 ] zzc commented on SPARK-2468: Hi,Reynold Xin, When version 1.2 released, approximate time?

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187881#comment-14187881 ] zzc commented on SPARK-2468: thanks Netty-based block server / client module

[jira] [Closed] (SPARK-3898) History Web UI display incorrectly.

2014-10-15 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc closed SPARK-3898. -- Resolution: Not a Problem Target Version/s: 1.2.0 History Web UI display incorrectly.

[jira] [Created] (SPARK-3898) History Web UI display incorrectly.

2014-10-10 Thread zzc (JIRA)
zzc created SPARK-3898: -- Summary: History Web UI display incorrectly. Key: SPARK-3898 URL: https://issues.apache.org/jira/browse/SPARK-3898 Project: Spark Issue Type: Bug Components: Web UI

[jira] [Updated] (SPARK-3898) History Web UI display incorrectly.

2014-10-10 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc updated SPARK-3898: --- Fix Version/s: 1.2.0 History Web UI display incorrectly. --- Key:

[jira] [Updated] (SPARK-3898) History Web UI display incorrectly.

2014-10-10 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc updated SPARK-3898: --- Fix Version/s: 1.1.1 History Web UI display incorrectly. --- Key:

[jira] [Updated] (SPARK-3898) History Web UI display incorrectly.

2014-10-10 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zzc updated SPARK-3898: --- Fix Version/s: (was: 1.1.1) History Web UI display incorrectly. ---