[jira] [Commented] (SPARK-6061) File source dstream can not include the old file which timestamp is before the system time

[ https://issues.apache.org/jira/browse/SPARK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346640#comment-14346640 ] maji2014 commented on SPARK-6061: - Different rules exist between 1.1.0 and 1.2.1. In

[jira] [Created] (SPARK-4691) code optimization for judgement

maji2014 created SPARK-4691: --- Summary: code optimization for judgement Key: SPARK-4691 URL: https://issues.apache.org/jira/browse/SPARK-4691 Project: Spark Issue Type: Bug Reporter:

[jira] [Created] (SPARK-4619) Double ms in ShuffleBlockFetcherIterator log

maji2014 created SPARK-4619: --- Summary: Double ms in ShuffleBlockFetcherIterator log Key: SPARK-4619 URL: https://issues.apache.org/jira/browse/SPARK-4619 Project: Spark Issue Type: Bug Affects

[jira] [Commented] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225589#comment-14225589 ] maji2014 commented on SPARK-4314: - Discription for fileStream in textFileStream method is

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225589#comment-14225589 ] maji2014 edited comment on SPARK-4314 at 11/26/14 1:57 AM: ---

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225589#comment-14225589 ] maji2014 edited comment on SPARK-4314 at 11/26/14 1:59 AM: ---

[jira] [Updated] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4314: Description: [Reproduce] 1. Run HdfsWordCount interface, such as ssc.textFileStream(args(0)) 2. Upload

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225589#comment-14225589 ] maji2014 edited comment on SPARK-4314 at 11/26/14 2:05 AM: ---

[jira] [Updated] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4314: Description: [Reproduce] 1. Run HdfsWordCount interface, such as ssc.textFileStream(args(0)) 2. Upload

[jira] [Issue Comment Deleted] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4314: Comment: was deleted (was: Yes, Not all of this intermediate state are caught. i wanna add following code

[jira] [Created] (SPARK-4314) Exception throws when finding new files like intermediate result(_COPYING_ file) through hdfs interface

maji2014 created SPARK-4314: --- Summary: Exception throws when finding new files like intermediate result(_COPYING_ file) through hdfs interface Key: SPARK-4314 URL: https://issues.apache.org/jira/browse/SPARK-4314

[jira] [Commented] (SPARK-4314) Exception throws when finding new files like intermediate result(_COPYING_ file) through hdfs interface

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205774#comment-14205774 ] maji2014 commented on SPARK-4314: - The actual behavior is the intermediate file _COPYING_

[jira] [Comment Edited] (SPARK-4314) Exception throws when the upload intermediate file(_COPYING_ file) is read through hdfs interface

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205774#comment-14205774 ] maji2014 edited comment on SPARK-4314 at 11/11/14 1:48 AM: --- The

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205774#comment-14205774 ] maji2014 edited comment on SPARK-4314 at 11/11/14 2:07 AM: --- The

[jira] [Commented] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205825#comment-14205825 ] maji2014 commented on SPARK-4314: - Yes, Not all of this intermediate state are caught. i

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205825#comment-14205825 ] maji2014 edited comment on SPARK-4314 at 11/11/14 2:16 AM: --- Yes,

[jira] [Comment Edited] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205825#comment-14205825 ] maji2014 edited comment on SPARK-4314 at 11/11/14 2:32 AM: --- Yes,

[jira] [Updated] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

[ https://issues.apache.org/jira/browse/SPARK-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4295: Description: After the first test case, all other test cases throw

[jira] [Updated] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

[ https://issues.apache.org/jira/browse/SPARK-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4295: Description: Run test suite normally, after the first test case, all other test cases throw

[jira] [Updated] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

[ https://issues.apache.org/jira/browse/SPARK-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4295: Description: [reproduce] Run test suite normally, after the first test case, all other test cases throw

[jira] [Updated] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

[ https://issues.apache.org/jira/browse/SPARK-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4295: Description: [reproduce] Run test suite normally, after the first test case, all other test cases throw

[jira] [Created] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

maji2014 created SPARK-4295: --- Summary: [External]Exception throws in SparkSinkSuite although all test cases pass Key: SPARK-4295 URL: https://issues.apache.org/jira/browse/SPARK-4295 Project: Spark

[jira] [Created] (SPARK-2057) run-example can only be ran under spark_home

maji2014 created SPARK-2057: --- Summary: run-example can only be ran under spark_home Key: SPARK-2057 URL: https://issues.apache.org/jira/browse/SPARK-2057 Project: Spark Issue Type: Bug