Re: welcome a new batch of committers

2018-10-03 Thread Kousuke Saruta
Congratulations! - Kousuke On 2018/10/04 0:30, Gengliang wrote: Congratulations to all ! On Wed, Oct 3, 2018 at 10:06 PM Wenchen Fan mailto:cloud0...@gmail.com>> wrote: Congratulations! On Wed, Oct 3, 2018 at 9:24 PM Madhusudanan Kandasamy mailto:madhusuda...@in.ibm.com>> wrote:

[jira] [Updated] (SPARK-25265) Fix memory leak in Barrier Execution Mode

2018-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-25265: --- Summary: Fix memory leak in Barrier Execution Mode (was: Fix memory leak vulnerability in

[jira] [Resolved] (SPARK-25265) Fix memory leak vulnerability in Barrier Execution Mode

2018-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-25265. Resolution: Duplicate Thanks for the notification. It may be accidentally duplicated

[jira] [Updated] (SPARK-25266) Fix memory leak in Barrier Execution Mode

2018-08-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-25266: --- Description: BarrierCoordinator uses Timer and TimerTask. `TimerTask#cancel()` is invoked

[jira] [Updated] (SPARK-25266) Fix memory leak in Barrier Execution Mode

2018-08-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-25266: --- Summary: Fix memory leak in Barrier Execution Mode (was: Fix memory leak vulnerability in

[jira] [Created] (SPARK-25266) Fix memory leak vulnerability in Barrier Execution Mode

2018-08-28 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-25266: -- Summary: Fix memory leak vulnerability in Barrier Execution Mode Key: SPARK-25266 URL: https://issues.apache.org/jira/browse/SPARK-25266 Project: Spark

[jira] [Created] (SPARK-25265) Fix memory leak vulnerability in Barrier Execution Mode

2018-08-28 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-25265: -- Summary: Fix memory leak vulnerability in Barrier Execution Mode Key: SPARK-25265 URL: https://issues.apache.org/jira/browse/SPARK-25265 Project: Spark

[jira] [Created] (IGNITE-6472) Remove unused GridOffHeapProcessor

2017-09-21 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created IGNITE-6472: -- Summary: Remove unused GridOffHeapProcessor Key: IGNITE-6472 URL: https://issues.apache.org/jira/browse/IGNITE-6472 Project: Ignite Issue Type

[jira] [Created] (IGNITE-6472) Remove unused GridOffHeapProcessor

2017-09-21 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created IGNITE-6472: -- Summary: Remove unused GridOffHeapProcessor Key: IGNITE-6472 URL: https://issues.apache.org/jira/browse/IGNITE-6472 Project: Ignite Issue Type

[jira] [Comment Edited] (IGNITE-6002) Make log message more pretty when instance name is null

2017-09-13 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/IGNITE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164521#comment-16164521 ] Kousuke Saruta edited comment on IGNITE-6002 at 9/13/17 11:3

[jira] [Commented] (IGNITE-6002) Make log message more pretty when instance name is null

2017-09-13 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/IGNITE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164521#comment-16164521 ] Kousuke Saruta commented on IGNITE-6002: [~avinogradov] Thanks for your r

[jira] [Commented] (IGNITE-6002) Make log message more pretty when instance name is null

2017-09-12 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/IGNITE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163463#comment-16163463 ] Kousuke Saruta commented on IGNITE-6002: [~avinogradov] If you have time, c

[jira] [Commented] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-09-12 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162922#comment-16162922 ] Kousuke Saruta commented on YARN-7058: -- I found YARN-5753 resolved this issue

[jira] [Commented] (IGNITE-6002) Make log message more pretty when instance name is null

2017-08-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/IGNITE-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141449#comment-16141449 ] Kousuke Saruta commented on IGNITE-6002: [~yzhdanov] If you have time, pl

[jira] [Updated] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-21 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated YARN-7058: - Attachment: YARN-7058-branch-2.001.patch > Add null check in AMRMClientImpl#getMatchingRequ

[jira] [Updated] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-21 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated YARN-7058: - Attachment: (was: YARN-7058-branch-2.001.patch) > Add null check in AMRMClientI

[jira] [Assigned] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned YARN-7058: Assignee: Kousuke Saruta > Add null check in AMRMClientImpl#getMatchingRequ

[jira] [Updated] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated YARN-7058: - Attachment: YARN-7058-branch-2.001.patch > Add null check in AMRMClientImpl#getMatchingRequ

[jira] [Created] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created YARN-7058: Summary: Add null check in AMRMClientImpl#getMatchingRequest Key: YARN-7058 URL: https://issues.apache.org/jira/browse/YARN-7058 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7058) Add null check in AMRMClientImpl#getMatchingRequest

2017-08-20 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created YARN-7058: Summary: Add null check in AMRMClientImpl#getMatchingRequest Key: YARN-7058 URL: https://issues.apache.org/jira/browse/YARN-7058 Project: Hadoop YARN Issue

[jira] [Created] (IGNITE-6002) Make log message more pretty when instance name is null

2017-08-08 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created IGNITE-6002: -- Summary: Make log message more pretty when instance name is null Key: IGNITE-6002 URL: https://issues.apache.org/jira/browse/IGNITE-6002 Project: Ignite

[jira] [Created] (IGNITE-6002) Make log message more pretty when instance name is null

2017-08-08 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created IGNITE-6002: -- Summary: Make log message more pretty when instance name is null Key: IGNITE-6002 URL: https://issues.apache.org/jira/browse/IGNITE-6002 Project: Ignite

[jira] [Created] (SPARK-21368) TPCDSQueryBenchmark can't refer query files.

2017-07-10 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-21368: -- Summary: TPCDSQueryBenchmark can't refer query files. Key: SPARK-21368 URL: https://issues.apache.org/jira/browse/SPARK-21368 Project: Spark Issue

[jira] [Created] (SPARK-19913) Log warning rather than throw AnalysisException when output is partitioned although format is memory, console or foreach

2017-03-10 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-19913: -- Summary: Log warning rather than throw AnalysisException when output is partitioned although format is memory, console or foreach Key: SPARK-19913 URL: https

[jira] [Created] (SPARK-19909) Batches will fail in case that temporary checkpoint dir is on local file system while metadata dir is on HDFS

2017-03-10 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-19909: -- Summary: Batches will fail in case that temporary checkpoint dir is on local file system while metadata dir is on HDFS Key: SPARK-19909 URL: https://issues.apache.org/jira

Re: welcoming Takuya Ueshin as a new Apache Spark committer

2017-02-13 Thread Kousuke Saruta
Congratulations, Takuya! - Kousuke On 2017/02/14 7:38, Herman van Hövell tot Westerflier wrote: Congrats Takuya! On Mon, Feb 13, 2017 at 11:27 PM, Neelesh Salian mailto:neeleshssal...@gmail.com>> wrote: Congratulations, Takuya! On Mon, Feb 13, 2017 at 11:16 AM, Reynold Xin mailto:

[jira] [Resolved] (SPARK-17874) Additional SSL port on HistoryServer should be configurable

2017-02-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-17874. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-19220) SSL redirect handler only redirects the server's root

2017-01-26 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-19220. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.2.0

Re: welcoming Burak and Holden as committers

2017-01-24 Thread Kousuke Saruta
Congrats, Burak and Holden! - Kousuke On 2017/01/25 6:36, Herman van Hövell tot Westerflier wrote: Congrats! On Tue, Jan 24, 2017 at 10:20 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: Congrats and welcome!! ---

[jira] [Commented] (SPARK-19334) Fix the code injection vulnerability related to Generator functions.

2017-01-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836841#comment-15836841 ] Kousuke Saruta commented on SPARK-19334: [~hvanhovell] Thanks. The aff

[jira] [Updated] (SPARK-19334) Fix the code injection vulnerability related to Generator functions.

2017-01-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-19334: --- Affects Version/s: (was: 2.1.0) 2.2.0 > Fix the code inject

[jira] [Commented] (SPARK-19302) Fix the wrong item format in security.md

2017-01-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831615#comment-15831615 ] Kousuke Saruta commented on SPARK-19302: [~srowen] Sorry, it's too mino

[jira] [Created] (SPARK-19302) Fix the wrong item format in security.md

2017-01-19 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-19302: -- Summary: Fix the wrong item format in security.md Key: SPARK-19302 URL: https://issues.apache.org/jira/browse/SPARK-19302 Project: Spark Issue Type: Bug

[kudu-CR] Remove Schema#toString from RowResult#toString

2017-01-12 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: Remove Schema#toString from RowResult#toString .. Patch Set 1: No problem. Thank you for taking a look at this :) -- To view, visit http

[jira] [Commented] (SPARK-18837) Very long stage descriptions do not wrap in the UI

2016-12-19 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761556#comment-15761556 ] Kousuke Saruta commented on SPARK-18837: I've found the cause. The wid

[kudu-CR] Remove Schema#toString from RowResult#toString

2016-12-18 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: Remove Schema#toString from RowResult#toString .. Patch Set 1: (1 comment) Thanks for the comment. At first, I tried to add the row data but is it already

[kudu-CR] Remove Schema#toString from RowResult#toString

2016-12-15 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5534 Change subject: Remove Schema#toString from RowResult#toString .. Remove Schema#toString from RowResult#toString In RowResult#toString

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-15 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: KuduRDD.collect fails because of NoSerializableException .. Patch Set 4: > > Can we have any compatibility issue? Do you have any examples? >

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-14 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: KuduRDD.collect fails because of NoSerializableException .. Patch Set 4: Hi Dan, Thank you for the review! I have a question and a comment. > I'm

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
rit-Change-Id: If0463424481a33c66fd7464345c305062420cfe9 Gerrit-PatchSet: 4 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Kousuke Saruta Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
ranch: master Gerrit-Owner: Kousuke Saruta Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has abandoned this change. Change subject: KuduRDD.collect fails because of NoSerializableException .. Abandoned This is duplicate PR. -- To view, visit http://gerrit.cloudera.org:8080/5497 To unsubscribe

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5497 Change subject: KuduRDD.collect fails because of NoSerializableException .. KuduRDD.collect fails because of NoSerializableException

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
ranch: master Gerrit-Owner: Kousuke Saruta Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins

[kudu-CR] KuduRDD.collect fails because of NoSerializableException

2016-12-13 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5496 Change subject: KuduRDD.collect fails because of NoSerializableException .. KuduRDD.collect fails because of NoSerializableException

[kudu-CR] Modify the default value of log dir flag.

2016-12-08 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5436 Change subject: Modify the default value of log_dir flag. .. Modify the default value of log_dir flag. The document about

[jira] [Commented] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-07 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728209#comment-15728209 ] Kousuke Saruta commented on SPARK-18761: Sorry, my PR is not for this i

[jira] [Commented] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-06 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727986#comment-15727986 ] Kousuke Saruta commented on SPARK-18762: Yeah of course. > Web UI sh

[jira] [Commented] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-06 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727963#comment-15727963 ] Kousuke Saruta commented on SPARK-18762: [~mengxr] Ah... O.K, I'll su

[kudu-CR] Note to install "which" command in the installation guide in case of building on RHEL/CentOS.

2016-11-28 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: Note to install "which" command in the installation guide in case of building on RHEL/CentOS. .. Patch Set 2: Thank you for pointing it out. I&#

[kudu-CR] Note to install "which" command in the installation guide in case of building on RHEL/CentOS.

2016-11-28 Thread Kousuke Saruta (Code Review)
://gerrit.cloudera.org:8080/5216 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: If02eae6f22a51965120a037cc9a68ddefa418b6c Gerrit-PatchSet: 2 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Kousuke Saruta Gerrit-Reviewer: Kudu Jenkins Gerrit-Reviewer: Todd Lipcon

[kudu-CR] For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a should be remo

2016-11-24 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has abandoned this change. Change subject: For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a should be removed only when

[kudu-CR] Note to install "which" command in the installation guide in case of building on RHEL/CentOS. I tried to build on Docker container with official CentOS7 image and when I tried to build third

2016-11-24 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5216 Change subject: Note to install "which" command in the installation guide in case of building on RHEL/CentOS. I tried to build on Docker container with official CentOS7 image and when I trie

[kudu-CR] Enforce LANG=C to check the version of compiler. Otherwise, extracting compiler information could fail. One example is here (built on CentOS 7).

2016-11-23 Thread Kousuke Saruta (Code Review)
rit.cloudera.org:8080/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I1a178f503f918aea308b6073b57c2b991d34e848 Gerrit-PatchSet: 2 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Kousuke Saruta Gerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Kudu Jenkins

[kudu-CR] For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a should be remo

2016-11-23 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has posted comments on this change. Change subject: For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a should be removed only when

[kudu-CR] For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a should be remo

2016-11-23 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5199 Change subject: For the first time of building bitshuffle, `rm bitshuffle.a` will return an exit code 1 and the build will fail because "-e" option is set in build-thirdparty.sh. bitshuffle.a

[kudu-CR] Enforce LANG=C to check the version of compiler.

2016-11-22 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has restored this change. Change subject: Enforce LANG=C to check the version of compiler. .. Restored -- To view, visit http://gerrit.cloudera.org:8080/5175 To unsubscribe, visit http://gerrit.cloudera.org

[kudu-CR] Enforce LANG=C to check the version of compiler.

2016-11-22 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has abandoned this change. Change subject: Enforce LANG=C to check the version of compiler. .. Abandoned It's wrong branch. I'll abandon this. -- To view, visit http://gerrit.cloudera.org:80

[kudu-CR] Enforce LANG=C to check the version of compiler.

2016-11-22 Thread Kousuke Saruta (Code Review)
Kousuke Saruta has uploaded a new change for review. http://gerrit.cloudera.org:8080/5175 Change subject: Enforce LANG=C to check the version of compiler. .. Enforce LANG=C to check the version of compiler. Otherwise

[jira] [Resolved] (SPARK-18432) Fix HDFS block size in programming guide

2016-11-14 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-18432. Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 > Fix HDFS bl

[jira] [Updated] (SPARK-18432) Fix HDFS block size in programming guide

2016-11-14 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-18432: --- Assignee: Noritaka Sekiyama > Fix HDFS block size in programming gu

[jira] [Resolved] (SPARK-18382) "run at null:-1" in UI when no file/line info in call site info

2016-11-14 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-18382. Resolution: Fixed > "run at null:-1" in UI when no file/line info in c

[jira] [Updated] (SPARK-18382) "run at null:-1" in UI when no file/line info in call site info

2016-11-14 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-18382: --- Fix Version/s: 2.1.0 2.0.3 > "run at null:-1" in UI when

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

2016-11-10 Thread Kousuke Saruta
+1 (non-binding) On 2016年11月08日 15:09, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 2.0.2. The vote is open until Thu, Nov 10, 2016 at 22:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as Apache S

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

2016-11-03 Thread Kousuke Saruta
+1 (non-binding) - Kousuke On 2016/11/03 9:40, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.3. The vote is open until Sat, Nov 5, 2016 at 18:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as A

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

2016-10-27 Thread Kousuke Saruta
+1 - Kousuke On 2016/10/28 2:07, vaquar khan wrote: +1 On Thu, Oct 27, 2016 at 11:56 AM, Davies Liu > wrote: +1 On Thu, Oct 27, 2016 at 12:18 AM, Reynold Xin mailto:r...@databricks.com>> wrote: > Greetings from Spark Summit Europe at Brussels.

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Core) Web UI > spark history server log ne

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Shell) > spark history server log needs to be fixed to s

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: Spark Core > spark history server log needs to be fixed to show https url w

[jira] [Resolved] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-16988. Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > spark hist

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Assignee: chie hayashida > spark history server log needs to be fixed to show https url w

[jira] [Created] (SPARK-17880) The url linking to `AccumulatorV2` in the document is incorrect.

2016-10-11 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-17880: -- Summary: The url linking to `AccumulatorV2` in the document is incorrect. Key: SPARK-17880 URL: https://issues.apache.org/jira/browse/SPARK-17880 Project: Spark

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Kousuke Saruta
Congratulations Xiao! - Kousuke On 2016/10/05 7:44, Bryan Cutler wrote: Congrats Xiao! On Tue, Oct 4, 2016 at 11:14 AM, Holden Karau > wrote: Congratulations :D :) Yay! On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati mailto:suresh.thalam...@gmail.c

[jira] [Commented] (SPARK-17154) Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations

2016-09-28 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529552#comment-15529552 ] Kousuke Saruta commented on SPARK-17154: [~cloud_fan] Sorry I forgot to an

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Kousuke Saruta
+1 (non-binding) On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: +1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida mailto:ricardo.alme...@actnowib.com>> wrote: +1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS /

[jira] [Commented] (SPARK-17577) SparkR support add files to Spark job and get by executors

2016-09-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15517408#comment-15517408 ] Kousuke Saruta commented on SPARK-17577: I add 2.0.1 as a fix version but we

[jira] [Updated] (SPARK-17577) SparkR support add files to Spark job and get by executors

2016-09-23 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-17577: --- Fix Version/s: 2.0.1 > SparkR support add files to Spark job and get by execut

[jira] [Resolved] (SPARK-17339) Fix SparkR tests on Windows

2016-09-07 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-17339. Resolution: Fixed Fix Version/s: 2.1.0 > Fix SparkR tests on Wind

[jira] [Updated] (SPARK-17339) Fix SparkR tests on Windows

2016-09-07 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-17339: --- Assignee: Hyukjin Kwon > Fix SparkR tests on Wind

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-09-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464247#comment-15464247 ] Kousuke Saruta commented on SPARK-17339: [~hyukjin.kwon] Go ahead and subm

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

2016-09-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464193#comment-15464193 ] Kousuke Saruta commented on SPARK-17339: [~shivaram] I think more discussio

[jira] [Updated] (SPARK-17154) Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations

2016-09-02 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-17154: --- Attachment: Solution_Proposal_SPARK-17154.pdf > Wrong result can be returned

[jira] [Created] (SPARK-17352) Executor computing time can be negative-number because of calculation error

2016-08-31 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-17352: -- Summary: Executor computing time can be negative-number because of calculation error Key: SPARK-17352 URL: https://issues.apache.org/jira/browse/SPARK-17352

[jira] [Created] (SPARK-17342) Style of event timeline is broken

2016-08-31 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-17342: -- Summary: Style of event timeline is broken Key: SPARK-17342 URL: https://issues.apache.org/jira/browse/SPARK-17342 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17154) Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations

2016-08-19 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-17154: -- Summary: Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations Key: SPARK-17154 URL: https://issues.apache.org/jira/browse

[jira] [Created] (ZEPPELIN-1289) Update the default value of 'spark.executor.memory' property

2016-08-04 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created ZEPPELIN-1289: Summary: Update the default value of 'spark.executor.memory' property Key: ZEPPELIN-1289 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1289

[jira] [Created] (ZEPPELIN-1288) Use new Spark logo in the document.

2016-08-03 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created ZEPPELIN-1288: Summary: Use new Spark logo in the document. Key: ZEPPELIN-1288 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1288 Project: Zeppelin Issue

[jira] [Created] (ZEPPELIN-1274) Write "Spark SQL" in docs rather than "SparkSQL"

2016-08-02 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created ZEPPELIN-1274: Summary: Write "Spark SQL" in docs rather than "SparkSQL" Key: ZEPPELIN-1274 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1274

Re: ERROR: java.net.UnknownHostException

2016-07-28 Thread Kousuke Saruta
Hi Miki, What version of Spark are you using? If the version is > 1.4, you might hit SPARK-11227. - Kousuke On 2016/07/28 18:34, Miki Shingo wrote: To whom who has knowledge? I have faced the following error try to use HA configuration. (java.net.UnknownHostException) below is the error fo

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-22 Thread Kousuke Saruta
+1 (non-binding) Tested on my cluster with three slave nodes. On 2016/07/23 10:25, Suresh Thalamati wrote: +1 (non-binding) Tested data source api , and jdbc data sources. On Jul 19, 2016, at 7:35 PM, Reynold Xin > wrote: Please vote on releasing the following c

Re: [VOTE] Release Apache Spark 1.6.2 (RC2)

2016-06-22 Thread Kousuke Saruta
+1 (non-binding) On 2016/06/23 4:53, Reynold Xin wrote: +1 myself On Wed, Jun 22, 2016 at 12:19 PM, Sean McNamara mailto:sean.mcnam...@webtrends.com>> wrote: +1 On Jun 22, 2016, at 1:14 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: +1 On Wed, Jun 22, 2

[jira] [Updated] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2016-06-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12404: --- Assignee: Kousuke Saruta (was: Apache Spark) > Ensure objects passed to StaticInvoke

[jira] [Updated] (SPARK-16061) The property "spark.streaming.stateStore.maintenanceInterval" should be renamed to "spark.sql.streaming.stateStore.maintenanceInterval"

2016-06-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16061: --- Summary: The property "spark.streaming.stateStore.maintenanceInterval" should be

[jira] [Created] (SPARK-16061) The property "spark.sql.stateStore.maintenanceInterval" should be renamed to "spark.streaming.stateStore.maintenanceInterval"

2016-06-19 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-16061: -- Summary: The property "spark.sql.stateStore.maintenanceInterval" should be renamed to "spark.streaming.stateStore.maintenanceInterval" Key: SPARK-16061

[jira] [Updated] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-19 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-11227: --- Affects Version/s: 2.0.0 1.6.1 > Spark1.5+ HDFS HA mode th

[jira] [Reopened] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-19 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-11227: I would like to reopen this ticket because I noticed there is a case when

Re: Welcoming Yanbo Liang as a committer

2016-06-05 Thread Kousuke Saruta
Congratulations Yanbo! - Kousuke On 2016/06/04 11:48, Matei Zaharia wrote: Hi all, The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a super active contributor in many areas of MLlib. Please join me in welcoming Yanbo! Matei --

[jira] [Resolved] (SPARK-15205) Codegen can compile the same source code more than twice

2016-05-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-15205. Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15205) Codegen can compile the same source code more than twice

2016-05-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15294776#comment-15294776 ] Kousuke Saruta commented on SPARK-15205: As a result, this issue was reso

[jira] [Updated] (SPARK-15165) Codegen can break because toCommentSafeString is not actually safe

2016-05-20 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15165: --- Fix Version/s: 1.6.2 > Codegen can break because toCommentSafeString is not actually s

<    4   5   6   7   8   9   10   11   12   13   >