[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-29 Thread Apache Spark (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15445320#comment-15445320
 ] 

Apache Spark commented on SPARK-17200:
--

User 'HyukjinKwon' has created a pull request for this issue:
https://github.com/apache/spark/pull/14859

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433739#comment-15433739
 ] 

Hyukjin Kwon commented on SPARK-17200:
--

Thank you so much!

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Dongjoon Hyun (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433209#comment-15433209
 ] 

Dongjoon Hyun commented on SPARK-17200:
---

Hi, [~hyukjin.kwon].

FYI, for Window CI, there is AppVeyor ( https://www.appveyor.com/ ) which is 
similar with Travis CI, too.

Some Apache projects use Travis CI / Windows CI / Jenkins CI in parallel like 
the following.

https://github.com/apache/reef/pull/1099

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432521#comment-15432521
 ] 

Hyukjin Kwon commented on SPARK-17200:
--

Maybe, I will try to do this and I guess this will be done with a lot of 
messing around with flaky builds.
I have tried this combination before but the combination itself is really 
flaky. So, I am thinking this would not be merged into codebase but I probably 
use this at least for SparkR (if I make it).

I will try this one anyway but please leave any thoughts if you have any better 
idea.


> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Sean Owen (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432511#comment-15432511
 ] 

Sean Owen commented on SPARK-17200:
---

Without a doubt that would be beneficial. The question is how much work it 
takes to set up and maintain, and that I don't know. 

While I think the goal is to make Spark run on Windows if possible, I'm not 
sure how well the dev setup / tests support Windows.

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432508#comment-15432508
 ] 

Hyukjin Kwon commented on SPARK-17200:
--

cc [~felixcheung] and [~shivaram] who might be interested in this ticket (from 
the linked PR above).

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432504#comment-15432504
 ] 

Hyukjin Kwon commented on SPARK-17200:
--

Could I please ask your opinion [~srowen]? I know you are an expert in this 
area.

> Automate building and testing on Windows 
> -
>
> Key: SPARK-17200
> URL: https://issues.apache.org/jira/browse/SPARK-17200
> Project: Spark
>  Issue Type: Test
>  Components: Build, Project Infra
>Affects Versions: 2.0.0
>Reporter: Hyukjin Kwon
>
> It seems there is no automated tests on Windows (I am not sure this is being 
> done manually before each release).
> Assuming from this comment, 
> https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems 
> we have Windows infrastructure in the AMPLab Jenkins cluster.
> It seems pretty much important because as far as I know we should manually 
> test and verify some patches related with Windows-specific problem.
> For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794
> I was thinking a combination with Travis CI and Docker with Windows image. 
> Although this might not be merged, I will try to give a shot with this (at 
> least for SparkR) anyway (just to verify some PRs I just linked above).
> I would appreciate it if I can hear any thoughts about this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org