[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15445320#comment-15445320 ] Apache Spark commented on SPARK-17200: -- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/14859 > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433739#comment-15433739 ] Hyukjin Kwon commented on SPARK-17200: -- Thank you so much! > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433209#comment-15433209 ] Dongjoon Hyun commented on SPARK-17200: --- Hi, [~hyukjin.kwon]. FYI, for Window CI, there is AppVeyor ( https://www.appveyor.com/ ) which is similar with Travis CI, too. Some Apache projects use Travis CI / Windows CI / Jenkins CI in parallel like the following. https://github.com/apache/reef/pull/1099 > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432521#comment-15432521 ] Hyukjin Kwon commented on SPARK-17200: -- Maybe, I will try to do this and I guess this will be done with a lot of messing around with flaky builds. I have tried this combination before but the combination itself is really flaky. So, I am thinking this would not be merged into codebase but I probably use this at least for SparkR (if I make it). I will try this one anyway but please leave any thoughts if you have any better idea. > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432511#comment-15432511 ] Sean Owen commented on SPARK-17200: --- Without a doubt that would be beneficial. The question is how much work it takes to set up and maintain, and that I don't know. While I think the goal is to make Spark run on Windows if possible, I'm not sure how well the dev setup / tests support Windows. > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432508#comment-15432508 ] Hyukjin Kwon commented on SPARK-17200: -- cc [~felixcheung] and [~shivaram] who might be interested in this ticket (from the linked PR above). > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-17200) Automate building and testing on Windows
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432504#comment-15432504 ] Hyukjin Kwon commented on SPARK-17200: -- Could I please ask your opinion [~srowen]? I know you are an expert in this area. > Automate building and testing on Windows > - > > Key: SPARK-17200 > URL: https://issues.apache.org/jira/browse/SPARK-17200 > Project: Spark > Issue Type: Test > Components: Build, Project Infra >Affects Versions: 2.0.0 >Reporter: Hyukjin Kwon > > It seems there is no automated tests on Windows (I am not sure this is being > done manually before each release). > Assuming from this comment, > https://github.com/apache/spark/pull/14743#issuecomment-241473794, It seems > we have Windows infrastructure in the AMPLab Jenkins cluster. > It seems pretty much important because as far as I know we should manually > test and verify some patches related with Windows-specific problem. > For example, https://github.com/apache/spark/pull/14743#issuecomment-241473794 > I was thinking a combination with Travis CI and Docker with Windows image. > Although this might not be merged, I will try to give a shot with this (at > least for SparkR) anyway (just to verify some PRs I just linked above). > I would appreciate it if I can hear any thoughts about this. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org