Re: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1
#1 - Yes. It doesn't look like that is being honored. This is something we should follow up with CRAN about #2 - Looking at it more closely, I'm not sure what the problem is. If the version string is 1.8.0_144 then our parsing code does work correctly. We might need to add more debug logging or ask CRAN to figure out what the output of `java -version` is on that machine. We can move this discussion to the JIRA. Shivaram On Tue, Jun 12, 2018 at 3:21 PM Felix Cheung wrote: > > For #1 is system requirements not honored? > > For #2 it looks like Oracle JDK? > > > From: Shivaram Venkataraman > Sent: Tuesday, June 12, 2018 3:17:52 PM > To: dev > Cc: Felix Cheung > Subject: Fwd: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 > > Corresponding to the Spark 2.3.1 release, I submitted the SparkR build > to CRAN yesterday. Unfortunately it looks like there are a couple of > issues (full message from CRAN is forwarded below) > > 1. There are some builds started with Java 10 > (http://home.apache.org/~shivaram/SparkR_2.3.1_check_results/Debian/00check.log) > which are right now counted as test failures. I wonder if we should > somehow mark them as skipped ? I can ping the CRAN team about this. > > 2. There is another issue with Java version parsing which > unfortunately affects even Java 8 builds. I've created > https://issues.apache.org/jira/browse/SPARK-24535 to track this. > > Thanks > Shivaram > > > -- Forwarded message ----- > From: > Date: Mon, Jun 11, 2018 at 11:24 AM > Subject: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 > To: > Cc: > > > Dear maintainer, > > package SparkR_2.3.1.tar.gz does not pass the incoming checks > automatically, please see the following pre-tests: > Windows: > <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Windows/00check.log> > Status: 2 ERRORs, 1 NOTE > Debian: > <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Debian/00check.log> > Status: 1 ERROR, 1 WARNING, 1 NOTE > > Last released version's CRAN status: ERROR: 1, OK: 1 > See: <https://CRAN.R-project.org/web/checks/check_results_SparkR.html> > > CRAN Web: <https://cran.r-project.org/package=SparkR> > > Please fix all problems and resubmit a fixed version via the webform. > If you are not sure how to fix the problems shown, please ask for help > on the R-package-devel mailing list: > <https://stat.ethz.ch/mailman/listinfo/r-package-devel> > If you are fairly certain the rejection is a false positive, please > reply-all to this message and explain. > > More details are given in the directory: > <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/> > The files will be removed after roughly 7 days. > > No strong reverse dependencies to be checked. > > Best regards, > CRAN teams' auto-check service > Flavor: r-devel-linux-x86_64-debian-gcc, r-devel-windows-ix86+x86_64 > Check: CRAN incoming feasibility, Result: NOTE > Maintainer: 'Shivaram Venkataraman ' > > New submission > > Package was archived on CRAN > > Possibly mis-spelled words in DESCRIPTION: > Frontend (4:10, 5:28) > > CRAN repository db overrides: > X-CRAN-Comment: Archived on 2018-05-01 as check problems were not > corrected despite reminders. > > Flavor: r-devel-windows-ix86+x86_64 > Check: running tests for arch 'i386', Result: ERROR > Running 'run-all.R' [30s] > Running the tests in 'tests/run-all.R' failed. > Complete output: > > # > > # Licensed to the Apache Software Foundation (ASF) under one or more > > # contributor license agreements. See the NOTICE file distributed with > > # this work for additional information regarding copyright ownership. > > # The ASF licenses this file to You under the Apache License, Version > 2.0 > > # (the "License"); you may not use this file except in compliance with > > # the License. You may obtain a copy of the License at > > # > > #http://www.apache.org/licenses/LICENSE-2.0 > > # > > # Unless required by applicable law or agreed to in writing, software > > # distributed under the License is distributed on an "AS IS" BASIS, > > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or > implied. > > # See the License for the specific language governing permissions and > > # limitations under the License. > > # > > > > library(testthat) > > library(SparkR) > > Attaching package: 'SparkR' > > Th
Re: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1
For #1 is system requirements not honored? For #2 it looks like Oracle JDK? From: Shivaram Venkataraman Sent: Tuesday, June 12, 2018 3:17:52 PM To: dev Cc: Felix Cheung Subject: Fwd: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 Corresponding to the Spark 2.3.1 release, I submitted the SparkR build to CRAN yesterday. Unfortunately it looks like there are a couple of issues (full message from CRAN is forwarded below) 1. There are some builds started with Java 10 (http://home.apache.org/~shivaram/SparkR_2.3.1_check_results/Debian/00check.log) which are right now counted as test failures. I wonder if we should somehow mark them as skipped ? I can ping the CRAN team about this. 2. There is another issue with Java version parsing which unfortunately affects even Java 8 builds. I've created https://issues.apache.org/jira/browse/SPARK-24535 to track this. Thanks Shivaram -- Forwarded message - From: Date: Mon, Jun 11, 2018 at 11:24 AM Subject: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 To: Cc: Dear maintainer, package SparkR_2.3.1.tar.gz does not pass the incoming checks automatically, please see the following pre-tests: Windows: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Windows/00check.log> Status: 2 ERRORs, 1 NOTE Debian: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Debian/00check.log> Status: 1 ERROR, 1 WARNING, 1 NOTE Last released version's CRAN status: ERROR: 1, OK: 1 See: <https://CRAN.R-project.org/web/checks/check_results_SparkR.html> CRAN Web: <https://cran.r-project.org/package=SparkR> Please fix all problems and resubmit a fixed version via the webform. If you are not sure how to fix the problems shown, please ask for help on the R-package-devel mailing list: <https://stat.ethz.ch/mailman/listinfo/r-package-devel> If you are fairly certain the rejection is a false positive, please reply-all to this message and explain. More details are given in the directory: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/> The files will be removed after roughly 7 days. No strong reverse dependencies to be checked. Best regards, CRAN teams' auto-check service Flavor: r-devel-linux-x86_64-debian-gcc, r-devel-windows-ix86+x86_64 Check: CRAN incoming feasibility, Result: NOTE Maintainer: 'Shivaram Venkataraman ' New submission Package was archived on CRAN Possibly mis-spelled words in DESCRIPTION: Frontend (4:10, 5:28) CRAN repository db overrides: X-CRAN-Comment: Archived on 2018-05-01 as check problems were not corrected despite reminders. Flavor: r-devel-windows-ix86+x86_64 Check: running tests for arch 'i386', Result: ERROR Running 'run-all.R' [30s] Running the tests in 'tests/run-all.R' failed. Complete output: > # > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the "License"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > #http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an "AS IS" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > # > > library(testthat) > library(SparkR) Attaching package: 'SparkR' The following objects are masked from 'package:testthat': describe, not The following objects are masked from 'package:stats': cov, filter, lag, na.omit, predict, sd, var, window The following objects are masked from 'package:base': as.data.frame, colnames, colnames<-, drop, endsWith, intersect, rank, rbind, sample, startsWith, subset, summary, transform, union > > # Turn all warnings into errors > options("warn" = 2) > > if (.Platform$OS.type == "windows") { + Sys.setenv(TZ = "GMT") + } > > # Setup global test environment > # Install Spark first to set SPARK_HOME > > # NOTE(shivaram): We set overwrite to handle any old tar.gz files or directories left behind on > # CRAN machines. For Jenkins we should already have SPARK_HOME set. > install.spark(overwrite = TRUE) Overwrite = TRUE: download and overwrite the tar fileand Spark package directo
Fwd: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1
Corresponding to the Spark 2.3.1 release, I submitted the SparkR build to CRAN yesterday. Unfortunately it looks like there are a couple of issues (full message from CRAN is forwarded below) 1. There are some builds started with Java 10 (http://home.apache.org/~shivaram/SparkR_2.3.1_check_results/Debian/00check.log) which are right now counted as test failures. I wonder if we should somehow mark them as skipped ? I can ping the CRAN team about this. 2. There is another issue with Java version parsing which unfortunately affects even Java 8 builds. I've created https://issues.apache.org/jira/browse/SPARK-24535 to track this. Thanks Shivaram -- Forwarded message - From: Date: Mon, Jun 11, 2018 at 11:24 AM Subject: [CRAN-pretest-archived] CRAN submission SparkR 2.3.1 To: Cc: Dear maintainer, package SparkR_2.3.1.tar.gz does not pass the incoming checks automatically, please see the following pre-tests: Windows: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Windows/00check.log> Status: 2 ERRORs, 1 NOTE Debian: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/Debian/00check.log> Status: 1 ERROR, 1 WARNING, 1 NOTE Last released version's CRAN status: ERROR: 1, OK: 1 See: <https://CRAN.R-project.org/web/checks/check_results_SparkR.html> CRAN Web: <https://cran.r-project.org/package=SparkR> Please fix all problems and resubmit a fixed version via the webform. If you are not sure how to fix the problems shown, please ask for help on the R-package-devel mailing list: <https://stat.ethz.ch/mailman/listinfo/r-package-devel> If you are fairly certain the rejection is a false positive, please reply-all to this message and explain. More details are given in the directory: <https://win-builder.r-project.org/incoming_pretest/SparkR_2.3.1_20180611_200923/> The files will be removed after roughly 7 days. No strong reverse dependencies to be checked. Best regards, CRAN teams' auto-check service Flavor: r-devel-linux-x86_64-debian-gcc, r-devel-windows-ix86+x86_64 Check: CRAN incoming feasibility, Result: NOTE Maintainer: 'Shivaram Venkataraman ' New submission Package was archived on CRAN Possibly mis-spelled words in DESCRIPTION: Frontend (4:10, 5:28) CRAN repository db overrides: X-CRAN-Comment: Archived on 2018-05-01 as check problems were not corrected despite reminders. Flavor: r-devel-windows-ix86+x86_64 Check: running tests for arch 'i386', Result: ERROR Running 'run-all.R' [30s] Running the tests in 'tests/run-all.R' failed. Complete output: > # > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the "License"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > #http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an "AS IS" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > # > > library(testthat) > library(SparkR) Attaching package: 'SparkR' The following objects are masked from 'package:testthat': describe, not The following objects are masked from 'package:stats': cov, filter, lag, na.omit, predict, sd, var, window The following objects are masked from 'package:base': as.data.frame, colnames, colnames<-, drop, endsWith, intersect, rank, rbind, sample, startsWith, subset, summary, transform, union > > # Turn all warnings into errors > options("warn" = 2) > > if (.Platform$OS.type == "windows") { + Sys.setenv(TZ = "GMT") + } > > # Setup global test environment > # Install Spark first to set SPARK_HOME > > # NOTE(shivaram): We set overwrite to handle any old tar.gz files or directories left behind on > # CRAN machines. For Jenkins we should already have SPARK_HOME set. > install.spark(overwrite = TRUE) Overwrite = TRUE: download and overwrite the tar fileand Spark package directory if they exist. Spark not found in the cache directory. Installation will start. MirrorUrl not provided. Looking for preferred site from apache website... Preferred mirror site found: http://apache.mirror.digionline.de/spark Downloading spark-2.3.