Re: Recovering SparkR on CRAN?

2020-12-30 Thread Hyukjin Kwon
I just double checked. 3.0.1 is the latest one that has my fix. 2020년 12월 31일 (목) 오전 9:21, Hyukjin Kwon 님이 작성: > Nice, yeah, 3.0.1 should have all fixes needed. > > 2020년 12월 31일 (목) 오전 5:23, Felix Cheung 님이 작성: > >> We could just submit the latest release with the fix again. I would not >>

Re: Recovering SparkR on CRAN?

2020-12-30 Thread Hyukjin Kwon
Nice, yeah, 3.0.1 should have all fixes needed. 2020년 12월 31일 (목) 오전 5:23, Felix Cheung 님이 작성: > We could just submit the latest release with the fix again. I would not > recommend waiting, often time there are some external changes that are not > caught, and a fix will need to go through a

Re: Recovering SparkR on CRAN?

2020-12-30 Thread Felix Cheung
We could just submit the latest release with the fix again. I would not recommend waiting, often time there are some external changes that are not caught, and a fix will need to go through a release vote. What is the latest release with your fix? 3.0.1? I can put it in but will need to make sure

Re: Recovering SparkR on CRAN?

2020-12-29 Thread Hyukjin Kwon
Let me try in this release - I will have to ask some questions to both of you. I will email you guys offline or private mailing list. If I happen to be stuck for a difficult reason, I think we can consider dropping it as Dongjoon initially pointed out. 2020년 12월 30일 (수) 오후 1:59, Felix Cheung 님이

Re: Recovering SparkR on CRAN?

2020-12-29 Thread Felix Cheung
Ah, I don’t recall actually - maybe it was just missed? The last message I had, was in June when it was broken by R 4.0.1, which was fixed. On Tue, Dec 29, 2020 at 7:21 PM Hyukjin Kwon wrote: > BTW, I remember I fixed all standing issues at > https://issues.apache.org/jira/browse/SPARK-31918

Re: Recovering SparkR on CRAN?

2020-12-29 Thread Hyukjin Kwon
BTW, I remember I fixed all standing issues at https://issues.apache.org/jira/browse/SPARK-31918 and https://issues.apache.org/jira/browse/SPARK-32073. I wonder why other releases were not uploaded yet. Do you guys know any context or if there is a standing issue on this, @Felix Cheung or

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Mridul Muralidharan
I agree, is there something we can do to ensure CRAN publish goes through consistently and predictably ? If possible, it would be good to continue supporting it. Regards, Mridul On Tue, Dec 22, 2020 at 7:48 PM Felix Cheung wrote: > Ok - it took many years to get it first published, so it was

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Michael Heuer
To clarify, I'm fine with distributing our project by tarball, and would support > Given the current circumstance, I'm thinking of dropping it officially from > the community release scope. +1 (non-binding) michael > On Dec 22, 2020, at 7:47 PM, Felix Cheung wrote: > > Ok - it took many

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Felix Cheung
Ok - it took many years to get it first published, so it was hard to get there. On Tue, Dec 22, 2020 at 5:45 PM Hyukjin Kwon wrote: > Adding @Shivaram Venkataraman and @Felix > Cheung FYI > > 2020년 12월 23일 (수) 오전 9:22, Michael Heuer 님이 작성: > >> Anecdotally, as a project downstream of Spark,

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Hyukjin Kwon
Adding @Shivaram Venkataraman and @Felix Cheung FYI 2020년 12월 23일 (수) 오전 9:22, Michael Heuer 님이 작성: > Anecdotally, as a project downstream of Spark, we've been prevented from > pushing to CRAN because of this > > https://github.com/bigdatagenomics/adam/issues/1851 > > We've given up and marked

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Michael Heuer
Anecdotally, as a project downstream of Spark, we've been prevented from pushing to CRAN because of this https://github.com/bigdatagenomics/adam/issues/1851 We've given up and marked as WontFix. michael > On Dec 22, 2020, at 5:14 PM,

Re: Recovering SparkR on CRAN?

2020-12-22 Thread Dongjoon Hyun
Given the current circumstance, I'm thinking of dropping it officially from the community release scope. It's because - It turns out that our CRAN check is insufficient to guarantee the availability of SparkR on CRAN. Apache Spark 3.1.0 may not not available on CRAN, too. - In daily CIs, CRAN

Recovering SparkR on CRAN?

2020-12-21 Thread Dongjoon Hyun
Hi, All. The last `SparkR` package of Apache Spark in CRAN is `2.4.6`. https://cran-archive.r-project.org/web/checks/2020/2020-07-10_check_results_SparkR.html The latest three Apache Spark distributions (2.4.7/3.0.0/3.0.1) are not published to CRAN and the lack of SparkR on CRAN has been