Re: Please keep s3://spark-related-packages/ alive

For Flintrock, have you considered using a Requester Pays bucket? That way you’d get the availability of S3 without having to foot the bill for bandwidth yourself (which was the bulk of the cost for the old bucket). Matei > On Feb 27, 2018, at 4:35 PM, Nicholas Chammas

Re: Please keep s3://spark-related-packages/ alive

So is there no hope for this S3 bucket, or room to replace it with a bucket owned by some organization other than AMPLab (which is technically now defunct , I guess)? Sorry to persist, but I just have to ask. On Tue, Feb 27, 2018 at 10:36 AM Michael

Re: Help needed in R documentation generation

Ok, it sounds like this was the intended behavior of the doc changes... I'm not an R developer, so maybe the new docs make enough sense, but the previous ones did look nicer. On Tue, Feb 27, 2018 at 11:09 AM, Felix Cheung wrote: > I had agreed it was a compromise when

Re: Help needed in R documentation generation

I had agreed it was a compromise when it was proposed back in May 2017. I don’t think I can capture the long reviews and many discussed that went in, for further discussion please start from JIRA SPARK-20889. From: Marcelo Vanzin Sent:

Re: Help needed in R documentation generation

I followed Misi's instructions: - click on https://dist.apache.org/repos/dist/dev/spark/v2.3.0-rc5-docs/_site/api/R/index.html - click on "s" at the top - find "sin" and click on it And that does not give me the documentation for the "sin" function. That leads to you to a really ugly list of

Re: [VOTE] Spark 2.3.0 (RC5)

This vote passes! I'll follow up with a formal release announcement soon. +1: Wenchen Fan (binding) Takuya Ueshin Xingbo Jiang Gengliang Wang Weichen Xu Sean Owen (binding) Josh Goldsborough Denny Lee Nicholas Chammas Marcelo Vanzin (binding) Holden Karau (binding) Cheng Lian (binding) Bryan

Re: Help needed in R documentation generation

I think what you are calling out is discoverability of names from index - I agree this should be improved. There are several reasons for this change, if I recall, some are: - we have too many doc pages and a very long index page because of the atypical large number of functions - many R

Re: Help needed in R documentation generation

Hi, Earlier, at https://spark.apache.org/docs/latest/api/R/index.html I see 1. sin as a title 2. description describes what sin does 3. usage, arguments, note, see also are specific to sin function When opening sin from

Re: Help needed in R documentation generation

The help content on sin is in https://dist.apache.org/repos/dist/dev/spark/v2.3.0-rc5-docs/_site/api/R/column_math_functions.html It’s a fairly long list but sin is in there. Is that not what you are seeing? From: Mihály Tóth Sent: Tuesday,

Fwd: Help needed in R documentation generation

Hi, Actually, when I open the link you provided and click on - for example - 'sin' the page does not seem to describe that function at all. Actually I get same effect that I get locally. I have attached a screenshot about that: [image: Szövegközi kép 1] I tried with Chrome and then with

Re: Please keep s3://spark-related-packages/ alive

On Tue, Feb 27, 2018 at 8:17 AM, Sean Owen wrote: > See http://apache-spark-developers-list.1001551.n3.nabble.com/What-is- > d3kbcqa49mib13-cloudfront-net-td22427.html -- it was 'retired', yes. > > Agree with all that, though they're intended for occasional individual use > and

Re: Please keep s3://spark-related-packages/ alive

See http://apache-spark-developers-list.1001551.n3.nabble.com/What-is-d3kbcqa49mib13-cloudfront-net-td22427.html -- it was 'retired', yes. Agree with all that, though they're intended for occasional individual use and not a case where performance and uptime matter. For that, I think you'd want to

Re: Please keep s3://spark-related-packages/ alive

This was actually an AMPLab bucket. On Feb 27, 2018, 6:04 PM +1300, Holden Karau , wrote: > Thanks Nick, we deprecated this during the roll over to the new release > managers. I assume this bucket was maintained by someone at databricks so > maybe they can chime in. > >

Re: [VOTE] Spark 2.3.0 (RC5)

+1 (binding) Built and ran Scala tests with "-Phadoop-2.6 -Pyarn -Phive", all passed. Python tests passed (also including pyspark-streaming w/kafka-0.8 and flume packages built) On Tue, 27 Feb 2018 at 10:09 Felix Cheung wrote: > +1 > > Tested R: > > install from

Re: [VOTE] Spark 2.3.0 (RC5)

+1 Tested R: install from package, CRAN tests, manual tests, help check, vignettes check Filed this https://issues.apache.org/jira/browse/SPARK-23461 This is not a regression so not a blocker of the release. Tested this on win-builder and r-hub. On r-hub on multiple platforms everything