http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/gapplyCollect.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/gapplyCollect.html b/site/docs/2.2.2/api/R/gapplyCollect.html new file mode 100644 index 0000000..64efe5b --- /dev/null +++ b/site/docs/2.2.2/api/R/gapplyCollect.html @@ -0,0 +1,183 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: gapplyCollect</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for gapplyCollect {SparkR}"><tr><td>gapplyCollect {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>gapplyCollect</h2> + +<h3>Description</h3> + +<p>gapplyCollect +</p> +<p>Groups the SparkDataFrame using the specified columns, applies the R function to each +group and collects the result back to R as data.frame. +</p> + + +<h3>Usage</h3> + +<pre> +gapplyCollect(x, ...) + +## S4 method for signature 'GroupedData' +gapplyCollect(x, func) + +## S4 method for signature 'SparkDataFrame' +gapplyCollect(x, cols, func) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame or GroupedData.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional argument(s) passed to the method.</p> +</td></tr> +<tr valign="top"><td><code>func</code></td> +<td> +<p>a function to be applied to each group partition specified by grouping +column of the SparkDataFrame. The function <code>func</code> takes as argument +a key - grouping columns and a data frame - a local R data.frame. +The output of <code>func</code> is a local R data.frame.</p> +</td></tr> +<tr valign="top"><td><code>cols</code></td> +<td> +<p>grouping columns.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A data.frame. +</p> + + +<h3>Note</h3> + +<p>gapplyCollect(GroupedData) since 2.0.0 +</p> +<p>gapplyCollect(SparkDataFrame) since 2.0.0 +</p> + + +<h3>See Also</h3> + +<p><a href="gapply.html">gapply</a> +</p> +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapply.html">gapply</a></code>, <code><a href="getNumPartitions.html">getNumPartitions</a></code>, +<code><a href="groupBy.html">group_by</a></code>, <code><a href="head.html">head</a></code>, +<code><a href="hint.html">hint</a></code>, <code><a href="histogram.html">histogram</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D Computes the arithmetic mean of the second column by grouping +##D on the first and third columns. Output the grouping values and the average. +##D +##D df <- createDataFrame ( +##D list(list(1L, 1, "1", 0.1), list(1L, 2, "1", 0.2), list(3L, 3, "3", 0.3)), +##D c("a", "b", "c", "d")) +##D +##D result <- gapplyCollect( +##D df, +##D c("a", "c"), +##D function(key, x) { +##D y <- data.frame(key, mean(x$b), stringsAsFactors = FALSE) +##D colnames(y) <- c("key_a", "key_c", "mean_b") +##D y +##D }) +##D +##D We can also group the data and afterwards call gapply on GroupedData. +##D For Example: +##D gdf <- group_by(df, "a", "c") +##D result <- gapplyCollect( +##D gdf, +##D function(key, x) { +##D y <- data.frame(key, mean(x$b), stringsAsFactors = FALSE) +##D colnames(y) <- c("key_a", "key_c", "mean_b") +##D y +##D }) +##D +##D Result +##D ------ +##D key_a key_c mean_b +##D 3 3 3.0 +##D 1 1 1.5 +##D +##D Fits linear models on iris dataset by grouping on the 'Species' column and +##D using 'Sepal_Length' as a target variable, 'Sepal_Width', 'Petal_Length' +##D and 'Petal_Width' as training features. +##D +##D df <- createDataFrame (iris) +##D result <- gapplyCollect( +##D df, +##D df$"Species", +##D function(key, x) { +##D m <- suppressWarnings(lm(Sepal_Length ~ +##D Sepal_Width + Petal_Length + Petal_Width, x)) +##D data.frame(t(coef(m))) +##D }) +##D +##D Result +##D --------- +##D Model X.Intercept. Sepal_Width Petal_Length Petal_Width +##D 1 0.699883 0.3303370 0.9455356 -0.1697527 +##D 2 1.895540 0.3868576 0.9083370 -0.6792238 +##D 3 2.351890 0.6548350 0.2375602 0.2521257 +##D +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/generateAliasesForIntersectedCols.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/generateAliasesForIntersectedCols.html b/site/docs/2.2.2/api/R/generateAliasesForIntersectedCols.html new file mode 100644 index 0000000..a0993ce --- /dev/null +++ b/site/docs/2.2.2/api/R/generateAliasesForIntersectedCols.html @@ -0,0 +1,54 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Creates a list of columns by replacing the intersected ones...</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> +</head><body> + +<table width="100%" summary="page for generateAliasesForIntersectedCols {SparkR}"><tr><td>generateAliasesForIntersectedCols {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Creates a list of columns by replacing the intersected ones with aliases</h2> + +<h3>Description</h3> + +<p>Creates a list of columns by replacing the intersected ones with aliases. +The name of the alias column is formed by concatanating the original column name and a suffix. +</p> + + +<h3>Usage</h3> + +<pre> +generateAliasesForIntersectedCols(x, intersectedColNames, suffix) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame</p> +</td></tr> +<tr valign="top"><td><code>intersectedColNames</code></td> +<td> +<p>a list of intersected column names of the SparkDataFrame</p> +</td></tr> +<tr valign="top"><td><code>suffix</code></td> +<td> +<p>a suffix for the column name</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>list of columns +</p> + + +<h3>Note</h3> + +<p>generateAliasesForIntersectedCols since 1.6.0 +</p> + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/getNumPartitions.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/getNumPartitions.html b/site/docs/2.2.2/api/R/getNumPartitions.html new file mode 100644 index 0000000..abf8de5 --- /dev/null +++ b/site/docs/2.2.2/api/R/getNumPartitions.html @@ -0,0 +1,99 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: getNumPartitions</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for getNumPartitions {SparkR}"><tr><td>getNumPartitions {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>getNumPartitions</h2> + +<h3>Description</h3> + +<p>Return the number of partitions +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'SparkDataFrame' +getNumPartitions(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>A SparkDataFrame</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>getNumPartitions since 2.1.1 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="groupBy.html">group_by</a></code>, <code><a href="head.html">head</a></code>, +<code><a href="hint.html">hint</a></code>, <code><a href="histogram.html">histogram</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D df <- createDataFrame(cars, numPartitions = 2) +##D getNumPartitions(df) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/glm.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/glm.html b/site/docs/2.2.2/api/R/glm.html new file mode 100644 index 0000000..f06a43e --- /dev/null +++ b/site/docs/2.2.2/api/R/glm.html @@ -0,0 +1,107 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Generalized Linear Models (R-compliant)</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for glm,formula,ANY,SparkDataFrame-method {SparkR}"><tr><td>glm,formula,ANY,SparkDataFrame-method {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Generalized Linear Models (R-compliant)</h2> + +<h3>Description</h3> + +<p>Fits a generalized linear model, similarly to R's glm(). +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'formula,ANY,SparkDataFrame' +glm(formula, family = gaussian, data, + epsilon = 1e-06, maxit = 25, weightCol = NULL, var.power = 0, + link.power = 1 - var.power) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>formula</code></td> +<td> +<p>a symbolic description of the model to be fitted. Currently only a few formula +operators are supported, including '~', '.', ':', '+', and '-'.</p> +</td></tr> +<tr valign="top"><td><code>family</code></td> +<td> +<p>a description of the error distribution and link function to be used in the model. +This can be a character string naming a family function, a family function or +the result of a call to a family function. Refer R family at +<a href="https://stat.ethz.ch/R-manual/R-devel/library/stats/html/family.html";>https://stat.ethz.ch/R-manual/R-devel/library/stats/html/family.html</a>. +Currently these families are supported: <code>binomial</code>, <code>gaussian</code>, +<code>poisson</code>, <code>Gamma</code>, and <code>tweedie</code>.</p> +</td></tr> +<tr valign="top"><td><code>data</code></td> +<td> +<p>a SparkDataFrame or R's glm data for training.</p> +</td></tr> +<tr valign="top"><td><code>epsilon</code></td> +<td> +<p>positive convergence tolerance of iterations.</p> +</td></tr> +<tr valign="top"><td><code>maxit</code></td> +<td> +<p>integer giving the maximal number of IRLS iterations.</p> +</td></tr> +<tr valign="top"><td><code>weightCol</code></td> +<td> +<p>the weight column name. If this is not set or <code>NULL</code>, we treat all instance +weights as 1.0.</p> +</td></tr> +<tr valign="top"><td><code>var.power</code></td> +<td> +<p>the index of the power variance function in the Tweedie family.</p> +</td></tr> +<tr valign="top"><td><code>link.power</code></td> +<td> +<p>the index of the power link function in the Tweedie family.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p><code>glm</code> returns a fitted generalized linear model. +</p> + + +<h3>Note</h3> + +<p>glm since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p><a href="spark.glm.html">spark.glm</a> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D t <- as.data.frame(Titanic) +##D df <- createDataFrame(t) +##D model <- glm(Freq ~ Sex + Age, df, family = "gaussian") +##D summary(model) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/greatest.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/greatest.html b/site/docs/2.2.2/api/R/greatest.html new file mode 100644 index 0000000..0d2c14f --- /dev/null +++ b/site/docs/2.2.2/api/R/greatest.html @@ -0,0 +1,73 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: greatest</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for greatest {SparkR}"><tr><td>greatest {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>greatest</h2> + +<h3>Description</h3> + +<p>Returns the greatest value of the list of column names, skipping null values. +This function takes at least 2 parameters. It will return null if all parameters are null. +</p> + + +<h3>Usage</h3> + +<pre> +greatest(x, ...) + +## S4 method for signature 'Column' +greatest(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>other columns</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>greatest since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other normal_funcs: <code><a href="abs.html">abs</a></code>, +<code><a href="bitwiseNOT.html">bitwiseNOT</a></code>, <code><a href="coalesce.html">coalesce</a></code>, +<code><a href="column.html">column</a></code>, <code><a href="expr.html">expr</a></code>, +<code><a href="from_json.html">from_json</a></code>, <code><a href="ifelse.html">ifelse</a></code>, +<code><a href="is.nan.html">isnan</a></code>, <code><a href="least.html">least</a></code>, +<code><a href="lit.html">lit</a></code>, <code><a href="nanvl.html">nanvl</a></code>, +<code><a href="negate.html">negate</a></code>, <code><a href="randn.html">randn</a></code>, +<code><a href="rand.html">rand</a></code>, <code><a href="struct.html">struct</a></code>, +<code><a href="to_json.html">to_json</a></code>, <code><a href="when.html">when</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: greatest(df$c, df$d) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/groupBy.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/groupBy.html b/site/docs/2.2.2/api/R/groupBy.html new file mode 100644 index 0000000..4825792 --- /dev/null +++ b/site/docs/2.2.2/api/R/groupBy.html @@ -0,0 +1,120 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: GroupBy</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for group_by {SparkR}"><tr><td>group_by {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>GroupBy</h2> + +<h3>Description</h3> + +<p>Groups the SparkDataFrame using the specified columns, so we can run aggregation on them. +</p> + + +<h3>Usage</h3> + +<pre> +group_by(x, ...) + +groupBy(x, ...) + +## S4 method for signature 'SparkDataFrame' +groupBy(x, ...) + +## S4 method for signature 'SparkDataFrame' +group_by(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>variable(s) (character names(s) or Column(s)) to group on.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A GroupedData. +</p> + + +<h3>Note</h3> + +<p>groupBy since 1.4.0 +</p> +<p>group_by since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="head.html">head</a></code>, +<code><a href="hint.html">hint</a></code>, <code><a href="histogram.html">histogram</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D # Compute the average for all numeric columns grouped by department. +##D avg(groupBy(df, "department")) +##D +##D # Compute the max age and average salary, grouped by department and gender. +##D agg(groupBy(df, "department", "gender"), salary="avg", "age" -> "max") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hash.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hash.html b/site/docs/2.2.2/api/R/hash.html new file mode 100644 index 0000000..148bb2c --- /dev/null +++ b/site/docs/2.2.2/api/R/hash.html @@ -0,0 +1,66 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: hash</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hash {SparkR}"><tr><td>hash {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>hash</h2> + +<h3>Description</h3> + +<p>Calculates the hash code of given columns, and returns the result as a int column. +</p> + + +<h3>Usage</h3> + +<pre> +hash(x, ...) + +## S4 method for signature 'Column' +hash(x, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>additional Column(s) to be included.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>hash since 2.0.0 +</p> + + +<h3>See Also</h3> + +<p>Other misc_funcs: <code><a href="crc32.html">crc32</a></code>, <code><a href="md5.html">md5</a></code>, +<code><a href="monotonically_increasing_id.html">monotonically_increasing_id</a></code>, +<code><a href="sha1.html">sha1</a></code>, <code><a href="sha2.html">sha2</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: hash(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hashCode.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hashCode.html b/site/docs/2.2.2/api/R/hashCode.html new file mode 100644 index 0000000..4a3dad0 --- /dev/null +++ b/site/docs/2.2.2/api/R/hashCode.html @@ -0,0 +1,68 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Compute the hashCode of an object</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hashCode {SparkR}"><tr><td>hashCode {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Compute the hashCode of an object</h2> + +<h3>Description</h3> + +<p>Java-style function to compute the hashCode for the given object. Returns +an integer value. +</p> + + +<h3>Usage</h3> + +<pre> +hashCode(key) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>key</code></td> +<td> +<p>the object to be hashed</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>This only works for integer, numeric and character types right now. +</p> + + +<h3>Value</h3> + +<p>the hash code as an integer +</p> + + +<h3>Note</h3> + +<p>hashCode since 1.4.0 +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D hashCode(1L) # 1 +##D hashCode(1.0) # 1072693248 +##D hashCode("1") # 49 +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/head.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/head.html b/site/docs/2.2.2/api/R/head.html new file mode 100644 index 0000000..46b2b2e --- /dev/null +++ b/site/docs/2.2.2/api/R/head.html @@ -0,0 +1,111 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Head</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for head {SparkR}"><tr><td>head {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Head</h2> + +<h3>Description</h3> + +<p>Return the first <code>num</code> rows of a SparkDataFrame as a R data.frame. If <code>num</code> is not +specified, then head() returns the first 6 rows as with R data.frame. +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'SparkDataFrame' +head(x, num = 6L) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>num</code></td> +<td> +<p>the number of rows to return. Default is 6.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A data.frame. +</p> + + +<h3>Note</h3> + +<p>head since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="hint.html">hint</a></code>, <code><a href="histogram.html">histogram</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D path <- "path/to/file.json" +##D df <- read.json(path) +##D head(df) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hex.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hex.html b/site/docs/2.2.2/api/R/hex.html new file mode 100644 index 0000000..5598cf1 --- /dev/null +++ b/site/docs/2.2.2/api/R/hex.html @@ -0,0 +1,79 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: hex</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hex {SparkR}"><tr><td>hex {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>hex</h2> + +<h3>Description</h3> + +<p>Computes hex value of the given column. +</p> + + +<h3>Usage</h3> + +<pre> +hex(x) + +## S4 method for signature 'Column' +hex(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>hex since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cosh.html">cosh</a></code>, <code><a href="cos.html">cos</a></code>, +<code><a href="covar_pop.html">covar_pop</a></code>, <code><a href="cov.html">cov</a></code>, +<code><a href="expm1.html">expm1</a></code>, <code><a href="exp.html">exp</a></code>, +<code><a href="factorial.html">factorial</a></code>, <code><a href="floor.html">floor</a></code>, +<code><a href="hypot.html">hypot</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: hex(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hint.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hint.html b/site/docs/2.2.2/api/R/hint.html new file mode 100644 index 0000000..d2af30c --- /dev/null +++ b/site/docs/2.2.2/api/R/hint.html @@ -0,0 +1,116 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: hint</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hint {SparkR}"><tr><td>hint {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>hint</h2> + +<h3>Description</h3> + +<p>Specifies execution plan hint and return a new SparkDataFrame. +</p> + + +<h3>Usage</h3> + +<pre> +hint(x, name, ...) + +## S4 method for signature 'SparkDataFrame,character' +hint(x, name, ...) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>name</code></td> +<td> +<p>a name of the hint.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>optional parameters for the hint.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>A SparkDataFrame. +</p> + + +<h3>Note</h3> + +<p>hint since 2.2.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="histogram.html">histogram</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D df <- createDataFrame(mtcars) +##D avg_mpg <- mean(groupBy(createDataFrame(mtcars), "cyl"), "mpg") +##D +##D head(join(df, hint(avg_mpg, "broadcast"), df$cyl == avg_mpg$cyl)) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/histogram.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/histogram.html b/site/docs/2.2.2/api/R/histogram.html new file mode 100644 index 0000000..29031ae --- /dev/null +++ b/site/docs/2.2.2/api/R/histogram.html @@ -0,0 +1,124 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Compute histogram statistics for given column</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for histogram {SparkR}"><tr><td>histogram {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Compute histogram statistics for given column</h2> + +<h3>Description</h3> + +<p>This function computes a histogram for a given SparkR Column. +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'SparkDataFrame,characterOrColumn' +histogram(df, col, nbins = 10) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>df</code></td> +<td> +<p>the SparkDataFrame containing the Column to build the histogram from.</p> +</td></tr> +<tr valign="top"><td><code>col</code></td> +<td> +<p>the column as Character string or a Column to build the histogram from.</p> +</td></tr> +<tr valign="top"><td><code>nbins</code></td> +<td> +<p>the number of bins (optional). Default value is 10.</p> +</td></tr> +</table> + + +<h3>Value</h3> + +<p>a data.frame with the histogram statistics, i.e., counts and centroids. +</p> + + +<h3>Note</h3> + +<p>histogram since 2.0.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="insertInto.html">insertInto</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D +##D # Create a SparkDataFrame from the Iris dataset +##D irisDF <- createDataFrame(iris) +##D +##D # Compute histogram statistics +##D histStats <- histogram(irisDF, irisDF$Sepal_Length, nbins = 12) +##D +##D # Once SparkR has computed the histogram statistics, the histogram can be +##D # rendered using the ggplot2 library: +##D +##D require(ggplot2) +##D plot <- ggplot(histStats, aes(x = centroids, y = counts)) + +##D geom_bar(stat = "identity") + +##D xlab("Sepal_Length") + ylab("Frequency") +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hour.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hour.html b/site/docs/2.2.2/api/R/hour.html new file mode 100644 index 0000000..2c7b679 --- /dev/null +++ b/site/docs/2.2.2/api/R/hour.html @@ -0,0 +1,72 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: hour</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hour {SparkR}"><tr><td>hour {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>hour</h2> + +<h3>Description</h3> + +<p>Extracts the hours as an integer from a given date/timestamp/string. +</p> + + +<h3>Usage</h3> + +<pre> +hour(x) + +## S4 method for signature 'Column' +hour(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>hour since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other datetime_funcs: <code><a href="add_months.html">add_months</a></code>, +<code><a href="date_add.html">date_add</a></code>, <code><a href="date_format.html">date_format</a></code>, +<code><a href="date_sub.html">date_sub</a></code>, <code><a href="datediff.html">datediff</a></code>, +<code><a href="dayofmonth.html">dayofmonth</a></code>, <code><a href="dayofyear.html">dayofyear</a></code>, +<code><a href="from_unixtime.html">from_unixtime</a></code>, +<code><a href="from_utc_timestamp.html">from_utc_timestamp</a></code>, <code><a href="last_day.html">last_day</a></code>, +<code><a href="minute.html">minute</a></code>, <code><a href="months_between.html">months_between</a></code>, +<code><a href="month.html">month</a></code>, <code><a href="next_day.html">next_day</a></code>, +<code><a href="quarter.html">quarter</a></code>, <code><a href="second.html">second</a></code>, +<code><a href="to_date.html">to_date</a></code>, <code><a href="to_timestamp.html">to_timestamp</a></code>, +<code><a href="to_utc_timestamp.html">to_utc_timestamp</a></code>, +<code><a href="unix_timestamp.html">unix_timestamp</a></code>, <code><a href="weekofyear.html">weekofyear</a></code>, +<code><a href="window.html">window</a></code>, <code><a href="year.html">year</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: hour(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/hypot.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/hypot.html b/site/docs/2.2.2/api/R/hypot.html new file mode 100644 index 0000000..243a733 --- /dev/null +++ b/site/docs/2.2.2/api/R/hypot.html @@ -0,0 +1,83 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: hypot</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for hypot {SparkR}"><tr><td>hypot {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>hypot</h2> + +<h3>Description</h3> + +<p>Computes "sqrt(a^2 + b^2)" without intermediate overflow or underflow. +</p> + + +<h3>Usage</h3> + +<pre> +hypot(y, x) + +## S4 method for signature 'Column' +hypot(y, x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>y</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>hypot since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other math_funcs: <code><a href="acos.html">acos</a></code>, <code><a href="asin.html">asin</a></code>, +<code><a href="atan2.html">atan2</a></code>, <code><a href="atan.html">atan</a></code>, +<code><a href="bin.html">bin</a></code>, <code><a href="bround.html">bround</a></code>, +<code><a href="cbrt.html">cbrt</a></code>, <code><a href="ceil.html">ceil</a></code>, +<code><a href="conv.html">conv</a></code>, <code><a href="corr.html">corr</a></code>, +<code><a href="cosh.html">cosh</a></code>, <code><a href="cos.html">cos</a></code>, +<code><a href="covar_pop.html">covar_pop</a></code>, <code><a href="cov.html">cov</a></code>, +<code><a href="expm1.html">expm1</a></code>, <code><a href="exp.html">exp</a></code>, +<code><a href="factorial.html">factorial</a></code>, <code><a href="floor.html">floor</a></code>, +<code><a href="hex.html">hex</a></code>, <code><a href="log10.html">log10</a></code>, +<code><a href="log1p.html">log1p</a></code>, <code><a href="log2.html">log2</a></code>, +<code><a href="log.html">log</a></code>, <code><a href="pmod.html">pmod</a></code>, +<code><a href="rint.html">rint</a></code>, <code><a href="round.html">round</a></code>, +<code><a href="shiftLeft.html">shiftLeft</a></code>, +<code><a href="shiftRightUnsigned.html">shiftRightUnsigned</a></code>, +<code><a href="shiftRight.html">shiftRight</a></code>, <code><a href="sign.html">signum</a></code>, +<code><a href="sinh.html">sinh</a></code>, <code><a href="sin.html">sin</a></code>, +<code><a href="sqrt.html">sqrt</a></code>, <code><a href="tanh.html">tanh</a></code>, +<code><a href="tan.html">tan</a></code>, <code><a href="toDegrees.html">toDegrees</a></code>, +<code><a href="toRadians.html">toRadians</a></code>, <code><a href="unhex.html">unhex</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: hypot(df$c, x) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/ifelse.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/ifelse.html b/site/docs/2.2.2/api/R/ifelse.html new file mode 100644 index 0000000..609ef11 --- /dev/null +++ b/site/docs/2.2.2/api/R/ifelse.html @@ -0,0 +1,80 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: ifelse</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for ifelse {SparkR}"><tr><td>ifelse {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>ifelse</h2> + +<h3>Description</h3> + +<p>Evaluates a list of conditions and returns <code>yes</code> if the conditions are satisfied. +Otherwise <code>no</code> is returned for unmatched conditions. +</p> + + +<h3>Usage</h3> + +<pre> +## S4 method for signature 'Column' +ifelse(test, yes, no) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>test</code></td> +<td> +<p>a Column expression that describes the condition.</p> +</td></tr> +<tr valign="top"><td><code>yes</code></td> +<td> +<p>return values for <code>TRUE</code> elements of test.</p> +</td></tr> +<tr valign="top"><td><code>no</code></td> +<td> +<p>return values for <code>FALSE</code> elements of test.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>ifelse since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p><a href="when.html">when</a> +</p> +<p>Other normal_funcs: <code><a href="abs.html">abs</a></code>, +<code><a href="bitwiseNOT.html">bitwiseNOT</a></code>, <code><a href="coalesce.html">coalesce</a></code>, +<code><a href="column.html">column</a></code>, <code><a href="expr.html">expr</a></code>, +<code><a href="from_json.html">from_json</a></code>, <code><a href="greatest.html">greatest</a></code>, +<code><a href="is.nan.html">isnan</a></code>, <code><a href="least.html">least</a></code>, +<code><a href="lit.html">lit</a></code>, <code><a href="nanvl.html">nanvl</a></code>, +<code><a href="negate.html">negate</a></code>, <code><a href="randn.html">randn</a></code>, +<code><a href="rand.html">rand</a></code>, <code><a href="struct.html">struct</a></code>, +<code><a href="to_json.html">to_json</a></code>, <code><a href="when.html">when</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D ifelse(df$a > 1 & df$b > 2, 0, 1) +##D ifelse(df$a > 1, df$a, 1) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/index.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/index.html b/site/docs/2.2.2/api/R/index.html new file mode 100644 index 0000000..11d4c8d --- /dev/null +++ b/site/docs/2.2.2/api/R/index.html @@ -0,0 +1,9 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Frameset//EN" "http://www.w3.org/TR/html4/frameset.dtd";> +<html> +<head><title>Documentation of the SparkR package</title></head> +<frameset cols="15%,*"> + <frame src="00frame_toc.html"> + <frame src="00Index.html" name="content"> +</frameset> +</html> + http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/initcap.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/initcap.html b/site/docs/2.2.2/api/R/initcap.html new file mode 100644 index 0000000..8cb5b47 --- /dev/null +++ b/site/docs/2.2.2/api/R/initcap.html @@ -0,0 +1,80 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: initcap</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for initcap {SparkR}"><tr><td>initcap {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>initcap</h2> + +<h3>Description</h3> + +<p>Returns a new string column by converting the first letter of each word to uppercase. +Words are delimited by whitespace. +</p> + + +<h3>Usage</h3> + +<pre> +initcap(x) + +## S4 method for signature 'Column' +initcap(x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>Column to compute on.</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>For example, "hello world" will become "Hello World". +</p> + + +<h3>Note</h3> + +<p>initcap since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other string_funcs: <code><a href="ascii.html">ascii</a></code>, +<code><a href="base64.html">base64</a></code>, <code><a href="concat_ws.html">concat_ws</a></code>, +<code><a href="concat.html">concat</a></code>, <code><a href="decode.html">decode</a></code>, +<code><a href="encode.html">encode</a></code>, <code><a href="format_number.html">format_number</a></code>, +<code><a href="format_string.html">format_string</a></code>, <code><a href="instr.html">instr</a></code>, +<code><a href="length.html">length</a></code>, <code><a href="levenshtein.html">levenshtein</a></code>, +<code><a href="locate.html">locate</a></code>, <code><a href="lower.html">lower</a></code>, +<code><a href="lpad.html">lpad</a></code>, <code><a href="ltrim.html">ltrim</a></code>, +<code><a href="regexp_extract.html">regexp_extract</a></code>, +<code><a href="regexp_replace.html">regexp_replace</a></code>, <code><a href="reverse.html">reverse</a></code>, +<code><a href="rpad.html">rpad</a></code>, <code><a href="rtrim.html">rtrim</a></code>, +<code><a href="soundex.html">soundex</a></code>, <code><a href="substring_index.html">substring_index</a></code>, +<code><a href="translate.html">translate</a></code>, <code><a href="trim.html">trim</a></code>, +<code><a href="unbase64.html">unbase64</a></code>, <code><a href="upper.html">upper</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: initcap(df$c) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/insertInto.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/insertInto.html b/site/docs/2.2.2/api/R/insertInto.html new file mode 100644 index 0000000..5b016bf --- /dev/null +++ b/site/docs/2.2.2/api/R/insertInto.html @@ -0,0 +1,117 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: insertInto</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for insertInto {SparkR}"><tr><td>insertInto {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>insertInto</h2> + +<h3>Description</h3> + +<p>Insert the contents of a SparkDataFrame into a table registered in the current SparkSession. +</p> + + +<h3>Usage</h3> + +<pre> +insertInto(x, tableName, ...) + +## S4 method for signature 'SparkDataFrame,character' +insertInto(x, tableName, + overwrite = FALSE) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>x</code></td> +<td> +<p>a SparkDataFrame.</p> +</td></tr> +<tr valign="top"><td><code>tableName</code></td> +<td> +<p>a character vector containing the name of the table.</p> +</td></tr> +<tr valign="top"><td><code>...</code></td> +<td> +<p>further arguments to be passed to or from other methods. +the existing rows in the table.</p> +</td></tr> +<tr valign="top"><td><code>overwrite</code></td> +<td> +<p>a logical argument indicating whether or not to overwrite.</p> +</td></tr> +</table> + + +<h3>Note</h3> + +<p>insertInto since 1.4.0 +</p> + + +<h3>See Also</h3> + +<p>Other SparkDataFrame functions: <code><a href="SparkDataFrame.html">SparkDataFrame-class</a></code>, +<code><a href="summarize.html">agg</a></code>, <code><a href="arrange.html">arrange</a></code>, +<code><a href="as.data.frame.html">as.data.frame</a></code>, +<code><a href="attach.html">attach,SparkDataFrame-method</a></code>, +<code><a href="cache.html">cache</a></code>, <code><a href="checkpoint.html">checkpoint</a></code>, +<code><a href="coalesce.html">coalesce</a></code>, <code><a href="collect.html">collect</a></code>, +<code><a href="columns.html">colnames</a></code>, <code><a href="coltypes.html">coltypes</a></code>, +<code><a href="createOrReplaceTempView.html">createOrReplaceTempView</a></code>, +<code><a href="crossJoin.html">crossJoin</a></code>, <code><a href="dapplyCollect.html">dapplyCollect</a></code>, +<code><a href="dapply.html">dapply</a></code>, <code><a href="summary.html">describe</a></code>, +<code><a href="dim.html">dim</a></code>, <code><a href="distinct.html">distinct</a></code>, +<code><a href="dropDuplicates.html">dropDuplicates</a></code>, <code><a href="nafunctions.html">dropna</a></code>, +<code><a href="drop.html">drop</a></code>, <code><a href="dtypes.html">dtypes</a></code>, +<code><a href="except.html">except</a></code>, <code><a href="explain.html">explain</a></code>, +<code><a href="filter.html">filter</a></code>, <code><a href="first.html">first</a></code>, +<code><a href="gapplyCollect.html">gapplyCollect</a></code>, <code><a href="gapply.html">gapply</a></code>, +<code><a href="getNumPartitions.html">getNumPartitions</a></code>, <code><a href="groupBy.html">group_by</a></code>, +<code><a href="head.html">head</a></code>, <code><a href="hint.html">hint</a></code>, +<code><a href="histogram.html">histogram</a></code>, <code><a href="intersect.html">intersect</a></code>, +<code><a href="isLocal.html">isLocal</a></code>, <code><a href="isStreaming.html">isStreaming</a></code>, +<code><a href="join.html">join</a></code>, <code><a href="limit.html">limit</a></code>, +<code><a href="merge.html">merge</a></code>, <code><a href="mutate.html">mutate</a></code>, +<code><a href="ncol.html">ncol</a></code>, <code><a href="nrow.html">nrow</a></code>, +<code><a href="persist.html">persist</a></code>, <code><a href="printSchema.html">printSchema</a></code>, +<code><a href="randomSplit.html">randomSplit</a></code>, <code><a href="rbind.html">rbind</a></code>, +<code><a href="registerTempTable-deprecated.html">registerTempTable</a></code>, <code><a href="rename.html">rename</a></code>, +<code><a href="repartition.html">repartition</a></code>, <code><a href="sample.html">sample</a></code>, +<code><a href="saveAsTable.html">saveAsTable</a></code>, <code><a href="schema.html">schema</a></code>, +<code><a href="selectExpr.html">selectExpr</a></code>, <code><a href="select.html">select</a></code>, +<code><a href="showDF.html">showDF</a></code>, <code><a href="show.html">show</a></code>, +<code><a href="storageLevel.html">storageLevel</a></code>, <code><a href="str.html">str</a></code>, +<code><a href="subset.html">subset</a></code>, <code><a href="take.html">take</a></code>, +<code><a href="toJSON.html">toJSON</a></code>, <code><a href="union.html">union</a></code>, +<code><a href="unpersist.html">unpersist</a></code>, <code><a href="withColumn.html">withColumn</a></code>, +<code><a href="with.html">with</a></code>, <code><a href="write.df.html">write.df</a></code>, +<code><a href="write.jdbc.html">write.jdbc</a></code>, <code><a href="write.json.html">write.json</a></code>, +<code><a href="write.orc.html">write.orc</a></code>, <code><a href="write.parquet.html">write.parquet</a></code>, +<code><a href="write.stream.html">write.stream</a></code>, <code><a href="write.text.html">write.text</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D sparkR.session() +##D df <- read.df(path, "parquet") +##D df2 <- read.df(path2, "parquet") +##D createOrReplaceTempView(df, "table1") +##D insertInto(df2, "table1", overwrite = TRUE) +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/install.spark.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/install.spark.html b/site/docs/2.2.2/api/R/install.spark.html new file mode 100644 index 0000000..bcaf680 --- /dev/null +++ b/site/docs/2.2.2/api/R/install.spark.html @@ -0,0 +1,118 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: Download and Install Apache Spark to a Local Directory</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for install.spark {SparkR}"><tr><td>install.spark {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>Download and Install Apache Spark to a Local Directory</h2> + +<h3>Description</h3> + +<p><code>install.spark</code> downloads and installs Spark to a local directory if +it is not found. If SPARK_HOME is set in the environment, and that directory is found, that is +returned. The Spark version we use is the same as the SparkR version. Users can specify a desired +Hadoop version, the remote mirror site, and the directory where the package is installed locally. +</p> + + +<h3>Usage</h3> + +<pre> +install.spark(hadoopVersion = "2.7", mirrorUrl = NULL, localDir = NULL, + overwrite = FALSE) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>hadoopVersion</code></td> +<td> +<p>Version of Hadoop to install. Default is <code>"2.7"</code>. It can take other +version number in the format of "x.y" where x and y are integer. +If <code>hadoopVersion = "without"</code>, "Hadoop free" build is installed. +See +<a href="http://spark.apache.org/docs/latest/hadoop-provided.html";> +"Hadoop Free" Build</a> for more information. +Other patched version names can also be used, e.g. <code>"cdh4"</code></p> +</td></tr> +<tr valign="top"><td><code>mirrorUrl</code></td> +<td> +<p>base URL of the repositories to use. The directory layout should follow +<a href="http://www.apache.org/dyn/closer.lua/spark/";>Apache mirrors</a>.</p> +</td></tr> +<tr valign="top"><td><code>localDir</code></td> +<td> +<p>a local directory where Spark is installed. The directory contains +version-specific folders of Spark packages. Default is path to +the cache directory: +</p> + +<ul> +<li><p> Mac OS X: ‘<span class="file">~/Library/Caches/spark</span>’ +</p> +</li> +<li><p> Unix: <span class="env">$XDG_CACHE_HOME</span> if defined, otherwise ‘<span class="file">~/.cache/spark</span>’ +</p> +</li> +<li><p> Windows: ‘<span class="file">%LOCALAPPDATA%\Apache\Spark\Cache</span>’. +</p> +</li></ul> +</td></tr> +<tr valign="top"><td><code>overwrite</code></td> +<td> +<p>If <code>TRUE</code>, download and overwrite the existing tar file in localDir +and force re-install Spark (in case the local directory or file is corrupted)</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>The full url of remote file is inferred from <code>mirrorUrl</code> and <code>hadoopVersion</code>. +<code>mirrorUrl</code> specifies the remote path to a Spark folder. It is followed by a subfolder +named after the Spark version (that corresponds to SparkR), and then the tar filename. +The filename is composed of four parts, i.e. [Spark version]-bin-[Hadoop version].tgz. +For example, the full path for a Spark 2.0.0 package for Hadoop 2.7 from +<code>http://apache.osuosl.org</code> has path: +<code>http://apache.osuosl.org/spark/spark-2.0.0/spark-2.0.0-bin-hadoop2.7.tgz</code>. +For <code>hadoopVersion = "without"</code>, [Hadoop version] in the filename is then +<code>without-hadoop</code>. +</p> + + +<h3>Value</h3> + +<p>the (invisible) local directory where Spark is found or installed +</p> + + +<h3>Note</h3> + +<p>install.spark since 2.1.0 +</p> + + +<h3>See Also</h3> + +<p>See available Hadoop versions: +<a href="http://spark.apache.org/downloads.html";>Apache Spark</a> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: +##D install.spark() +## End(Not run) +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/instr.html ---------------------------------------------------------------------- diff --git a/site/docs/2.2.2/api/R/instr.html b/site/docs/2.2.2/api/R/instr.html new file mode 100644 index 0000000..bdc1bf9 --- /dev/null +++ b/site/docs/2.2.2/api/R/instr.html @@ -0,0 +1,85 @@ +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd";><html xmlns="http://www.w3.org/1999/xhtml";><head><title>R: instr</title> +<meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> +<link rel="stylesheet" type="text/css" href="R.css" /> + +<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/styles/github.min.css";> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/highlight.min.js";></script> +<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/8.3/languages/r.min.js";></script> +<script>hljs.initHighlightingOnLoad();</script> +</head><body> + +<table width="100%" summary="page for instr {SparkR}"><tr><td>instr {SparkR}</td><td style="text-align: right;">R Documentation</td></tr></table> + +<h2>instr</h2> + +<h3>Description</h3> + +<p>Locate the position of the first occurrence of substr column in the given string. +Returns null if either of the arguments are null. +</p> + + +<h3>Usage</h3> + +<pre> +instr(y, x) + +## S4 method for signature 'Column,character' +instr(y, x) +</pre> + + +<h3>Arguments</h3> + +<table summary="R argblock"> +<tr valign="top"><td><code>y</code></td> +<td> +<p>column to check</p> +</td></tr> +<tr valign="top"><td><code>x</code></td> +<td> +<p>substring to check</p> +</td></tr> +</table> + + +<h3>Details</h3> + +<p>Note: The position is not zero based, but 1 based index. Returns 0 if substr +could not be found in str. +</p> + + +<h3>Note</h3> + +<p>instr since 1.5.0 +</p> + + +<h3>See Also</h3> + +<p>Other string_funcs: <code><a href="ascii.html">ascii</a></code>, +<code><a href="base64.html">base64</a></code>, <code><a href="concat_ws.html">concat_ws</a></code>, +<code><a href="concat.html">concat</a></code>, <code><a href="decode.html">decode</a></code>, +<code><a href="encode.html">encode</a></code>, <code><a href="format_number.html">format_number</a></code>, +<code><a href="format_string.html">format_string</a></code>, <code><a href="initcap.html">initcap</a></code>, +<code><a href="length.html">length</a></code>, <code><a href="levenshtein.html">levenshtein</a></code>, +<code><a href="locate.html">locate</a></code>, <code><a href="lower.html">lower</a></code>, +<code><a href="lpad.html">lpad</a></code>, <code><a href="ltrim.html">ltrim</a></code>, +<code><a href="regexp_extract.html">regexp_extract</a></code>, +<code><a href="regexp_replace.html">regexp_replace</a></code>, <code><a href="reverse.html">reverse</a></code>, +<code><a href="rpad.html">rpad</a></code>, <code><a href="rtrim.html">rtrim</a></code>, +<code><a href="soundex.html">soundex</a></code>, <code><a href="substring_index.html">substring_index</a></code>, +<code><a href="translate.html">translate</a></code>, <code><a href="trim.html">trim</a></code>, +<code><a href="unbase64.html">unbase64</a></code>, <code><a href="upper.html">upper</a></code> +</p> + + +<h3>Examples</h3> + +<pre><code class="r">## Not run: instr(df$c, 'b') +</code></pre> + + +<hr /><div style="text-align: center;">[Package <em>SparkR</em> version 2.2.2 <a href="00Index.html">Index</a>]</div> +</body></html> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
