Mailing lists matching spark.apache.org
commits spark.apache.orgdev spark.apache.org
issues spark.apache.org
reviews spark.apache.org
user spark.apache.org
Re: subscribe
See http://spark.apache.org/community.html Cheers On Sat, Aug 22, 2015 at 2:51 AM, Lars Hermes wrote: > subscribe > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands,
Re: Unsubscribe
To unsubscribe e-mail: user-unsubscr...@spark.apache.org This is explained here: http://spark.apache.org/community.html#mailing-lists On Thu, Dec 8, 2016 at 12:12 AM Ajit Jaokar wrote: > > > - > To unsubscribe
Re: Subscribe
Please email user-subscr...@spark.apache.org > On Apr 8, 2015, at 6:28 AM, Idris Ali wrote: > > - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
spark git commit: [docs] [SPARK-6306] Readme points to dead link
Repository: spark Updated Branches: refs/heads/master 0cba802ad -> 4e47d54be [docs] [SPARK-6306] Readme points to dead link The link to "Specifying the Hadoop Version" currently points to http://spark.apache.org/docs/latest/building-with-maven.html#specifying-the-hadoop-version.
(spark-kubernetes-operator) branch main updated: [SPARK-49315] Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`
] Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml` f05de22 is described below commit f05de223662dedf5f645a828dea10c72a8ec9d55 Author: Dongjoon Hyun AuthorDate: Mon Aug 19 20:53:47 2024 -0700 [SPARK-49315] Generalize `relocateGeneratedCRD` Gradle Task to handle
Re: enum-like types in Spark
oth pros and cons. I wonder > whether there should be an “official” approach for enum-like types in > Spark. > > 1. Scala’s Enumeration (e.g., SchedulingMode, WorkerState, etc) > > * All types show up as Enumeration.Value in Java. > > http://spark.apache.org/docs/latest
Re: Spark 2.0.0-preview artifacts still not available in Maven
n about preview docs accordingly. On Tue, Jun 7, 2016 at 4:10 PM, Tom Graves wrote: > Thanks Sean, you were right, hard refresh made it show up. > > Seems like we should at least link to the preview docs from > http://spark.apache.org/documentation.html. > > Tom > > > On
Re: Question about SparkSQL and Hive-on-Spark
aking a look this week. > > > best, > wb > > > - Original Message - >> From: "Yi Tian" >> To: dev@spark.apache.org >> Sent: Tuesday, September 23, 2014 2:47:17 AM >> Subject: Question about SparkSQL and Hive-on-Spark >> >> H
[jira] [Comment Edited] (SPARK-22472) Datasets generate random values for null primitive types
9 AM: --- I guess it's too late to add to http://spark.apache.org/docs/latest/sql-programming-guide.html#migration-guide (and we don't seem to document this in patch release there anyway) I guess I'll just add this to the website on the actual release announcement like http
Re: redshift spark
http://docs.aws.amazon.com/redshift/latest/dg/t_Unloading_tables.html > > The path in the parameters below is the s3 bucket path. > > Hope this helps, > Ewan > > -Original Message- > From: Hafiz Mujadid [mailto:hafizmujadi...@gmail.com] > Sent: 05 June 2015 15:2
RE: [SparkR] Float type coercion with hiveContext
: huangzheng Cc: Apache Spark User List Subject: Re: [SparkR] Float type coercion with hiveContext I used spark 1.4.0 binaries from official site: http://spark.apache.org/downloads.html And running it on: * Hortonworks HDP 2.2.0.0-2041 * with Hive 0.14 * with disabled hooks for Application Timeline Servers
Re: Where to set properties for the retainedJobs/Stages?
Okay I put the props in the spark-defaults, but they are not recognized, as they don't appear in the 'Environment' tab during a application execution. spark.eventLog.enabled for example. Am 01.04.2016 um 21:22 schrieb Ted Yu: > Please > read > https://spar
Re: Small File to HDFS
yuzhih...@gmail.com > À: nib...@free.fr Cc: "user" < user@spark.apache.org > Envoyé: Mercredi 2 Septembre 2015 18:34:17 Objet: Re: Small File to HDFS Instead of storing those messages in HDFS, have you considered storing them in key-value store (e.g. hbase) ? Cheers On W
Re: Spark 1.5 Streaming and Kinesis
PARK-11193 to track progress, hope that is okay! In the meantime, can anyone confirm their ability to run the Kinesis-ASL example using Spark > 1.5.x ? Would be helpful to know if it works in some cases but not others. http://spark.apache.org/docs/1.5.1/streaming-kinesis-integration.html Thanks
Re: [PR] Fix https://spark.apache.org/docs/preview/ to target 4.0.0-preview1 [spark-website]
. To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional
[GitHub] [spark-website] gatorsmile commented on pull request #319: Add docs for Apache Spark 3.1.1
gatorsmile commented on pull request #319: URL: https://github.com/apache/spark-website/pull/319#issuecomment-789066541 https://spark.apache.org/docs/3.1.1/ works, but https://spark.apache.org/docs/latest/ misses the menu
Re: [VOTE] Standardize Spark Exception Messages SPIP
tp://apache-spark-developers-list.1001551.n3.nabble.com/ > > <http://apache-spark-developers-list.1001551.n3.nabble.com/> > > > > ----- > > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > <mailto:dev-unsubscr...@spark.apache.org> > > > > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > <mailto:dev-unsubscr...@spark.apache.org> >
Re: Welcoming three new committers
ubscribe, e-mail: dev-unsubscr...@spark.apache.org > (mailto:dev-unsubscr...@spark.apache.org) > For additional commands, e-mail: dev-h...@spark.apache.org > (mailto:dev-h...@spark.apache.org) > >
Re: Mima test failure in the master branch?
-in-the-master-branch-tp11949p11950.html > Sent from the Apache Spark Developers List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional command
Announcing Spark 1.4.1!
Hi All, I'm happy to announce the Spark 1.4.1 maintenance release. We recommend all users on the 1.4 branch upgrade to this release, which contain several important bug fixes. Download Spark 1.4.1 - http://spark.apache.org/downloads.html Release notes - http://spark.apache.org/releases/
Re: Welcoming Yanbo Liang as a committer
en >> a super active contributor in many areas of MLlib. Please join me in >> welcoming Yanbo! >> >> Matei >> ----- >> To unsubscribe, e-mail: dev-unsub
[jira] [Updated] (SPARK-16761) Fix doc link in docs/ml-guide.md
[ https://issues.apache.org/jira/browse/SPARK-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dapeng Sun updated SPARK-16761: --- Description: Fix the invalid link at http://spark.apache.org/docs/latest/ml-guide.html > Fix
[jira] [Created] (SPARK-38831) How to enable encryption for checkpoint data?
Components: Security Affects Versions: 3.2.1 Reporter: zoli Setting spark.io.encryption.enabled to true as described here: [https://spark.apache.org/docs/latest/security.html#local-storage-encryption |https://spark.apache.org/docs/latest/security.html#local-storage-encryption
[jira] [Resolved] (SPARK-14921) does sparksql support 'transform() using script' in hive which used for creating python udf
[ https://issues.apache.org/jira/browse/SPARK-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14921. --- Resolution: Invalid Questions go to u...@spark.apache.org http://spark.apache.org/contributing.html
[jira] [Updated] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`
to handle > `*.spark.apache.org-v1.yml` > --- > > Key: SPARK-49315 > URL: https://issues.apache.org/jira/browse/SPARK-49315 > Project: Spark >
[jira] [Updated] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files
dle `*.spark.apache.org-v1.yml` files > --- > > Key: SPARK-49316 > URL: https://issues.apache.org/jira/browse/SPARK-49316 > Project: Spark > Issue Type: Sub-task
[jira] [Assigned] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`
dle > `*.spark.apache.org-v1.yml` > --- > > Key: SPARK-49315 > URL: https://issues.apache.org/jira/browse/SPARK-49315 > Project: Spark >
[jira] [Assigned] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files
dle `*.spark.apache.org-v1.yml` files > --- > > Key: SPARK-49316 > URL: https://issues.apache.org/jira/browse/SPARK-49316 > Project: Spark > Issue Type: Sub-task >
[jira] [Created] (SPARK-10759) Missing Python code example in ML Programming guide
: Improvement Components: Documentation Affects Versions: 1.5.0 Reporter: Raela Wang Priority: Minor http://spark.apache.org/docs/latest/ml-guide.html#example-model-selection-via-cross-validation http://spark.apache.org/docs/latest/ml-guide.html#example-model
[jira] [Created] (SPARK-6306) Readme points to dead link
Components: Documentation Reporter: Theodore Vasiloudis Priority: Trivial The link to "Specifying the Hadoop Version" now points to http://spark.apache.org/docs/latest/building-with-maven.html#specifying-the-hadoop-version. The correct link is: http://spark.
Re: [PR] Promote `PrometheusServlet` to `DeveloperApi` [spark]
HyukjinKwon commented on PR #46716: URL: https://github.com/apache/spark/pull/46716#issuecomment-2126538170 Mind filing a JIRA please? See also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on
Re: [PR] Insert Into Statement improvement [spark]
HyukjinKwon commented on PR #47428: URL: https://github.com/apache/spark/pull/47428#issuecomment-2241820903 Mind filing a JIRA please? See also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on
Re: [PR] [SPARK-49276] Use API Group `spark.apache.org` [spark-kubernetes-operator]
above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews
Re: [PR] [SPARK-49276] Use API Group `spark.apache.org` [spark-kubernetes-operator]
go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr
Re: [PR] [SPARK-49276] Use API Group `spark.apache.org` [spark-kubernetes-operator]
above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews
Re: [PR] [SPARK-49315] Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml` [spark-kubernetes-operator]
the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr
[GitHub] [spark] srowen commented on pull request #39909: Fix constructor for java.nio.DirectByteBuffer
srowen commented on PR #39909: URL: https://github.com/apache/spark/pull/39909#issuecomment-1419396484 (Please make a JIRA, etc. though - https://spark.apache.org/contributing.html ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to
[GitHub] [spark] srowen commented on pull request #40116: [WIP]SPARK-41391 Fix
srowen commented on PR #40116: URL: https://github.com/apache/spark/pull/40116#issuecomment-1445261458 Please fix the PR description too https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to
[GitHub] [spark] HyukjinKwon commented on pull request #38404: Replace Where
HyukjinKwon commented on PR #38404: URL: https://github.com/apache/spark/pull/38404#issuecomment-1292832395 Mind adding a test, filing a JIRA, etc? See also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message
[GitHub] spark issue #18134: [SPARK-20909][SQL] Add build-int SQL function - DAYOFWEE...
Github user sergiobilello-eb commented on the issue: https://github.com/apache/spark/pull/18134 This function is not reported in the API documentation: https://spark.apache.org/docs/2.2.0/api/java/index.html?org/apache/spark/sql/functions.html or https://spark.apache.org/docs/2.1.0
[GitHub] [spark] HyukjinKwon commented on pull request #34903: Tell spark-env.sh the python interpreter
HyukjinKwon commented on pull request #34903: URL: https://github.com/apache/spark/pull/34903#issuecomment-994182440 Mind filing a JIRA please? see also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message
[GitHub] [spark] HyukjinKwon commented on pull request #34353: Set spark.sql.files.openCostInBytes to bytesConf
HyukjinKwon commented on pull request #34353: URL: https://github.com/apache/spark/pull/34353#issuecomment-948389308 Let's also file a JIRA, see also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, p
Re: [PR] Miland db/miland legacy error class [spark]
HyukjinKwon commented on PR #45423: URL: https://github.com/apache/spark/pull/45423#issuecomment-1984835207 See also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL
Re: [PR] PySpark worker pool crash resilience [spark]
HyukjinKwon commented on PR #45635: URL: https://github.com/apache/spark/pull/45635#issuecomment-2019202983 Let's file a JIRA, see https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G
[GitHub] [spark] srowen commented on pull request #36859: DTW: new distance measure for clustering
srowen commented on PR #36859: URL: https://github.com/apache/spark/pull/36859#issuecomment-1156429914 Please see https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL
Re: Why does driver transfer application jar to executors?
ark do the above? To my understanding, the tasks to be run > are already serialized with TaskDescription. > > > Regards. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For addition
Re: Is it a bug?
le.com/Is-it-a-bug-tp26898.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > ----- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For ad
Re: Spark Website
do you mean 'as supposed to'? ~Manish On Wed, Jul 13, 2016 at 11:45 AM, Benjamin Kim mailto:bbuil...@gmail.com>> wrote: Has anyone noticed that the spark.apache.org<http://spark.apache.org/> is not working as supposed to?
Re: Negative Number of Active Tasks in Spark UI
this? > How is this possible? > > Thanks, > Prasad. > > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional
Re: Spark Streaming - History UI
r any streaming jobs? > I am using version 1.5.1. Any ideas? > > Thanks, > Patcharee > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >
Re: Movie Recommendation tutorial
-user-list.1001560.n3.nabble.com/Movie-Recommendation-tutorial-tp21769p21771.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
Re: Effects of persist(XYZ_2)
lso increase job > speed by avoiding network transfers? Assuming I’m doing joins or other > shuffle operations. > > Thanks > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >
Re: Regularization parameters
3.nabble.com/Regularization-parameters-tp11601p11631.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional co
Re: Spark assembly for YARN/CDH5
e created and available for > download that have been built for CDH5 and YARN? > > Thanks, > Philip > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional command
Re: Spark 1.1.0 on Hive 0.13.1
news about when will Spark 1.1.0 on Hive 0.1.3.1 be available? Regards Arthur - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apach
Re: sparse x sparse matrix multiplication
0.n3.nabble.com/sparse-x-sparse-matrix-multiplication-tp18163.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >
Re: How to recovery application running records when I restart Spark master?
http://spark.apache.org/docs/latest/monitoring.html http://spark.apache.org/docs/latest/configuration.html#spark-ui spark.eventLog.enabled On Mon, Jan 12, 2015 at 3:00 PM, ChongTang wrote: > Is there any body can help me with this? Thank you very much! > > > > -- > Vi
Re: spark java options
.extraJavaOptions=-XX:+UnlockCommercialFeatures > -XX:+FlightRecorder" > > But looks like it doesn't get set. Where I can add it to make it working? > > Thanks. > > - > To unsubscribe, e-mail: user-unsubscr...@spa
Re:
See first section of http://spark.apache.org/community On Wed, Oct 22, 2014 at 7:42 AM, Margusja wrote: > unsubscribe > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands,
Re: unsubscribe
Abdul, Please send an email to user-unsubscr...@spark.apache.org On Tue, Nov 18, 2014 at 2:05 PM, Abdul Hakeem wrote: > > > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additi
RE: Easy way to convert Row back to case class
Thank you for suggestions! From: Reynold Xin [mailto:r...@databricks.com] Sent: Friday, May 08, 2015 11:10 AM To: Will Benton Cc: Ulanov, Alexander; dev@spark.apache.org Subject: Re: Easy way to convert Row back to case class In 1.4, you can do row.getInt("colName") In 1.5, some
Re: [VOTE] Release Apache Spark 1.6.2 (RC2)
>>> (DirectKafkaStreamSuite.scala:301) >>> >>> This actually fails consistently for me too in the Kafka integration >>> code. Not timezone related, I think. >
[jira] [Updated] (SPARK-39253) Improve PySpark API reference to be more readable
part|https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql.html#] is not-well organized so it's a bit uncomfortable to be read. For example, the [pyspark.sql.SparkSession|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.sql.SparkSession.html] class shows every avail
[jira] [Updated] (SPARK-39253) Improve PySpark API reference to be more readable
part|https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql.html#] is not-well organized so it's a bit uncomfortable to be read. For example, the [pyspark.sql.SparkSession|https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.sql.SparkSession.html] class shows every avail
[jira] [Updated] (SPARK-35405) Submitting Applications documentation has outdated information about K8s client mode support
[ https://issues.apache.org/jira/browse/SPARK-35405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shevchenko updated SPARK-35405: - Description: [Submitting Applications doc|https://spark.apache.org/docs/latest
[jira] [Updated] (SPARK-12144) Support more external data source API in SparkR
SQL but defined with R-like style. DataFrameReader API: http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameReader DataFrameWriter API: http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameWriter was: Currently we support
[jira] [Updated] (SPARK-46815) Structured Streaming - Arbitrary State API v2
Streaming|https://spark.apache.org/streaming/] around [arbitrary stateful operations|https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#arbitrary-stateful-operations]. The operator(s) we have today ([mapGroupsWithState/flatMapGroupsWithState|https://spark.apache.org
RE: SparkSQL : using Hive UDF returning Map throws "rror: scala.MatchError: interface java.util.Map (of class java.lang.Class) (state=,code=0)"
Confirmed, with latest master, we don't support complex data type for Simple Hive UDF, do you mind file an issue in jira? -Original Message- From: Cheng, Hao [mailto:hao.ch...@intel.com] Sent: Friday, June 5, 2015 12:35 PM To: ogoh; user@spark.apache.org Subject: RE: SparkSQL :
Re: spark-shell failing but pyspark works
mport StreamingContext > > app = "test-python" > > conf = SparkConf().setAppName(app).setMaster("yarn-client") > > sc = SparkContext(conf=conf) > > ssc = StreamingContext(sc, 3) > > > > command used : pyspark test.py > > > > Any
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
sage----- > From: Sun, Rui [mailto:rui@intel.com ] > Sent: Tuesday, October 06, 2015 9:39 AM > To: akhandeshi; user@spark.apache.org > Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio > > What you have done is supposed to work. Need more debugging inf
Re: Any NLP library for sentiment analysis in Spark?
lto:gabriel.ja...@heliase.com>" mailto:gabriel.ja...@heliase.com>> Date: Tuesday, April 11, 2017 at 2:13 PM To: 'Kevin Wang' mailto:buz...@gmail.com>>, 'Alonso Isidoro Roman' mailto:alons...@gmail.com>> Cc: 'Gaurav1809' mailto:gauravhpa
Re: Configuring Spark Memory
his is after having closely read > the documentation several times: > > *http://spark.apache.org/docs/latest/configuration.html > <http://spark.apache.org/docs/latest/configuration.html>* > *http://spark.apache.org/docs/latest/spark-standalone.html > <http://spark.apache.o
spark-website git commit: Fix doc link and touch up sitemap; mostly an excuse to trigger github sync again
1.0 - http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.package @@ -125,22 +124,20 @@ http://spark.apache.org/docs/latest/api/java/index.html - daily + weekly 1.0 http://spark.apache.org/docs/latest/api/python/index.html - daily + weekly 1.0 h
Re: Help needed in R documentation generation
:03:34 AM To: dev@spark.apache.org Subject: Fwd: Help needed in R documentation generation Hi, Actually, when I open the link you provided and click on - for example - 'sin' the page does not seem to describe that function at all. Actually I get same effect that I get locally. I have
[jira] [Updated] (SPARK-18437) Inconsistent mark-down for `Note:`/`NOTE:`/`Note that` across Scala/Java/R/Python in API documentations
; information about when the function came out such as {{locate since 1.5.0}} > without other information[7]. So, I am not too sure for this. > It would be nicer if they are consistent, at least for Scala/Python/Java. > [1] > http://spark.apache.org/docs/latest/api/scala/index.html
[jira] [Commented] (SPARK-18437) Inconsistent mark-down for `Note:`/`NOTE:`/`Note that` across Scala/Java/R/Python in API documentations
e that}} > - {{@note}} > In case of R, it seems pretty consistent. {{@note}} only contains the > information about when the function came out such as {{locate since 1.5.0}} > without other information[7]. So, I am not too sure for this. > It would be nicer if they are consistent, at l
Re: Small File to HDFS
Wed, Sep 2, 2015 at 12:43 PM, < nib...@free.fr > wrote: >> >> >> Hi, >> I already store them in MongoDB in parralel for operational access and don't >> want to add an other database in the loop >> Is it the only solution ? >> >
Re: Datastore HDFS vs Cassandra
:franc.car...@rozettatech.com>> Datum: Mittwoch, 11. Februar 2015 10:03 An: Paolo Platter mailto:paolo.plat...@agilelab.it>> Cc: Mike Trienis mailto:mike.trie...@orcsol.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Betreff
(spark-website) branch asf-site updated: Fix https://spark.apache.org/docs/preview/ to target 4.0.0-preview1 (#549)
This is an automated email from the ASF dual-hosted git repository. yao pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new fe406e8f1c Fix https://spark.apache.org
[GitHub] [spark-website] JuanPabloDiaz opened a new pull request, #459: 🚀 Including ApacheSparkMéxicoCity Meetup on community page 🚀
/apache-spark-mexicocity/](https://www.meetup.com/es/apache-spark-mexicocity/) I And would like to include the community on the following web page [https://spark.apache.org/community.html](https://spark.apache.org/community.html) I change the .md and the .html community files. I hope this
[jira] [Resolved] (SPARK-21593) Fix broken configuration page
pg, dyn_latest.jpg > > > Latest configuration page for Spark 2.2.0 has broken menu list and named > anchors. > Compare [2.1.1 docs |https://spark.apache.org/docs/2.1.1/configuration.html] > with [Latest docs |https://spark.apache.org/docs/latest/configuration.html]
[jira] [Commented] (SPARK-16705) Kafka Direct Stream is not experimental anymore
Issue Type: Documentation > Components: Documentation >Affects Versions: 1.6.2 >Reporter: Bertrand Dechoux > Priority: Minor > > http://spark.apache.org/docs/latest/streaming-kafka-integration.html > {quote} > Note that this is an experimental fea
[jira] [Commented] (SPARK-16705) Kafka Direct Stream is not experimental anymore
K-16705 > Project: Spark > Issue Type: Documentation > Components: Documentation >Affects Versions: 1.6.2 >Reporter: Bertrand Dechoux >Priority: Minor > > http://spark.apache.org/docs/latest/streaming-kafka-integrati
[jira] [Assigned] (SPARK-16705) Kafka Direct Stream is not experimental anymore
1.6.2 >Reporter: Bertrand Dechoux >Assignee: Apache Spark > Priority: Minor > > http://spark.apache.org/docs/latest/streaming-kafka-integration.html > {quote} > Note that this is an experimental feature introduced in Spark 1.3 for the >
[jira] [Updated] (SPARK-16705) Kafka Direct Stream is not experimental anymore
Project: Spark > Issue Type: Documentation > Components: Documentation >Affects Versions: 2.0.0 >Reporter: Bertrand Dechoux >Priority: Trivial > > http://spark.apache.org/docs/latest/streaming-kafka-integration.html > {quote} > Note that
[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location
like this is broken again - For 2.0.2 I get a 404 from http://spark.apache.org/docs/2.0.2/ec2-scripts.html and the markdown file exists at http://spark.apache.org/docs/2.0.2/ec2-scripts.md. FWIW This was reported in https://github.com/amplab/spark-ec2/issues/76 > Redirect spark-ec2 doc
[jira] [Commented] (SPARK-32058) Use Apache Hadoop 3.2.0 dependency by default
olds. 1. The user provided Hadoop distribution is in the same location at the website. * [https://spark.apache.org/downloads.html |https://spark.apache.org/downloads.html] !Screen Shot 2021-03-08 at 11.09.04 AM.png! 2. A document running it on the existing Hadoop 2.7.1 I guess you are using
[jira] [Updated] (SPARK-37243) Fix the format of the document
|https://spark.apache.org/docs/latest/sql-ref-syntax-dml-insert-into.html] it should be normal like other parts. was: Currently, the format of `sql-ref-syntax-dml-insert-overwrite-table.md` is: [currently format|https://spark.apache.org/docs/latest/sql-ref-syntax-dml-insert-into.html] it should
[jira] [Updated] (SPARK-37243) Fix the format of the document
://spark.apache.org/docs/latest/sql-ref-syntax-dml-insert-into.html] it should be normal like other parts. was: Currently, the format of `sql-ref-syntax-dml-insert-overwrite-table.md` is: [currently format|https://spark.apache.org/docs/latest/sql-ref-syntax-dml-insert-into.html] it should be normal
[jira] [Created] (SPARK-25082) Documentation for Spark Function expm1 is incomplete
Issue Type: Documentation Components: Spark Core Affects Versions: 2.3.1, 2.0.0 Reporter: Alexander Belov The documentation for the function expm1 that takes in a string public static [Column|https://spark.apache.org/docs/2.3.1/api/java/org/apache/spark/sql/Column.html
[jira] [Assigned] (SPARK-26807) Confusing documentation regarding installation from PyPi
Affects Versions: 2.4.0 >Reporter: Emmanuel Arias >Assignee: Apache Spark >Priority: Trivial > > Hello! > I am new using Spark. Reading the documentation I think that is a little > confusing on Downloading section. > [ttps://spark.apache.or
[jira] [Assigned] (SPARK-26807) Confusing documentation regarding installation from PyPi
on >Affects Versions: 2.4.0 >Reporter: Emmanuel Arias >Priority: Trivial > > Hello! > I am new using Spark. Reading the documentation I think that is a little > confusing on Downloading section. > [ttps://spark.apache.org/docs/latest/#downloading|h
[jira] [Assigned] (SPARK-26807) Confusing documentation regarding installation from PyPi
Affects Versions: 2.4.0 >Reporter: Emmanuel Arias >Assignee: Sean Owen >Priority: Trivial > > Hello! > I am new using Spark. Reading the documentation I think that is a little > confusing on Downloading section. > [ttps://spark.apache.org/doc
[jira] [Created] (SPARK-19445) Please remove tylerchap...@yahoo-inc.com subscription from u...@spark.apache.org
Aseem Bansal created SPARK-19445: Summary: Please remove tylerchap...@yahoo-inc.com subscription from u...@spark.apache.org Key: SPARK-19445 URL: https://issues.apache.org/jira/browse/SPARK-19445
[jira] [Created] (SPARK-25795) Fix R Spark SQL Example
epos/dist/dev/spark/v2.4.0-rc3-docs/_site/sql-programming-guide.html#manually-specifying-options - http://spark.apache.org/docs/2.3.2/sql-programming-guide.html#manually-specifying-options - http://spark.apache.org/docs/2.3.1/sql-programming-guide.html#manually-specifying-options - http://spark
[jira] [Updated] (SPARK-17561) DataFrameWriter documentation formatting problems
[ https://issues.apache.org/jira/browse/SPARK-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-17561: - Description: I visited this page https://spark.apache.org/docs/2.0.0/api/java/org/apache/spark
[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization
@spark.apache.org/msg45643.html The lossSum has possibility of infinity because we do not standardize the feature before fitting model, we should handle this. was: This bug is reported by Stuti Awasthi. https://www.mail-archive.com/user@spark.apache.org/msg45643.html The lossSum has possibility of infinity
[jira] [Updated] (SPARK-14553) PCA wrapper for SparkR
[ https://issues.apache.org/jira/browse/SPARK-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alok Singh updated SPARK-14553: --- Description: Implement the SparkR wrapper for the PCA transformer https://spark.apache.org/docs
[jira] [Updated] (SPARK-14553) PCA wrapper for SparkR
[ https://issues.apache.org/jira/browse/SPARK-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alok Singh updated SPARK-14553: --- Description: Implement the SparkR wrapper for the PCA transformer https://spark.apache.org/docs
[jira] [Updated] (SPARK-43322) Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty
> Issue Type: Documentation > Components: SQL >Affects Versions: 3.4.0 >Reporter: Robert Juchnicki >Priority: Minor > > The Spark SQL documentation for > [explode_outer|https://spark.apache.org/docs/latest/api/sql/index.html#expl
