Re: [build system] rolling back R to working version

Thanks Shane! From: shane knapp Sent: Tuesday, June 20, 2017 9:23:57 PM To: dev Subject: Re: [build system] rolling back R to working version this is done... i backported R to 3.1.1 and reinstalled all the R packages so we're starting w/a

Re: How save streaming aggregations on 'Structured Streams' in parquet format ?

And perhaps the error message can be improved here? From: Tathagata Das Sent: Monday, June 19, 2017 8:24:01 PM To: kaniska Mandal Cc: Burak Yavuz; user Subject: Re: How save streaming aggregations on 'Structured Streams' in parquet

[jira] [Created] (SPARK-21149) Add job description API for R

Felix Cheung created SPARK-21149: Summary: Add job description API for R Key: SPARK-21149 URL: https://issues.apache.org/jira/browse/SPARK-21149 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-20889) SparkR grouped documentation for Column methods

[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20889. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20892) Add SQL trunc function to SparkR

[ https://issues.apache.org/jira/browse/SPARK-20892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20892. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20520) R streaming tests failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20520. -- Resolution: Cannot Reproduce Fix Version/s: 2.2.0 tested no longer repo on windows

[jira] [Resolved] (SPARK-21128) Running R tests multiple times failed due to pre-exiting "spark-warehouse" / "metastore_db"

[ https://issues.apache.org/jira/browse/SPARK-21128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21128. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Sounds good. Think we checked and should be good to go. Appreciated. From: Michael Armbrust <mich...@databricks.com> Sent: Wednesday, June 14, 2017 4:51:48 PM To: Hyukjin Kwon Cc: Felix Cheung; Nick Pentreath; dev; Sean Owen Subject: Re: [VOTE] Apache Spark

[jira] [Updated] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21093: - Shepherd: Felix Cheung > Multiple gapply execution occasionally failed in Spa

[jira] [Commented] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050052#comment-16050052 ] Felix Cheung commented on SPARK-21076: -- this looks to happen when mapping the Spark type to the R

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Thanks! Will try to setup RHEL/CentOS to test it out _ From: Nick Pentreath <nick.pentre...@gmail.com<mailto:nick.pentre...@gmail.com>> Sent: Tuesday, June 13, 2017 11:38 PM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: Felix Cheung <felixcheun

Re: [VOTE] Apache Spark 2.2.0 (RC4)

<so...@cloudera.com<mailto:so...@cloudera.com>>, Nick Pentreath <nick.pentre...@gmail.com<mailto:nick.pentre...@gmail.com>>, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> For the test failure on R, I checked: Per https://githu

[jira] [Commented] (SPARK-21068) SparkR error message when passed an R object rather than Java object could be more informative

[ https://issues.apache.org/jira/browse/SPARK-21068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047338#comment-16047338 ] Felix Cheung commented on SPARK-21068: -- surely. what brings you to R land? :) > SparkR er

Re: SBT / PR builder builds failing on "include an external JAR in SparkR"

Facepalm I broken them - I was making changes to test files and of course Jenkins was only running only R tests since I was only changing R files, and everything passed there. Fix is Seq(sparkHome, "R", "pkg", "inst", "tests", To Seq(sparkHome, "R", "pkg", "tests", "fulltests", And 2

Re: [VOTE] Release Apache Zeppelin 0.7.2 (RC1)

+1 netinst Check sig, basic tests _ From: Jongyoul Lee > Sent: Saturday, June 10, 2017 2:13 AM Subject: Re: [VOTE] Release Apache Zeppelin 0.7.2 (RC1) To: dev >

[jira] [Commented] (SPARK-20520) R streaming tests failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045883#comment-16045883 ] Felix Cheung commented on SPARK-20520: -- these tests are no longer run as a part of CRAN check

[jira] [Updated] (SPARK-20520) R streaming tests failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20520: - Priority: Major (was: Critical) > R streaming tests failed on Wind

Re: problem initiating spark context with pyspark

Curtis, assuming you are running a somewhat recent windows version you would not have access to c:\tmp, in your command example winutils.exe ls -F C:\tmp\hive Try changing the path to under your user directory. Running Spark on Windows should work :) From:

[jira] [Updated] (SPARK-20877) Shorten test sets to run on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20877: - Summary: Shorten test sets to run on CRAN (was: Investigate if tests will time out on CRAN

Re: [VOTE] Apache Spark 2.2.0 (RC4)

Hmm, that's odd. This test would be in Jenkins too - let me double check _ From: Nick Pentreath > Sent: Friday, June 9, 2017 1:12 AM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: dev

[jira] [Created] (SPARK-21030) extend hint syntax to support any expression for Python and R

Felix Cheung created SPARK-21030: Summary: extend hint syntax to support any expression for Python and R Key: SPARK-21030 URL: https://issues.apache.org/jira/browse/SPARK-21030 Project: Spark

[jira] [Created] (SPARK-21029) All StreamingQuery should be stopped when the SparkSession is stopped

Felix Cheung created SPARK-21029: Summary: All StreamingQuery should be stopped when the SparkSession is stopped Key: SPARK-21029 URL: https://issues.apache.org/jira/browse/SPARK-21029 Project: Spark

[jira] [Commented] (SPARK-20510) SparkR 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-20510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043895#comment-16043895 ] Felix Cheung commented on SPARK-20510: -- credit to SPARK-20208 SPARK-20849 SPARK-20477 SPARK-20478

[jira] [Commented] (SPARK-20511) SparkR 2.2 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-20511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043894#comment-16043894 ] Felix Cheung commented on SPARK-20511: -- credit to SPARK-20208 SPARK-20849 SPARK-20477 SPARK-20478

[jira] [Commented] (SPARK-20513) Update SparkR website for 2.2

[ https://issues.apache.org/jira/browse/SPARK-20513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043892#comment-16043892 ] Felix Cheung commented on SPARK-20513: -- right, I don't think there's a site for R https://github.com

Re: [VOTE] Apache Spark 2.2.0 (RC4)

All tasks on the R QA umbrella are completed SPARK-20512 We can close this. _ From: Sean Owen > Sent: Tuesday, June 6, 2017 1:16 AM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: Michael Armbrust

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

rs into maven separately. We already had a install-interpreter script inside it. If someone wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung <felixcheun...@hotmail.com&l

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

rs into maven separately. We already had a install-interpreter script inside it. If someone wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung <felixcheun...@hotmail.com&l

Re: [DISCUSS] Release 0.7.2

+1 From: moon soo Lee Sent: Saturday, June 3, 2017 10:47:39 AM To: dev Subject: [DISCUSS] Release 0.7.2 Hi, Since 0.7.1 release, we have resolved 38 issues and that includes most of critical issues in 0.7.2 umbrella issue [1]. Since 0.7.1 has

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee > Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS]

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee > Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS]

Re: [VOTE] Livy to enter Apache Incubator

+1 On Thu, Jun 1, 2017 at 11:14 AM Hitesh Shah wrote: > +1 > > -- Hitesh > > On Wed, May 31, 2017 at 6:03 AM, Sean Busbey wrote: > > > Hi folks! > > > > I'm calling a vote to accept "Livy" into the Apache Incubator. > > > > The full proposal is available

[jira] [Commented] (SPARK-20854) extend hint syntax to support any expression, not just identifiers or strings

[ https://issues.apache.org/jira/browse/SPARK-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034115#comment-16034115 ] Felix Cheung commented on SPARK-20854: -- seems like would be good to add support for the same

Re: Livy - add external libraries from additional maven repo

ral and not a local repo. --Ben On Tue, May 30, 2017 at 12:36 PM, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API direct

Re: Livy - add external libraries from additional maven repo

To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhile to follow up with the Livy community separately. From: Felix Cheung <felixcheun...@hotmail.

Re: Livy - add external libraries from additional maven repo

if I recall, %dep only works with the built in Spark interpreter and not the Livy interpreter. To manage dependency win Livy you will need to set Spark conf with Livy. From: Theofilos Kakantousis Sent: Tuesday, May 30, 2017 9:05:15 AM To:

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: dev@zeppelin.apache.org; us...@zeppelin.apache.org Subject: Permission

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: d...@zeppelin.apache.org; users@zeppelin.apache.org Subject: Permission

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027720#comment-16027720 ] Felix Cheung commented on SPARK-20877: -- Have a run on AppVeyor https://ci.appveyor.com/project

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026760#comment-16026760 ] Felix Cheung commented on SPARK-20877: -- ok, I will track down the test run time on windows

[jira] [Comment Edited] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025861#comment-16025861 ] Felix Cheung edited comment on SPARK-20877 at 5/26/17 6:10 AM: --- One run

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025861#comment-16025861 ] Felix Cheung commented on SPARK-20877: -- One run with skip_on_cran was 27min <7min - tests Gi

[jira] [Resolved] (SPARK-20849) Document R DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-20849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20849. -- Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025800#comment-16025800 ] Felix Cheung commented on SPARK-20877: -- According to one run, in Jenkins, the build/run took 34 min

[jira] [Updated] (SPARK-20889) SparkR grouped documentation for Column methods

[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20889: - Labels: documentation (was: ) > SparkR grouped documentation for Column meth

[jira] [Updated] (SPARK-20889) SparkR grouped documentation for Column methods

[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20889: - Issue Type: Documentation (was: Improvement) > SparkR grouped documentation for Column meth

[jira] [Created] (SPARK-20877) Investigate if tests will time out on CRAN

Felix Cheung created SPARK-20877: Summary: Investigate if tests will time out on CRAN Key: SPARK-20877 URL: https://issues.apache.org/jira/browse/SPARK-20877 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023343#comment-16023343 ] Felix Cheung commented on SPARK-20815: -- Thanks Sean > NullPointerException in RPackageUt

[jira] [Assigned] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-20815: Assignee: James Shuster > NullPointerException in RPackageUtils#checkManifestF

[jira] [Resolved] (SPARK-20727) Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

[ https://issues.apache.org/jira/browse/SPARK-20727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20727. -- Resolution: Fixed Assignee: Shivaram Venkataraman Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020673#comment-16020673 ] Felix Cheung commented on SPARK-20307: -- Thanks Miao! + [~actuaryzhang]who has been working

[jira] [Comment Edited] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020656#comment-16020656 ] Felix Cheung edited comment on SPARK-20815 at 5/23/17 4:48 AM: --- [~srowen

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020656#comment-16020656 ] Felix Cheung commented on SPARK-20815: -- [~srowen] could you help add jrshust to contributor list? I

[jira] [Resolved] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20815. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 Target

[jira] [Resolved] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-15767. -- Resolution: Fixed Fix Version/s: 2.3.0 > Decision Tree Regression wrapper in Spa

[jira] [Assigned] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-15767: Assignee: zhengruifeng (was: Kai Jiang) > Decision Tree Regression wrapper in Spa

[jira] [Resolved] (SPARK-20736) PySpark StringIndexer supports StringOrderType

[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20736. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18825: - There might be some delicacy here since this might need to work without an external script when we

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018314#comment-16018314 ] Felix Cheung commented on SPARK-18825: -- handling a fork of knitr might be too hard to maintain

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018313#comment-16018313 ] Felix Cheung commented on SPARK-18825: -- I see about dontrun - yes, I don't think we could remove

[jira] [Updated] (SPARK-20727) Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

[ https://issues.apache.org/jira/browse/SPARK-20727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20727: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Skip SparkR tests when miss

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018300#comment-16018300 ] Felix Cheung commented on SPARK-20815: -- make sense to me. would you like to contribute the fix

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017699#comment-16017699 ] Felix Cheung commented on SPARK-18825: -- interesting - do you think knitr can take your change

[jira] [Updated] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19568: - Certainly - we recognize the problem with SparkR not published in CRAN and have been actively

[jira] [Resolved] (SPARK-20726) R wrapper for SQL broadcast

[ https://issues.apache.org/jira/browse/SPARK-20726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20726. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009830#comment-16009830 ] Felix Cheung edited comment on SPARK-19568 at 5/14/17 7:37 PM: --- I checked

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009831#comment-16009831 ] Felix Cheung commented on SPARK-19568: -- .. based on that, I might just resolve this bug

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009830#comment-16009830 ] Felix Cheung commented on SPARK-19568: -- I checked the Rd files are generated and included

[jira] [Resolved] (SPARK-20704) CRAN test should run single threaded

[ https://issues.apache.org/jira/browse/SPARK-20704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20704. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20619) StringIndexer supports multiple ways of label ordering

[ https://issues.apache.org/jira/browse/SPARK-20619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20619. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20512) SparkR 2.2 QA: Programming guide, migration guide, vignettes updates

[ https://issues.apache.org/jira/browse/SPARK-20512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006951#comment-16006951 ] Felix Cheung commented on SPARK-20512: -- I did a QA pass on the R vignettes > SparkR 2.2

[jira] [Created] (SPARK-20704) CRAN test should run single threaded

Felix Cheung created SPARK-20704: Summary: CRAN test should run single threaded Key: SPARK-20704 URL: https://issues.apache.org/jira/browse/SPARK-20704 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20590) Map default input data source formats to inlined classes

[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005864#comment-16005864 ] Felix Cheung commented on SPARK-20590: -- When the user explicitly specifies the package to use

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only,-> seems like in ot

[jira] [Resolved] (SPARK-20670) Simplify FPGrowth transform

[ https://issues.apache.org/jira/browse/SPARK-20670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20670. -- Resolution: Fixed Assignee: yuhao yang Fix Version/s: 2.3.0 Target

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Updated] (SPARK-20689) python doctest leaking bucketed table

[ https://issues.apache.org/jira/browse/SPARK-20689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20689: - Description: When trying to address build test failure in SPARK-20661 we discovered some tables

[jira] [Created] (SPARK-20689) python doctest leaking bucketed table

Felix Cheung created SPARK-20689: Summary: python doctest leaking bucketed table Key: SPARK-20689 URL: https://issues.apache.org/jira/browse/SPARK-20689 Project: Spark Issue Type: Bug

Re: Hive Reserve Keyword support

I think you can put backticks around the name date https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL From: Jongyoul Lee Sent: Tuesday, May 9, 2017 10:33:50 AM To: users@zeppelin.apache.org Subject: Re: Hive Reserve Keyword

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Summary: Flaky test - SparkListenerBus randomly failing on Windows (was: Flaky test - random ml

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Summary: Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError on Windows

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only, always only when running

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Component/s: Spark Core > Flaky test - SparkListenerBus randomly failing on Wind

[jira] [Updated] (SPARK-20666) Flaky test - random ml test failure on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only {code} Exception

[jira] [Created] (SPARK-20666) Flaky test - random ml test failure on Windows

Felix Cheung created SPARK-20666: Summary: Flaky test - random ml test failure on Windows Key: SPARK-20666 URL: https://issues.apache.org/jira/browse/SPARK-20666 Project: Spark Issue Type

[jira] [Updated] (SPARK-20666) Flaky test - random ml test failure on Windows

[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20666: - Description: seeing quite a bit of this on AppVeyor, aka Windows only {code

[jira] [Resolved] (SPARK-20550) R wrappers for Dataset.alias

[ https://issues.apache.org/jira/browse/SPARK-20550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20550. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20626) Fix SparkR test warning on Windows with timestamp time zone

[ https://issues.apache.org/jira/browse/SPARK-20626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20626. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-20626) Fix SparkR test warning on Windows with timestamp time zone

[ https://issues.apache.org/jira/browse/SPARK-20626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20626: - Summary: Fix SparkR test warning on Windows with timestamp time zone (was: Fix SparkR test

[jira] [Created] (SPARK-20626) Fix SparkR test on Windows with timestamp time zone

Felix Cheung created SPARK-20626: Summary: Fix SparkR test on Windows with timestamp time zone Key: SPARK-20626 URL: https://issues.apache.org/jira/browse/SPARK-20626 Project: Spark Issue

[jira] [Created] (SPARK-20625) SQL test running on Windows hadoop command warning

Felix Cheung created SPARK-20625: Summary: SQL test running on Windows hadoop command warning Key: SPARK-20625 URL: https://issues.apache.org/jira/browse/SPARK-20625 Project: Spark Issue

[jira] [Resolved] (SPARK-20614) Use the same log4j configuration with Jenkins in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-20614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20614. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20520) R streaming tests failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999252#comment-15999252 ] Felix Cheung commented on SPARK-20520: -- waiting for the next RC to try with fix for SPARK-20571 >

[jira] [Commented] (SPARK-20613) Double quotes in Windows batch script

[ https://issues.apache.org/jira/browse/SPARK-20613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998474#comment-15998474 ] Felix Cheung commented on SPARK-20613: -- [~shivaram]could you add jarretmeyer to contributor list

[jira] [Resolved] (SPARK-20613) Double quotes in Windows batch script

[ https://issues.apache.org/jira/browse/SPARK-20613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20613. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0

[jira] [Resolved] (SPARK-20257) Fix test for directory created to work when running as R CMD check

[ https://issues.apache.org/jira/browse/SPARK-20257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20257. -- Resolution: Not A Problem Assignee: Felix Cheung We have disabled this test on CRAN, so

[jira] [Resolved] (SPARK-20015) Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

[ https://issues.apache.org/jira/browse/SPARK-20015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20015. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 Target

[jira] [Resolved] (SPARK-20571) Flaky SparkR StructuredStreaming tests

[ https://issues.apache.org/jira/browse/SPARK-20571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20571. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 Target

[jira] [Commented] (SPARK-20571) Flaky SparkR StructuredStreaming tests

[ https://issues.apache.org/jira/browse/SPARK-20571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996390#comment-15996390 ] Felix Cheung commented on SPARK-20571: -- done. will monitor tests for a couple of days > Fl

<    9   10   11   12   13   14   15   16   17   18   >