[jira] [Commented] (SPARK-20684) expose createOrReplaceGlobalTempView/createGlobalTempView and dropGlobalTempView in SparkR

[ https://issues.apache.org/jira/browse/SPARK-20684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166801#comment-17166801 ] Felix Cheung commented on SPARK-20684: --

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung edited comment on SPARK-12172 at 7/29/20, 1:20 AM: These

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung edited comment on SPARK-12172 at 7/29/20, 1:19 AM: These

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166581#comment-17166581 ] Felix Cheung commented on SPARK-12172: -- These are methods (map etc) that were never public and not

[jira] [Updated] (SPARK-29042) Sampling-based RDD with unordered input should be INDETERMINATE

[ https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-29042: - Labels: correctness (was: ) > Sampling-based RDD with unordered input should be INDETERMINATE

[jira] [Commented] (SPARK-27495) SPIP: Support Stage level resource configuration and scheduling

[ https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920479#comment-16920479 ] Felix Cheung commented on SPARK-27495: -- +1 on this.   I've reviewed this. A few

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920476#comment-16920476 ] Felix Cheung commented on SPARK-28594: -- Reviewed. looks reasonable to me. I can help shepherd this

[jira] [Updated] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-28594: - Shepherd: Felix Cheung > Allow event logs for running streaming apps to be rolled over. >

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838188#comment-16838188 ] Felix Cheung commented on SPARK-21367: -- great thx! > R older version of Roxygen2 on Jenkins >

[jira] [Commented] (SPARK-27684) Reduce ScalaUDF conversion overheads for primitives

[ https://issues.apache.org/jira/browse/SPARK-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838187#comment-16838187 ] Felix Cheung commented on SPARK-27684: -- definitely could be interesting.. > Reduce ScalaUDF

[jira] [Updated] (SPARK-21805) disable R vignettes code on Windows

[ https://issues.apache.org/jira/browse/SPARK-21805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21805: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > disable R vignettes code on

[jira] [Updated] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22344: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Prevent R CMD check from using

[jira] [Updated] (SPARK-24535) Fix java version parsing in SparkR on Windows

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24535: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > Fix java version parsing in

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > SparkR tests failed on CRAN on

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Issue Type: Sub-task (was: Bug) Parent: SPARK-15799 > SparkR vignette fails on CRAN on

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811654#comment-16811654 ] Felix Cheung commented on SPARK-15799: -- more fixed for this (did not open JIRA)

[jira] [Resolved] (SPARK-26910) Re-release SparkR to CRAN

[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26910. -- Resolution: Fixed Fix Version/s: 2.4.1 2.4.1. released 

[jira] [Commented] (SPARK-27389) pyspark test failures w/ "UnknownTimeZoneError: 'US/Pacific-New'"

[ https://issues.apache.org/jira/browse/SPARK-27389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811461#comment-16811461 ] Felix Cheung commented on SPARK-27389: -- maybe a new JDK changes TimeZone? > pyspark test failures

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792120#comment-16792120 ] Felix Cheung commented on SPARK-26910: -- 2.3.3 failed. we are waiting for 2.4.1 to be released >

[jira] [Commented] (SPARK-26604) Register channel for stream request

[ https://issues.apache.org/jira/browse/SPARK-26604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786397#comment-16786397 ] Felix Cheung commented on SPARK-26604: -- could we backport this to branch-2.4? > Register channel

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung edited comment on SPARK-26918 at 3/5/19 5:47 AM: --

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung commented on SPARK-26918: -- [~rmsm...@gmail.com] - you don't need to checkout a tag -

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782565#comment-16782565 ] Felix Cheung commented on SPARK-26918: -- [~srowen] what do you think? > All .md should have ASF

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782564#comment-16782564 ] Felix Cheung commented on SPARK-26918: -- I'm for doing this (Reopen this issue) Also

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776080#comment-16776080 ] Felix Cheung edited comment on SPARK-26918 at 2/24/19 12:36 AM:

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776080#comment-16776080 ] Felix Cheung commented on SPARK-26918: -- actually, it does - it's a comment in ASF incubator that

[jira] [Created] (SPARK-26918) All .md should have ASF license header

Felix Cheung created SPARK-26918: Summary: All .md should have ASF license header Key: SPARK-26918 URL: https://issues.apache.org/jira/browse/SPARK-26918 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26918: - Description: per policy, all md files should have the header, like eg.

[jira] [Updated] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26918: - Description: per policy, all md files should have the header, like eg.

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771496#comment-16771496 ] Felix Cheung commented on SPARK-26910: -- 2.3.3 has been submitted to CRAN. we are currently waiting

[jira] [Commented] (SPARK-26910) Re-release SparkR to CRAN

[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771498#comment-16771498 ] Felix Cheung commented on SPARK-26910: -- once that works we should look into 2.4.1 > Re-release

[jira] [Assigned] (SPARK-26910) Re-release SparkR to CRAN

[ https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26910: Assignee: Felix Cheung > Re-release SparkR to CRAN > - > >

[jira] [Commented] (SPARK-26858) Vectorized gapplyCollect, Arrow optimization in native R function execution

[ https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771494#comment-16771494 ] Felix Cheung commented on SPARK-26858: -- If I understand, this is the case where Spark actually

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767935#comment-16767935 ] Felix Cheung commented on SPARK-26855: -- possibly. sounds like there are more cases like this, and

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765759#comment-16765759 ] Felix Cheung commented on SPARK-26855: -- IMO we have two options: # document tests only pass after

[jira] [Updated] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26855: - Description: SparkSubmitSuite "include an external JAR in SparkR" fails consistently but the

[jira] [Created] (SPARK-26855) SparkSubmitSuite fails on a clean build

Felix Cheung created SPARK-26855: Summary: SparkSubmitSuite fails on a clean build Key: SPARK-26855 URL: https://issues.apache.org/jira/browse/SPARK-26855 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26762) Arrow optimization for conversion from Spark DataFrame to R DataFrame

[ https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764092#comment-16764092 ] Felix Cheung commented on SPARK-26762: -- does this include head, take etc? > Arrow optimization for

[jira] [Comment Edited] (SPARK-26762) Arrow optimization for conversion from Spark DataFrame to R DataFrame

[ https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764092#comment-16764092 ] Felix Cheung edited comment on SPARK-26762 at 2/9/19 7:35 AM: -- does this

[jira] [Assigned] (SPARK-26603) Update minikube backend in K8s integration tests

[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26603: Assignee: Stavros Kontopoulos > Update minikube backend in K8s integration tests >

[jira] [Resolved] (SPARK-26603) Update minikube backend in K8s integration tests

[ https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26603. -- Resolution: Fixed Fix Version/s: 3.0.0 > Update minikube backend in K8s integration

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750751#comment-16750751 ] Felix Cheung commented on SPARK-24615: -- We are interested to know as well.   [~mengxr] touched on

[jira] [Commented] (SPARK-26679) Deconflict spark.executor.pyspark.memory and spark.python.worker.memory

[ https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750696#comment-16750696 ] Felix Cheung commented on SPARK-26679: -- I find the fraction configs very confusing and there are

[jira] [Assigned] (SPARK-26642) Add --num-executors option to spark-submit for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-26642: Assignee: Luca Canali > Add --num-executors option to spark-submit for Spark on K8S >

[jira] [Resolved] (SPARK-26642) Add --num-executors option to spark-submit for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26642. -- Resolution: Fixed Fix Version/s: 3.0.0 > Add --num-executors option to spark-submit

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742845#comment-16742845 ] Felix Cheung commented on SPARK-26565: -- ok AFAIK the first `cannot stat` is from this line  

[jira] [Updated] (SPARK-26120) Fix a streaming query leak in Structured Streaming R tests

[ https://issues.apache.org/jira/browse/SPARK-26120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26120: - Fix Version/s: 2.3.3 > Fix a streaming query leak in Structured Streaming R tests >

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741453#comment-16741453 ] Felix Cheung commented on SPARK-26565: -- Yeah, my point wasn’t to allow access to unsigned release

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Fix Version/s: 2.3.3 > SparkR tests failed on CRAN on Java 10 >

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Fix Version/s: 2.3.3 > SparkR vignette fails on CRAN on Java 11 >

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Description: This ticket tracks an SPIP to improve model load time and model serving

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Target Version/s: 3.0.0 (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Online

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Fix Version/s: (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Online Serving >

[jira] [Resolved] (SPARK-26189) Fix the doc of unionAll in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26189. -- Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 3.0.0

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701505#comment-16701505 ] Felix Cheung commented on SPARK-21291: -- hmm, ok > R bucketBy partitionBy API >

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700743#comment-16700743 ] Felix Cheung commented on SPARK-21291: -- I think we need to reopen this Jira since bucketBy is not

[jira] [Commented] (SPARK-24255) Require Java 8 in SparkR description

[ https://issues.apache.org/jira/browse/SPARK-24255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684668#comment-16684668 ] Felix Cheung commented on SPARK-24255: -- [~shivaram] I'm thinking if this is handling all version

[jira] [Resolved] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-26010. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 3.0.0

[jira] [Created] (SPARK-26010) SparkR vignette fails on Java 11

Felix Cheung created SPARK-26010: Summary: SparkR vignette fails on Java 11 Key: SPARK-26010 URL: https://issues.apache.org/jira/browse/SPARK-26010 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Summary: SparkR vignette fails on CRAN on Java 11 (was: SparkR vignette fails on Java 11) >

[jira] [Commented] (SPARK-25995) sparkR should ensure user args are after the argument used for the port

[ https://issues.apache.org/jira/browse/SPARK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682762#comment-16682762 ] Felix Cheung commented on SPARK-25995: -- sparkR is just taking the whole string as-is

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674216#comment-16674216 ] Felix Cheung commented on SPARK-25923: -- thanks - what's the exchange required with CRAN admin? >

[jira] [Resolved] (SPARK-25859) add scala/java/python example and doc for PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-25859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25859. -- Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 2.4.0

[jira] [Resolved] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-16693. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 3.0.0 > Remove R

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665908#comment-16665908 ] Felix Cheung commented on SPARK-12172: -- sounds good > Consider removing SparkR internal RDD APIs >

[jira] [Resolved] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-15545. -- Resolution: Duplicate > R remove non-exported unused methods, like jsonRDD >

[jira] [Updated] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-15545: - Affects Version/s: 2.3.2 External issue ID: SPARK-12172 > R remove non-exported unused

[jira] [Comment Edited] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664631#comment-16664631 ] Felix Cheung edited comment on SPARK-12172 at 10/26/18 4:11 AM: ok,

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664631#comment-16664631 ] Felix Cheung commented on SPARK-12172: -- ok, what's our option for spark.lapply? > Consider

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664628#comment-16664628 ] Felix Cheung commented on SPARK-16611: -- ping - we are going to consider removing RDD methods in

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664630#comment-16664630 ] Felix Cheung commented on SPARK-16611: -- see SPARK-12172 > Expose several hidden DataFrame/RDD

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664626#comment-16664626 ] Felix Cheung commented on SPARK-16693: -- rebuilt this on spark 3.0.0 > Remove R deprecated methods

[jira] [Updated] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16693: - Description: For methods deprecated in Spark 2.0.0, we should remove them in 2.1.0 -> 3.0.0

[jira] [Resolved] (SPARK-24572) "eager execution" for R shell, IDE

[ https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24572. -- Resolution: Fixed Assignee: Weiqiang Zhuang Fix Version/s: 3.0.0

[jira] [Resolved] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

[ https://issues.apache.org/jira/browse/SPARK-24516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24516. -- Resolution: Fixed Assignee: Ilan Filonenko Fix Version/s: 3.0.0

[jira] [Comment Edited] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658377#comment-16658377 ] Felix Cheung edited comment on SPARK-22947 at 10/21/18 8:53 PM: so

[jira] [Commented] (SPARK-22947) SPIP: as-of join in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658377#comment-16658377 ] Felix Cheung commented on SPARK-22947: -- so what's our take on this? it seems quite useful for time

[jira] [Resolved] (SPARK-24207) PrefixSpan: R API

[ https://issues.apache.org/jira/browse/SPARK-24207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-24207. -- Resolution: Fixed Fix Version/s: 3.0.0 > PrefixSpan: R API > - > >

[jira] [Assigned] (SPARK-24207) PrefixSpan: R API

[ https://issues.apache.org/jira/browse/SPARK-24207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-24207: Assignee: Huaxin Gao > PrefixSpan: R API > - > > Key:

[jira] [Commented] (SPARK-25634) New Metrics in External Shuffle Service to help identify abusing application

[ https://issues.apache.org/jira/browse/SPARK-25634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658343#comment-16658343 ] Felix Cheung commented on SPARK-25634: -- how about off-heap and netty buffer usage? > New Metrics

[jira] [Resolved] (SPARK-25675) [Spark Job History] Job UI page does not show pagination with one page

[ https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25675. -- Resolution: Fixed Fix Version/s: 3.0.0 > [Spark Job History] Job UI page does not show

[jira] [Assigned] (SPARK-25675) [Spark Job History] Job UI page does not show pagination with one page

[ https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-25675: Assignee: Shivu Sondur > [Spark Job History] Job UI page does not show pagination with

[jira] [Updated] (SPARK-25730) Kubernetes scheduler tries to read pod details that it just deleted

[ https://issues.apache.org/jira/browse/SPARK-25730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25730: - Affects Version/s: (was: 2.5.0) > Kubernetes scheduler tries to read pod details that it

[jira] [Assigned] (SPARK-25730) Kubernetes scheduler tries to read pod details that it just deleted

[ https://issues.apache.org/jira/browse/SPARK-25730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-25730: Assignee: Mike Kaplinskiy > Kubernetes scheduler tries to read pod details that it just

[jira] [Resolved] (SPARK-25730) Kubernetes scheduler tries to read pod details that it just deleted

[ https://issues.apache.org/jira/browse/SPARK-25730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25730. -- Resolution: Fixed Fix Version/s: 3.0.0 > Kubernetes scheduler tries to read pod

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Description: follow up to SPARK-24255 from 2.3.2 release we can see that CRAN doesn't seem to

[jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633129#comment-16633129 ] Felix Cheung commented on SPARK-25572: -- [~cloud_fan] while not a blocker, it would be great to

[jira] [Commented] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633130#comment-16633130 ] Felix Cheung commented on SPARK-25572: -- [~shivaram] > SparkR tests failed on CRAN on Java 10 >

[jira] [Resolved] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-25572. -- Resolution: Fixed Fix Version/s: 2.5.0 2.4.1 Target

[jira] [Updated] (SPARK-25572) SparkR tests failed on CRAN on Java 10

[ https://issues.apache.org/jira/browse/SPARK-25572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-25572: - Summary: SparkR tests failed on CRAN on Java 10 (was: SparkR to skip tests because Java 10) >

[jira] [Created] (SPARK-25572) SparkR to skip tests because Java 10

Felix Cheung created SPARK-25572: Summary: SparkR to skip tests because Java 10 Key: SPARK-25572 URL: https://issues.apache.org/jira/browse/SPARK-25572 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630410#comment-16630410 ] Felix Cheung commented on SPARK-21291: -- Wait. I don’t think saveAsTable is the same thing? > R

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628721#comment-16628721 ] Felix Cheung commented on SPARK-21291: -- The PR did not have bucketBy? > R bucketBy partitionBy

[jira] [Resolved] (SPARK-23648) extend hint syntax to support any expression for R

[ https://issues.apache.org/jira/browse/SPARK-23648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23648. -- Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 2.5.0 > extend hint

[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE

[ https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617120#comment-16617120 ] Felix Cheung commented on SPARK-24572: -- thanks! very close -  showDF doesn't return anything so we

[jira] [Comment Edited] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617118#comment-16617118 ] Felix Cheung edited comment on SPARK-21291 at 9/17/18 6:07 AM: --- I think it

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617118#comment-16617118 ] Felix Cheung commented on SPARK-21291: -- I think it should be like this one  

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613994#comment-16613994 ] Felix Cheung commented on SPARK-21291: -- No, you wouldn’t return a writer in R. I will reply with

[jira] [Commented] (SPARK-23200) Reset configuration when restarting from checkpoints

[ https://issues.apache.org/jira/browse/SPARK-23200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610089#comment-16610089 ] Felix Cheung commented on SPARK-23200: -- probably need someone to rebuild on the current config

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610083#comment-16610083 ] Felix Cheung commented on SPARK-22632: -- mismatch between R and JVM time zone could be an issue but

  1   2   3   4   5   6   7   8   9   10   >