[jira] [Comment Edited] (SPARK-22817) Use fixed testthat version for SparkR tests in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-22817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365263#comment-16365263 ] Felix Cheung edited comment on SPARK-22817 at 2/15/18 9:13 AM: --- I should

[jira] [Commented] (SPARK-22817) Use fixed testthat version for SparkR tests in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-22817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365263#comment-16365263 ] Felix Cheung commented on SPARK-22817: -- I should have caught this - we need to fix the test because

Re: NullPointerException in paragraph when getting batched TableEnvironment

Does it work within the Flink Scala Shell? From: André Schütz Sent: Wednesday, February 14, 2018 4:02:30 AM To: us...@zeppelin.incubator.apache.org Subject: NullPointerException in paragraph when getting batched TableEnvironment Hi, within the

Re: SparkR test script issue: unable to run run-tests.h on spark 2.2

Yes it is issue with the newer release of testthat. To workaround could you install an earlier version with devtools? will follow up for a fix. _ From: Hyukjin Kwon Sent: Wednesday, February 14, 2018 6:49 PM Subject: Re: SparkR test script

[jira] [Commented] (SPARK-23285) Allow spark.executor.cores to be fractional

[ https://issues.apache.org/jira/browse/SPARK-23285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357755#comment-16357755 ] Felix Cheung commented on SPARK-23285: -- Aounds reasonable to me > Allow spark.executor.co

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351333#comment-16351333 ] Felix Cheung commented on SPARK-23314: -- I've isolated this down to this particular file [https

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351188#comment-16351188 ] Felix Cheung commented on SPARK-23314: -- Thanks. I have isolated this to a different subset of data

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350819#comment-16350819 ] Felix Cheung commented on SPARK-23314: -- Im running python 2 Pandas 0.22.0 Pyarrow 0.8.0 > Pan

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23314: - Description: Under  SPARK-22216 When testing pandas_udf on group bys, I saw this error

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23314: - Description: Under  SPARK-22216 When testing pandas_udf on group bys, I saw this error

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23314: - Description: Under  SPARK-22216 When testing pandas_udf on group bys, I saw this error

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349899#comment-16349899 ] Felix Cheung commented on SPARK-23314: -- [~icexelloss] [~bryanc] > Pandas grouped udf on data

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349898#comment-16349898 ] Felix Cheung commented on SPARK-23314: -- log [Stage 3

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349897#comment-16349897 ] Felix Cheung commented on SPARK-23314: -- code   >>> flights = spark.read.option("infe

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23314: - Environment: (was: data sample adshex,flight_id,latitude,longitude,altitude,speed,track

[jira] [Commented] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349896#comment-16349896 ] Felix Cheung commented on SPARK-23314: -- data sample adshex,flight_id,latitude,longitude,altitude

[jira] [Updated] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

[ https://issues.apache.org/jira/browse/SPARK-23314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23314: - Description: Under  SPARK-22216 When testing pandas_udf on group bys, I saw this error

[jira] [Created] (SPARK-23314) Pandas grouped udf on dataset with timestamp column error

Felix Cheung created SPARK-23314: Summary: Pandas grouped udf on dataset with timestamp column error Key: SPARK-23314 URL: https://issues.apache.org/jira/browse/SPARK-23314 Project: Spark

Re: data source v2 online meetup

+1 hangout From: Xiao Li Sent: Wednesday, January 31, 2018 10:46:26 PM To: Ryan Blue Cc: Reynold Xin; dev; Wenchen Fen; Russell Spitzer Subject: Re: data source v2 online meetup Hi, Ryan, wow, your Iceberg already used data source V2 API!

[jira] [Updated] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23291: - Shepherd: Felix Cheung (was: Hossein Falaki) > SparkR : substr : In SparkR dataframe , start

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342441#comment-16342441 ] Felix Cheung commented on SPARK-23114: -- Sure! > Spark R 2.3 QA umbre

[jira] [Resolved] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23114. -- Resolution: Fixed > Spark R 2.3 QA umbrella > --- > >

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342394#comment-16342394 ] Felix Cheung commented on SPARK-23114: -- Resolving. [~sameerag] please see release note above

[jira] [Resolved] (SPARK-23117) SparkR 2.3 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-23117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23117. -- Resolution: Won't Fix Assignee: Felix Cheung > SparkR 2.3 QA: Check for new R A

[jira] [Commented] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341232#comment-16341232 ] Felix Cheung commented on SPARK-23107: -- Thanks My bad RFormula does have a page https

[jira] [Commented] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340876#comment-16340876 ] Felix Cheung commented on SPARK-23107: -- We have never had any doc for it and it’s not new in 2.3.0

[jira] [Assigned] (SPARK-23200) Reset configuration when restarting from checkpoints

[ https://issues.apache.org/jira/browse/SPARK-23200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-23200: Assignee: Santiago Saavedra (was: Anirudh Ramanathan) > Reset configuration w

[jira] [Commented] (SPARK-23213) SparkR:::textFile(sc1,"/opt/test333") can not work on spark2.2.1

[ https://issues.apache.org/jira/browse/SPARK-23213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339748#comment-16339748 ] Felix Cheung commented on SPARK-23213: -- To clarify we don’t support RDD in R. Anything you access

[jira] [Commented] (SPARK-23213) SparkR:::textFile(sc1,"/opt/test333") can not work on spark2.2.1

[ https://issues.apache.org/jira/browse/SPARK-23213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339559#comment-16339559 ] Felix Cheung commented on SPARK-23213: -- If you have any specific on what you need - we should have

[jira] [Commented] (SPARK-23213) SparkR:::textFile(sc1,"/opt/test333") can not work on spark2.2.1

[ https://issues.apache.org/jira/browse/SPARK-23213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339522#comment-16339522 ] Felix Cheung commented on SPARK-23213: -- You can convert DataFrame into RDD But again textFile

[jira] [Commented] (SPARK-23213) SparkR:::textFile(sc1,"/opt/test333") can not work on spark2.2.1

[ https://issues.apache.org/jira/browse/SPARK-23213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338987#comment-16338987 ] Felix Cheung commented on SPARK-23213: -- Try read.text instead? [http://spark.apache.org/docs/latest

[jira] [Commented] (SPARK-23117) SparkR 2.3 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-23117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338043#comment-16338043 ] Felix Cheung commented on SPARK-23117: -- I'm ok to sign off if we don't have example for SPARK-20307

[jira] [Resolved] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23115. -- Resolution: Fixed Assignee: Felix Cheung > SparkR 2.3 QA: New R APIs and API d

[jira] [Commented] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337947#comment-16337947 ] Felix Cheung commented on SPARK-23115: -- done > SparkR 2.3 QA: New R APIs and API d

[jira] [Comment Edited] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333677#comment-16333677 ] Felix Cheung edited comment on SPARK-23115 at 1/24/18 7:17 AM: --- Another

[jira] [Resolved] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21727. -- Resolution: Fixed Fix Version/s: 2.4.0 2.3.0 Target

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts

[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336254#comment-16336254 ] Felix Cheung commented on SPARK-22522: -- It’s to the right place but not the supported plugin. It’s

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts

[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336204#comment-16336204 ] Felix Cheung commented on SPARK-22522: -- No it’s not done AFAIK > Convert to apache-rele

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335872#comment-16335872 ] Felix Cheung commented on SPARK-23114: -- I’m merely asking if anyone would have some real workload

[jira] [Comment Edited] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333712#comment-16333712 ] Felix Cheung edited comment on SPARK-23107 at 1/21/18 11:08 PM: We don't

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333733#comment-16333733 ] Felix Cheung commented on SPARK-21727: -- how are we doing? > Operating on an ArrayType in a Spa

[jira] [Comment Edited] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333730#comment-16333730 ] Felix Cheung edited comment on SPARK-23114 at 1/21/18 11:03 PM: [~falaki

[jira] [Comment Edited] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333725#comment-16333725 ] Felix Cheung edited comment on SPARK-23114 at 1/21/18 11:02 PM

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333730#comment-16333730 ] Felix Cheung commented on SPARK-23114: -- [~falaki] [~hyukjin.kwon] About SPARK-21093, do you think

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333725#comment-16333725 ] Felix Cheung commented on SPARK-23114: -- [~sameerag] Here are some ideas for the release notes

[jira] [Comment Edited] (SPARK-23117) SparkR 2.3 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-23117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333718#comment-16333718 ] Felix Cheung edited comment on SPARK-23117 at 1/21/18 10:47 PM: I did

[jira] [Commented] (SPARK-23116) SparkR 2.3 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-23116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333717#comment-16333717 ] Felix Cheung commented on SPARK-23116: -- I did a pass. > SparkR 2.3 QA: Update user guide for

[jira] [Resolved] (SPARK-23116) SparkR 2.3 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-23116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23116. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0 > SparkR 2.3

[jira] [Commented] (SPARK-23117) SparkR 2.3 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-23117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333718#comment-16333718 ] Felix Cheung commented on SPARK-23117: -- I did a pass, I think these could use an example, preferably

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333716#comment-16333716 ] Felix Cheung commented on SPARK-20307: -- I think [~wm624] if you have the time > SparkR: p

[jira] [Comment Edited] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333682#comment-16333682 ] Felix Cheung edited comment on SPARK-20307 at 1/21/18 10:40 PM: Hi Felix

[jira] [Commented] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333712#comment-16333712 ] Felix Cheung commented on SPARK-23107: -- We don't have doc on RFormula but it'll be good idea to also

[jira] [Comment Edited] (SPARK-20906) Constrained Logistic Regression for SparkR

[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333654#comment-16333654 ] Felix Cheung edited comment on SPARK-20906 at 1/21/18 10:30 PM: [~wm624

[jira] [Commented] (SPARK-23108) ML, Graph 2.3 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-23108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333708#comment-16333708 ] Felix Cheung commented on SPARK-23108: -- >From reviewing R, it would be good to document constrai

[jira] [Resolved] (SPARK-23118) SparkR 2.3 QA: Programming guide, migration guide, vignettes updates

[ https://issues.apache.org/jira/browse/SPARK-23118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23118. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0 > SparkR 2.3

[jira] [Commented] (SPARK-23118) SparkR 2.3 QA: Programming guide, migration guide, vignettes updates

[ https://issues.apache.org/jira/browse/SPARK-23118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333707#comment-16333707 ] Felix Cheung commented on SPARK-23118: -- for programming guide, perhaps  SPARK-20906 But it mostly

[jira] [Commented] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333677#comment-16333677 ] Felix Cheung commented on SPARK-23115: -- Another pass, we should add API doc for SPARK-20906

[jira] [Comment Edited] (SPARK-20906) Constrained Logistic Regression for SparkR

[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333654#comment-16333654 ] Felix Cheung edited comment on SPARK-20906 at 1/21/18 8:54 PM: --- [~wm624

[jira] [Updated] (SPARK-22208) Improve percentile_approx by not rounding up targetError and starting from index 0

[ https://issues.apache.org/jira/browse/SPARK-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22208: - Labels: releasenotes (was: ) > Improve percentile_approx by not rounding up targetEr

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333663#comment-16333663 ] Felix Cheung commented on SPARK-20307: -- for SPARK-20307 and SPARK-21381, do you think you can write

[jira] [Commented] (SPARK-22208) Improve percentile_approx by not rounding up targetError and starting from index 0

[ https://issues.apache.org/jira/browse/SPARK-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333659#comment-16333659 ] Felix Cheung commented on SPARK-22208: -- Is this documented in the SQL programming guide/ migration

[jira] [Commented] (SPARK-20906) Constrained Logistic Regression for SparkR

[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333654#comment-16333654 ] Felix Cheung commented on SPARK-20906: -- [~wm624] would you like to add example of this in the R

[jira] [Resolved] (SPARK-21293) R document update structured streaming

[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21293. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R docum

Re: Issue with multiple users running Spark

Should we have some doc on this? I think this could be a common problem From: Austin Heyne Sent: Monday, January 15, 2018 6:59:55 AM To: users@zeppelin.apache.org Subject: Re: Issue with multiple users running Spark Thanks Jeff and Michael for

[jira] [Commented] (SPARK-23118) SparkR 2.3 QA: Programming guide, migration guide, vignettes updates

[ https://issues.apache.org/jira/browse/SPARK-23118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328430#comment-16328430 ] Felix Cheung commented on SPARK-23118: -- did this and opened SPARK-21616 > SparkR 2.3

[jira] [Commented] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328422#comment-16328422 ] Felix Cheung commented on SPARK-23115: -- did this, and opened this https://issues.apache.org/jira

[jira] [Comment Edited] (SPARK-23115) SparkR 2.3 QA: New R APIs and API docs

[ https://issues.apache.org/jira/browse/SPARK-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328422#comment-16328422 ] Felix Cheung edited comment on SPARK-23115 at 1/17/18 8:01 AM: --- did

[jira] [Commented] (SPARK-23114) Spark R 2.3 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-23114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328419#comment-16328419 ] Felix Cheung commented on SPARK-23114: -- sure, [~josephkb] > Spark R 2.3 QA umbre

[jira] [Updated] (SPARK-23068) Jekyll doc build error does not fail build

[ https://issues.apache.org/jira/browse/SPARK-23068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23068: - Summary: Jekyll doc build error does not fail build (was: R doc build error does not fail build

[jira] [Updated] (SPARK-23068) Jekyll doc build error does not fail build

[ https://issues.apache.org/jira/browse/SPARK-23068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23068: - Component/s: Documentation > Jekyll doc build error does not fail bu

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Description: See title says {code} asc {SparkR} {code} https://dist.apache.org/repos/dist/dev

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Component/s: (was: SpakrR) SparkR > Fix incorrect R doc page hea

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Description: See title says {code} asc {SparkR} {code} https://dist.apache.org/repos/dist/dev

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Description: See title says {{asc {SparkR}}} https://dist.apache.org/repos/dist/dev/spark/v2.3.0

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Attachment: Screen Shot 2018-01-14 at 11.11.05 AM.png > Fix incorrect R doc page hea

[jira] [Created] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

Felix Cheung created SPARK-23073: Summary: Fix incorrect R doc page header for generated sql functions Key: SPARK-23073 URL: https://issues.apache.org/jira/browse/SPARK-23073 Project: Spark

[jira] [Updated] (SPARK-23038) Update docker/spark-test (JDK/OS)

[ https://issues.apache.org/jira/browse/SPARK-23038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23038: - Fix Version/s: 2.4.0 > Update docker/spark-test (JDK

[jira] [Resolved] (SPARK-23038) Update docker/spark-test (JDK/OS)

[ https://issues.apache.org/jira/browse/SPARK-23038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23038. -- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-23069) R doc for describe missing text

[ https://issues.apache.org/jira/browse/SPARK-23069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23069: - Issue Type: Documentation (was: Bug) > R doc for describe missing t

[jira] [Resolved] (SPARK-23063) Changes to publish the spark-kubernetes package

[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23063. -- Resolution: Fixed Assignee: Anirudh Ramanathan Fix Version/s: 2.3.0 > Chan

[jira] [Created] (SPARK-23069) R doc for describe missing text

Felix Cheung created SPARK-23069: Summary: R doc for describe missing text Key: SPARK-23069 URL: https://issues.apache.org/jira/browse/SPARK-23069 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325465#comment-16325465 ] Felix Cheung commented on SPARK-23065: -- I have checked the doc, looks good, but I have a few small

[jira] [Resolved] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23065. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R API

[jira] [Created] (SPARK-23068) R doc build error does not fail build

Felix Cheung created SPARK-23068: Summary: R doc build error does not fail build Key: SPARK-23068 URL: https://issues.apache.org/jira/browse/SPARK-23068 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325400#comment-16325400 ] Felix Cheung commented on SPARK-23065: -- Something was definitely cached - not sure what since I have

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325229#comment-16325229 ] Felix Cheung commented on SPARK-23065: -- Was the Jekyll error failed the doc build? Just want to make

[jira] [Updated] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23065: - Priority: Blocker (was: Major) > R API doc empty in Spark 2.3.0

[jira] [Created] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

Felix Cheung created SPARK-23065: Summary: R API doc empty in Spark 2.3.0 RC1 Key: SPARK-23065 URL: https://issues.apache.org/jira/browse/SPARK-23065 Project: Spark Issue Type: Bug

Re: Use Bokeh in Apache Zeppelin

Nice! Get this in https://github.com/apache/zeppelin/blob/master/docs/interpreter/python.md? From: Partridge, Lucas (GE Aviation) Sent: Wednesday, January 10, 2018 2:27:19 AM To: Jeff Zhang Cc: users@zeppelin.apache.org Subject: Use Bokeh

Re: py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet

java.nio.BufferUnderflowException Can you try reading the same data in Scala? From: Liana Napalkova Sent: Wednesday, January 10, 2018 12:04:00 PM To: Timur Shenkao Cc: user@spark.apache.org Subject: Re: py4j.protocol.Py4JJavaError:

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319855#comment-16319855 ] Felix Cheung commented on SPARK-21727: -- good call... if ( (is.atomic(object) && !is.ra

[jira] [Resolved] (SPARK-22998) Value for SPARK_MOUNTED_CLASSPATH in executor pods is not set

[ https://issues.apache.org/jira/browse/SPARK-22998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22998. -- Resolution: Fixed Assignee: Yinan Li Target Version/s: 2.3.0 > Va

Re: Integration testing and Scheduler Backends

How would (2) be uncommon elsewhere? On Mon, Jan 8, 2018 at 10:16 PM Anirudh Ramanathan wrote: > This is with regard to the Kubernetes Scheduler Backend and scaling the > process to accept contributions. Given we're moving past upstreaming > changes from our fork, and into

[jira] [Commented] (SPARK-21293) R document update structured streaming

[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317805#comment-16317805 ] Felix Cheung commented on SPARK-21293: -- leaving it open for the rest of items > R document upd

[jira] [Resolved] (SPARK-21292) R document Catalog function metadata refresh

[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21292. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R docum

[jira] [Updated] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21290: - Target Version/s: (was: 2.3.0) > R document Programmatically Specifying the Schema in

[jira] [Commented] (SPARK-21293) R document update structured streaming

[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317739#comment-16317739 ] Felix Cheung commented on SPARK-21293: -- not done: Join Operations Streaming Deduplication >

Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0

And Hadoop-3.x is not part of the release and sign off for 2.2.1. Maybe we could update the website to avoid any confusion with "later". From: Josh Rosen Sent: Monday, January 8, 2018 10:17:14 AM To: akshay naidu Cc: Saisai Shao; Raj

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315438#comment-16315438 ] Felix Cheung commented on SPARK-22918: -- [~sameerag] we might want to check this for 2.3.0 release

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315436#comment-16315436 ] Felix Cheung commented on SPARK-22632: -- yes, first I'd agree we should generalize this to R & Py

<    4   5   6   7   8   9   10   11   12   13   >