[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Description: See title says {{asc {SparkR}}}

[jira] [Updated] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

[ https://issues.apache.org/jira/browse/SPARK-23073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23073: - Attachment: Screen Shot 2018-01-14 at 11.11.05 AM.png > Fix incorrect R doc page header for

[jira] [Created] (SPARK-23073) Fix incorrect R doc page header for generated sql functions

Felix Cheung created SPARK-23073: Summary: Fix incorrect R doc page header for generated sql functions Key: SPARK-23073 URL: https://issues.apache.org/jira/browse/SPARK-23073 Project: Spark

[jira] [Updated] (SPARK-23038) Update docker/spark-test (JDK/OS)

[ https://issues.apache.org/jira/browse/SPARK-23038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23038: - Fix Version/s: 2.4.0 > Update docker/spark-test (JDK/OS) > - > >

[jira] [Resolved] (SPARK-23038) Update docker/spark-test (JDK/OS)

[ https://issues.apache.org/jira/browse/SPARK-23038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23038. -- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-23069) R doc for describe missing text

[ https://issues.apache.org/jira/browse/SPARK-23069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23069: - Issue Type: Documentation (was: Bug) > R doc for describe missing text >

[jira] [Resolved] (SPARK-23063) Changes to publish the spark-kubernetes package

[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23063. -- Resolution: Fixed Assignee: Anirudh Ramanathan Fix Version/s: 2.3.0 > Changes

[jira] [Created] (SPARK-23069) R doc for describe missing text

Felix Cheung created SPARK-23069: Summary: R doc for describe missing text Key: SPARK-23069 URL: https://issues.apache.org/jira/browse/SPARK-23069 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325465#comment-16325465 ] Felix Cheung commented on SPARK-23065: -- I have checked the doc, looks good, but I have a few small

[jira] [Resolved] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-23065. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R API doc

[jira] [Created] (SPARK-23068) R doc build error does not fail build

Felix Cheung created SPARK-23068: Summary: R doc build error does not fail build Key: SPARK-23068 URL: https://issues.apache.org/jira/browse/SPARK-23068 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325400#comment-16325400 ] Felix Cheung commented on SPARK-23065: -- Something was definitely cached - not sure what since I have

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325229#comment-16325229 ] Felix Cheung commented on SPARK-23065: -- Was the Jekyll error failed the doc build? Just want to make

[jira] [Updated] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-23065: - Priority: Blocker (was: Major) > R API doc empty in Spark 2.3.0 RC1 >

[jira] [Created] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

Felix Cheung created SPARK-23065: Summary: R API doc empty in Spark 2.3.0 RC1 Key: SPARK-23065 URL: https://issues.apache.org/jira/browse/SPARK-23065 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319855#comment-16319855 ] Felix Cheung commented on SPARK-21727: -- good call... if ( (is.atomic(object) && !is.raw(object)) &&

[jira] [Resolved] (SPARK-22998) Value for SPARK_MOUNTED_CLASSPATH in executor pods is not set

[ https://issues.apache.org/jira/browse/SPARK-22998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22998. -- Resolution: Fixed Assignee: Yinan Li Target Version/s: 2.3.0 > Value for

[jira] [Commented] (SPARK-21293) R document update structured streaming

[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317805#comment-16317805 ] Felix Cheung commented on SPARK-21293: -- leaving it open for the rest of items > R document update

[jira] [Resolved] (SPARK-21292) R document Catalog function metadata refresh

[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21292. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R document

[jira] [Updated] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21290: - Target Version/s: (was: 2.3.0) > R document Programmatically Specifying the Schema in SQL

[jira] [Commented] (SPARK-21293) R document update structured streaming

[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317739#comment-16317739 ] Felix Cheung commented on SPARK-21293: -- not done: Join Operations Streaming Deduplication > R

[jira] [Commented] (SPARK-22918) sbt test (spark - local) fail after upgrading to 2.2.1 with: java.security.AccessControlException: access denied org.apache.derby.security.SystemPermission( "engine",

[ https://issues.apache.org/jira/browse/SPARK-22918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315438#comment-16315438 ] Felix Cheung commented on SPARK-22918: -- [~sameerag] we might want to check this for 2.3.0 release >

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315436#comment-16315436 ] Felix Cheung commented on SPARK-22632: -- yes, first I'd agree we should generalize this to R & Python

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315434#comment-16315434 ] Felix Cheung commented on SPARK-21727: -- I think we should use is.atomic(object) ? > Operating on

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310872#comment-16310872 ] Felix Cheung commented on SPARK-16693: -- I thought we did but I couldn't find any record. I suppose

[jira] [Resolved] (SPARK-22933) R Structured Streaming API for withWatermark, trigger, partitionBy

[ https://issues.apache.org/jira/browse/SPARK-22933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22933. -- Resolution: Fixed Fix Version/s: 2.3.0 Target Version/s: 2.3.0 > R Structured

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308367#comment-16308367 ] Felix Cheung commented on SPARK-16693: -- These are all non public methods, so officially not public

[jira] [Updated] (SPARK-14037) count(df) is very slow for dataframe constructed using SparkR::createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-14037: - Summary: count(df) is very slow for dataframe constructed using SparkR::createDataFrame (was:

[jira] [Commented] (SPARK-16366) Time comparison failures in SparkR unit tests

[ https://issues.apache.org/jira/browse/SPARK-16366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307728#comment-16307728 ] Felix Cheung commented on SPARK-16366: -- not 100% sure, but a a similar timestamp test failure was

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307725#comment-16307725 ] Felix Cheung commented on SPARK-16693: -- [~shivaram]we didn't do this, not sure if we should to get

[jira] [Commented] (SPARK-17762) invokeJava fails when serialized argument list is larger than INT_MAX (2,147,483,647) bytes

[ https://issues.apache.org/jira/browse/SPARK-17762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307724#comment-16307724 ] Felix Cheung commented on SPARK-17762: -- is this still needed after SPARK-17790 is fixed? >

[jira] [Created] (SPARK-22933) R Structured Streaming API for withWatermark, trigger, partitionBy

Felix Cheung created SPARK-22933: Summary: R Structured Streaming API for withWatermark, trigger, partitionBy Key: SPARK-22933 URL: https://issues.apache.org/jira/browse/SPARK-22933 Project: Spark

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Issue Type: Improvement (was: Bug) > ml model persistence creates a lot of small files >

[jira] [Updated] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22925: - Description: Today in when calling model.save(), some ML models we do makeRDD(data, 1) or

[jira] [Commented] (SPARK-22925) ml model persistence creates a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16306520#comment-16306520 ] Felix Cheung commented on SPARK-22925: --

[jira] [Created] (SPARK-22925) ml model persistence creates a lot of small files

Felix Cheung created SPARK-22925: Summary: ml model persistence creates a lot of small files Key: SPARK-22925 URL: https://issues.apache.org/jira/browse/SPARK-22925 Project: Spark Issue

[jira] [Created] (SPARK-22924) R DataFrame API for sortWithinPartitions

Felix Cheung created SPARK-22924: Summary: R DataFrame API for sortWithinPartitions Key: SPARK-22924 URL: https://issues.apache.org/jira/browse/SPARK-22924 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22920) R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

[ https://issues.apache.org/jira/browse/SPARK-22920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22920. -- Resolution: Fixed Assignee: Felix Cheung > R sql functions for current_date,

[jira] [Updated] (SPARK-22920) R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

[ https://issues.apache.org/jira/browse/SPARK-22920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22920: - Target Version/s: 2.3.0 Fix Version/s: 2.3.0 > R sql functions for current_date,

[jira] [Created] (SPARK-22920) R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

Felix Cheung created SPARK-22920: Summary: R sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString Key: SPARK-22920 URL: https://issues.apache.org/jira/browse/SPARK-22920

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305192#comment-16305192 ] Felix Cheung commented on SPARK-21616: -- SPARK-22315 > SparkR 2.3.0 migration guide, release note >

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305157#comment-16305157 ] Felix Cheung commented on SPARK-21727: -- [~neilalex] How it is going? > Operating on an ArrayType in

[jira] [Updated] (SPARK-22889) CRAN checks can fail if older Spark install exists

[ https://issues.apache.org/jira/browse/SPARK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22889: - Fix Version/s: 2.3.0 2.2.2 > CRAN checks can fail if older Spark install

[jira] [Resolved] (SPARK-22889) CRAN checks can fail if older Spark install exists

[ https://issues.apache.org/jira/browse/SPARK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22889. -- Resolution: Fixed Assignee: Shivaram Venkataraman Target Version/s:

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301717#comment-16301717 ] Felix Cheung commented on SPARK-22683: -- I think the challenge here is the ability to determine

[jira] [Comment Edited] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301709#comment-16301709 ] Felix Cheung edited comment on SPARK-22683 at 12/22/17 5:35 PM: I

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301709#comment-16301709 ] Felix Cheung commented on SPARK-22683: -- I couldn't find the exact source line, but from running

[jira] [Commented] (SPARK-22870) Dynamic allocation should allow 0 idle time

[ https://issues.apache.org/jira/browse/SPARK-22870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301701#comment-16301701 ] Felix Cheung commented on SPARK-22870: -- +1 yes there is more than the check for the value 0 as the

[jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301015#comment-16301015 ] Felix Cheung commented on SPARK-20007: -- any taker on this for 2.3.0? > Make SparkR apply()

[jira] [Commented] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301011#comment-16301011 ] Felix Cheung commented on SPARK-21076: -- any taker on this for 2.3.0? > R dapply doesn't return

[jira] [Updated] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21076: - Target Version/s: 2.3.0 > R dapply doesn't return array or raw columns when array have different

[jira] [Updated] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21291: - Target Version/s: 2.3.0 > R bucketBy partitionBy API > -- > >

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301006#comment-16301006 ] Felix Cheung commented on SPARK-22632: -- how are we on this for 2.3? > Fix the behavior of timestamp

[jira] [Updated] (SPARK-21940) Support timezone for timestamps in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21940: - Target Version/s: 2.3.0 > Support timezone for timestamps in SparkR >

[jira] [Updated] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22632: - Target Version/s: 2.3.0 > Fix the behavior of timestamp values for R's DataFrame to respect

[jira] [Updated] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20007: - Target Version/s: 2.3.0 > Make SparkR apply() functions robust to workers that return empty

[jira] [Updated] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21208: - Target Version/s: 2.3.0 > Ability to "setLocalProperty" from sc, in sparkR >

[jira] [Commented] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301012#comment-16301012 ] Felix Cheung commented on SPARK-21208: -- any taker on this for 2.3.0? > Ability to

[jira] [Updated] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21030: - Target Version/s: 2.3.0 > extend hint syntax to support any expression for Python and R >

[jira] [Commented] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301014#comment-16301014 ] Felix Cheung commented on SPARK-21030: -- any taker on this for 2.3.0? > extend hint syntax to

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301010#comment-16301010 ] Felix Cheung commented on SPARK-21291: -- any taker on this for 2.3.0? > R bucketBy partitionBy API >

[jira] [Commented] (SPARK-21940) Support timezone for timestamps in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301007#comment-16301007 ] Felix Cheung commented on SPARK-21940: -- any taker on this for 2.3.0? > Support timezone for

[jira] [Updated] (SPARK-22843) R localCheckpoint API

[ https://issues.apache.org/jira/browse/SPARK-22843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22843: - Target Version/s: 2.3.0 > R localCheckpoint API > - > > Key:

[jira] [Commented] (SPARK-22843) R localCheckpoint API

[ https://issues.apache.org/jira/browse/SPARK-22843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301005#comment-16301005 ] Felix Cheung commented on SPARK-22843: -- any taker on this for 2.3.0? > R localCheckpoint API >

[jira] [Commented] (SPARK-22766) Install R linter package in spark lib directory

[ https://issues.apache.org/jira/browse/SPARK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301003#comment-16301003 ] Felix Cheung commented on SPARK-22766: -- how is this vs SPARK-22063 ? > Install R linter

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300965#comment-16300965 ] Felix Cheung commented on SPARK-21727: -- Neil McQuarrie is going to work on this > Operating on an

[jira] [Assigned] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21727: Assignee: Neil McQuarrie > Operating on an ArrayType in a SparkR DataFrame throws error >

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300599#comment-16300599 ] Felix Cheung commented on SPARK-22851: -- Ah then it’s the browser - i know Safari does unpack it

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300338#comment-16300338 ] Felix Cheung commented on SPARK-22851: -- That’s odd. Mirror replication is handled transparently. If

[jira] [Created] (SPARK-22843) R localCheckpoint API

Felix Cheung created SPARK-22843: Summary: R localCheckpoint API Key: SPARK-22843 URL: https://issues.apache.org/jira/browse/SPARK-22843 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-22812) Failing cran-check on master

[ https://issues.apache.org/jira/browse/SPARK-22812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293648#comment-16293648 ] Felix Cheung commented on SPARK-22812: -- Not exactly... what’s the environment? Seems like something

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: (was: 2.2.1) > Flaky Test:

[jira] [Comment Edited] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung edited comment on SPARK-22472 at 12/1/17 7:09 AM: --- I guess

[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung commented on SPARK-22472: -- I guess it's too late to add to

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274029#comment-16274029 ] Felix Cheung commented on SPARK-22632: -- interesting re: timezone on macOS

[jira] [Updated] (SPARK-22637) CatalogImpl.refresh() has quadratic complexity for a view

[ https://issues.apache.org/jira/browse/SPARK-22637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22637: - Target Version/s: 2.2.2, 2.3.0 (was: 2.3.0) > CatalogImpl.refresh() has quadratic complexity

[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270178#comment-16270178 ] Felix Cheung commented on SPARK-22472: -- This is going out in 2.2.1 - do we need a rel note on this

[jira] [Commented] (SPARK-22627) Fix formatting of headers in configuration.html page

[ https://issues.apache.org/jira/browse/SPARK-22627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270169#comment-16270169 ] Felix Cheung commented on SPARK-22627: -- quite possibly this is related to jekyll changes.. yap this

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.2) 2.2.0 > Allow fetcher URIs to be

[jira] [Commented] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265584#comment-16265584 ] Felix Cheung commented on SPARK-22402: -- Any update on this one? > Allow fetcher URIs to be

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Fix Version/s: 2.2.1 > Fix setup of SPARK_HOME variable on Windows >

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > flaky test: CastSuite.SPARK-22500: cast

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > GenerateOrdering shouldn't change

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > Incorrect nested AND expression pushed

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > HiveWriterContainer passes null

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.1, 2.3.0 (was: 2.2.0, 2.3.0) > 64KB JVM bytecode limit problem with cast

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22549: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22550: - Target Version/s: 2.2.1, 2.3.0 > 64KB JVM bytecode limit problem with elt >

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22508: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22544: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > SQLTransformer.transform(inputDataFrame)

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with in >

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with least

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.1 (was: 2.2.2) > Coalesce and AtLeastNNonNulls can cause 64KB JVM

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

<    1   2   3   4   5   6   7   8   9   10   >