[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.1 (was: 2.2.2) > Coalesce and AtLeastNNonNulls can cause 64KB JVM

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with in >

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with least

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.1, 2.3.0 (was: 2.2.0, 2.3.0) > 64KB JVM bytecode limit problem with cast

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > HiveWriterContainer passes null

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > Incorrect nested AND expression pushed

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > GenerateOrdering shouldn't change

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > flaky test: CastSuite.SPARK-22500: cast

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Fix Version/s: 2.2.1 > Fix setup of SPARK_HOME variable on Windows >

[jira] [Commented] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265584#comment-16265584 ] Felix Cheung commented on SPARK-22402: -- Any update on this one? > Allow fetcher URIs to be

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.2) 2.2.0 > Allow fetcher URIs to be

[jira] [Commented] (SPARK-22627) Fix formatting of headers in configuration.html page

2017-11-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270169#comment-16270169 ] Felix Cheung commented on SPARK-22627: -- quite possibly this is related to jekyll changes.. yap this

[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

2017-11-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270178#comment-16270178 ] Felix Cheung commented on SPARK-22472: -- This is going out in 2.2.1 - do we need a rel note on this

[jira] [Updated] (SPARK-22637) CatalogImpl.refresh() has quadratic complexity for a view

2017-11-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22637: - Target Version/s: 2.2.2, 2.3.0 (was: 2.3.0) > CatalogImpl.refresh() has quadratic complexity

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

2017-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: (was: 2.2.1) > Flaky Test:

[jira] [Commented] (SPARK-22472) Datasets generate random values for null primitive types

2017-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung commented on SPARK-22472: -- I guess it's too late to add to

[jira] [Comment Edited] (SPARK-22472) Datasets generate random values for null primitive types

2017-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274042#comment-16274042 ] Felix Cheung edited comment on SPARK-22472 at 12/1/17 7:09 AM: --- I guess

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

2017-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274029#comment-16274029 ] Felix Cheung commented on SPARK-22632: -- interesting re: timezone on macOS

[jira] [Commented] (SPARK-22812) Failing cran-check on master

2017-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293648#comment-16293648 ] Felix Cheung commented on SPARK-22812: -- Not exactly... what’s the environment? Seems like something

[jira] [Created] (SPARK-22843) R localCheckpoint API

2017-12-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22843: Summary: R localCheckpoint API Key: SPARK-22843 URL: https://issues.apache.org/jira/browse/SPARK-22843 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247884#comment-16247884 ] Felix Cheung commented on SPARK-21693: -- let's continue this conversation. >From the first link on

[jira] [Resolved] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22344. -- Resolution: Fixed Assignee: Shivaram Venkataraman Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250589#comment-16250589 ] Felix Cheung commented on SPARK-22471: -- yes, RC1 has been cut. > SQLListener consumes much memory

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.3.0 > Update maven central repo address > -

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Fix Version/s: (was: 2.2.1) 2.2.2 > SQLListener consumes much memory

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.2 (was: 2.2.1) > ReorderJoinPredicates can break when child's

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.2 > SQLListener consumes much memory causing OutOfMemoryError >

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.2.2 > Update maven central repo address > -

[jira] [Updated] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21245: - Affects Version/s: (was: 2.2.1) 2.2.2 > Resolve code duplication for

[jira] [Updated] (SPARK-21859) SparkFiles.get failed on driver in yarn-cluster and yarn-client mode

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21859: - Affects Version/s: (was: 2.2.1) > SparkFiles.get failed on driver in yarn-cluster and

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: 2.2.2 > PySpark doc has misleading string for SparkSession.builder >

[jira] [Updated] (SPARK-21098) Set lineseparator csv multiline and csv write to \n

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21098: - Affects Version/s: (was: 2.2.1) 2.2.2 > Set lineseparator csv

[jira] [Updated] (SPARK-21259) More rules for scalastyle

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21259: - Affects Version/s: (was: 2.2.1) 2.2.2 > More rules for scalastyle >

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.3.0 (was: 2.2.2) > ReorderJoinPredicates can break when child's

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Target Version/s: 2.2.1, 2.3.0 > Fix setup of SPARK_HOME variable on Windows >

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22543: - Target Version/s: 2.2.1, 2.3.0 > fix java 64kb compile error for deeply nested expressions >

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: 2.2.1 > Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite >

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with least and greatest >

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: (was: 2.2.2) > PySpark doc has misleading string for SparkSession.builder

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.3.0, 2.2.2 Fix Version/s: (was: 2.2.1) 2.2.2

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.2 > PythonRunner.MonitorThread should give the task a little time to

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.3.0, 2.2.2 (was: 2.2.2) > Accuracy problem in comparison with string and

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.2 > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.3.0, 2.2.2 > SaveIntoDataSourceCommand logs jdbc credentials >

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Target Version/s: 2.3.0, 2.2.2 > Update maven central repo address >

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.2 Fix Version/s: (was: 2.2.1) > Maven nightly snapshot jenkins

[jira] [Created] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22511: Summary: Update maven central repo address Key: SPARK-22511 URL: https://issues.apache.org/jira/browse/SPARK-22511 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19606. -- Resolution: Fixed Assignee: paul mackles Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248361#comment-16248361 ] Felix Cheung commented on SPARK-18136: -- is this still being targeted for 2.2.1? > Make PySpark pip

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248372#comment-16248372 ] Felix Cheung commented on SPARK-22042: -- any taker? is this a blocker for 2.2.1? >

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.1 > ReorderJoinPredicates can break when child's partitioning is not

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Fix Version/s: 2.3.0 2.2.1 2.1.3 > Make PySpark pip

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Affects Version/s: 2.3.0 2.1.2 2.2.0 Target

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248377#comment-16248377 ] Felix Cheung commented on SPARK-18136: -- thanks [~hyukjin.kwon] > Make PySpark pip install works on

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248364#comment-16248364 ] Felix Cheung commented on SPARK-22406: -- is this still being targeted for 2.2.1? > pyspark version

[jira] [Commented] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248365#comment-16248365 ] Felix Cheung commented on SPARK-22054: -- moving to 2.3.0 > Allow release managers to inject their

[jira] [Commented] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248366#comment-16248366 ] Felix Cheung commented on SPARK-22055: -- moving to 2.3.0 I think it would be great to make progress

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Port release scripts > > >

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Allow release managers to inject their keys >

[jira] [Assigned] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-18136: Assignee: Jakub Nowacki > Make PySpark pip install works on windows >

[jira] [Resolved] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21693. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249005#comment-16249005 ] Felix Cheung commented on SPARK-22042: -- since this is in 2.1.0 and 2.2.0, technically this isn't a

[jira] [Commented] (SPARK-22430) Unknown tag warnings when building R docs with Roxygen 6.0.1

2017-11-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237719#comment-16237719 ] Felix Cheung commented on SPARK-22430: -- I am seeing it too. I think we can just remove the tag but

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233762#comment-16233762 ] Felix Cheung commented on SPARK-22344: -- Maybe just delete the directory returned from

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233751#comment-16233751 ] Felix Cheung commented on SPARK-22344: -- Hmm yes we do have to know if it has just found it, or

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236103#comment-16236103 ] Felix Cheung commented on SPARK-22344: -- Yes to both. If SPARK_HOME is set before calling

[jira] [Resolved] (SPARK-22327) R CRAN check fails on non-latest branches

2017-11-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22327. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-22281) Handle R method breaking signature changes

2017-11-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22281. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19606: - Target Version/s: 2.2.1 > Support constraints in spark-dispatcher >

[jira] [Updated] (SPARK-22287) SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22287: - Target Version/s: 2.2.1 > SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher >

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080 ] Felix Cheung commented on SPARK-22344: -- this is what I see on a clean machine tracking

[jira] [Comment Edited] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080 ] Felix Cheung edited comment on SPARK-22344 at 10/26/17 7:25 AM: this is

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220083#comment-16220083 ] Felix Cheung commented on SPARK-22344: -- why is hive there when enableHiveSupport should be off? what

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218104#comment-16218104 ] Felix Cheung commented on SPARK-21616: -- True, I don't know if we are tracking changes to programming

[jira] [Updated] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22344: - Affects Version/s: 2.3.0 1.6.3 2.2.0 > Prevent R

[jira] [Commented] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213781#comment-16213781 ] Felix Cheung commented on SPARK-22327: --

[jira] [Updated] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22327: - Affects Version/s: 2.3.0 > R CRAN check fails on non-latest branches >

[jira] [Updated] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22327: - Description: with warning Insufficient package version (submitted: 2.0.3, existing: 2.1.2) We

[jira] [Updated] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22327: - Description: with warning * checking CRAN incoming feasibility ... WARNING Maintainer: 'Shivaram

[jira] [Comment Edited] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213798#comment-16213798 ] Felix Cheung edited comment on SPARK-22327 at 10/21/17 7:45 AM: in

[jira] [Created] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22327: Summary: R CRAN check fails on non-latest branches Key: SPARK-22327 URL: https://issues.apache.org/jira/browse/SPARK-22327 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22327: - Affects Version/s: 2.2.1 > R CRAN check fails on non-latest branches >

[jira] [Updated] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22327: - Description: with warning * checking CRAN incoming feasibility ... WARNING Maintainer: 'Shivaram

[jira] [Commented] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213798#comment-16213798 ] Felix Cheung commented on SPARK-22327: -- in contrast, this is from master * checking CRAN incoming

[jira] [Comment Edited] (SPARK-22327) R CRAN check fails on non-latest branches

2017-10-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213798#comment-16213798 ] Felix Cheung edited comment on SPARK-22327 at 10/21/17 7:45 AM: in

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225770#comment-16225770 ] Felix Cheung commented on SPARK-22344: -- Kinda. We have some alternate code paths and the packageName

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224139#comment-16224139 ] Felix Cheung commented on SPARK-22344: -- Kinda we don't have any uninstall feature though >

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226197#comment-16226197 ] Felix Cheung commented on SPARK-22344: -- Yes I think we should do just that. Might need to delete the

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:35 PM: --- actually,

[jira] [Commented] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung commented on SPARK-23291: -- actually, I'm not sure we should backport this to a x.x.1

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:34 PM: --- actually,

[jira] [Comment Edited] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465307#comment-16465307 ] Felix Cheung edited comment on SPARK-23291 at 5/6/18 10:38 PM: --- actually,

[jira] [Updated] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24195: - Affects Version/s: 1.3.1 1.4.1 1.5.2

[jira] [Created] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-24195: Summary: sc.addFile for local:/ path is broken Key: SPARK-24195 URL: https://issues.apache.org/jira/browse/SPARK-24195 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23291) SparkR : substr : In SparkR dataframe , starting and ending position arguments in "substr" is giving wrong result when the position is greater than 1

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465433#comment-16465433 ] Felix Cheung commented on SPARK-23291: -- I don't disagree the behavior issue. (ah, so someone did run

[jira] [Updated] (SPARK-24195) sc.addFile for local:/ path is broken

2018-05-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-24195: - Description: In changing SPARK-6300

[jira] [Commented] (SPARK-23780) Failed to use googleVis library with new SparkR

2018-05-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16475202#comment-16475202 ] Felix Cheung commented on SPARK-23780: -- [~vanzin] - FYI - if we have another RC this can be pulled

<    6   7   8   9   10   11   12   13   14   15   >