[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: (was: 2.2.2) Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2)

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Fix Version/s: 2.2.2 > Maven nightly snapshot jenkins jobs are broken on multiple workers due to

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.3.0, 2.2.2 > HighlyCompressedMapStatus's avgSize is incorrect >

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with in >

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with concat >

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.3.0, 2.2.2 > SQLTransformer.transform(inputDataFrame) uncaches

[jira] [Updated] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22544: - Target Version/s: 2.3.0, 2.2.2 > FileStreamSource should use its own hadoop conf to call

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22549: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with concat_ws >

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22508: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.0, 2.3.0 > 64KB JVM bytecode limit problem with cast >

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.3.0, 2.2.2 > Incorrect nested AND expression pushed down to JDBC data source

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.3.0, 2.2.2 > GenerateOrdering shouldn't change ctx.INPUT_ROW >

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.3.0, 2.2.2 > flaky test: CastSuite.SPARK-22500: cast for struct should not

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.3.0, 2.2.2 > HiveWriterContainer passes null configuration to

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: 2.2.1 > Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite >

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22543: - Target Version/s: 2.2.1, 2.3.0 > fix java 64kb compile error for deeply nested expressions >

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Target Version/s: 2.2.1, 2.3.0 > Fix setup of SPARK_HOME variable on Windows >

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.3.0 (was: 2.2.2) > ReorderJoinPredicates can break when child's

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.3.0, 2.2.2 > SaveIntoDataSourceCommand logs jdbc credentials >

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.2 Fix Version/s: (was: 2.2.1) > Maven nightly snapshot jenkins

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Target Version/s: 2.3.0, 2.2.2 > Update maven central repo address >

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.3.0, 2.2.2 Fix Version/s: (was: 2.2.1) 2.2.2

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.2 > PythonRunner.MonitorThread should give the task a little time to

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: (was: 2.2.2) > PySpark doc has misleading string for SparkSession.builder

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.2 > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.3.0, 2.2.2 (was: 2.2.2) > Accuracy problem in comparison with string and

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with least and greatest >

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.2.2 Description: {code:sql} select '1.5' > 0.5; // Result is NULL

[jira] [Comment Edited] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung edited comment on SPARK-22522 at 11/15/17 6:33 PM: sorry

[jira] [Comment Edited] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung edited comment on SPARK-22522 at 11/15/17 6:33 PM: sorry

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html to publish to

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Summary: Convert to apache-release to publish Maven artifacts (was: Convert to apache-release

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung commented on SPARK-22522: -- sorry about the confusion - to clarify, the repo is the same

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252937#comment-16252937 ] Felix Cheung commented on SPARK-22522: -- and repository.apache.org is been the same place we are

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252934#comment-16252934 ] Felix Cheung commented on SPARK-22522: -- the profile and associated config is inherited from the

[jira] [Created] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22522: Summary: Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org Key: SPARK-22522 URL: https://issues.apache.org/jira/browse/SPARK-22522

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: 2.2.2 > PySpark doc has misleading string for SparkSession.builder >

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.3.0 > Update maven central repo address > -

[jira] [Updated] (SPARK-21098) Set lineseparator csv multiline and csv write to \n

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21098: - Affects Version/s: (was: 2.2.1) 2.2.2 > Set lineseparator csv

[jira] [Updated] (SPARK-21859) SparkFiles.get failed on driver in yarn-cluster and yarn-client mode

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21859: - Affects Version/s: (was: 2.2.1) > SparkFiles.get failed on driver in yarn-cluster and

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.2.2 > Update maven central repo address > -

[jira] [Updated] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21245: - Affects Version/s: (was: 2.2.1) 2.2.2 > Resolve code duplication for

[jira] [Updated] (SPARK-21259) More rules for scalastyle

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21259: - Affects Version/s: (was: 2.2.1) 2.2.2 > More rules for scalastyle >

[jira] [Commented] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250589#comment-16250589 ] Felix Cheung commented on SPARK-22471: -- yes, RC1 has been cut. > SQLListener consumes much memory

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.2 (was: 2.2.1) > ReorderJoinPredicates can break when child's

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.2 > SQLListener consumes much memory causing OutOfMemoryError >

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Fix Version/s: (was: 2.2.1) 2.2.2 > SQLListener consumes much memory

[jira] [Created] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22511: Summary: Update maven central repo address Key: SPARK-22511 URL: https://issues.apache.org/jira/browse/SPARK-22511 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22442: - Target Version/s: 2.2.1, 2.3.0 > Schema generated by Product Encoder doesn't match case class

[jira] [Updated] (SPARK-22202) Release tgz content differences for python and R

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22202: - Affects Version/s: (was: 2.2.1) 2.2.0 > Release tgz content

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Affects Version/s: (was: 2.2.1) > Allow release managers to inject their keys >

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.3.0) 2.2.0 > Extend ColumnName to create

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.2.1) 2.3.0 > Extend ColumnName to create

[jira] [Updated] (SPARK-21427) Describe mapGroupsWithState and flatMapGroupsWithState for stateful aggregation in Structured Streaming

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21427: - Affects Version/s: (was: 2.2.1) 2.2.0 > Describe mapGroupsWithState

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.1) 2.3.0 2.2.2 >

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Affects Version/s: (was: 2.2.1) > Port release scripts > > >

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249005#comment-16249005 ] Felix Cheung commented on SPARK-22042: -- since this is in 2.1.0 and 2.2.0, technically this isn't a

[jira] [Resolved] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21693. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19606. -- Resolution: Fixed Assignee: paul mackles Fix Version/s: 2.3.0

[jira] [Assigned] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-18136: Assignee: Jakub Nowacki > Make PySpark pip install works on windows >

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248377#comment-16248377 ] Felix Cheung commented on SPARK-18136: -- thanks [~hyukjin.kwon] > Make PySpark pip install works on

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Fix Version/s: 2.3.0 2.2.1 2.1.3 > Make PySpark pip

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Affects Version/s: 2.3.0 2.1.2 2.2.0 Target

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248372#comment-16248372 ] Felix Cheung commented on SPARK-22042: -- any taker? is this a blocker for 2.2.1? >

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.1 > ReorderJoinPredicates can break when child's partitioning is not

[jira] [Commented] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248366#comment-16248366 ] Felix Cheung commented on SPARK-22055: -- moving to 2.3.0 I think it would be great to make progress

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Port release scripts > > >

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Allow release managers to inject their keys >

[jira] [Commented] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248365#comment-16248365 ] Felix Cheung commented on SPARK-22054: -- moving to 2.3.0 > Allow release managers to inject their

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248364#comment-16248364 ] Felix Cheung commented on SPARK-22406: -- is this still being targeted for 2.2.1? > pyspark version

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248361#comment-16248361 ] Felix Cheung commented on SPARK-18136: -- is this still being targeted for 2.2.1? > Make PySpark pip

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247884#comment-16247884 ] Felix Cheung commented on SPARK-21693: -- let's continue this conversation. >From the first link on

[jira] [Resolved] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22344. -- Resolution: Fixed Assignee: Shivaram Venkataraman Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-22287) SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22287: - Target Version/s: 2.2.1 > SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher >

[jira] [Updated] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19606: - Target Version/s: 2.2.1 > Support constraints in spark-dispatcher >

[jira] [Resolved] (SPARK-22281) Handle R method breaking signature changes

2017-11-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22281. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-22327) R CRAN check fails on non-latest branches

2017-11-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22327. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-22430) Unknown tag warnings when building R docs with Roxygen 6.0.1

2017-11-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237719#comment-16237719 ] Felix Cheung commented on SPARK-22430: -- I am seeing it too. I think we can just remove the tag but

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236103#comment-16236103 ] Felix Cheung commented on SPARK-22344: -- Yes to both. If SPARK_HOME is set before calling

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233762#comment-16233762 ] Felix Cheung commented on SPARK-22344: -- Maybe just delete the directory returned from

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233751#comment-16233751 ] Felix Cheung commented on SPARK-22344: -- Hmm yes we do have to know if it has just found it, or

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226197#comment-16226197 ] Felix Cheung commented on SPARK-22344: -- Yes I think we should do just that. Might need to delete the

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225770#comment-16225770 ] Felix Cheung commented on SPARK-22344: -- Kinda. We have some alternate code paths and the packageName

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224139#comment-16224139 ] Felix Cheung commented on SPARK-22344: -- Kinda we don't have any uninstall feature though >

[jira] [Comment Edited] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223228#comment-16223228 ] Felix Cheung edited comment on SPARK-22344 at 10/28/17 4:26 AM: I think

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223228#comment-16223228 ] Felix Cheung commented on SPARK-22344: -- I think the PR addresses other cases, but what do we want to

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220083#comment-16220083 ] Felix Cheung commented on SPARK-22344: -- why is hive there when enableHiveSupport should be off? what

[jira] [Comment Edited] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080 ] Felix Cheung edited comment on SPARK-22344 at 10/26/17 7:25 AM: this is

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080 ] Felix Cheung commented on SPARK-22344: -- this is what I see on a clean machine tracking

[jira] [Updated] (SPARK-22344) Prevent R CMD check from using /tmp

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22344: - Affects Version/s: 2.3.0 1.6.3 2.2.0 > Prevent R

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218104#comment-16218104 ] Felix Cheung commented on SPARK-21616: -- True, I don't know if we are tracking changes to programming

[jira] [Commented] (SPARK-21616) SparkR 2.3.0 migration guide, release note

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216439#comment-16216439 ] Felix Cheung commented on SPARK-21616: -- SPARK-17902 > SparkR 2.3.0 migration guide, release note >

[jira] [Commented] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

2017-10-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216438#comment-16216438 ] Felix Cheung commented on SPARK-21208: -- hi - any taker on this? > Ability to "setLocalProperty"

<    1   2   3   4   5   6   7   8   9   10   >