[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > SQLTransformer.transform(inputDataFr

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit prob

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit prob

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with le

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.1 (was: 2.2.2) > Coalesce and AtLeastNNonNulls can cause 64KB

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: (was: 2.2.2) Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Fix Version/s: 2.2.2 > Maven nightly snapshot jenkins jobs are broken on multiple workers

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.3.0, 2.2.2 > HighlyCompressedMapStatus's avgSize is incorr

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit prob

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with con

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.3.0, 2.2.2 > SQLTransformer.transform(inputDataFrame) uncac

[jira] [Updated] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22544: - Target Version/s: 2.3.0, 2.2.2 > FileStreamSource should use its own hadoop conf to c

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22549: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with concat

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22508: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit prob

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.0, 2.3.0 > 64KB JVM bytecode limit problem with c

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.3.0, 2.2.2 > Incorrect nested AND expression pushed down to JDBC data sou

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.3.0, 2.2.2 > GenerateOrdering shouldn't change ctx.INPUT_

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.3.0, 2.2.2 > flaky test: CastSuite.SPARK-22500: cast for struct sho

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

2017-11-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.3.0, 2.2.2 > HiveWriterContainer passes null configurat

Re: [CANCEL] Spark 2.2.1 (RC1)

2017-11-19 Thread Felix Cheung
This vote is cancelled due to no vote. I’m going to test or track down a few issues (please see link below for those targeting this release) and roll RC2 in a few days if we could make progress. On Tue, Nov 14, 2017 at 10:25 PM Felix Cheung <felixche...@apache.org> wrote: > Pl

[jira] [Updated] (SPARK-20201) Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSuite

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20201: - Target Version/s: 2.2.1 > Flaky Test: org.apache.spark.sql.catalyst.expressions.OrderingSu

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22543: - Target Version/s: 2.2.1, 2.3.0 > fix java 64kb compile error for deeply nested expressi

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

2017-11-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Target Version/s: 2.2.1, 2.3.0 > Fix setup of SPARK_HOME variable on Wind

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.3.0 (was: 2.2.2) > ReorderJoinPredicates can break when chil

Re: [VOTE] Spark 2.2.1 (RC1)

2017-11-17 Thread Felix Cheung
ain; see > https://issues.apache.org/jira/browse/SPARK-16845?focusedCommentId=16018840=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16018840 > > > On Wed, Nov 15, 2017 at 12:25 AM Felix Cheung <felixche...@apache.org> > wrote: > > Please vote

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.3.0, 2.2.2 > SaveIntoDataSourceCommand logs jdbc credenti

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.2 Fix Version/s: (was: 2.2.1) > Maven nightly snapshot jenk

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Target Version/s: 2.3.0, 2.2.2 > Update maven central repo addr

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.3.0, 2.2.2 Fix Version/s: (was: 2.2.1) 2.2.2

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.2 > PythonRunner.MonitorThread should give the task a little t

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: (was: 2.2.2) > PySpark doc has misleading string for SparkSession.buil

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.2 > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode li

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.3.0, 2.2.2 (was: 2.2.2) > Accuracy problem in comparison with str

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with least and great

Re: [VOTE] Spark 2.2.1 (RC1)

2017-11-15 Thread Felix Cheung
.org/jira/browse/SPARK-22469 >> >> Maybe also include this regression of 2.2? It works in 2.1 >> >> Thanks, >> >> Xiao >> >> >> >> 2017-11-14 22:25 GMT-08:00 Felix Cheung <felixche...@apache.org>: >> >>> Please vote on rel

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.2.2 Description: {code:sql} select '1.5' > 0.5; // Result is N

[jira] [Comment Edited] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung edited comment on SPARK-22522 at 11/15/17 6:33 PM: sorry

[jira] [Comment Edited] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung edited comment on SPARK-22522 at 11/15/17 6:33 PM: sorry

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html to publish to Nexus

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Summary: Convert to apache-release to publish Maven artifacts (was: Convert to apache-release

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253918#comment-16253918 ] Felix Cheung commented on SPARK-22522: -- sorry about the confusion - to clarify, the repo is the same

[VOTE] Spark 2.2.1 (RC1)

2017-11-14 Thread Felix Cheung
Please vote on releasing the following candidate as Apache Spark version 2.2.1. The vote is open until Monday November 20, 2017 at 23:00 UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package as Apache Spark 2.2.1 [ ] -1 Do not release this package because

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252937#comment-16252937 ] Felix Cheung commented on SPARK-22522: -- and repository.apache.org is been the same place we

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Updated] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22522: - Description: see http://www.apache.org/dev/publishing-maven-artifacts.html ...at the very least

[jira] [Commented] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252934#comment-16252934 ] Felix Cheung commented on SPARK-22522: -- the profile and associated config is inherited from

[jira] [Created] (SPARK-22522) Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org

2017-11-14 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22522: Summary: Convert to apache-release to publish Maven artifacts to Nexus/repository.apache.org Key: SPARK-22522 URL: https://issues.apache.org/jira/browse/SPARK-22522

Re: Cutting the RC for Spark 2.2.1 release

2017-11-14 Thread Felix Cheung
nterface at repository.apache.org either. ____ From: Felix Cheung <felixcheun...@hotmail.com> Sent: Monday, November 13, 2017 11:23:44 AM To: Sean Owen Cc: Holden Karau; dev@spark.apache.org Subject: Re: Cutting the RC for Spark 2.2.1 release Ouch ;) yes that works and RC1 is t

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: 2.2.2 > PySpark doc has misleading string for SparkSession.buil

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.3.0 > Update maven central repo addr

[jira] [Updated] (SPARK-21098) Set lineseparator csv multiline and csv write to \n

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21098: - Affects Version/s: (was: 2.2.1) 2.2.2 > Set lineseparator

[jira] [Updated] (SPARK-21859) SparkFiles.get failed on driver in yarn-cluster and yarn-client mode

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21859: - Affects Version/s: (was: 2.2.1) > SparkFiles.get failed on driver in yarn-cluster and y

[jira] [Updated] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: 2.2.2 > Update maven central repo addr

[jira] [Updated] (SPARK-21245) Resolve code duplication for classification/regression summarizers

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21245: - Affects Version/s: (was: 2.2.1) 2.2.2 > Resolve code duplicat

[jira] [Updated] (SPARK-21259) More rules for scalastyle

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21259: - Affects Version/s: (was: 2.2.1) 2.2.2 > More rules for scalast

[jira] [Commented] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250589#comment-16250589 ] Felix Cheung commented on SPARK-22471: -- yes, RC1 has been cut. > SQLListener consumes much mem

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.2 (was: 2.2.1) > ReorderJoinPredicates can break when chil

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.2 > SQLListener consumes much memory causing OutOfMemoryEr

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

2017-11-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Fix Version/s: (was: 2.2.1) 2.2.2 > SQLListener consumes much mem

[jira] [Created] (SPARK-22511) Update maven central repo address

2017-11-13 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22511: Summary: Update maven central repo address Key: SPARK-22511 URL: https://issues.apache.org/jira/browse/SPARK-22511 Project: Spark Issue Type: Bug

Re: Cutting the RC for Spark 2.2.1 release

2017-11-13 Thread Felix Cheung
Ouch ;) yes that works and RC1 is tagged. From: Sean Owen <so...@cloudera.com> Sent: Monday, November 13, 2017 10:54:48 AM To: Felix Cheung Cc: Holden Karau; dev@spark.apache.org Subject: Re: Cutting the RC for Spark 2.2.1 release It's repo.maven.apache.or

Re: Cutting the RC for Spark 2.2.1 release

2017-11-13 Thread Felix Cheung
: Monday, November 13, 2017 10:48 AM Subject: Re: Cutting the RC for Spark 2.2.1 release To: Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> Cc: Holden Karau <hol...@pigscanfly.ca<mailto:hol...@pigscanfly.ca>>, <dev@spark.apache.org<mailto:d

Re: Cutting the RC for Spark 2.2.1 release

2017-11-13 Thread Felix Cheung
Anything to build with maven on a clean machine. It couldn’t connect to maven central repo. From: Holden Karau <hol...@pigscanfly.ca> Sent: Monday, November 13, 2017 10:38:03 AM To: Felix Cheung Cc: dev@spark.apache.org Subject: Re: Cutting the RC for Spark

Re: Cutting the RC for Spark 2.2.1 release

2017-11-13 Thread Felix Cheung
VNCENTRAL-1369 Stay tuned. ________ From: Felix Cheung <felixcheun...@hotmail.com> Sent: Monday, November 13, 2017 12:00:41 AM To: dev@spark.apache.org Subject: Re: Cutting the RC for Spark 2.2.1 release Quick update: We merged 6 fixes Friday and 7 fixes today (than

Re: Cutting the RC for Spark 2.2.1 release

2017-11-13 Thread Felix Cheung
). There should not be any issue targetting 2.2.1 except for SPARK-22042. As it is not a regression and it seems it might take a while, we won’t be blocking the release. _ From: Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> Sen

[jira] [Updated] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22442: - Target Version/s: 2.2.1, 2.3.0 > Schema generated by Product Encoder doesn't match case cl

[jira] [Updated] (SPARK-22202) Release tgz content differences for python and R

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22202: - Affects Version/s: (was: 2.2.1) 2.2.0 > Release tgz cont

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Affects Version/s: (was: 2.2.1) > Allow release managers to inject their k

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.3.0) 2.2.0 > Extend ColumnName to cre

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.2.1) 2.3.0 > Extend ColumnName to cre

[jira] [Updated] (SPARK-21427) Describe mapGroupsWithState and flatMapGroupsWithState for stateful aggregation in Structured Streaming

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21427: - Affects Version/s: (was: 2.2.1) 2.2.0 > Describe mapGroupsWithSt

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.1) 2.3.0 2.2.2

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Affects Version/s: (was: 2.2.1) > Port release scri

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249005#comment-16249005 ] Felix Cheung commented on SPARK-22042: -- since this is in 2.1.0 and 2.2.0, technically this isn't

[jira] [Resolved] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21693. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19606. -- Resolution: Fixed Assignee: paul mackles Fix Version/s: 2.3.0

[jira] [Assigned] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-18136: Assignee: Jakub Nowacki > Make PySpark pip install works on wind

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248377#comment-16248377 ] Felix Cheung commented on SPARK-18136: -- thanks [~hyukjin.kwon] > Make PySpark pip install wo

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Fix Version/s: 2.3.0 2.2.1 2.1.3 > Make PySpark

[jira] [Updated] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18136: - Affects Version/s: 2.3.0 2.1.2 2.2.0 Target

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248372#comment-16248372 ] Felix Cheung commented on SPARK-22042: -- any taker? is this a blocker for 2.2.1

[jira] [Updated] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22042: - Target Version/s: 2.2.1 > ReorderJoinPredicates can break when child's partition

[jira] [Commented] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248366#comment-16248366 ] Felix Cheung commented on SPARK-22055: -- moving to 2.3.0 I think it would be great to make progress

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Port release scri

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > Allow release managers to inject their k

[jira] [Commented] (SPARK-22054) Allow release managers to inject their keys

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248365#comment-16248365 ] Felix Cheung commented on SPARK-22054: -- moving to 2.3.0 > Allow release managers to inj

[jira] [Commented] (SPARK-22406) pyspark version tag is wrong on PyPi

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248364#comment-16248364 ] Felix Cheung commented on SPARK-22406: -- is this still being targeted for 2.2.1? > pyspark vers

[jira] [Commented] (SPARK-18136) Make PySpark pip install works on windows

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248361#comment-16248361 ] Felix Cheung commented on SPARK-18136: -- is this still being targeted for 2.2.1? > Make PySpark

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247884#comment-16247884 ] Felix Cheung commented on SPARK-21693: -- let's continue this conversation. >From the first l

[jira] [Resolved] (SPARK-22344) Prevent R CMD check from using /tmp

2017-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-22344. -- Resolution: Fixed Assignee: Shivaram Venkataraman Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-22287) SPARK_DAEMON_MEMORY not honored by MesosClusterDispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22287: - Target Version/s: 2.2.1 > SPARK_DAEMON_MEMORY not honored by MesosClusterDispatc

[jira] [Updated] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19606: - Target Version/s: 2.2.1 > Support constraints in spark-dispatc

<    6   7   8   9   10   11   12   13   14   15   >