[jira] [Updated] (SPARK-3987) NNLS generates incorrect result

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3987: --- Fix Version/s: (was: 1.3.0) 1.2.0 > NNLS generates incorrect result > -

[jira] [Updated] (SPARK-3632) ConnectionManager can run out of receive threads with authentication on

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3632: --- Fix Version/s: (was: 1.3.0) > ConnectionManager can run out of receive threads with authen

[jira] [Updated] (SPARK-3632) ConnectionManager can run out of receive threads with authentication on

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3632: --- Fix Version/s: 1.2.0 > ConnectionManager can run out of receive threads with authentication on

[jira] [Updated] (SPARK-3632) ConnectionManager can run out of receive threads with authentication on

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3632: --- Labels: backport-needed (was: ) > ConnectionManager can run out of receive threads with authe

[jira] [Updated] (SPARK-3628) Don't apply accumulator updates multiple times for tasks in result stages

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3628: --- Labels: backport-needed (was: ) > Don't apply accumulator updates multiple times for tasks in

[jira] [Updated] (SPARK-3505) Augmenting SparkStreaming updateStateByKey API with timestamp

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3505: --- Target Version/s: 1.3.0 (was: 1.1.0) > Augmenting SparkStreaming updateStateByKey API with ti

[jira] [Updated] (SPARK-3505) Augmenting SparkStreaming updateStateByKey API with timestamp

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3505: --- Fix Version/s: (was: 1.3.0) > Augmenting SparkStreaming updateStateByKey API with timestam

[jira] [Updated] (SPARK-3628) Don't apply accumulator updates multiple times for tasks in result stages

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3628: --- Fix Version/s: (was: 1.3.0) 1.2.0 > Don't apply accumulator updates mul

[jira] [Updated] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3403: --- Fix Version/s: (was: 1.3.0) > NaiveBayes crashes with blas/lapack native libraries for bre

[jira] [Updated] (SPARK-3379) Implement 'POWER' for sql

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3379: --- Fix Version/s: (was: 1.3.0) > Implement 'POWER' for sql > - > >

[jira] [Resolved] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3039. Resolution: Fixed This fix did appear in Spark 1.2.0 so I'm closing this issue. > Spark ass

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3039: --- Fix Version/s: 1.2.0 > Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for h

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3039: --- Target Version/s: 1.2.0 (was: 1.1.1, 1.2.0) > Spark assembly for new hadoop API (hadoop 2) co

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3039: --- Fix Version/s: (was: 1.3.0) > Spark assembly for new hadoop API (hadoop 2) contains avro-m

[jira] [Updated] (SPARK-2973) Add a way to show tables without executing a job

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2973: --- Fix Version/s: (was: 1.3.0) 1.2.0 > Add a way to show tables without ex

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2914: --- Assignee: Andrew Or > spark.*.extraJavaOptions are evaluated too many times >

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2914: --- Fix Version/s: 1.2.0 > spark.*.extraJavaOptions are evaluated too many times > ---

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2914: --- Fix Version/s: (was: 1.3.0) > spark.*.extraJavaOptions are evaluated too many times >

[jira] [Updated] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2913: --- Fix Version/s: (was: 1.3.0) > Spark's log4j.properties should always appear ahead of Hadoo

[jira] [Updated] (SPARK-2794) Use Java 7 isSymlink when available

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2794: --- Fix Version/s: (was: 1.3.0) > Use Java 7 isSymlink when available > --

[jira] [Updated] (SPARK-2795) Improve DiskBlockObjectWriter API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2795: --- Fix Version/s: (was: 1.3.0) > Improve DiskBlockObjectWriter API >

[jira] [Updated] (SPARK-2770) Rename spark-ganglia-lgpl to ganglia-lgpl

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2770: --- Fix Version/s: (was: 1.3.0) > Rename spark-ganglia-lgpl to ganglia-lgpl >

[jira] [Updated] (SPARK-2793) Correctly lock directory creation in DiskBlockManager.getFile

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2793: --- Fix Version/s: (was: 1.3.0) > Correctly lock directory creation in DiskBlockManager.getFil

[jira] [Updated] (SPARK-2722) Mechanism for escaping spark configs is not consistent

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2722: --- Fix Version/s: (was: 1.3.0) > Mechanism for escaping spark configs is not consistent > ---

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2757: --- Target Version/s: 1.3.0 (was: 1.2.0) > Add Mima test for Spark Sink after 1.10 is released >

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2757: --- Assignee: Hari Shreedharan > Add Mima test for Spark Sink after 1.10 is released > ---

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2757: --- Fix Version/s: (was: 1.3.0) > Add Mima test for Spark Sink after 1.10 is released > --

[jira] [Updated] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2703: --- Fix Version/s: (was: 1.3.0) > Make Tachyon related unit tests execute without deploying a

[jira] [Updated] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2624: --- Fix Version/s: (was: 1.3.0) > Datanucleus jars not accessible in yarn-cluster mode > -

[jira] [Updated] (SPARK-2638) Improve concurrency of fetching Map outputs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2638: --- Fix Version/s: (was: 1.3.0) > Improve concurrency of fetching Map outputs > --

[jira] [Updated] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2167: --- Fix Version/s: (was: 1.3.0) > spark-submit should return exit code based on failure/succes

[jira] [Updated] (SPARK-2584) Do not mutate block storage level on the UI

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2584: --- Fix Version/s: (was: 1.3.0) > Do not mutate block storage level on the UI > --

[jira] [Resolved] (SPARK-2069) MIMA false positives (umbrella)

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2069. Resolution: Fixed Fix Version/s: (was: 1.3.0) 1.2.0 > MIMA fal

[jira] [Updated] (SPARK-2068) Remove other uses of @transient lazy val in physical plan nodes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2068: --- Fix Version/s: (was: 1.3.0) > Remove other uses of @transient lazy val in physical plan no

[jira] [Updated] (SPARK-2063) Creating a SchemaRDD via sql() does not correctly resolve nested types

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2063: --- Fix Version/s: (was: 1.3.0) > Creating a SchemaRDD via sql() does not correctly resolve ne

[jira] [Updated] (SPARK-1921) Allow duplicate jar files among the app jar and secondary jars in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1921: --- Fix Version/s: (was: 1.3.0) > Allow duplicate jar files among the app jar and secondary ja

[jira] [Updated] (SPARK-1972) Add support for setting and visualizing custom task-related metrics

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1972: --- Fix Version/s: (was: 1.3.0) > Add support for setting and visualizing custom task-related

[jira] [Updated] (SPARK-1989) Exit executors faster if they get into a cycle of heavy GC

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1989: --- Fix Version/s: (was: 1.3.0) > Exit executors faster if they get into a cycle of heavy GC >

[jira] [Updated] (SPARK-1924) Make local:/ scheme work in more deploy modes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1924: --- Fix Version/s: (was: 1.3.0) > Make local:/ scheme work in more deploy modes >

[jira] [Updated] (SPARK-1866) Closure cleaner does not null shadowed fields when outer scope is referenced

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1866: --- Fix Version/s: (was: 1.3.0) (was: 1.0.1) > Closure cleaner does not

[jira] [Updated] (SPARK-1792) Missing Spark-Shell Configure Options

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1792: --- Fix Version/s: (was: 1.3.0) > Missing Spark-Shell Configure Options >

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1911: --- Fix Version/s: (was: 1.3.0) > Warn users if their assembly jars are not built with Java 6

[jira] [Updated] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1706: --- Fix Version/s: (was: 1.3.0) > Allow multiple executors per worker in Standalone mode > ---

[jira] [Resolved] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1652. Resolution: Fixed > Fixes and improvements for spark-submit/configs > --

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Fix Version/s: (was: 1.3.0) > Merge script should standardize SPARK-XXX prefix > -

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Labels: starter (was: ) > Merge script should standardize SPARK-XXX prefix >

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Fix Version/s: (was: 1.3.0) > Add JavaScript into Javadoc to turn ::Experimental:: and suc

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.2.1) 1.2.0 > Fixes and improvements for spark-su

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.3.0) 1.2.1 > Fixes and improvements for spark-su

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1529: --- Fix Version/s: (was: 1.3.0) > Support setting spark.local.dirs to a hadoop FileSystem > -

[jira] [Updated] (SPARK-1272) Don't fail job if some local directories are buggy

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1272: --- Fix Version/s: (was: 1.3.0) > Don't fail job if some local directories are buggy > ---

[jira] [Updated] (SPARK-1369) HiveUDF wrappers are slow

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1369: --- Fix Version/s: (was: 1.3.0) > HiveUDF wrappers are slow > - > >

[jira] [Updated] (SPARK-1079) EC2 scripts should allow mounting as XFS or EXT4

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1079: --- Fix Version/s: (was: 1.3.0) > EC2 scripts should allow mounting as XFS or EXT4 > -

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Target Version/s: (was: 1.2.0) > sortByKey() launches a cluster job when it shouldn't >

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Fix Version/s: (was: 1.3.0) > sortByKey() launches a cluster job when it shouldn't > -

[jira] [Resolved] (SPARK-4952) Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4952. Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 1.3

[jira] [Updated] (SPARK-1972) Add support for setting and visualizing custom task-related metrics

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1972: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Add support for setting and visuali

[jira] [Updated] (SPARK-2068) Remove other uses of @transient lazy val in physical plan nodes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2068: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Remove other uses of @transient laz

[jira] [Updated] (SPARK-1652) Fixes and improvements for spark-submit/configs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1652: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Fixes and improvements for spark-su

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1021: --- Fix Version/s: (was: 1.2.0) 1.3.0 > sortByKey() launches a cluster job

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1529: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Support setting spark.local.dirs to

[jira] [Updated] (SPARK-1079) EC2 scripts should allow mounting as XFS or EXT4

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1079: --- Fix Version/s: (was: 1.2.0) 1.3.0 > EC2 scripts should allow mounting a

[jira] [Updated] (SPARK-1369) HiveUDF wrappers are slow

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1369: --- Fix Version/s: (was: 1.2.0) 1.3.0 > HiveUDF wrappers are slow > ---

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1564: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Add JavaScript into Javadoc to turn

[jira] [Updated] (SPARK-4952) Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4952: --- Summary: Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails (was: In som

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1911: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Warn users if their assembly jars a

[jira] [Updated] (SPARK-2063) Creating a SchemaRDD via sql() does not correctly resolve nested types

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2063: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Creating a SchemaRDD via sql() does

[jira] [Updated] (SPARK-1706) Allow multiple executors per worker in Standalone mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1706: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Allow multiple executors per worker

[jira] [Updated] (SPARK-1866) Closure cleaner does not null shadowed fields when outer scope is referenced

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1866: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Closure cleaner does not null shado

[jira] [Updated] (SPARK-1921) Allow duplicate jar files among the app jar and secondary jars in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1921: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Allow duplicate jar files among the

[jira] [Updated] (SPARK-1989) Exit executors faster if they get into a cycle of heavy GC

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1989: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Exit executors faster if they get i

[jira] [Updated] (SPARK-2584) Do not mutate block storage level on the UI

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2584: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Do not mutate block storage level o

[jira] [Updated] (SPARK-1272) Don't fail job if some local directories are buggy

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1272: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Don't fail job if some local direct

[jira] [Updated] (SPARK-1792) Missing Spark-Shell Configure Options

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1792: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Missing Spark-Shell Configure Optio

[jira] [Updated] (SPARK-1924) Make local:/ scheme work in more deploy modes

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1924: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Make local:/ scheme work in more de

[jira] [Updated] (SPARK-2069) MIMA false positives (umbrella)

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2069: --- Fix Version/s: (was: 1.2.0) 1.3.0 > MIMA false positives (umbrella) > -

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Merge script should standardize SPA

[jira] [Updated] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2167: --- Fix Version/s: (was: 1.2.0) 1.3.0 > spark-submit should return exit cod

[jira] [Updated] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2624: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Datanucleus jars not accessible in

[jira] [Updated] (SPARK-4559) Adding support for ucase and lcase

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4559: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Adding support for ucase and lcase

[jira] [Updated] (SPARK-2638) Improve concurrency of fetching Map outputs

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2638: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Improve concurrency of fetching Map

[jira] [Updated] (SPARK-3379) Implement 'POWER' for sql

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3379: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Implement 'POWER' for sql > ---

[jira] [Updated] (SPARK-4355) OnlineSummarizer doesn't merge mean correctly

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4355: --- Fix Version/s: (was: 1.2.0) 1.3.0 > OnlineSummarizer doesn't merge mean

[jira] [Updated] (SPARK-4237) Generate right Manifest File for maven building

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4237: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Generate right Manifest File for ma

[jira] [Updated] (SPARK-3505) Augmenting SparkStreaming updateStateByKey API with timestamp

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3505: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Augmenting SparkStreaming updateSta

[jira] [Updated] (SPARK-2794) Use Java 7 isSymlink when available

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2794: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Use Java 7 isSymlink when available

[jira] [Updated] (SPARK-4449) specify port range in spark

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4449: --- Fix Version/s: (was: 1.2.0) 1.3.0 > specify port range in spark > -

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Spark Driver crashes whenever an Ex

[jira] [Updated] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4699: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Make caseSensitive configurable in

[jira] [Updated] (SPARK-2973) Add a way to show tables without executing a job

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2973: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Add a way to show tables without ex

[jira] [Updated] (SPARK-2770) Rename spark-ganglia-lgpl to ganglia-lgpl

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2770: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Rename spark-ganglia-lgpl to gangli

[jira] [Updated] (SPARK-3632) ConnectionManager can run out of receive threads with authentication on

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3632: --- Fix Version/s: (was: 1.2.0) 1.3.0 > ConnectionManager can run out of re

[jira] [Updated] (SPARK-2913) Spark's log4j.properties should always appear ahead of Hadoop's on classpath

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2913: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Spark's log4j.properties should alw

[jira] [Updated] (SPARK-2795) Improve DiskBlockObjectWriter API

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2795: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Improve DiskBlockObjectWriter API >

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4180: --- Fix Version/s: (was: 1.2.0) 1.3.0 > SparkContext constructor should thr

[jira] [Updated] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2757: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Add Mima test for Spark Sink after

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4258: --- Fix Version/s: (was: 1.2.0) 1.3.0 > NPE with new Parquet Filters >

[jira] [Updated] (SPARK-3987) NNLS generates incorrect result

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3987: --- Fix Version/s: (was: 1.2.0) 1.3.0 > NNLS generates incorrect result > -

[jira] [Updated] (SPARK-4184) Improve Spark Streaming documentation

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4184: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Improve Spark Streaming documentati

[jira] [Updated] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-12-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4231: --- Fix Version/s: (was: 1.2.0) 1.3.0 > Add RankingMetrics to examples.Movi

  1   2   >