[jira] [Commented] (SPARK-6459) Warn when Column API is constructing trivially true equality

[ https://issues.apache.org/jira/browse/SPARK-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074327#comment-15074327 ] Michael Armbrust commented on SPARK-6459: - We do special case that very common problem, but I bet

[jira] [Created] (SPARK-12564) Improve missing column AnalysisException

Michael Armbrust created SPARK-12564: Summary: Improve missing column AnalysisException Key: SPARK-12564 URL: https://issues.apache.org/jira/browse/SPARK-12564 Project: Spark Issue Type:

[jira] [Created] (SPARK-12562) DataFrame.write.format("text") requires the column name to be called value

Michael Armbrust created SPARK-12562: Summary: DataFrame.write.format("text") requires the column name to be called value Key: SPARK-12562 URL: https://issues.apache.org/jira/browse/SPARK-12562

[jira] [Commented] (SPARK-6459) Warn when Column API is constructing trivially true equality

[ https://issues.apache.org/jira/browse/SPARK-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074279#comment-15074279 ] Michael Armbrust commented on SPARK-6459: - I don't think so, why do you say that? > Warn when

[jira] [Resolved] (SPARK-12441) Fixing missingInput in all Logical/Physical operators

[ https://issues.apache.org/jira/browse/SPARK-12441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12441. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10393

[jira] [Resolved] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12231. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10388

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12231: - Assignee: kevin yu > Failed to generate predicate Error when using dropna >

[jira] [Resolved] (SPARK-7727) Avoid inner classes in RuleExecutor

[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7727. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10174

[jira] [Commented] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073052#comment-15073052 ] Michael Armbrust commented on SPARK-12533: -- Just call the table method with a table that doesn't

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12319: - Target Version/s: 2.0.0 > Address endian specific problems surfaced in 1.6 >

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073099#comment-15073099 ] Michael Armbrust commented on SPARK-12319: -- Do you want to open a PR with your failing test

[jira] [Updated] (SPARK-12287) Support UnsafeRow in MapPartitions/MapGroups/CoGroup

[ https://issues.apache.org/jira/browse/SPARK-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12287: - Assignee: Xiao Li > Support UnsafeRow in MapPartitions/MapGroups/CoGroup >

[jira] [Resolved] (SPARK-12287) Support UnsafeRow in MapPartitions/MapGroups/CoGroup

[ https://issues.apache.org/jira/browse/SPARK-12287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12287. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10398

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11600: - Target Version/s: 1.6.1 (was: 1.6.0) > Spark MLlib 1.6 QA umbrella >

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8447: Target Version/s: 1.6.1 (was: 1.6.0) > Test external shuffle service with all shuffle

[jira] [Updated] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

[ https://issues.apache.org/jira/browse/SPARK-11224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11224: - Target Version/s: 1.6.1 (was: 1.6.0) > Flaky test: o.a.s.ExternalShuffleServiceSuite >

[jira] [Updated] (SPARK-11266) Peak memory tests swallow failures

[ https://issues.apache.org/jira/browse/SPARK-11266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11266: - Target Version/s: 1.6.1 (was: 1.6.0) > Peak memory tests swallow failures >

[jira] [Updated] (SPARK-11607) Update MLlib website for 1.6

[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11607: - Target Version/s: 1.6.1 (was: 1.6.0) > Update MLlib website for 1.6 >

[jira] [Updated] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11603: - Target Version/s: 1.6.1 (was: 1.6.0) > ML 1.6 QA: API: Experimental, DeveloperApi,

[jira] [Updated] (SPARK-10680) Flaky test: network.RequestTimeoutIntegrationSuite.timeoutInactiveRequests

[ https://issues.apache.org/jira/browse/SPARK-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10680: - Target Version/s: 1.6.1 (was: 1.6.0) > Flaky test:

[jira] [Updated] (SPARK-12507) Update Streaming configurations for 1.6

[ https://issues.apache.org/jira/browse/SPARK-12507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12507: - Target Version/s: 1.6.1 (was: 1.6.0) > Update Streaming configurations for 1.6 >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Shepherd: Michael Armbrust > Join-key Pushdown via Predicate Transitivity >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Target Version/s: 2.0.0 > Join-key Pushdown via Predicate Transitivity >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12532: - Assignee: Xiao Li > Join-key Pushdown via Predicate Transitivity >

[jira] [Updated] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12505: - Target Version/s: 2.0.0 > Pushdown a Limit on top of an Outer-Join >

[jira] [Created] (SPARK-12533) hiveContext.table() throws the wrong exception

Michael Armbrust created SPARK-12533: Summary: hiveContext.table() throws the wrong exception Key: SPARK-12533 URL: https://issues.apache.org/jira/browse/SPARK-12533 Project: Spark Issue

[jira] [Resolved] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12321. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10311

[jira] [Resolved] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12398. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10373

[jira] [Updated] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12321: - Assignee: Wenchen Fan > JSON format for logical/physical execution plans >

[jira] [Resolved] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12374. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10335

[jira] [Resolved] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12150. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10335

[jira] [Resolved] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12404. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10357

[jira] [Resolved] (SPARK-12397) Improve error messages for data sources when they are not found

[ https://issues.apache.org/jira/browse/SPARK-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12397. -- Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-12164) [SQL] Display the binary/encoded values

[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12164. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10215

[jira] [Updated] (SPARK-12164) [SQL] Display the binary/encoded values

[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12164: - Assignee: Xiao Li > [SQL] Display the binary/encoded values >

[jira] [Resolved] (SPARK-12320) throw exception if the number of fields does not line up for Tuple encoder

[ https://issues.apache.org/jira/browse/SPARK-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12320. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10293

[jira] [Updated] (SPARK-12320) throw exception if the number of fields does not line up for Tuple encoder

[ https://issues.apache.org/jira/browse/SPARK-12320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12320: - Assignee: Wenchen Fan > throw exception if the number of fields does not line up for

[jira] [Resolved] (SPARK-11677) ORC filter tests all pass if filters are actually not pushed down.

[ https://issues.apache.org/jira/browse/SPARK-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11677. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9687

[jira] [Updated] (SPARK-11677) ORC filter tests all pass if filters are actually not pushed down.

[ https://issues.apache.org/jira/browse/SPARK-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11677: - Assignee: Hyukjin Kwon > ORC filter tests all pass if filters are actually not pushed

[jira] [Resolved] (SPARK-6936) SQLContext.sql() caused deadlock in multi-thread env

[ https://issues.apache.org/jira/browse/SPARK-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6936. - Resolution: Fixed Fix Version/s: 1.5.0 > SQLContext.sql() caused deadlock in

[jira] [Resolved] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12271. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10260

[jira] [Resolved] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12236. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10221

[jira] [Resolved] (SPARK-12274) WrapOption should not have type constraint for child

[ https://issues.apache.org/jira/browse/SPARK-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12274. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10263

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049127#comment-15049127 ] Michael Armbrust commented on SPARK-12231: -- It would also be helpful to know if this bug can be

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12231: - Description: code to reproduce error # write.py {code} import pyspark sc =

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12231: - Affects Version/s: 1.6.0 > Failed to generate predicate Error when using dropna >

[jira] [Updated] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12231: - Target Version/s: 1.6.0 > Failed to generate predicate Error when using dropna >

[jira] [Resolved] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12201. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10196

[jira] [Resolved] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12188. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10184

[jira] [Resolved] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12195. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10188

[jira] [Resolved] (SPARK-12069) Documentation update for Datasets

[ https://issues.apache.org/jira/browse/SPARK-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12069. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10060

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1504#comment-1504 ] Michael Armbrust commented on SPARK-12045: -- Our general policy for exceptions is that we return

[jira] [Resolved] (SPARK-11884) Drop multiple columns in the DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11884. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9862

[jira] [Commented] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038561#comment-15038561 ] Michael Armbrust commented on SPARK-12107: -- Yeah, I was planning do a bulk update if/when that

[jira] [Commented] (SPARK-12083) java.lang.IllegalArgumentException: requirement failed: Overflowed precision (q98)

[ https://issues.apache.org/jira/browse/SPARK-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038829#comment-15038829 ] Michael Armbrust commented on SPARK-12083: -- I mean the first release candidate (RC1):

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12000: - Target Version/s: 1.7.0 (was: 1.6.0) > `sbt publishLocal` hits a Scala compiler bug

[jira] [Updated] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12107: - Target Version/s: 1.6.0 > Update spark-ec2 versions > - > >

[jira] [Commented] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036683#comment-15036683 ] Michael Armbrust commented on SPARK-12066: -- Can you reproduce this on 1.6-rc1? > spark sql

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12089: - Target Version/s: 1.6.0 > java.lang.NegativeArraySizeException when growing BufferHolder

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12089: - Priority: Blocker (was: Critical) > java.lang.NegativeArraySizeException when growing

[jira] [Updated] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

[ https://issues.apache.org/jira/browse/SPARK-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12108: - Target Version/s: 1.6.0 (was: 1.6.1) > Event logs are much bigger in 1.6 than in 1.5 >

[jira] [Updated] (SPARK-7264) SparkR API for parallel functions

[ https://issues.apache.org/jira/browse/SPARK-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7264: Target Version/s: (was: 1.6.0) > SparkR API for parallel functions >

[jira] [Updated] (SPARK-9697) Project Tungsten (Spark 1.6)

[ https://issues.apache.org/jira/browse/SPARK-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9697: Target Version/s: (was: 1.6.0) > Project Tungsten (Spark 1.6) >

[jira] [Commented] (SPARK-12083) java.lang.IllegalArgumentException: requirement failed: Overflowed precision (q98)

[ https://issues.apache.org/jira/browse/SPARK-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036954#comment-15036954 ] Michael Armbrust commented on SPARK-12083: -- Can you test with 1.6-RC1? >

[jira] [Updated] (SPARK-12063) Group by Column Number identifier is not successfully parsed

[ https://issues.apache.org/jira/browse/SPARK-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12063: - Issue Type: New Feature (was: Bug) > Group by Column Number identifier is not

[jira] [Updated] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12088: - Target Version/s: 1.6.0 > check connection.isClose before connection.getAutoCommit in

[jira] [Updated] (SPARK-11868) wrong results returned from dataframe create from Rows without consistent schma on pyspark

[ https://issues.apache.org/jira/browse/SPARK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11868: - Target Version/s: (was: 1.6.0) > wrong results returned from dataframe create from

[jira] [Commented] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034908#comment-15034908 ] Michael Armbrust commented on SPARK-11873: -- We did a lot of performance work in Spark 1.6 (e.g.,

[jira] [Updated] (SPARK-12061) Persist for Map/filter with Lambda Functions don't always read from Cache

[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12061: - Target Version/s: 1.7.0 > Persist for Map/filter with Lambda Functions don't always read

[jira] [Updated] (SPARK-12061) [SQL] Dataset API: Adding Persist for Map/filter with Lambda Functions

[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12061: - Issue Type: Bug (was: Improvement) > [SQL] Dataset API: Adding Persist for Map/filter

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12000: - Priority: Blocker (was: Major) > `sbt publishLocal` hits a Scala compiler bug caused by

[jira] [Updated] (SPARK-11932) trackStateByKey throws java.lang.IllegalArgumentException: requirement failed on restarting from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-11932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11932: - Priority: Critical (was: Blocker) > trackStateByKey throws

[jira] [Resolved] (SPARK-11503) SQL API audit for Spark 1.6

[ https://issues.apache.org/jira/browse/SPARK-11503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11503. -- Resolution: Fixed Fix Version/s: 1.6.0 > SQL API audit for Spark 1.6 >

[jira] [Updated] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11780: - Assignee: Santiago M. Mola > Provide type aliases in org.apache.spark.sql.types for

[jira] [Updated] (SPARK-11596) SQL execution very slow for nested query plans because of DataFrame.withNewExecutionId

[ https://issues.apache.org/jira/browse/SPARK-11596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11596: - Assignee: Yin Huai > SQL execution very slow for nested query plans because of >

[jira] [Updated] (SPARK-12061) Persist for Map/filter with Lambda Functions don't always read from Cache

[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12061: - Summary: Persist for Map/filter with Lambda Functions don't always read from Cache

[jira] [Updated] (SPARK-11352) codegen.GeneratePredicate fails due to unquoted comment

[ https://issues.apache.org/jira/browse/SPARK-11352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11352: - Assignee: Yin Huai > codegen.GeneratePredicate fails due to unquoted comment >

[jira] [Updated] (SPARK-12061) Persist for Map/filter with Lambda Functions

[ https://issues.apache.org/jira/browse/SPARK-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12061: - Summary: Persist for Map/filter with Lambda Functions (was: [SQL] Dataset API: Adding

[jira] [Resolved] (SPARK-11596) SQL execution very slow for nested query plans because of DataFrame.withNewExecutionId

[ https://issues.apache.org/jira/browse/SPARK-11596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11596. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10079

[jira] [Resolved] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

[ https://issues.apache.org/jira/browse/SPARK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12046. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10063

[jira] [Resolved] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

[ https://issues.apache.org/jira/browse/SPARK-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12068. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10059

[jira] [Updated] (SPARK-11856) add type cast if the real type is different but compatible with encoder schema

[ https://issues.apache.org/jira/browse/SPARK-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11856: - Assignee: Wenchen Fan > add type cast if the real type is different but compatible with

[jira] [Resolved] (SPARK-11856) add type cast if the real type is different but compatible with encoder schema

[ https://issues.apache.org/jira/browse/SPARK-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11856. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9840

[jira] [Updated] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11780: - Target Version/s: 1.6.0 > Provide type aliases in org.apache.spark.sql.types for

[jira] [Resolved] (SPARK-11954) Encoder for JavaBeans / POJOs

[ https://issues.apache.org/jira/browse/SPARK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11954. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9937

[jira] [Resolved] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11905. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9889

[jira] [Updated] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8414: Target Version/s: (was: 1.6.0) > Ensure ContextCleaner actually triggers clean ups >

[jira] [Commented] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032403#comment-15032403 ] Michael Armbrust commented on SPARK-12032: -- The standard algorithm for join reordering should

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11553: - Labels: releasenotes (was: ) > row.getInt(i) if row[i]=null returns 0 >

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032877#comment-15032877 ] Michael Armbrust commented on SPARK-11966: -- Have you seen

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Issue Type: Improvement (was: Bug) > JSON representation of nested StructTypes could be

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032899#comment-15032899 ] Michael Armbrust commented on SPARK-11941: -- /cc [~lian cheng] > JSON representation of nested

[jira] [Updated] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12032: - Issue Type: Improvement (was: Bug) > Filter can't be pushed down to correct Join

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes is incorrect

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032889#comment-15032889 ] Michael Armbrust commented on SPARK-11941: -- While I can appreciate that this might be nicer if

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Summary: JSON representation of nested StructTypes could be more uniform (was: JSON

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032925#comment-15032925 ] Michael Armbrust commented on SPARK-11966: -- Ah, I was proposing the DataFrame function explode

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032946#comment-15032946 ] Michael Armbrust commented on SPARK-11941: -- Sorry, maybe I'm misunderstanding. Can you

[jira] [Commented] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032921#comment-15032921 ] Michael Armbrust commented on SPARK-11873: -- What about with Spark 1.6? > Regression for TPC-DS

[jira] [Updated] (SPARK-12030) Incorrect results when aggregate joined data

[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12030: - Target Version/s: 1.6.0 Priority: Blocker (was: Critical) > Incorrect

[jira] [Resolved] (SPARK-12018) Refactor common subexpression elimination code

[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12018. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10009

<    3   4   5   6   7   8   9   10   11   12   >