[jira] [Resolved] (SPARK-13091) Rewrite/Propagate constraints for Aliases

[ https://issues.apache.org/jira/browse/SPARK-13091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13091. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11144

[jira] [Resolved] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

[ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13261. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11147

[jira] [Resolved] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12966. -- Resolution: Fixed Fix Version/s: 2.0.0 > Postgres JDBC ArrayType(DecimalType)

[jira] [Updated] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13384: - Assignee: Liang-Chi Hsieh > Keep attribute qualifiers after dedup in Analyzer >

[jira] [Resolved] (SPARK-13384) Keep attribute qualifiers after dedup in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-13384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13384. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11261

[jira] [Updated] (SPARK-13363) Aggregator not working with DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13363: - Priority: Blocker (was: Minor) > Aggregator not working with DataFrame >

[jira] [Updated] (SPARK-13363) Aggregator not working with DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13363: - Affects Version/s: (was: 2.0.0) 1.6.0 Target Version/s:

[jira] [Updated] (SPARK-12583) spark shuffle fails with mesos after 2mins

[ https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12583: - Target Version/s: 1.6.1 > spark shuffle fails with mesos after 2mins >

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Description: Getting an "UnsupportedOperationException" when trying to alias an array

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Affects Version/s: 1.6.0 > Error aliasing array columns. > -

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Target Version/s: 1.6.1, 2.0.0 > Error aliasing array columns. >

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13101: - Fix Version/s: 1.6.1 > Dataset complex types mapping to DataFrame (element nullability)

[jira] [Resolved] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13101. -- Resolution: Fixed Fix Version/s: (was: 1.6.1) 2.0.0

[jira] [Resolved] (SPARK-12939) migrate encoder resolution to Analyzer

[ https://issues.apache.org/jira/browse/SPARK-12939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12939. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10852

[jira] [Updated] (SPARK-12939) migrate encoder resolution to Analyzer

[ https://issues.apache.org/jira/browse/SPARK-12939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12939: - Assignee: Wenchen Fan > migrate encoder resolution to Analyzer >

[jira] [Commented] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135264#comment-15135264 ] Michael Armbrust commented on SPARK-11725: -- [~onetoinfin...@yahoo.com], unfortunatly I don't

[jira] [Resolved] (SPARK-13166) Remove DataStreamReader/Writer

[ https://issues.apache.org/jira/browse/SPARK-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13166. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11062

[jira] [Reopened] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-13101: -- Assignee: Wenchen Fan > Dataset complex types mapping to DataFrame (element

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13101: - Target Version/s: 1.6.1, 2.0.0 (was: 1.6.1) > Dataset complex types mapping to

[jira] [Resolved] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13101. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 11042

[jira] [Updated] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Assignee: Michael Armbrust > No encoder implicits for Seq[Primitive] >

[jira] [Resolved] (SPARK-12783) Dataset map serialization error

[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12783. -- Resolution: Fixed Fix Version/s: 1.6.1 Closing, please reopen if you can

[jira] [Resolved] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13094. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Updated] (SPARK-13002) Mesos scheduler backend does not follow the property spark.dynamicAllocation.initialExecutors

[ https://issues.apache.org/jira/browse/SPARK-13002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13002: - Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Mesos scheduler backend does not follow

[jira] [Resolved] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10820. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11006

[jira] [Resolved] (SPARK-12957) Derive and propagate data constrains in logical plan

[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12957. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10844

[jira] [Updated] (SPARK-12957) Derive and propagate data constrains in logical plan

[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12957: - Assignee: Sameer Agarwal > Derive and propagate data constrains in logical plan >

[jira] [Resolved] (SPARK-13090) Add initial support for constraint propagation in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13090. -- Resolution: Fixed Fix Version/s: 2.0.0 > Add initial support for constraint

[jira] [Reopened] (SPARK-12957) Derive and propagate data constrains in logical plan

[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-12957: -- > Derive and propagate data constrains in logical plan >

[jira] [Assigned] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-10820: Assignee: Michael Armbrust > Initial infrastructure > -- > >

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Description: Dataset aggregators with complex types fail with unable to find encoder for

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126996#comment-15126996 ] Michael Armbrust commented on SPARK-13094: -- Sorry, I'm looking at this closer now. The problem

[jira] [Updated] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10820: - Summary: Initial infrastructure (was: Physical plan: determine physical operators

[jira] [Resolved] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10777. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10678

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Priority: Critical (was: Major) > Grouping by a complex expression may lead to

[jira] [Updated] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Summary: No encoder implicits for Seq[Primitive] (was: Dataset Aggregators do not work

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Issue Type: Improvement (was: Bug) > Dataset Aggregators do not work with complex types

[jira] [Created] (SPARK-13118) Support for classes defined in package objects

Michael Armbrust created SPARK-13118: Summary: Support for classes defined in package objects Key: SPARK-13118 URL: https://issues.apache.org/jira/browse/SPARK-13118 Project: Spark Issue

[jira] [Resolved] (SPARK-12705) Sorting column can't be resolved if it's not in projection

[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12705. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10678

[jira] [Commented] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126954#comment-15126954 ] Michael Armbrust commented on SPARK-13083: -- The other possibility is that you are blocking the

[jira] [Commented] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126905#comment-15126905 ] Michael Armbrust commented on SPARK-13083: -- You need to also ensure the queries are running in

[jira] [Resolved] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12989. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13083. -- Resolution: Not A Problem Assignee: Michael Armbrust > Small spark sql queries

[jira] [Resolved] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11780. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10915

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Affects Version/s: 2.0.0 > Grouping by a complex expression may lead to incorrect

[jira] [Updated] (SPARK-13122) Race condition in MemoryStore.unrollSafely() causes memory leak

[ https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13122: - Target Version/s: 1.6.1 > Race condition in MemoryStore.unrollSafely() causes memory

[jira] [Commented] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127353#comment-15127353 ] Michael Armbrust commented on SPARK-13087: -- Here's a self-contained test case: {code}

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12705: - Assignee: Xiao Li > Sorting column can't be resolved if it's not in projection >

[jira] [Updated] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10777: - Assignee: Xiao Li > order by fails when column is aliased and projection includes

[jira] [Created] (SPARK-13128) API for building arrays / lists encoders

Michael Armbrust created SPARK-13128: Summary: API for building arrays / lists encoders Key: SPARK-13128 URL: https://issues.apache.org/jira/browse/SPARK-13128 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126678#comment-15126678 ] Michael Armbrust commented on SPARK-13101: -- /cc [~lian cheng] [~cloud_fan] > Dataset complex

[jira] [Updated] (SPARK-13091) Rewrite/Propagate constraints for Aliases

[ https://issues.apache.org/jira/browse/SPARK-13091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13091: - Assignee: Sameer Agarwal > Rewrite/Propagate constraints for Aliases >

[jira] [Updated] (SPARK-13090) Add initial support for constraint propagation in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13090: - Assignee: Sameer Agarwal > Add initial support for constraint propagation in SparkSQL >

[jira] [Updated] (SPARK-13092) Track constraints in ExpressionSet

[ https://issues.apache.org/jira/browse/SPARK-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13092: - Assignee: Sameer Agarwal > Track constraints in ExpressionSet >

[jira] [Created] (SPARK-13099) ccjlbr

Michael Armbrust created SPARK-13099: Summary: ccjlbr Key: SPARK-13099 URL: https://issues.apache.org/jira/browse/SPARK-13099 Project: Spark Issue Type: Bug Reporter: Michael

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Target Version/s: 1.6.1 > Grouping by a complex expression may lead to incorrect

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124205#comment-15124205 ] Michael Armbrust commented on SPARK-13094: -- Sorry, I think I was unclear. When I said

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Target Version/s: 1.6.1 > Dataset Aggregators do not work with complex types >

[jira] [Commented] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122016#comment-15122016 ] Michael Armbrust commented on SPARK-12725: -- Why don't we just add a flag to AttributeReference

[jira] [Resolved] (SPARK-12926) SQLContext to display warning message when non-sql configs are being set

[ https://issues.apache.org/jira/browse/SPARK-12926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12926. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10849

[jira] [Commented] (SPARK-8279) udf_round_3 test fails

[ https://issues.apache.org/jira/browse/SPARK-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117838#comment-15117838 ] Michael Armbrust commented on SPARK-8279: - I don't think it was a super principled decision. If

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118433#comment-15118433 ] Michael Armbrust commented on SPARK-12988: -- Here are my thoughts after discussing with [~rxin]:

[jira] [Created] (SPARK-12987) Drop fails when columns contain quotes

Michael Armbrust created SPARK-12987: Summary: Drop fails when columns contain quotes Key: SPARK-12987 URL: https://issues.apache.org/jira/browse/SPARK-12987 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12987) Drop fails when columns contain dots

[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12987: - Summary: Drop fails when columns contain dots (was: Drop fails when columns contain

[jira] [Created] (SPARK-12988) Can't drop columns that contain dots

Michael Armbrust created SPARK-12988: Summary: Can't drop columns that contain dots Key: SPARK-12988 URL: https://issues.apache.org/jira/browse/SPARK-12988 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12987) Drop fails when columns contain dots

[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12987: - Priority: Critical (was: Major) > Drop fails when columns contain dots >

[jira] [Created] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

Michael Armbrust created SPARK-12989: Summary: Bad interaction between StarExpansion and ExtractWindowExpressions Key: SPARK-12989 URL: https://issues.apache.org/jira/browse/SPARK-12989 Project:

[jira] [Updated] (SPARK-12975) Throwing Exception when Bucketing Columns are part of Partitioning Columns

[ https://issues.apache.org/jira/browse/SPARK-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12975: - Assignee: Xiao Li > Throwing Exception when Bucketing Columns are part of Partitioning

[jira] [Resolved] (SPARK-12975) Throwing Exception when Bucketing Columns are part of Partitioning Columns

[ https://issues.apache.org/jira/browse/SPARK-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12975. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10891

[jira] [Resolved] (SPARK-12816) Schema generation for type aliases does not work

[ https://issues.apache.org/jira/browse/SPARK-12816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12816. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10749

[jira] [Created] (SPARK-12841) UnresolvedException with cast

Michael Armbrust created SPARK-12841: Summary: UnresolvedException with cast Key: SPARK-12841 URL: https://issues.apache.org/jira/browse/SPARK-12841 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12813) Eliminate serialization for back to back operations

[ https://issues.apache.org/jira/browse/SPARK-12813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12813. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10747

[jira] [Created] (SPARK-12813) Eliminate serialization for back to back operations

Michael Armbrust created SPARK-12813: Summary: Eliminate serialization for back to back operations Key: SPARK-12813 URL: https://issues.apache.org/jira/browse/SPARK-12813 Project: Spark

[jira] [Updated] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11780: - Target Version/s: 1.6.1 > Provide type aliases in org.apache.spark.sql.types for

[jira] [Resolved] (SPARK-12478) Dataset fields of product types can't be null

[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12478. -- Resolution: Fixed Fix Version/s: 1.6.1 This is fixed in branch-1.6 now. >

[jira] [Updated] (SPARK-12478) Dataset fields of product types can't be null

[ https://issues.apache.org/jira/browse/SPARK-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12478: - Fix Version/s: 2.0.0 > Dataset fields of product types can't be null >

[jira] [Updated] (SPARK-12783) Dataset map serialization error

[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12783: - Summary: Dataset map serialization error (was: Dataset map) > Dataset map serialization

[jira] [Resolved] (SPARK-9843) Catalyst: Allow adding custom optimizers

[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9843. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10210

[jira] [Updated] (SPARK-12783) Dataset map

[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12783: - Assignee: Wenchen Fan Target Version/s: 1.6.1, 2.0.0 Priority:

[jira] [Resolved] (SPARK-12758) Add note to Spark SQL Migration section about SPARK-11724

[ https://issues.apache.org/jira/browse/SPARK-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12758. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Commented] (SPARK-12714) Transforming Dataset with sequences of case classes to RDD causes Task Not Serializable exception

[ https://issues.apache.org/jira/browse/SPARK-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092591#comment-15092591 ] Michael Armbrust commented on SPARK-12714: -- Would you be able to test with {{branch-1.6}}? I

[jira] [Resolved] (SPARK-12696) Dataset serialization error

[ https://issues.apache.org/jira/browse/SPARK-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12696. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10650

[jira] [Updated] (SPARK-12704) we may repartition a relation even it's not needed

[ https://issues.apache.org/jira/browse/SPARK-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12704: - Issue Type: Improvement (was: Bug) > we may repartition a relation even it's not needed

[jira] [Commented] (SPARK-12704) we may repartition a relation even it's not needed

[ https://issues.apache.org/jira/browse/SPARK-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088638#comment-15088638 ] Michael Armbrust commented on SPARK-12704: -- I think this explanation might be clearer with with

[jira] [Created] (SPARK-12696) Dataset serialization error

Michael Armbrust created SPARK-12696: Summary: Dataset serialization error Key: SPARK-12696 URL: https://issues.apache.org/jira/browse/SPARK-12696 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12696) Dataset serialization error

[ https://issues.apache.org/jira/browse/SPARK-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12696: - Priority: Blocker (was: Major) > Dataset serialization error >

[jira] [Updated] (SPARK-12696) Dataset serialization error

[ https://issues.apache.org/jira/browse/SPARK-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12696: - Target Version/s: 1.6.1 (was: 1.6.1, 2.0.0) > Dataset serialization error >

[jira] [Resolved] (SPARK-11878) Eliminate distribute by in case group by is present with exactly the same grouping expressions

[ https://issues.apache.org/jira/browse/SPARK-11878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11878. -- Resolution: Fixed Assignee: Yash Datta Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-12438) Add SQLUserDefinedType support for encoder

[ https://issues.apache.org/jira/browse/SPARK-12438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12438. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10390

[jira] [Resolved] (SPARK-12439) Fix toCatalystArray and MapObjects

[ https://issues.apache.org/jira/browse/SPARK-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12439. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10391

[jira] [Updated] (SPARK-12439) Fix toCatalystArray and MapObjects

[ https://issues.apache.org/jira/browse/SPARK-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12439: - Assignee: Liang-Chi Hsieh (was: Apache Spark) > Fix toCatalystArray and MapObjects >

[jira] [Resolved] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12504. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10452

[jira] [Resolved] (SPARK-12421) Fix copy() method of GenericRow

[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12421. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10553

[jira] [Updated] (SPARK-12421) Fix copy() method of GenericRow

[ https://issues.apache.org/jira/browse/SPARK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12421: - Assignee: Herman van Hovell > Fix copy() method of GenericRow >

[jira] [Updated] (SPARK-12512) WithColumn does not work on multiple column with special character

[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12512: - Assignee: Xiu (Joe) Guo (was: Apache Spark) > WithColumn does not work on multiple

[jira] [Resolved] (SPARK-12512) WithColumn does not work on multiple column with special character

[ https://issues.apache.org/jira/browse/SPARK-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12512. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10500

[jira] [Resolved] (SPARK-12600) Remove deprecated methods in SQL / DataFrames

[ https://issues.apache.org/jira/browse/SPARK-12600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12600. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10559

[jira] [Resolved] (SPARK-12568) Add BINARY to Encoders

[ https://issues.apache.org/jira/browse/SPARK-12568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12568. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10516

[jira] [Resolved] (SPARK-12495) use true as default value for propagateNull in NewInstance

[ https://issues.apache.org/jira/browse/SPARK-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12495. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10443

[jira] [Created] (SPARK-12568) Add BINARY to Encoders

Michael Armbrust created SPARK-12568: Summary: Add BINARY to Encoders Key: SPARK-12568 URL: https://issues.apache.org/jira/browse/SPARK-12568 Project: Spark Issue Type: Sub-task

<    2   3   4   5   6   7   8   9   10   11   >