[jira] [Commented] (SPARK-15406) Structured streaming support for consuming from Kafka

[ https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487875#comment-15487875 ] Michael Armbrust commented on SPARK-15406: -- Hey Cody, thanks for the input and for sharing your

[jira] [Created] (SPARK-16724) Expose DefinedByConstructorParams

Michael Armbrust created SPARK-16724: Summary: Expose DefinedByConstructorParams Key: SPARK-16724 URL: https://issues.apache.org/jira/browse/SPARK-16724 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-16609) Single function for parsing timestamps/dates

Michael Armbrust created SPARK-16609: Summary: Single function for parsing timestamps/dates Key: SPARK-16609 URL: https://issues.apache.org/jira/browse/SPARK-16609 Project: Spark Issue

[jira] [Updated] (SPARK-16609) Single function for parsing timestamps/dates

[ https://issues.apache.org/jira/browse/SPARK-16609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-16609: - Target Version/s: 2.1.0 > Single function for parsing timestamps/dates >

[jira] [Resolved] (SPARK-16531) Remove TimeZone from DataFrameTimeWindowingSuite

[ https://issues.apache.org/jira/browse/SPARK-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-16531. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14170

[jira] [Updated] (SPARK-16483) Unifying struct fields and columns

[ https://issues.apache.org/jira/browse/SPARK-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-16483: - Target Version/s: 2.1.0 > Unifying struct fields and columns >

[jira] [Commented] (SPARK-8360) Structured Streaming (aka Streaming DataFrames)

[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359516#comment-15359516 ] Michael Armbrust commented on SPARK-8360: - This kind of question would be better asked on the

[jira] [Closed] (SPARK-16188) Spark sql create a lot of small files

[ https://issues.apache.org/jira/browse/SPARK-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-16188. Resolution: Not A Bug This is by design and changes would likely be too disruptive. The

[jira] [Resolved] (SPARK-16050) Flaky Test: Complete aggregation with Console sink

[ https://issues.apache.org/jira/browse/SPARK-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-16050. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13776

[jira] [Resolved] (SPARK-15964) Assignment to RDD-typed val fails

[ https://issues.apache.org/jira/browse/SPARK-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15964. -- Resolution: Won't Fix > Assignment to RDD-typed val fails >

[jira] [Commented] (SPARK-15964) Assignment to RDD-typed val fails

[ https://issues.apache.org/jira/browse/SPARK-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332224#comment-15332224 ] Michael Armbrust commented on SPARK-15964: -- Thanks for reporting this, but I believe this is

[jira] [Updated] (SPARK-15915) CacheManager should use canonicalized plan for planToCache.

[ https://issues.apache.org/jira/browse/SPARK-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15915: - Assignee: Takuya Ueshin > CacheManager should use canonicalized plan for planToCache. >

[jira] [Resolved] (SPARK-15915) CacheManager should use canonicalized plan for planToCache.

[ https://issues.apache.org/jira/browse/SPARK-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15915. -- Resolution: Fixed Fix Version/s: 2.0.0 > CacheManager should use canonicalized

[jira] [Updated] (SPARK-15934) Return binary mode in ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-15934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15934: - Assignee: Egor Pakhomov Target Version/s: 2.0.0 Priority:

[jira] [Updated] (SPARK-15934) Return binary mode in ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-15934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15934: - Assignee: (was: Egor Pakhomov) > Return binary mode in ThriftServer >

[jira] [Resolved] (SPARK-15489) Dataset kryo encoder won't load custom user settings

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15489. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13424

[jira] [Resolved] (SPARK-6320) Adding new query plan strategy to SQLContext

[ https://issues.apache.org/jira/browse/SPARK-6320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6320. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13147

[jira] [Resolved] (SPARK-15743) Prevent saving with all-column partitioning

[ https://issues.apache.org/jira/browse/SPARK-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15743. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13486

[jira] [Updated] (SPARK-15743) Prevent saving with all-column partitioning

[ https://issues.apache.org/jira/browse/SPARK-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15743: - Labels: releasenotes (was: ) > Prevent saving with all-column partitioning >

[jira] [Updated] (SPARK-15786) joinWith bytecode generation calling ByteBuffer.wrap with InternalRow

[ https://issues.apache.org/jira/browse/SPARK-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15786: - Target Version/s: 2.0.0 > joinWith bytecode generation calling ByteBuffer.wrap with

[jira] [Updated] (SPARK-15732) Dataset generated code "generated.java" Fails with Certain Case Classes

[ https://issues.apache.org/jira/browse/SPARK-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15732: - Priority: Critical (was: Major) > Dataset generated code "generated.java" Fails with

[jira] [Updated] (SPARK-15732) Dataset generated code "generated.java" Fails with Certain Case Classes

[ https://issues.apache.org/jira/browse/SPARK-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15732: - Target Version/s: 2.0.0 > Dataset generated code "generated.java" Fails with Certain

[jira] [Commented] (SPARK-12931) Improve bucket read path to only create one single RDD

[ https://issues.apache.org/jira/browse/SPARK-12931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312702#comment-15312702 ] Michael Armbrust commented on SPARK-12931: -- It was fixed in:

[jira] [Resolved] (SPARK-15686) Move user-facing structured streaming classes into sql.streaming

[ https://issues.apache.org/jira/browse/SPARK-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15686. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13429

[jira] [Commented] (SPARK-15654) Reading gzipped files results in duplicate rows

[ https://issues.apache.org/jira/browse/SPARK-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306831#comment-15306831 ] Michael Armbrust commented on SPARK-15654: -- Thanks for point this out! Looks like we need to at

[jira] [Updated] (SPARK-15654) Reading gzipped files results in duplicate rows

[ https://issues.apache.org/jira/browse/SPARK-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15654: - Target Version/s: 2.0.0 > Reading gzipped files results in duplicate rows >

[jira] [Updated] (SPARK-15654) Reading gzipped files results in duplicate rows

[ https://issues.apache.org/jira/browse/SPARK-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15654: - Priority: Blocker (was: Critical) > Reading gzipped files results in duplicate rows >

[jira] [Commented] (SPARK-15489) Dataset kryo encoder won't load custom user settings

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306826#comment-15306826 ] Michael Armbrust commented on SPARK-15489: -- As soon as you open a PR it will auto assign. >

[jira] [Updated] (SPARK-15483) IncrementalExecution should use extra strategies.

[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15483: - Assignee: Takuya Ueshin > IncrementalExecution should use extra strategies. >

[jira] [Resolved] (SPARK-15483) IncrementalExecution should use extra strategies.

[ https://issues.apache.org/jira/browse/SPARK-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15483. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13261

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298883#comment-15298883 ] Michael Armbrust commented on SPARK-15489: -- It should run in the same JVM when running in local

[jira] [Updated] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15489: - Target Version/s: 2.0.0 > Dataset kryo encoder fails on

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297095#comment-15297095 ] Michael Armbrust commented on SPARK-15489: -- Wild guess...

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296964#comment-15296964 ] Michael Armbrust commented on SPARK-15489: -- Also, does this problem exist in the 2.0 preview? >

[jira] [Commented] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection

[ https://issues.apache.org/jira/browse/SPARK-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296963#comment-15296963 ] Michael Armbrust commented on SPARK-15489: -- Is your registration making into the instance of

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296805#comment-15296805 ] Michael Armbrust commented on SPARK-15140: -- I don't think you should ever get a null row back.

[jira] [Resolved] (SPARK-15471) ScalaReflection cleanup

[ https://issues.apache.org/jira/browse/SPARK-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15471. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13250

[jira] [Resolved] (SPARK-15190) Support using SQLUserDefinedType for case classes

[ https://issues.apache.org/jira/browse/SPARK-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15190. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12965

[jira] [Updated] (SPARK-15308) RowEncoder should preserve nested column name.

[ https://issues.apache.org/jira/browse/SPARK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15308: - Target Version/s: 2.0.0 > RowEncoder should preserve nested column name. >

[jira] [Updated] (SPARK-15313) EmbedSerializerInFilter rule should keep exprIds of output of surrounded SerializeFromObject.

[ https://issues.apache.org/jira/browse/SPARK-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15313: - Target Version/s: 2.0.0 > EmbedSerializerInFilter rule should keep exprIds of output of

[jira] [Updated] (SPARK-15416) Display a better message for not finding classes removed in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15416: - Assignee: Shixiong Zhu > Display a better message for not finding classes removed in

[jira] [Resolved] (SPARK-15416) Display a better message for not finding classes removed in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15416. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13201

[jira] [Commented] (SPARK-12141) Use Jackson to serialize all events when writing event log

[ https://issues.apache.org/jira/browse/SPARK-12141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291971#comment-15291971 ] Michael Armbrust commented on SPARK-12141: -- My issue with the catch-all case that was added is

[jira] [Updated] (SPARK-15384) Codegen CompileException "mapelements_isNull" is not an rvalue

[ https://issues.apache.org/jira/browse/SPARK-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15384: - Assignee: Wenchen Fan Target Version/s: 2.0.0 > Codegen CompileException

[jira] [Updated] (SPARK-15367) Add refreshTable back

[ https://issues.apache.org/jira/browse/SPARK-15367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15367: - Priority: Critical (was: Major) > Add refreshTable back > -- > >

[jira] [Resolved] (SPARK-10216) Avoid creating empty files during overwrite into Hive table with group by query

[ https://issues.apache.org/jira/browse/SPARK-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10216. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12855

[jira] [Commented] (SPARK-15140) ensure input object of encoder is not null

[ https://issues.apache.org/jira/browse/SPARK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273100#comment-15273100 ] Michael Armbrust commented on SPARK-15140: -- The 2.0 behavior seems correct. Ideally

[jira] [Updated] (SPARK-14959) ​Problem Reading partitioned ORC or Parquet files

[ https://issues.apache.org/jira/browse/SPARK-14959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14959: - Priority: Critical (was: Major) > ​Problem Reading partitioned ORC or Parquet files >

[jira] [Updated] (SPARK-14959) ​Problem Reading partitioned ORC or Parquet files

[ https://issues.apache.org/jira/browse/SPARK-14959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14959: - Target Version/s: 2.0.0 Component/s: (was: Input/Output)

[jira] [Resolved] (SPARK-15077) StreamExecution.awaitOffset may take too long because of thread starvation

[ https://issues.apache.org/jira/browse/SPARK-15077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15077. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12852

[jira] [Updated] (SPARK-15062) Show on DataFrame causes OutOfMemoryError, NegativeArraySizeException or segfault

[ https://issues.apache.org/jira/browse/SPARK-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15062: - Assignee: Bo Meng > Show on DataFrame causes OutOfMemoryError,

[jira] [Resolved] (SPARK-15062) Show on DataFrame causes OutOfMemoryError, NegativeArraySizeException or segfault

[ https://issues.apache.org/jira/browse/SPARK-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15062. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12849

[jira] [Resolved] (SPARK-14747) Add assertStreaming/assertNoneStreaming checks in DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14747. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12521

[jira] [Resolved] (SPARK-14830) Add RemoveRepetitionFromGroupExpressions optimizer

[ https://issues.apache.org/jira/browse/SPARK-14830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14830. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12590

[jira] [Resolved] (SPARK-14579) Fix a race condition in StreamExecution.processAllAvailable

[ https://issues.apache.org/jira/browse/SPARK-14579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14579. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12582

[jira] [Resolved] (SPARK-14637) object expressions cleanup

[ https://issues.apache.org/jira/browse/SPARK-14637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14637. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12399

[jira] [Resolved] (SPARK-14970) DataSource enumerates all files in FileCatalog to infer schema even if there is user specified schema

[ https://issues.apache.org/jira/browse/SPARK-14970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14970. -- Resolution: Fixed Fix Version/s: 2.0.0 > DataSource enumerates all files in

[jira] [Updated] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14997: - Labels: regresion (was: ) > Files in subdirectories are incorrectly considered in

[jira] [Updated] (SPARK-15011) org.apache.spark.sql.hive.StatisticsSuite.analyze MetastoreRelations fails when hadoop 2.3 or hadoop 2.4 is used

[ https://issues.apache.org/jira/browse/SPARK-15011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-15011: - Priority: Critical (was: Major) > org.apache.spark.sql.hive.StatisticsSuite.analyze

[jira] [Updated] (SPARK-14993) Inconsistent behavior of partitioning discovery

[ https://issues.apache.org/jira/browse/SPARK-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14993: - Priority: Critical (was: Major) > Inconsistent behavior of partitioning discovery >

[jira] [Resolved] (SPARK-14337) Push down casts beneath CaseWhen and If expressions

[ https://issues.apache.org/jira/browse/SPARK-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14337. -- Resolution: Later Target Version/s: (was: 2.0.0) Closing as later since

[jira] [Resolved] (SPARK-14981) CatalogTable should contain sorting directions of sorting columns

[ https://issues.apache.org/jira/browse/SPARK-14981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14981. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12759

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264836#comment-15264836 ] Michael Armbrust commented on SPARK-6817: - [~shivaram] Sill trying to get any of this in Spark

[jira] [Updated] (SPARK-14997) Files in subdirectories are incorrectly considered in sqlContext.read.json()

[ https://issues.apache.org/jira/browse/SPARK-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14997: - Priority: Critical (was: Major) > Files in subdirectories are incorrectly considered in

[jira] [Updated] (SPARK-12854) Vectorize Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12854: - Assignee: Nong Li > Vectorize Parquet reader > > >

[jira] [Resolved] (SPARK-12854) Vectorize Parquet reader

[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12854. -- Resolution: Fixed Closing since all subtasks are done > Vectorize Parquet reader >

[jira] [Updated] (SPARK-13421) Make output of a SparkPlan configurable

[ https://issues.apache.org/jira/browse/SPARK-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13421: - Target Version/s: 2.1.0 (was: 2.0.0) > Make output of a SparkPlan configurable >

[jira] [Resolved] (SPARK-12852) Support create table DDL with bucketing

[ https://issues.apache.org/jira/browse/SPARK-12852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12852. -- Resolution: Later > Support create table DDL with bucketing >

[jira] [Resolved] (SPARK-12849) Bucketing improvements follow-up

[ https://issues.apache.org/jira/browse/SPARK-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12849. -- Resolution: Later Target Version/s: (was: 2.0.0) > Bucketing improvements

[jira] [Resolved] (SPARK-12851) Add the ability to understand tables bucketed by Hive

[ https://issues.apache.org/jira/browse/SPARK-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12851. -- Resolution: Later > Add the ability to understand tables bucketed by Hive >

[jira] [Resolved] (SPARK-13571) Track current database in SQL/HiveContext

[ https://issues.apache.org/jira/browse/SPARK-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13571. -- Resolution: Fixed I think this was done as part of another PR. > Track current

[jira] [Resolved] (SPARK-13424) Improve test coverage of EnsureRequirements

[ https://issues.apache.org/jira/browse/SPARK-13424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13424. -- Resolution: Later Closing along with the PR, reopen when you have time. > Improve

[jira] [Updated] (SPARK-14273) Add FileFormat.isSplittable to indicate whether a format is splittable

[ https://issues.apache.org/jira/browse/SPARK-14273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14273: - Target Version/s: 2.1.0 (was: 2.0.0) > Add FileFormat.isSplittable to indicate whether

[jira] [Updated] (SPARK-14237) De-duplicate partition value appending logic in various buildReader() implementations

[ https://issues.apache.org/jira/browse/SPARK-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14237: - Target Version/s: 2.1.0 (was: 2.0.0) > De-duplicate partition value appending logic in

[jira] [Updated] (SPARK-14237) De-duplicate partition value appending logic in various buildReader() implementations

[ https://issues.apache.org/jira/browse/SPARK-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14237: - Parent Issue: SPARK-13682 (was: SPARK-13664) > De-duplicate partition value appending

[jira] [Updated] (SPARK-13683) Finalize the public interface for OutputWriter[Factory]

[ https://issues.apache.org/jira/browse/SPARK-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13683: - Target Version/s: 2.1.0 (was: 2.0.0) > Finalize the public interface for

[jira] [Updated] (SPARK-14273) Add FileFormat.isSplittable to indicate whether a format is splittable

[ https://issues.apache.org/jira/browse/SPARK-14273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14273: - Parent Issue: SPARK-13682 (was: SPARK-13664) > Add FileFormat.isSplittable to indicate

[jira] [Updated] (SPARK-13683) Finalize the public interface for OutputWriter[Factory]

[ https://issues.apache.org/jira/browse/SPARK-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13683: - Parent Issue: SPARK-13682 (was: SPARK-13664) > Finalize the public interface for

[jira] [Resolved] (SPARK-15016) Simplify and Speedup HadoopFSRelation (follow-up)

[ https://issues.apache.org/jira/browse/SPARK-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-15016. -- Resolution: Duplicate > Simplify and Speedup HadoopFSRelation (follow-up) >

[jira] [Updated] (SPARK-13682) Finalize the public API for FileFormat

[ https://issues.apache.org/jira/browse/SPARK-13682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13682: - Target Version/s: 2.1.0 (was: 2.0.0) > Finalize the public API for FileFormat >

[jira] [Updated] (SPARK-13682) Finalize the public API for FileFormat

[ https://issues.apache.org/jira/browse/SPARK-13682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13682: - Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-13664) >

[jira] [Resolved] (SPARK-14874) Remove the obsolete Batch representation

[ https://issues.apache.org/jira/browse/SPARK-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14874. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12638

[jira] [Resolved] (SPARK-14678) Add a file sink log to support versioning and compaction

[ https://issues.apache.org/jira/browse/SPARK-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14678. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12435

[jira] [Updated] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14767: - Priority: Critical (was: Major) > Codegen "no constructor found" errors with Maps

[jira] [Resolved] (SPARK-14741) Streaming from partitioned directory structure captures unintended partition columns

[ https://issues.apache.org/jira/browse/SPARK-14741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14741. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12517

[jira] [Resolved] (SPARK-14555) Python API for methods introduced for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14555. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12320

[jira] [Resolved] (SPARK-13929) Use Scala reflection for UDFs

[ https://issues.apache.org/jira/browse/SPARK-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13929. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12149

[jira] [Updated] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-14648: - Assignee: Josh Rosen > Spark EC2 script creates cluster but spark is not installed

[jira] [Updated] (SPARK-13753) Column nullable is derived incorrectly

[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13753: - Description: There is a problem in spark sql to derive nullable column and used in

[jira] [Updated] (SPARK-13753) Column nullable is derived incorrectly

[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13753: - Description: There is a problem in spark sql to derive nullable column and used in

[jira] [Updated] (SPARK-13753) Column nullable is derived incorrectly

[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13753: - Target Version/s: 2.0.0 Priority: Critical (was: Major) > Column nullable

[jira] [Resolved] (SPARK-14474) Move FileSource offset log into checkpointLocation

[ https://issues.apache.org/jira/browse/SPARK-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14474. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12247

[jira] [Resolved] (SPARK-14494) Fix the race conditions in MemoryStream and MemorySink

[ https://issues.apache.org/jira/browse/SPARK-14494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14494. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12261

[jira] [Created] (SPARK-14463) read.text broken for partitioned tables

Michael Armbrust created SPARK-14463: Summary: read.text broken for partitioned tables Key: SPARK-14463 URL: https://issues.apache.org/jira/browse/SPARK-14463 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14463) read.text broken for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-14463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230946#comment-15230946 ] Michael Armbrust commented on SPARK-14463: -- [~rxin] > read.text broken for partitioned tables >

[jira] [Resolved] (SPARK-14456) Remove unused variables and logics in DataSource

[ https://issues.apache.org/jira/browse/SPARK-14456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14456. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12237

[jira] [Created] (SPARK-14449) SparkContext should use SparkListenerInterface

Michael Armbrust created SPARK-14449: Summary: SparkContext should use SparkListenerInterface Key: SPARK-14449 URL: https://issues.apache.org/jira/browse/SPARK-14449 Project: Spark Issue

[jira] [Resolved] (SPARK-14411) Add a note to warn that onQueryProgress is asynchronous

[ https://issues.apache.org/jira/browse/SPARK-14411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14411. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12180

[jira] [Resolved] (SPARK-14402) initcap UDF doesn't match Hive/Oracle behavior in lowercasing rest of string

[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14402. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12175

[jira] [Resolved] (SPARK-14257) Allow multiple continuous queries to be started from the same DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14257. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12049

<    1   2   3   4   5   6   7   8   9   10   >