[jira] [Created] (SPARK-13582) Improve performance of parquet reader with dictionary encoding

Davies Liu created SPARK-13582: -- Summary: Improve performance of parquet reader with dictionary encoding Key: SPARK-13582 URL: https://issues.apache.org/jira/browse/SPARK-13582 Project: Spark

[jira] [Commented] (SPARK-13541) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

[ https://issues.apache.org/jira/browse/SPARK-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171216#comment-15171216 ] Davies Liu commented on SPARK-13541: [~nongli] Since the test failed in vectorized parquet reader,

[jira] [Issue Comment Deleted] (SPARK-13415) Visualize subquery in SQL web UI

[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13415: --- Comment: was deleted (was: [~nongli] Since the test failed in vectorized parquet reader, so I

[jira] [Commented] (SPARK-13415) Visualize subquery in SQL web UI

[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171215#comment-15171215 ] Davies Liu commented on SPARK-13415: [~nongli] Since the test failed in vectorized parquet reader,

[jira] [Created] (SPARK-13541) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

Davies Liu created SPARK-13541: -- Summary: Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType Key: SPARK-13541 URL: https://issues.apache.org/jira/browse/SPARK-13541 Project: Spark

[jira] [Assigned] (SPARK-13415) Visualize subquery in SQL web UI

[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-13415: -- Assignee: Davies Liu > Visualize subquery in SQL web UI > >

[jira] [Created] (SPARK-13523) Reuse the exchanges in a query

Davies Liu created SPARK-13523: -- Summary: Reuse the exchanges in a query Key: SPARK-13523 URL: https://issues.apache.org/jira/browse/SPARK-13523 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-13465) Add a task failure listener to TaskContext

[ https://issues.apache.org/jira/browse/SPARK-13465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13465. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11340

[jira] [Resolved] (SPARK-13499) Optimize vectorized parquet reader for dictionary encoded data and RLE decoding

[ https://issues.apache.org/jira/browse/SPARK-13499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13499. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11375

[jira] [Resolved] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12313. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11328

[jira] [Resolved] (SPARK-13476) Generate does not always output UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13476. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11354

[jira] [Resolved] (SPARK-13376) Improve column pruning

[ https://issues.apache.org/jira/browse/SPARK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13376. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11354

[jira] [Resolved] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

[ https://issues.apache.org/jira/browse/SPARK-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13250. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11141

[jira] [Created] (SPARK-13476) Generate does not always output UnsafeRow

Davies Liu created SPARK-13476: -- Summary: Generate does not always output UnsafeRow Key: SPARK-13476 URL: https://issues.apache.org/jira/browse/SPARK-13476 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13467) abstract python function to simplify pyspark code

[ https://issues.apache.org/jira/browse/SPARK-13467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13467. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11342

[jira] [Resolved] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13431. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11331

[jira] [Resolved] (SPARK-13376) Improve column pruning

[ https://issues.apache.org/jira/browse/SPARK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13376. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11256

[jira] [Created] (SPARK-13463) Support Column pruning for Dataset logical plan

Davies Liu created SPARK-13463: -- Summary: Support Column pruning for Dataset logical plan Key: SPARK-13463 URL: https://issues.apache.org/jira/browse/SPARK-13463 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13373) Generate code for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-13373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13373. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11248

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159682#comment-15159682 ] Davies Liu commented on SPARK-13431: https://github.com/apache/spark/pull/11331 > Maven build fails

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159670#comment-15159670 ] Davies Liu commented on SPARK-13431: I'd like to split ExpressionParser.g, or we can't touch it

[jira] [Resolved] (SPARK-13329) Considering output for statistics of logical plan

[ https://issues.apache.org/jira/browse/SPARK-13329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13329. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11210

[jira] [Resolved] (SPARK-13358) Retrieve grep path when doing Benchmark

[ https://issues.apache.org/jira/browse/SPARK-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13358. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11231

[jira] [Resolved] (SPARK-13306) Uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13306. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11190

[jira] [Resolved] (SPARK-13310) Missing Sorting Columns in Generate

[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13310. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11198

[jira] [Created] (SPARK-13415) Visualize subquery on SQL tab

Davies Liu created SPARK-13415: -- Summary: Visualize subquery on SQL tab Key: SPARK-13415 URL: https://issues.apache.org/jira/browse/SPARK-13415 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-13408) Exception in resultHandler will shutdown SparkContext

[ https://issues.apache.org/jira/browse/SPARK-13408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13408. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11280

[jira] [Resolved] (SPARK-13304) Broadcast join with two ints could be very slow

[ https://issues.apache.org/jira/browse/SPARK-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13304. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 Fixed by

[jira] [Commented] (SPARK-13409) Log the stacktrace when stopping a SparkContext

[ https://issues.apache.org/jira/browse/SPARK-13409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155439#comment-15155439 ] Davies Liu commented on SPARK-13409: [~rxin] I think we should remember the stacktrace, put that in

[jira] [Commented] (SPARK-13213) BroadcastNestedLoopJoin is very slow

[ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155438#comment-15155438 ] Davies Liu commented on SPARK-13213: It depends, I'm open to any reasonable solution. >

[jira] [Resolved] (SPARK-12567) Add aes_{encrypt,decrypt} UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12567. Resolution: Fixed Assignee: Kai Jiang Fix Version/s: 2.0.0 > Add

[jira] [Resolved] (SPARK-12594) Outer Join Elimination by Filter Condition

[ https://issues.apache.org/jira/browse/SPARK-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12594. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10567

[jira] [Updated] (SPARK-13409) Remember the stacktrace when stop a SparkContext

[ https://issues.apache.org/jira/browse/SPARK-13409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13409: --- Component/s: Spark Core > Remember the stacktrace when stop a SparkContext >

[jira] [Created] (SPARK-13409) Remember the stacktrace when stop a SparkContext

Davies Liu created SPARK-13409: -- Summary: Remember the stacktrace when stop a SparkContext Key: SPARK-13409 URL: https://issues.apache.org/jira/browse/SPARK-13409 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13408) Exception in resultHandler will shutdown SparkContext

Davies Liu created SPARK-13408: -- Summary: Exception in resultHandler will shutdown SparkContext Key: SPARK-13408 URL: https://issues.apache.org/jira/browse/SPARK-13408 Project: Spark Issue

[jira] [Created] (SPARK-13406) NPE in LazilyGeneratedOrdering

Davies Liu created SPARK-13406: -- Summary: NPE in LazilyGeneratedOrdering Key: SPARK-13406 URL: https://issues.apache.org/jira/browse/SPARK-13406 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13404) Create the variables for input when it's used

Davies Liu created SPARK-13404: -- Summary: Create the variables for input when it's used Key: SPARK-13404 URL: https://issues.apache.org/jira/browse/SPARK-13404 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13237) Generate broadcast outer join

[ https://issues.apache.org/jira/browse/SPARK-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13237. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11130

[jira] [Created] (SPARK-13376) Improve column pruning

Davies Liu created SPARK-13376: -- Summary: Improve column pruning Key: SPARK-13376 URL: https://issues.apache.org/jira/browse/SPARK-13376 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13373) Generate code for sort merge join

Davies Liu created SPARK-13373: -- Summary: Generate code for sort merge join Key: SPARK-13373 URL: https://issues.apache.org/jira/browse/SPARK-13373 Project: Spark Issue Type: New Feature

[jira] [Closed] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

[ https://issues.apache.org/jira/browse/SPARK-13354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-13354. -- Resolution: Duplicate > Push filter throughout outer join when the condition can filter out empty row

[jira] [Created] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

Davies Liu created SPARK-13354: -- Summary: Push filter throughout outer join when the condition can filter out empty row Key: SPARK-13354 URL: https://issues.apache.org/jira/browse/SPARK-13354 Project:

[jira] [Created] (SPARK-13353) Use UnsafeRowSerializer to collect DataFrame

Davies Liu created SPARK-13353: -- Summary: Use UnsafeRowSerializer to collect DataFrame Key: SPARK-13353 URL: https://issues.apache.org/jira/browse/SPARK-13353 Project: Spark Issue Type:

[jira] [Created] (SPARK-13352) BlockFetch does not scale well on large block

Davies Liu created SPARK-13352: -- Summary: BlockFetch does not scale well on large block Key: SPARK-13352 URL: https://issues.apache.org/jira/browse/SPARK-13352 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13351) Column pruning fails on expand

Davies Liu created SPARK-13351: -- Summary: Column pruning fails on expand Key: SPARK-13351 URL: https://issues.apache.org/jira/browse/SPARK-13351 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13348) Avoid duplicated broadcasts

Davies Liu created SPARK-13348: -- Summary: Avoid duplicated broadcasts Key: SPARK-13348 URL: https://issues.apache.org/jira/browse/SPARK-13348 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13347) Reuse the shuffle for duplicated exchange

Davies Liu created SPARK-13347: -- Summary: Reuse the shuffle for duplicated exchange Key: SPARK-13347 URL: https://issues.apache.org/jira/browse/SPARK-13347 Project: Spark Issue Type:

[jira] [Created] (SPARK-13329) Considering output for statistics of logicol plan

Davies Liu created SPARK-13329: -- Summary: Considering output for statistics of logicol plan Key: SPARK-13329 URL: https://issues.apache.org/jira/browse/SPARK-13329 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13323) Type cast support in type inference during merging types.

[ https://issues.apache.org/jira/browse/SPARK-13323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147591#comment-15147591 ] Davies Liu commented on SPARK-13323: HiveTypeCoercion is pretty complicated, we may don't want to

[jira] [Created] (SPARK-13311) prettyString of IN is not good

Davies Liu created SPARK-13311: -- Summary: prettyString of IN is not good Key: SPARK-13311 URL: https://issues.apache.org/jira/browse/SPARK-13311 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12705) Sorting column can't be resolved if it's not in projection

[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12705. Resolution: Fixed Issue resolved by pull request 11153

[jira] [Created] (SPARK-13304) Broadcast join with two ints could be very slow

Davies Liu created SPARK-13304: -- Summary: Broadcast join with two ints could be very slow Key: SPARK-13304 URL: https://issues.apache.org/jira/browse/SPARK-13304 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13306) Uncorrelated scalar subquery

Davies Liu created SPARK-13306: -- Summary: Uncorrelated scalar subquery Key: SPARK-13306 URL: https://issues.apache.org/jira/browse/SPARK-13306 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-12962) PySpark support covar_samp and covar_pop

[ https://issues.apache.org/jira/browse/SPARK-12962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12962. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10876

[jira] [Resolved] (SPARK-12544) Support window functions in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12544. Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 Since we

[jira] [Updated] (SPARK-13304) Broadcast join with two ints could be very slow

[ https://issues.apache.org/jira/browse/SPARK-13304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13304: --- Component/s: SQL > Broadcast join with two ints could be very slow >

[jira] [Updated] (SPARK-13306) Uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13306: --- Component/s: SQL > Uncorrelated scalar subquery > > >

[jira] [Commented] (SPARK-12544) Support window functions in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145442#comment-15145442 ] Davies Liu commented on SPARK-12544: [~hvanhovell] Does window functions sill require HiveContext? Or

[jira] [Commented] (SPARK-12544) Support window functions in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145581#comment-15145581 ] Davies Liu commented on SPARK-12544: We are retiring HiveContext in 2.0, we may update the docs

[jira] [Assigned] (SPARK-12915) SQL metrics for generated operators

[ https://issues.apache.org/jira/browse/SPARK-12915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12915: -- Assignee: Davies Liu > SQL metrics for generated operators >

[jira] [Commented] (SPARK-12949) Support common expression elimination

[ https://issues.apache.org/jira/browse/SPARK-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143787#comment-15143787 ] Davies Liu commented on SPARK-12949: After some prototype, enable common expression elimination could

[jira] [Created] (SPARK-13293) Generate code for Expand

Davies Liu created SPARK-13293: -- Summary: Generate code for Expand Key: SPARK-13293 URL: https://issues.apache.org/jira/browse/SPARK-13293 Project: Spark Issue Type: Improvement

[jira] [Reopened] (SPARK-12705) Sorting column can't be resolved if it's not in projection

[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-12705: Assignee: Davies Liu (was: Xiao Li) The Q98 is still can't be analyzed, I will send a PR to fix

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15141438#comment-15141438 ] Davies Liu commented on SPARK-13174: [~GayathriMurali] Yes, there is a way, but it's not as good as

[jira] [Resolved] (SPARK-12706) support grouping/grouping_id function together group set

[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12706. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10677

[jira] [Resolved] (SPARK-13234) Remove duplicated SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13234. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11163

[jira] [Created] (SPARK-13249) Filter null keys for inner join

Davies Liu created SPARK-13249: -- Summary: Filter null keys for inner join Key: SPARK-13249 URL: https://issues.apache.org/jira/browse/SPARK-13249 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-13173) Fail to load CSV file with NPE

[ https://issues.apache.org/jira/browse/SPARK-13173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-13173. -- Resolution: Cannot Reproduce > Fail to load CSV file with NPE > -- > >

[jira] [Updated] (SPARK-13173) Fail to load CSV file with NPE

[ https://issues.apache.org/jira/browse/SPARK-13173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13173: --- Description: {code} id|end_date|start_date|location 1|2015-10-14 00:00:00|2015-09-14 00:00:00|CA-SF

[jira] [Resolved] (SPARK-12950) Improve performance of BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12950. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11010

[jira] [Resolved] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11055

[jira] [Resolved] (SPARK-8964) Use Exchange in limit operations (per partition limit -> exchange to one partition -> per partition limit)

[ https://issues.apache.org/jira/browse/SPARK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8964. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 7334

[jira] [Updated] (SPARK-12840) Support passing arbitrary objects (not just expressions) into code generated classes

[ https://issues.apache.org/jira/browse/SPARK-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12840: --- Component/s: SQL > Support passing arbitrary objects (not just expressions) into code generated >

[jira] [Updated] (SPARK-13215) Remove fallback in codegen

[ https://issues.apache.org/jira/browse/SPARK-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13215: --- Component/s: SQL > Remove fallback in codegen > -- > > Key:

[jira] [Created] (SPARK-13234) Remove duplicated SQL metrics

Davies Liu created SPARK-13234: -- Summary: Remove duplicated SQL metrics Key: SPARK-13234 URL: https://issues.apache.org/jira/browse/SPARK-13234 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13213) BroadcastNestedLoopJoin is very slow

[ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137551#comment-15137551 ] Davies Liu commented on SPARK-13213: [~sowen] Thanks very much for update these, I try to remember to

[jira] [Updated] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12585: --- Component/s: SQL > The numFields of UnsafeRow should not changed by pointTo() >

[jira] [Resolved] (SPARK-13095) improve performance of hash join with dimension table

[ https://issues.apache.org/jira/browse/SPARK-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13095. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11065

[jira] [Created] (SPARK-13237) Generate broadcast outer join

Davies Liu created SPARK-13237: -- Summary: Generate broadcast outer join Key: SPARK-13237 URL: https://issues.apache.org/jira/browse/SPARK-13237 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13213) BroadcastNestedLoopJoin is very slow

Davies Liu created SPARK-13213: -- Summary: BroadcastNestedLoopJoin is very slow Key: SPARK-13213 URL: https://issues.apache.org/jira/browse/SPARK-13213 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-13215) Remove fallback in codegen

[ https://issues.apache.org/jira/browse/SPARK-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13215. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11097

[jira] [Created] (SPARK-13217) UI of visualization of stage

Davies Liu created SPARK-13217: -- Summary: UI of visualization of stage Key: SPARK-13217 URL: https://issues.apache.org/jira/browse/SPARK-13217 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-13217) UI of visualization of stage

[ https://issues.apache.org/jira/browse/SPARK-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-13217. -- Resolution: Not A Problem It works after restart the driver. > UI of visualization of stage >

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134979#comment-15134979 ] Davies Liu commented on SPARK-13116: I tried the test you attached, it work well on master. >

[jira] [Created] (SPARK-13215) Remove fallback in codegen

Davies Liu created SPARK-13215: -- Summary: Remove fallback in codegen Key: SPARK-13215 URL: https://issues.apache.org/jira/browse/SPARK-13215 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134959#comment-15134959 ] Davies Liu commented on SPARK-13116: Which UnaryExpression generate incorrect code? I think we may

[jira] [Assigned] (SPARK-13210) NPE in Sort

[ https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-13210: -- Assignee: Davies Liu > NPE in Sort > --- > > Key: SPARK-13210 >

[jira] [Created] (SPARK-13210) NPE in Sort

Davies Liu created SPARK-13210: -- Summary: NPE in Sort Key: SPARK-13210 URL: https://issues.apache.org/jira/browse/SPARK-13210 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129994#comment-15129994 ] Davies Liu commented on SPARK-13157: THis is introduced by

[jira] [Commented] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129995#comment-15129995 ] Davies Liu commented on SPARK-13157: Could be reproduce by {code} test("path with @") { val

[jira] [Commented] (SPARK-13046) Partitioning looks broken in 1.6

[ https://issues.apache.org/jira/browse/SPARK-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131170#comment-15131170 ] Davies Liu commented on SPARK-13046: I tried Spark 1.6 and master with a directory like this {code}

[jira] [Updated] (SPARK-13131) Use best time and average time in micro benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13131: --- Summary: Use best time and average time in micro benchmark (was: Use median time in benchmark) >

[jira] [Updated] (SPARK-13131) Use best time and average time in micro benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13131: --- Description: Best time should be more stable than average time in benchmark, together with average

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131138#comment-15131138 ] Davies Liu commented on SPARK-13116: Could you provide a test to reproduce this issue? >

[jira] [Commented] (SPARK-13131) Use median time in benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131205#comment-15131205 ] Davies Liu commented on SPARK-13131: [~piccolbo] Thanks for you comments, we also have lots of

[jira] [Resolved] (SPARK-13157) ADD JAR command cannot handle path with @ character

[ https://issues.apache.org/jira/browse/SPARK-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13157. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11052

[jira] [Created] (SPARK-13174) Add API and options for csv data sources

Davies Liu created SPARK-13174: -- Summary: Add API and options for csv data sources Key: SPARK-13174 URL: https://issues.apache.org/jira/browse/SPARK-13174 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-13173) Fail to load CSV file with NPE

Davies Liu created SPARK-13173: -- Summary: Fail to load CSV file with NPE Key: SPARK-13173 URL: https://issues.apache.org/jira/browse/SPARK-13173 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131336#comment-15131336 ] Davies Liu commented on SPARK-12992: [~nongli] We usually have one PR for one JIRA, the JIRA will be

[jira] [Commented] (SPARK-13131) Use best time and average time in micro benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131413#comment-15131413 ] Davies Liu commented on SPARK-13131: [~srowen] Fully agreed with you, that's my first thought. Some

<    3   4   5   6   7   8   9   10   11   12   >