[jira] [Commented] (SPARK-26644) Add documents for SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-26644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745011#comment-16745011 ] Takeshi Yamamuro commented on SPARK-26644: -- An example I made is: 

[jira] [Created] (SPARK-26644) Add documents for SQL metrics

Takeshi Yamamuro created SPARK-26644: Summary: Add documents for SQL metrics Key: SPARK-26644 URL: https://issues.apache.org/jira/browse/SPARK-26644 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26576) Broadcast hint not applied to partitioned table

[ https://issues.apache.org/jira/browse/SPARK-26576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26576: - Fix Version/s: (was: 2.3.3) > Broadcast hint not applied to partitioned table >

[jira] [Created] (SPARK-26637) Makes GetArrayItem nullability more precise

Takeshi Yamamuro created SPARK-26637: Summary: Makes GetArrayItem nullability more precise Key: SPARK-26637 URL: https://issues.apache.org/jira/browse/SPARK-26637 Project: Spark Issue

[jira] [Updated] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

[ https://issues.apache.org/jira/browse/SPARK-26012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26012: - Affects Version/s: 2.3.2 > Dynamic partition will fail when both '' and null values are

[jira] [Updated] (SPARK-25853) Parts of spark components (DAG Visualizationand executors page) not available in Internet Explorer

[ https://issues.apache.org/jira/browse/SPARK-25853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25853: - Fix Version/s: (was: 2.3.3) > Parts of spark components (DAG Visualizationand

[jira] [Commented] (SPARK-25853) Parts of spark components (DAG Visualizationand executors page) not available in Internet Explorer

[ https://issues.apache.org/jira/browse/SPARK-25853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741511#comment-16741511 ] Takeshi Yamamuro commented on SPARK-25853: -- Yea, thanks for pinging me. Dropped. > Parts of

[jira] [Issue Comment Deleted] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Comment: was deleted (was: This fix has been reverted by

[jira] [Commented] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739315#comment-16739315 ] Takeshi Yamamuro commented on SPARK-21351: -- This fix has been reverted by

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Affects Version/s: (was: 2.1.1) 2.2.2 > Update nullability

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Affects Version/s: 2.3.2 > Update nullability based on children's output in optimized

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Fix Version/s: (was: 2.4.0) > Update nullability based on children's output in

[jira] [Reopened] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-21351: -- > Update nullability based on children's output in optimized logical plan >

[jira] [Resolved] (SPARK-26459) remove UpdateNullabilityInAttributeReferences

[ https://issues.apache.org/jira/browse/SPARK-26459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26459. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23390

[jira] [Commented] (SPARK-26540) Support PostgreSQL numeric arrays without precision/scale

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734887#comment-16734887 ] Takeshi Yamamuro commented on SPARK-26540: -- We need to close SPARK-26538 as duplicated when

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734727#comment-16734727 ] Takeshi Yamamuro edited comment on SPARK-26540 at 1/5/19 1:42 AM: -- I

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734727#comment-16734727 ] Takeshi Yamamuro commented on SPARK-26540: -- yea, the workaround is good. The query failed in

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734701#comment-16734701 ] Takeshi Yamamuro commented on SPARK-26540: -- [~dongjoon] [~smilegator] could you check if this

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26540: - Description: This bug was reported in spark-user:

[jira] [Created] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

Takeshi Yamamuro created SPARK-26540: Summary: Requirement failed when reading numeric arrays from PostgreSQL Key: SPARK-26540 URL: https://issues.apache.org/jira/browse/SPARK-26540 Project:

[jira] [Updated] (SPARK-26224) Results in stackOverFlowError when trying to add 3000 new columns using withColumn function of dataframe.

[ https://issues.apache.org/jira/browse/SPARK-26224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26224: - Component/s: (was: Spark Core) SQL > Results in stackOverFlowError

[jira] [Commented] (SPARK-26182) Cost increases when optimizing scalaUDF

[ https://issues.apache.org/jira/browse/SPARK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711014#comment-16711014 ] Takeshi Yamamuro commented on SPARK-26182: -- This is an expected behaviour and a known issue,

[jira] [Updated] (SPARK-26182) Cost increases when optimizing scalaUDF

[ https://issues.apache.org/jira/browse/SPARK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26182: - Issue Type: Improvement (was: Bug) > Cost increases when optimizing scalaUDF >

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Description: For better test coverage, we need to run `SQLQueryTestSuite` on 4 mixed

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Summary: Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Description: For better test coverage, we need to run `SQLQueryTestSuite` on 4 mixed

[jira] [Created] (SPARK-26262) Run SQLQueryTestSuite with WHOLESTAGE_CODEGEN_ENABLED=false

Takeshi Yamamuro created SPARK-26262: Summary: Run SQLQueryTestSuite with WHOLESTAGE_CODEGEN_ENABLED=false Key: SPARK-26262 URL: https://issues.apache.org/jira/browse/SPARK-26262 Project: Spark

[jira] [Commented] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707099#comment-16707099 ] Takeshi Yamamuro commented on SPARK-26215: -- I found some useful documents about the reserved

[jira] [Commented] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707095#comment-16707095 ] Takeshi Yamamuro commented on SPARK-26215: -- These reserved words should be handled inside

[jira] [Commented] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707006#comment-16707006 ] Takeshi Yamamuro commented on SPARK-23264: -- Since the next release version is v3.0, I reopened.

[jira] [Reopened] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-23264: -- > Support interval values without INTERVAL clauses >

[jira] [Updated] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23264: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-26217 > Support interval

[jira] [Commented] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692546#comment-16692546 ] Takeshi Yamamuro commented on SPARK-26077: -- Thanks for your reporting! It seems the master

[jira] [Created] (SPARK-25734) Literal should have a value corresponding to dataType

Takeshi Yamamuro created SPARK-25734: Summary: Literal should have a value corresponding to dataType Key: SPARK-25734 URL: https://issues.apache.org/jira/browse/SPARK-25734 Project: Spark

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649681#comment-16649681 ] Takeshi Yamamuro commented on SPARK-25728: -- Cool! I'll join this activity. Anyway, I left some

[jira] [Resolved] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25469. -- Resolution: Fixed Assignee: Marek Novotny Fix Version/s: 2.4.0 Issue

[jira] [Created] (SPARK-25498) Fix SQLQueryTestSuite failures when the interpreter mode enabled

Takeshi Yamamuro created SPARK-25498: Summary: Fix SQLQueryTestSuite failures when the interpreter mode enabled Key: SPARK-25498 URL: https://issues.apache.org/jira/browse/SPARK-25498 Project:

[jira] [Commented] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys

[ https://issues.apache.org/jira/browse/SPARK-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620605#comment-16620605 ] Takeshi Yamamuro commented on SPARK-12978: -- yea, I think so and we need to discuss more about

***UNCHECKED*** [jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620468#comment-16620468 ] Takeshi Yamamuro commented on SPARK-20937: -- +1, too. Do you have time to write these docs?

***UNCHECKED*** [jira] [Commented] (SPARK-25462) hive on spark - got a weird output when count(*) from this script

[ https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620460#comment-16620460 ] Takeshi Yamamuro commented on SPARK-25462: -- You should first ask in the spark-user mailing

[jira] [Resolved] (SPARK-25462) hive on spark - got a weird output when count(*) from this script

[ https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25462. -- Resolution: Invalid > hive on spark - got a weird output when count(*) from this

[jira] [Commented] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619121#comment-16619121 ] Takeshi Yamamuro commented on SPARK-25453: -- oh, thanks. Can you fix this? >

[jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617437#comment-16617437 ] Takeshi Yamamuro commented on SPARK-25374: -- I do not have a strong opinion though, I feel it is

[jira] [Updated] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection

[ https://issues.apache.org/jira/browse/SPARK-25426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25426: - Summary: Remove the duplicate fallback logic in UnsafeProjection (was: Handles

[jira] [Created] (SPARK-25426) Handles subexpression elimination config inside CodeGeneratorWithInterpretedFallback

Takeshi Yamamuro created SPARK-25426: Summary: Handles subexpression elimination config inside CodeGeneratorWithInterpretedFallback Key: SPARK-25426 URL: https://issues.apache.org/jira/browse/SPARK-25426

[jira] [Updated] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25374: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23580 > SafeProjection

[jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607837#comment-16607837 ] Takeshi Yamamuro commented on SPARK-25374: -- WIP:

[jira] [Created] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

Takeshi Yamamuro created SPARK-25374: Summary: SafeProjection supports fallback to an interpreted mode Key: SPARK-25374 URL: https://issues.apache.org/jira/browse/SPARK-25374 Project: Spark

[jira] [Updated] (SPARK-25358) MutableProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25358: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23580 >

[jira] [Created] (SPARK-25358) MutableProjection supports fallback to an interpreted mode

Takeshi Yamamuro created SPARK-25358: Summary: MutableProjection supports fallback to an interpreted mode Key: SPARK-25358 URL: https://issues.apache.org/jira/browse/SPARK-25358 Project: Spark

[jira] [Updated] (SPARK-25340) Pushes down Sample beneath deterministic Project

[ https://issues.apache.org/jira/browse/SPARK-25340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25340: - Description: If computations in Project are heavy (e.g., UDFs), it is useful to push

[jira] [Commented] (SPARK-25340) Pushes down Sample beneath deterministic Project

[ https://issues.apache.org/jira/browse/SPARK-25340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604390#comment-16604390 ] Takeshi Yamamuro commented on SPARK-25340: -- Is this feasible? [~smilegator] > Pushes down

[jira] [Created] (SPARK-25340) Pushes down Sample beneath deterministic Project

Takeshi Yamamuro created SPARK-25340: Summary: Pushes down Sample beneath deterministic Project Key: SPARK-25340 URL: https://issues.apache.org/jira/browse/SPARK-25340 Project: Spark

[jira] [Updated] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25332: - Issue Type: Improvement (was: Bug) > Instead of broadcast hash join ,Sort merge join

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603761#comment-16603761 ] Takeshi Yamamuro commented on SPARK-25332: -- Probably, you need to describe more about this

[jira] [Commented] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597298#comment-16597298 ] Takeshi Yamamuro commented on SPARK-25193: -- I changed the component to SQL and add the link to

[jira] [Updated] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails

[ https://issues.apache.org/jira/browse/SPARK-25193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25193: - Component/s: (was: Spark Core) SQL > insert overwrite doesn't

[jira] [Commented] (SPARK-25232) Support Full-Text Search in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592442#comment-16592442 ] Takeshi Yamamuro commented on SPARK-25232: -- RLIKE is not enough? IMO they load data into

[jira] [Commented] (SPARK-25225) Add support for "List"-Type columns

[ https://issues.apache.org/jira/browse/SPARK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592397#comment-16592397 ] Takeshi Yamamuro commented on SPARK-25225: -- I don't understand exactly your secinario though,

[jira] [Commented] (SPARK-25232) Support Full-Text Search in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592375#comment-16592375 ] Takeshi Yamamuro commented on SPARK-25232: -- The other database-like systems other than mysql

[jira] [Comment Edited] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro edited comment on SPARK-25196 at 8/23/18 2:34 PM: ---

[jira] [Commented] (SPARK-25121) Support multi-part column name for hint resolution

[ https://issues.apache.org/jira/browse/SPARK-25121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589662#comment-16589662 ] Takeshi Yamamuro commented on SPARK-25121: -- Anybody starts working on this? If no, I could take

[jira] [Comment Edited] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro edited comment on SPARK-25196 at 8/23/18 2:28 AM: ---

[jira] [Commented] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589604#comment-16589604 ] Takeshi Yamamuro commented on SPARK-25196: -- yea, sure. So, I'll make a pr after branch-2.4 cut.

[jira] [Commented] (SPARK-25196) Analyze column statistics in cached query

[ https://issues.apache.org/jira/browse/SPARK-25196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588830#comment-16588830 ] Takeshi Yamamuro commented on SPARK-25196: -- How about this idea? [~smilegator] [~cloud_fan] >

[jira] [Created] (SPARK-25196) Analyze column statistics in cached query

Takeshi Yamamuro created SPARK-25196: Summary: Analyze column statistics in cached query Key: SPARK-25196 URL: https://issues.apache.org/jira/browse/SPARK-25196 Project: Spark Issue

[jira] [Commented] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583490#comment-16583490 ] Takeshi Yamamuro commented on SPARK-25140: -- ok! I’ll look into this. > Add optional logging to

[jira] [Commented] (SPARK-25140) Add optional logging to UnsafeProjection.create when it falls back to interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583476#comment-16583476 ] Takeshi Yamamuro commented on SPARK-25140: -- I can take this though, is kris not working on

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574259#comment-16574259 ] Takeshi Yamamuro commented on SPARK-25013: -- yea, we can by registering a new dialect via

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569811#comment-16569811 ] Takeshi Yamamuro commented on SPARK-25013: -- Spark currently doesn't have a dialect for mariadb.

[jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules

[ https://issues.apache.org/jira/browse/SPARK-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566266#comment-16566266 ] Takeshi Yamamuro commented on SPARK-23742: -- Can't we control this case by a new config

[jira] [Commented] (SPARK-24906) Enlarge split size for columnar file to ensure the task read enough data

[ https://issues.apache.org/jira/browse/SPARK-24906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554340#comment-16554340 ] Takeshi Yamamuro commented on SPARK-24906: -- Ah, I see. It make some sense to me. In

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552965#comment-16552965 ] Takeshi Yamamuro commented on SPARK-24869: -- yea, I made the branch just for this test purpose

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552257#comment-16552257 ] Takeshi Yamamuro commented on SPARK-18492: -- [~MDS Tang] You'd be better to describe more about

[jira] [Comment Edited] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551965#comment-16551965 ] Takeshi Yamamuro edited comment on SPARK-21274 at 7/22/18 9:35 AM: ---

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551965#comment-16551965 ] Takeshi Yamamuro commented on SPARK-21274: -- ok, thanks! > Implement EXCEPT ALL and INTERSECT

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551921#comment-16551921 ] Takeshi Yamamuro commented on SPARK-21274: -- Anybody still working on this? > Implement EXCEPT

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551779#comment-16551779 ] Takeshi Yamamuro commented on SPARK-24869: -- Actually, the cache is correctly used in the case?

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550738#comment-16550738 ] Takeshi Yamamuro commented on SPARK-24869: -- In the example above, cache() is not called

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16550029#comment-16550029 ] Takeshi Yamamuro commented on SPARK-24869: -- ok > SaveIntoDataSourceCommand's input Dataset

[jira] [Commented] (SPARK-24849) Convert StructType to DDL string

[ https://issues.apache.org/jira/browse/SPARK-24849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547906#comment-16547906 ] Takeshi Yamamuro commented on SPARK-24849: -- What is this new func used for? Is this the

[jira] [Updated] (SPARK-24844) spark REST API need to add ipFilter

[ https://issues.apache.org/jira/browse/SPARK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24844: - Priority: Minor (was: Blocker) > spark REST API need to add ipFilter >

[jira] [Commented] (SPARK-24844) spark REST API need to add ipFilter

[ https://issues.apache.org/jira/browse/SPARK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547831#comment-16547831 ] Takeshi Yamamuro commented on SPARK-24844: -- 'Blocker' tag in priority is reserved for

[jira] [Created] (SPARK-24806) Brush up generated code so that JDK Java compilers can handle it

Takeshi Yamamuro created SPARK-24806: Summary: Brush up generated code so that JDK Java compilers can handle it Key: SPARK-24806 URL: https://issues.apache.org/jira/browse/SPARK-24806 Project:

[jira] [Comment Edited] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543025#comment-16543025 ] Takeshi Yamamuro edited comment on SPARK-24498 at 7/13/18 12:57 PM:

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16543025#comment-16543025 ] Takeshi Yamamuro commented on SPARK-24498: -- I found some weird gen'd code that jdk java

[jira] [Commented] (SPARK-24799) A solution of dealing with data skew in left,right,inner join

[ https://issues.apache.org/jira/browse/SPARK-24799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542974#comment-16542974 ] Takeshi Yamamuro commented on SPARK-24799: -- This topic seems to be related to

[jira] [Commented] (SPARK-24705) Spark.sql.adaptive.enabled=true is enabled and self-join query

[ https://issues.apache.org/jira/browse/SPARK-24705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541065#comment-16541065 ] Takeshi Yamamuro commented on SPARK-24705: -- Sorry for my late response. IIUC I misunderstood

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539490#comment-16539490 ] Takeshi Yamamuro commented on SPARK-24753: -- I closed this as 'not a problem'. Feel free to open

[jira] [Resolved] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-24753. -- Resolution: Not A Problem > bad backslah parsing in SQL statements >

[jira] [Commented] (SPARK-24778) DateTimeUtils.getTimeZone method returns GMT time if timezone cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-24778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539478#comment-16539478 ] Takeshi Yamamuro commented on SPARK-24778: -- I think that it is more reasonable to reject the 

[jira] [Commented] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats

[ https://issues.apache.org/jira/browse/SPARK-24766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539469#comment-16539469 ] Takeshi Yamamuro commented on SPARK-24766: -- nit: Can you add `in parquet` in the title? I

[jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536519#comment-16536519 ] Takeshi Yamamuro commented on SPARK-24752: -- I closed this cuz this is expected. > date_format

[jira] [Resolved] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-24752. -- Resolution: Not A Problem > date_format provides incorrect year after a timezone

[jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536516#comment-16536516 ] Takeshi Yamamuro commented on SPARK-24752: -- oh, I see...that's it. > date_format provides

[jira] [Commented] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535681#comment-16535681 ] Takeshi Yamamuro commented on SPARK-24673: -- memo: not sure it is worth fixing though, other

[jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535671#comment-16535671 ] Takeshi Yamamuro commented on SPARK-24752: -- It seems the master has the same issue. Do you know

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535660#comment-16535660 ] Takeshi Yamamuro commented on SPARK-24753: -- you try

[jira] [Issue Comment Deleted] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24753: - Comment: was deleted (was: Your try `spark.sql.parser.quotedRegexColumnNames=true`?) >

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535659#comment-16535659 ] Takeshi Yamamuro commented on SPARK-24753: -- Your try

<    8   9   10   11   12   13   14   15   16   17   >