[jira] [Updated] (SPARK-10520) Dates cannot be summarised

[ https://issues.apache.org/jira/browse/SPARK-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-10520: - Labels: (was: bulk-closed) > Dates cannot be summarised > --

[jira] [Updated] (SPARK-10520) Dates cannot be summarised

[ https://issues.apache.org/jira/browse/SPARK-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-10520: - Affects Version/s: (was: 1.5.0) 3.1.0 > Dates cannot be

[jira] [Commented] (SPARK-10520) Dates cannot be summarised

[ https://issues.apache.org/jira/browse/SPARK-10520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182322#comment-17182322 ] Takeshi Yamamuro commented on SPARK-10520: -- [~fokko] We don't need to do so. When this issue

[jira] [Resolved] (SPARK-32669) expression unit tests should explore all cases that can lead to null result

[ https://issues.apache.org/jira/browse/SPARK-32669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32669. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-32682) Use workflow_dispatch to enable manual test triggers

[ https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32682. -- Fix Version/s: 3.1.0 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Created] (SPARK-32682) Use workflow_dispatch to enable manual test triggers

Takeshi Yamamuro created SPARK-32682: Summary: Use workflow_dispatch to enable manual test triggers Key: SPARK-32682 URL: https://issues.apache.org/jira/browse/SPARK-32682 Project: Spark

[jira] [Commented] (SPARK-32673) Pyspark/cloudpickle.py - no module named 'wfdb'

[ https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181504#comment-17181504 ] Takeshi Yamamuro commented on SPARK-32673: -- could you please show us a example query to

[jira] [Updated] (SPARK-32673) Pyspark/cloudpickle.py - no module named 'wfdb'

[ https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32673: - Flags: (was: Important) > Pyspark/cloudpickle.py - no module named 'wfdb' >

[jira] [Updated] (SPARK-32640) Spark 3.1 log(NaN) returns null instead of NaN

[ https://issues.apache.org/jira/browse/SPARK-32640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32640: - Labels: correctness (was: ) > Spark 3.1 log(NaN) returns null instead of NaN >

[jira] [Updated] (SPARK-32640) Spark 3.1 log(NaN) returns null instead of NaN

[ https://issues.apache.org/jira/browse/SPARK-32640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32640: - Labels: correction (was: ) > Spark 3.1 log(NaN) returns null instead of NaN >

[jira] [Updated] (SPARK-32640) Spark 3.1 log(NaN) returns null instead of NaN

[ https://issues.apache.org/jira/browse/SPARK-32640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32640: - Labels: (was: correction) > Spark 3.1 log(NaN) returns null instead of NaN >

[jira] [Commented] (SPARK-32632) Bad partitioning in spark jdbc method with parameter lowerBound and upperBound

[ https://issues.apache.org/jira/browse/SPARK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181193#comment-17181193 ] Takeshi Yamamuro commented on SPARK-32632: -- An original motivation for this feature was to use

[jira] [Created] (SPARK-32665) Deletes orphan directories under a warehouse dir in SQLQueryTestSuite

Takeshi Yamamuro created SPARK-32665: Summary: Deletes orphan directories under a warehouse dir in SQLQueryTestSuite Key: SPARK-32665 URL: https://issues.apache.org/jira/browse/SPARK-32665

[jira] [Commented] (SPARK-32638) WidenSetOperationTypes in subquery attribute missing

[ https://issues.apache.org/jira/browse/SPARK-32638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180415#comment-17180415 ] Takeshi Yamamuro commented on SPARK-32638: -- Looks like a minor bug. I'll make a PR later. >

[jira] [Resolved] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29767. -- Resolution: Cannot Reproduce > Core dump happening on executors while doing simple

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180353#comment-17180353 ] Takeshi Yamamuro commented on SPARK-29767: -- I'll close this. If you open this, please update

[jira] [Resolved] (SPARK-32632) Bad partitioning in spark jdbc method with parameter lowerBound and upperBound

[ https://issues.apache.org/jira/browse/SPARK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32632. -- Resolution: Invalid > Bad partitioning in spark jdbc method with parameter lowerBound

[jira] [Resolved] (SPARK-32633) GenericRowWithSchema cannot be cast to GenTraversableOnce

[ https://issues.apache.org/jira/browse/SPARK-32633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32633. -- Resolution: Cannot Reproduce > GenericRowWithSchema cannot be cast to

[jira] [Commented] (SPARK-32633) GenericRowWithSchema cannot be cast to GenTraversableOnce

[ https://issues.apache.org/jira/browse/SPARK-32633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180267#comment-17180267 ] Takeshi Yamamuro commented on SPARK-32633: -- [~Mengjie] Why did you reopen this? I also tried

[jira] [Updated] (SPARK-32633) GenericRowWithSchema cannot be cast to GenTraversableOnce

[ https://issues.apache.org/jira/browse/SPARK-32633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32633: - Component/s: (was: Spark Core) SQL > GenericRowWithSchema cannot

[jira] [Comment Edited] (SPARK-32632) Bad partitioning in spark jdbc method with parameter lowerBound and upperBound

[ https://issues.apache.org/jira/browse/SPARK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180236#comment-17180236 ] Takeshi Yamamuro edited comment on SPARK-32632 at 8/19/20, 3:38 AM:

[jira] [Commented] (SPARK-32632) Bad partitioning in spark jdbc method with parameter lowerBound and upperBound

[ https://issues.apache.org/jira/browse/SPARK-32632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180236#comment-17180236 ] Takeshi Yamamuro commented on SPARK-32632: -- hm, but the document clearly describe this

[jira] [Commented] (SPARK-32650) Not able to Deserialize Mleap bundle with latest spark configuration

[ https://issues.apache.org/jira/browse/SPARK-32650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180166#comment-17180166 ] Takeshi Yamamuro commented on SPARK-32650: -- I think MLeap just does not support spark v3.0 and

[jira] [Resolved] (SPARK-32650) Not able to Deserialize Mleap bundle with latest spark configuration

[ https://issues.apache.org/jira/browse/SPARK-32650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32650. -- Resolution: Invalid > Not able to Deserialize Mleap bundle with latest spark

[jira] [Resolved] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32399. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178475#comment-17178475 ] Takeshi Yamamuro commented on SPARK-32542: -- I unset the target/fix version. Please do not set

[jira] [Updated] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32542: - Fix Version/s: (was: 3.0.0) > Add an optimizer rule to split an Expand into

[jira] [Updated] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32542: - Component/s: (was: Optimizer) SQL > Add an optimizer rule to split

[jira] [Updated] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32542: - Target Version/s: (was: 3.0.0) > Add an optimizer rule to split an Expand into

[jira] [Commented] (SPARK-32620) Reset the numPartitions metric when DPP is enabled

[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178178#comment-17178178 ] Takeshi Yamamuro commented on SPARK-32620: -- Please fill the description. > Reset the

[jira] [Updated] (SPARK-32616) Window operators should be added determinedly

[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32616: - Issue Type: Improvement (was: Bug) > Window operators should be added determinedly >

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177398#comment-17177398 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:28 AM:

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177562#comment-17177562 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:28 AM:

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177398#comment-17177398 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:25 AM:

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177562#comment-17177562 ] Takeshi Yamamuro commented on SPARK-32046: -- >> The question when does a query evaluation start

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177398#comment-17177398 ] Takeshi Yamamuro commented on SPARK-32046: -- This issue depends on ZP or Jupyter? If so, I think

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1717#comment-1717 ] Takeshi Yamamuro commented on SPARK-32580: -- We are planning to release v3.0.1 soon. Please see:

[jira] [Resolved] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32580. -- Fix Version/s: 3.0.1 Resolution: Fixed > Issue accessing a column values after

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175505#comment-17175505 ] Takeshi Yamamuro commented on SPARK-32580: -- Yea, in branch-3.0, it seems this issue already has

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174361#comment-17174361 ] Takeshi Yamamuro commented on SPARK-32580: -- I made the given query simpler; {code} scala>

[jira] [Comment Edited] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174361#comment-17174361 ] Takeshi Yamamuro edited comment on SPARK-32580 at 8/10/20, 2:38 PM:

[jira] [Comment Edited] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174303#comment-17174303 ] Takeshi Yamamuro edited comment on SPARK-32580 at 8/10/20, 1:26 PM:

[jira] [Commented] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174303#comment-17174303 ] Takeshi Yamamuro commented on SPARK-32580: -- Please do not use "Blocker" in the priority and it

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32580: - Component/s: (was: Spark Core) > Issue accessing a column values after 'explode'

[jira] [Updated] (SPARK-32580) Issue accessing a column values after 'explode' function

[ https://issues.apache.org/jira/browse/SPARK-32580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32580: - Priority: Major (was: Blocker) > Issue accessing a column values after 'explode'

[jira] [Comment Edited] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174263#comment-17174263 ] Takeshi Yamamuro edited comment on SPARK-29767 at 8/10/20, 11:48 AM: -

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174263#comment-17174263 ] Takeshi Yamamuro commented on SPARK-29767: -- I checked the given query and I think your union

[jira] [Resolved] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32563. -- Resolution: Not A Problem > spark-sql doesn't support insert into mixed static &

[jira] [Commented] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173752#comment-17173752 ] Takeshi Yamamuro commented on SPARK-32563: -- Yea, I think so. Then I will close this. Thanks! >

[jira] [Resolved] (SPARK-32570) Thriftserver LDAP failed

[ https://issues.apache.org/jira/browse/SPARK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32570. -- Resolution: Invalid > Thriftserver LDAP failed > > >

[jira] [Updated] (SPARK-32570) Thriftserver LDAP failed

[ https://issues.apache.org/jira/browse/SPARK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32570: - Component/s: (was: Security) SQL > Thriftserver LDAP failed >

[jira] [Commented] (SPARK-32570) Thriftserver LDAP failed

[ https://issues.apache.org/jira/browse/SPARK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173547#comment-17173547 ] Takeshi Yamamuro commented on SPARK-32570: -- Please [use 

[jira] [Commented] (SPARK-32565) Parquet encryption policy interface

[ https://issues.apache.org/jira/browse/SPARK-32565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173166#comment-17173166 ] Takeshi Yamamuro commented on SPARK-32565: -- Could you describe more to make other developers

[jira] [Commented] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173131#comment-17173131 ] Takeshi Yamamuro commented on SPARK-32563: -- I tried it in master/branch-3.0/branch-2.4 and they

[jira] [Commented] (SPARK-32565) Encryption policy interface

[ https://issues.apache.org/jira/browse/SPARK-32565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173108#comment-17173108 ] Takeshi Yamamuro commented on SPARK-32565: -- Please fill the description, first. > Encryption

[jira] [Commented] (SPARK-32566) kafka consumer cache capacity is unclear

[ https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173107#comment-17173107 ] Takeshi Yamamuro commented on SPARK-32566: -- cc: [~kabhwan] > kafka consumer cache capacity is

[jira] [Created] (SPARK-32564) Inject data statistics to simulate plan generation on actual TPCDS data

Takeshi Yamamuro created SPARK-32564: Summary: Inject data statistics to simulate plan generation on actual TPCDS data Key: SPARK-32564 URL: https://issues.apache.org/jira/browse/SPARK-32564

[jira] [Commented] (SPARK-32560) improve exception message

[ https://issues.apache.org/jira/browse/SPARK-32560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172780#comment-17172780 ] Takeshi Yamamuro commented on SPARK-32560: -- Hi, [~小郭飞飞刀], thanks for the report, but I think

[jira] [Resolved] (SPARK-32538) Use local time zone for the timestamp logged in unit-tests.log

[ https://issues.apache.org/jira/browse/SPARK-32538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32538. -- Fix Version/s: 3.0.1 Resolution: Fixed Resolved by 

[jira] [Reopened] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-32515: -- > Distinct Function Weird Bug > --- > > Key:

[jira] [Resolved] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32515. -- Resolution: Not A Problem > Distinct Function Weird Bug > ---

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Target Version/s: (was: 2.4.6) > Distinct Function Weird Bug >

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Fix Version/s: (was: 2.4.6) > Distinct Function Weird Bug >

[jira] [Commented] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171870#comment-17171870 ] Takeshi Yamamuro commented on SPARK-32550: -- Looks nice. Thanks for the info. > Make

[jira] [Created] (SPARK-32554) Update the k8s document according to the current development status

Takeshi Yamamuro created SPARK-32554: Summary: Update the k8s document according to the current development status Key: SPARK-32554 URL: https://issues.apache.org/jira/browse/SPARK-32554 Project:

[jira] [Commented] (SPARK-32547) Cant able to process Timestamp 0001-01-01T00:00:00.000+0000 with TimestampType

[ https://issues.apache.org/jira/browse/SPARK-32547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171843#comment-17171843 ] Takeshi Yamamuro commented on SPARK-32547: -- Thanks for the report. I checked that

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171835#comment-17171835 ] Takeshi Yamamuro commented on SPARK-29767: -- Thanks for the bug report, but I think we couldn't

[jira] [Comment Edited] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171828#comment-17171828 ] Takeshi Yamamuro edited comment on SPARK-32550 at 8/5/20, 11:32 PM:

[jira] [Comment Edited] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171828#comment-17171828 ] Takeshi Yamamuro edited comment on SPARK-32550 at 8/5/20, 11:30 PM:

[jira] [Commented] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171828#comment-17171828 ] Takeshi Yamamuro commented on SPARK-32550: -- The proposed improvement can affect end-2-end

[jira] [Commented] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171827#comment-17171827 ] Takeshi Yamamuro commented on SPARK-32515: -- Could you narrow down the issue, first? At least,

[jira] [Commented] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169946#comment-17169946 ] Takeshi Yamamuro commented on SPARK-32293: -- Hi, [~attilapiros]. You don't need to set the

[jira] [Updated] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32293: - Target Version/s: (was: 3.1.0) > Inconsistent default unit between Spark memory

[jira] [Commented] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169673#comment-17169673 ] Takeshi Yamamuro commented on SPARK-32515: -- Thanks for the report. I updated some fields (e.g.,

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Component/s: (was: PySpark) SQL > Distinct Function Weird Bug >

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Target Version/s: (was: 2.4.6) > Distinct Function Weird Bug >

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Labels: (was: distinct groupby load read) > Distinct Function Weird Bug >

[jira] [Updated] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32515: - Priority: Major (was: Blocker) > Distinct Function Weird Bug >

[jira] [Updated] (SPARK-28818) FrequentItems applies an incorrect schema to the resulting dataframe when nulls are present

[ https://issues.apache.org/jira/browse/SPARK-28818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-28818: - Fix Version/s: 2.4.7 > FrequentItems applies an incorrect schema to the resulting

[jira] [Created] (SPARK-32488) Use @parser::members and @lexer::members to avoid generating unused code

Takeshi Yamamuro created SPARK-32488: Summary: Use @parser::members and @lexer::members to avoid generating unused code Key: SPARK-32488 URL: https://issues.apache.org/jira/browse/SPARK-32488

[jira] [Resolved] (SPARK-31753) Add missing keywords in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31753. -- Fix Version/s: 3.0.1 Assignee: philipse Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-31753) Add missing keywords in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31753: - Affects Version/s: (was: 3.0.0) 3.0.1 > Add missing keywords

[jira] [Updated] (SPARK-31753) Add missing keywords in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31753: - Affects Version/s: 3.0.0 > Add missing keywords in the SQL documents >

[jira] [Resolved] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32392. -- Fix Version/s: 3.1.0 Assignee: Kent Yao Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

[ https://issues.apache.org/jira/browse/SPARK-32286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32286. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32344: - Priority: Minor (was: Major) > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr

[jira] [Created] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

Takeshi Yamamuro created SPARK-32344: Summary: Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates Key: SPARK-32344 URL: https://issues.apache.org/jira/browse/SPARK-32344

[jira] [Comment Edited] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159224#comment-17159224 ] Takeshi Yamamuro edited comment on SPARK-32257 at 7/16/20, 1:48 PM:

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159224#comment-17159224 ] Takeshi Yamamuro commented on SPARK-32257: -- Can I take this over if you don't have much time.

[jira] [Resolved] (SPARK-32154) Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32154. -- Fix Version/s: 3.1.0 Assignee: wuyi Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155094#comment-17155094 ] Takeshi Yamamuro commented on SPARK-32257: -- Thanks, [~beliefer]. Please ping me for reviews. >

[jira] [Resolved] (SPARK-32193) update docs on regexp function

[ https://issues.apache.org/jira/browse/SPARK-32193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32193. -- Fix Version/s: 3.1.0 3.0.1 Assignee: philipse

[jira] [Commented] (SPARK-32001) Create Kerberos authentication provider API in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-32001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142969#comment-17142969 ] Takeshi Yamamuro commented on SPARK-32001: -- I just want to know the approach

[jira] [Commented] (SPARK-32001) Create Kerberos authentication provider API in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-32001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142916#comment-17142916 ] Takeshi Yamamuro commented on SPARK-32001: -- Do you know any other systems supporting that kind

[jira] [Commented] (SPARK-32001) Create Kerberos authentication provider API in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-32001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142838#comment-17142838 ] Takeshi Yamamuro commented on SPARK-32001: -- Do you propose to provide a develper's API for

[jira] [Resolved] (SPARK-31350) Coalesce bucketed tables for join if applicable

[ https://issues.apache.org/jira/browse/SPARK-31350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31350. -- Fix Version/s: 3.1.0 Assignee: Terry Kim Resolution: Fixed Resolved

[jira] [Commented] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136200#comment-17136200 ] Takeshi Yamamuro commented on SPARK-14651: -- Yea, not supported yet. Please use `create

[jira] [Resolved] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26905. -- Fix Version/s: 3.0.1 Assignee: Takeshi Yamamuro Resolution: Fixed

[jira] [Updated] (SPARK-31950) Extract SQL keywords from the generated parser class in TableIdentifierParserSuite

[ https://issues.apache.org/jira/browse/SPARK-31950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31950: - Fix Version/s: (was: 3.1.0) 3.0.1 > Extract SQL keywords from

[jira] [Commented] (SPARK-31990) Streaming's state store compatibility is broken

[ https://issues.apache.org/jira/browse/SPARK-31990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135313#comment-17135313 ] Takeshi Yamamuro commented on SPARK-31990: -- Oh, nice catch, [~XuanYuan] ! I'll make a PR for

<    1   2   3   4   5   6   7   8   9   10   >