[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830352#comment-17830352
]
Peter Vary commented on HIVE-26882:
---
If someone from the MySQL/MariaDB community could describe their
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830311#comment-17830311
]
katty he commented on HIVE-26882:
-
so this bug can be resolved in hive side?
> Allow transactional check
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827089#comment-17827089
]
Rui Li commented on HIVE-26882:
---
[~pvary] thanks for the pointer. I think it might work. Will run our e2e
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826830#comment-17826830
]
Peter Vary commented on HIVE-26882:
---
[~lirui]: You could try this:
```
query.executeUpdate()
```
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826001#comment-17826001
]
Rui Li commented on HIVE-26882:
---
Hi [~pvary], I tried writing direct SQL with JDO:
{code:Java}
String dml =
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825627#comment-17825627
]
Peter Vary commented on HIVE-26882:
---
{quote}
Yes, but that requires the direct SQL and JDO run in the
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825557#comment-17825557
]
Rui Li commented on HIVE-26882:
---
bq. I'm trying to suggest to use the direct SQL to update the metadata
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825536#comment-17825536
]
Peter Vary commented on HIVE-26882:
---
{quote}The issue is each alter table operation updates more than
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825297#comment-17825297
]
Rui Li commented on HIVE-26882:
---
bq. What do you see as an issue with that?
The issue is each alter table
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824979#comment-17824979
]
Peter Vary commented on HIVE-26882:
---
[~lirui]: Thanks for collecting the possibilities.
I am not
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824800#comment-17824800
]
Rui Li commented on HIVE-26882:
---
I found two options for MariaDB:
# Use SERIALIZABLE level.
# Use
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824745#comment-17824745
]
Peter Vary commented on HIVE-26882:
---
Do we have working solution for MariaDB?
> Allow transactional
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824669#comment-17824669
]
Rui Li commented on HIVE-26882:
---
In terms of performance, we tested both SERIALIZABLE, and REPEATABLE_READ
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824659#comment-17824659
]
Rui Li commented on HIVE-26882:
---
Hi [~pvary], I tested using docker image {{{}mysql:5.6.17{}}}.
Tried both
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824630#comment-17824630
]
Peter Vary commented on HIVE-26882:
---
[~lirui]: I try to wreck my brain to remember how did I test this
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824618#comment-17824618
]
Rui Li commented on HIVE-26882:
---
I tried running these SQLs in each transaction, but none of them made the
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824483#comment-17824483
]
Peter Vary commented on HIVE-26882:
---
Can we force the MariaDB \{REPEATABLE_READ} to prevent the
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824352#comment-17824352
]
Rui Li commented on HIVE-26882:
---
I run our test again, with MariaDB at SERIALIZABLE level and the results
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824303#comment-17824303
]
Rui Li commented on HIVE-26882:
---
[~pvary] Thanks for your comment. I ran some test for the scenarios
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824117#comment-17824117
]
Peter Vary commented on HIVE-26882:
---
[~lirui]: Is the same true if we read the previous value before
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823678#comment-17823678
]
Rui Li commented on HIVE-26882:
---
And if this feature has only been verified with Postgres, perhaps we
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823671#comment-17823671
]
Rui Li commented on HIVE-26882:
---
I tested again with MariaDB and there're fewer commit conflicts in HMS log
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822776#comment-17822776
]
Rui Li commented on HIVE-26882:
---
Hey [~pvary], thanks for your insights! I'll check whether the number of
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822714#comment-17822714
]
Peter Vary commented on HIVE-26882:
---
I see this in the MariaDB doc:
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822711#comment-17822711
]
Peter Vary commented on HIVE-26882:
---
Thanks for your interest in the change.
I have tested it with
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822618#comment-17822618
]
Rui Li commented on HIVE-26882:
---
Hi [~pvary], we're trying to improve performance of concurrent write to
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730671#comment-17730671
]
Alagappan Maruthappan commented on HIVE-26882:
--
Oracle doesn't support repeatable read -
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677358#comment-17677358
]
Peter Vary commented on HIVE-26882:
---
Thanks [~ayushtkn] for all the help!
> Allow transactional check
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677002#comment-17677002
]
Ayush Saxena commented on HIVE-26882:
-
3.2 will be the one getting released earliest, should be
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676999#comment-17676999
]
Peter Vary commented on HIVE-26882:
---
Merged all of them.
Thanks for the review [~ayushtkn]!
Is there a
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676968#comment-17676968
]
Ayush Saxena commented on HIVE-26882:
-
Sure, have approved them all [~pvary]
> Allow transactional
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676946#comment-17676946
]
Peter Vary commented on HIVE-26882:
---
[~ayushtkn]: Could you please approve the PR then?
Did the
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676862#comment-17676862
]
Ayush Saxena commented on HIVE-26882:
-
We can merge it [~pvary] , The branch-3 built isn't stable
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676720#comment-17676720
]
Peter Vary commented on HIVE-26882:
---
[~ayushtkn]: Thanks for the help!
I have created the PR, an run
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676504#comment-17676504
]
Ayush Saxena commented on HIVE-26882:
-
I gave it a try and faced the same issue, there was one line
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676455#comment-17676455
]
Peter Vary commented on HIVE-26882:
---
Hi [~ayushtkn]! Long time, no see. I hope things are going well
[
https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676233#comment-17676233
]
Ayush Saxena commented on HIVE-26882:
-
Hi [~pvary]
Got some offline pointers from Attila around
37 matches
Mail list logo