[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-25 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830352#comment-17830352 ] Peter Vary commented on HIVE-26882: --- If someone from the MySQL/MariaDB community could describe their

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-24 Thread katty he (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830311#comment-17830311 ] katty he commented on HIVE-26882: - so this bug can be resolved in hive side? > Allow transactional check

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-14 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827089#comment-17827089 ] Rui Li commented on HIVE-26882: --- [~pvary] thanks for the pointer. I think it might work. Will run our e2e

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-13 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826830#comment-17826830 ] Peter Vary commented on HIVE-26882: --- [~lirui]: You could try this: ``` query.executeUpdate() ```

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-13 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826001#comment-17826001 ] Rui Li commented on HIVE-26882: --- Hi [~pvary], I tried writing direct SQL with JDO: {code:Java} String dml =

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-12 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825627#comment-17825627 ] Peter Vary commented on HIVE-26882: --- {quote} Yes, but that requires the direct SQL and JDO run in the

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-12 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825557#comment-17825557 ] Rui Li commented on HIVE-26882: --- bq. I'm trying to suggest to use the direct SQL to update the metadata

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-12 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825536#comment-17825536 ] Peter Vary commented on HIVE-26882: --- {quote}The issue is each alter table operation updates more than

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-11 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825297#comment-17825297 ] Rui Li commented on HIVE-26882: --- bq. What do you see as an issue with that? The issue is each alter table

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-09 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824979#comment-17824979 ] Peter Vary commented on HIVE-26882: --- [~lirui]: Thanks for collecting the possibilities. I am not

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-08 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824800#comment-17824800 ] Rui Li commented on HIVE-26882: --- I found two options for MariaDB: # Use SERIALIZABLE level. # Use

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-08 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824745#comment-17824745 ] Peter Vary commented on HIVE-26882: --- Do we have working solution for MariaDB? > Allow transactional

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-08 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824669#comment-17824669 ] Rui Li commented on HIVE-26882: --- In terms of performance, we tested both SERIALIZABLE, and REPEATABLE_READ

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-08 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824659#comment-17824659 ] Rui Li commented on HIVE-26882: --- Hi [~pvary], I tested using docker image {{{}mysql:5.6.17{}}}. Tried both

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-07 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824630#comment-17824630 ] Peter Vary commented on HIVE-26882: --- [~lirui]: I try to wreck my brain to remember how did I test this

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-07 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824618#comment-17824618 ] Rui Li commented on HIVE-26882: --- I tried running these SQLs in each transaction, but none of them made the

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-07 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824483#comment-17824483 ] Peter Vary commented on HIVE-26882: --- Can we force the MariaDB \{REPEATABLE_READ} to prevent the

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-07 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824352#comment-17824352 ] Rui Li commented on HIVE-26882: --- I run our test again, with MariaDB at SERIALIZABLE level and the results

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-07 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824303#comment-17824303 ] Rui Li commented on HIVE-26882: --- [~pvary] Thanks for your comment. I ran some test for the scenarios

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824117#comment-17824117 ] Peter Vary commented on HIVE-26882: --- [~lirui]: Is the same true if we read the previous value before

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-05 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823678#comment-17823678 ] Rui Li commented on HIVE-26882: --- And if this feature has only been verified with Postgres, perhaps we

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-05 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823671#comment-17823671 ] Rui Li commented on HIVE-26882: --- I tested again with MariaDB and there're fewer commit conflicts in HMS log

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-01 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822776#comment-17822776 ] Rui Li commented on HIVE-26882: --- Hey [~pvary], thanks for your insights! I'll check whether the number of

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-01 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822714#comment-17822714 ] Peter Vary commented on HIVE-26882: --- I see this in the MariaDB doc:

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-01 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822711#comment-17822711 ] Peter Vary commented on HIVE-26882: --- Thanks for your interest in the change. I have tested it with

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2024-03-01 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822618#comment-17822618 ] Rui Li commented on HIVE-26882: --- Hi [~pvary], we're trying to improve performance of concurrent write to

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-06-08 Thread Alagappan Maruthappan (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730671#comment-17730671 ] Alagappan Maruthappan commented on HIVE-26882: -- Oracle doesn't support repeatable read -

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-16 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677358#comment-17677358 ] Peter Vary commented on HIVE-26882: --- Thanks [~ayushtkn] for all the help! > Allow transactional check

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677002#comment-17677002 ] Ayush Saxena commented on HIVE-26882: - 3.2 will be the one getting released earliest, should be

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-15 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676999#comment-17676999 ] Peter Vary commented on HIVE-26882: --- Merged all of them. Thanks for the review [~ayushtkn]! Is there a

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676968#comment-17676968 ] Ayush Saxena commented on HIVE-26882: - Sure, have approved them all [~pvary]  > Allow transactional

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-14 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676946#comment-17676946 ] Peter Vary commented on HIVE-26882: --- [~ayushtkn]: Could you please approve the PR then? Did the

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676862#comment-17676862 ] Ayush Saxena commented on HIVE-26882: - We can merge it [~pvary] , The branch-3 built isn't stable

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-13 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676720#comment-17676720 ] Peter Vary commented on HIVE-26882: --- [~ayushtkn]: Thanks for the help! I have created the PR, an run

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676504#comment-17676504 ] Ayush Saxena commented on HIVE-26882: - I gave it a try and faced the same issue, there was one line

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-12 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676455#comment-17676455 ] Peter Vary commented on HIVE-26882: --- Hi [~ayushtkn]! Long time, no see. I hope things are going well

[jira] [Commented] (HIVE-26882) Allow transactional check of Table parameter before altering the Table

2023-01-12 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HIVE-26882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676233#comment-17676233 ] Ayush Saxena commented on HIVE-26882: - Hi [~pvary]  Got some offline pointers from Attila around