[jira] [Updated] (IGNITE-16271) The Apache Ignite logo in the ignite-extensions README appears as a broken image
[ https://issues.apache.org/jira/browse/IGNITE-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brennan Fox updated IGNITE-16271: - Ignite Flags: (was: Docs Required,Release Notes Required) > The Apache Ignite logo in the ignite-extensions README appears as a broken > image > > > Key: IGNITE-16271 > URL: https://issues.apache.org/jira/browse/IGNITE-16271 > Project: Ignite > Issue Type: Bug > Components: documentation, extensions >Reporter: Brennan Fox >Assignee: Brennan Fox >Priority: Minor > Labels: newbie > Attachments: deadImage.png > > > The Apache Ignite logo in the ignite-extensions README appears as a broken > image > Steps to reproduce: > # Navigate to https://github.com/apache/ignite-extensions > # Look at the README > Issue - The image appears as a broken image (see screenshot) -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-15156) ITJRaftCounterServerTest.testFollowerCatchUpFromSnapshot2 is flaky
[
https://issues.apache.org/jira/browse/IGNITE-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476482#comment-17476482
]
Vladislav Pyatkov commented on IGNITE-15156:
The test passed more than one thousand and five hundred runs in local machine
and never fail.
It is difficult to understand the root cause of the fail, but I think, that is
no here anymore.
> ITJRaftCounterServerTest.testFollowerCatchUpFromSnapshot2 is flaky
> --
>
> Key: IGNITE-15156
> URL: https://issues.apache.org/jira/browse/IGNITE-15156
> Project: Ignite
> Issue Type: Bug
>Reporter: Ivan Bessonov
>Priority: Blocker
> Labels: ignite-3
>
> [https://ci.ignite.apache.org/buildConfiguration/ignite3_Test_IntegrationTests_IntegrationTests/6092693]
> {code:java}
> [11:17:18]W: [Step 2/2] [ERROR]
> org.apache.ignite.raft.server.ITJRaftCounterServerTest.testFollowerCatchUpFromSnapshot2
> Time elapsed: 42.007 s <<< ERROR![11:17:18]W: [Step 2/2] [ERROR]
> org.apache.ignite.raft.server.ITJRaftCounterServerTest.testFollowerCatchUpFromSnapshot2
> Time elapsed: 42.007 s <<< ERROR![11:17:18] : [Step 2/2]
> java.util.concurrent.ExecutionException:
> java.util.concurrent.TimeoutException: Did not observe any item or terminal
> signal within 1ms in 'source(MonoDefer)' (and no fallback has been
> configured)[11:17:18] : [Step 2/2] at
> org.apache.ignite.raft.server.ITJRaftCounterServerTest.applyIncrements(ITJRaftCounterServerTest.java:562)[11:17:18]
> : [Step 2/2] at
> org.apache.ignite.raft.server.ITJRaftCounterServerTest.doTestFollowerCatchUp(ITJRaftCounterServerTest.java:491)[11:17:18]
> : [Step 2/2] at
> org.apache.ignite.raft.server.ITJRaftCounterServerTest.testFollowerCatchUpFromSnapshot2(ITJRaftCounterServerTest.java:468)[11:17:18]
> : [Step 2/2] Caused by: java.util.concurrent.TimeoutException: Did not
> observe any item or terminal signal within 1ms in 'source(MonoDefer)'
> (and no fallback has been configured)[11:17:18] : [Step 2/2]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (IGNITE-16302) Register MessageSerializationRegistryInitializer as services to use with ServiceLoader
[ https://issues.apache.org/jira/browse/IGNITE-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Semyon Danilov updated IGNITE-16302: Labels: ignite-3 (was: ) > Register MessageSerializationRegistryInitializer as services to use with > ServiceLoader > -- > > Key: IGNITE-16302 > URL: https://issues.apache.org/jira/browse/IGNITE-16302 > Project: Ignite > Issue Type: Task >Reporter: Semyon Danilov >Priority: Major > Labels: ignite-3 > > Currently, the only way to obtain all of the > MessageSerializationRegistryInitializers at runtime is to use reflection (or > to use them directly which is error-prone and won't work with custom > extensions). We need to change the transferable annotation processor to > generate service meta-information for MessageSerializationRegistryInitializer > so they can be obtained via ServiceLoader. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (IGNITE-16302) Register MessageSerializationRegistryInitializer as services to use with ServiceLoader
Semyon Danilov created IGNITE-16302: --- Summary: Register MessageSerializationRegistryInitializer as services to use with ServiceLoader Key: IGNITE-16302 URL: https://issues.apache.org/jira/browse/IGNITE-16302 Project: Ignite Issue Type: Task Reporter: Semyon Danilov Currently, the only way to obtain all of the MessageSerializationRegistryInitializers at runtime is to use reflection (or to use them directly which is error-prone and won't work with custom extensions). We need to change the transferable annotation processor to generate service meta-information for MessageSerializationRegistryInitializer so they can be obtained via ServiceLoader. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Comment Edited] (IGNITE-14845) Upgrade H2 or enclose in Ignite classpath
[ https://issues.apache.org/jira/browse/IGNITE-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476274#comment-17476274 ] Elias Balasis edited comment on IGNITE-14845 at 1/14/22, 4:58 PM: -- The main reason for downgrading is, like I said, requirement by Apache ignite. It doesn't work with anything different to what it was built with. Therefore I have to have in the classpath the version of H2 that the version of Apache Ihnite I am using was built with, in this case 4.1.197, which can have unredictable classpath related runtime side effects besides making the classpath fragile. was (Author: eliasbalasis): The main reason for downgrading is, like I said, requirement by Apache ignite. It doesn't work with anything different to what it was built with. Therefore I have to have in the classpath the version of H2 that the version of Apache Ihnite I am using was built with, in this case 4.1.197, which can have unredictable classpath related runtime side effects besides making the lasspath fragile. > Upgrade H2 or enclose in Ignite classpath > - > > Key: IGNITE-14845 > URL: https://issues.apache.org/jira/browse/IGNITE-14845 > Project: Ignite > Issue Type: Improvement > Components: h2-limitation >Affects Versions: 2.10 >Reporter: Elias Balasis >Priority: Major > > When using Apache Ignite with SpringBoot or other dependency chains we are > forced to downgrade H2 to 4.1.197 which breaks other relationships besides > making the classpath fragile and less maintainable besides causing runtime > conflicts. > It would be very welcome if H2 could be upgraded to 4.1.200 > Ideally, H2 should be enclosed in Apache Ignite classpath which is the way > GridGain Ignite handles this problem, without a direct dependency on H2 > itself but enclosing H2 instead in internal packages. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-14845) Upgrade H2 or enclose in Ignite classpath
[ https://issues.apache.org/jira/browse/IGNITE-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476274#comment-17476274 ] Elias Balasis commented on IGNITE-14845: The main reason for downgrading is, like I said, requirement by Apache ignite. It doesn't work with anything different to what it was built with. Therefore I have to have in the classpath the version of H2 that the version of Apache Ihnite I am using was built with, in this case 4.1.197, which can have unredictable classpath related runtime side effects besides making the lasspath fragile. > Upgrade H2 or enclose in Ignite classpath > - > > Key: IGNITE-14845 > URL: https://issues.apache.org/jira/browse/IGNITE-14845 > Project: Ignite > Issue Type: Improvement > Components: h2-limitation >Affects Versions: 2.10 >Reporter: Elias Balasis >Priority: Major > > When using Apache Ignite with SpringBoot or other dependency chains we are > forced to downgrade H2 to 4.1.197 which breaks other relationships besides > making the classpath fragile and less maintainable besides causing runtime > conflicts. > It would be very welcome if H2 could be upgraded to 4.1.200 > Ideally, H2 should be enclosed in Apache Ignite classpath which is the way > GridGain Ignite handles this problem, without a direct dependency on H2 > itself but enclosing H2 instead in internal packages. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16278) CPP: Add sanitizers (UBSan and ASan at least) and run tests under them
[ https://issues.apache.org/jira/browse/IGNITE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Daschinsky updated IGNITE-16278: - Ignite Flags: (was: Release Notes Required) > CPP: Add sanitizers (UBSan and ASan at least) and run tests under them > -- > > Key: IGNITE-16278 > URL: https://issues.apache.org/jira/browse/IGNITE-16278 > Project: Ignite > Issue Type: Improvement >Reporter: Ivan Daschinsky >Assignee: Ivan Daschinsky >Priority: Major > Fix For: 2.13 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > https://github.com/google/sanitizers/wiki -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16278) CPP: Add sanitizers (UBSan and ASan at least) and run tests under them
[ https://issues.apache.org/jira/browse/IGNITE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Daschinsky updated IGNITE-16278: - Fix Version/s: 2.13 > CPP: Add sanitizers (UBSan and ASan at least) and run tests under them > -- > > Key: IGNITE-16278 > URL: https://issues.apache.org/jira/browse/IGNITE-16278 > Project: Ignite > Issue Type: Improvement >Reporter: Ivan Daschinsky >Assignee: Ivan Daschinsky >Priority: Major > Fix For: 2.13 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > https://github.com/google/sanitizers/wiki -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16278) CPP: Add sanitizers (UBSan and ASan at least) and run tests under them
[ https://issues.apache.org/jira/browse/IGNITE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Daschinsky updated IGNITE-16278: - Ignite Flags: Release Notes Required (was: Docs Required,Release Notes Required) > CPP: Add sanitizers (UBSan and ASan at least) and run tests under them > -- > > Key: IGNITE-16278 > URL: https://issues.apache.org/jira/browse/IGNITE-16278 > Project: Ignite > Issue Type: Improvement >Reporter: Ivan Daschinsky >Assignee: Ivan Daschinsky >Priority: Major > Time Spent: 1h 10m > Remaining Estimate: 0h > > https://github.com/google/sanitizers/wiki -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Resolved] (IGNITE-16279) CPP: ODBC Incorrent usage of SQLBindParameter in TestStingParamNullLen cause to heap buffer overflow
[
https://issues.apache.org/jira/browse/IGNITE-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Daschinsky resolved IGNITE-16279.
--
Resolution: Fixed
> CPP: ODBC Incorrent usage of SQLBindParameter in TestStingParamNullLen cause
> to heap buffer overflow
>
>
> Key: IGNITE-16279
> URL: https://issues.apache.org/jira/browse/IGNITE-16279
> Project: Ignite
> Issue Type: Bug
> Components: odbc, platforms
>Reporter: Ivan Daschinsky
>Assignee: Ivan Daschinsky
>Priority: Minor
>
> Platform: ubuntu 20.04, UnixODBC 2.3.7
> {code}
> Index: modules/platforms/cpp/odbc/src/utility.cpp
> IDEA additional info:
> Subsystem: com.intellij.openapi.diff.impl.patch.CharsetEP
> <+>UTF-8
> ===
> diff --git a/modules/platforms/cpp/odbc/src/utility.cpp
> b/modules/platforms/cpp/odbc/src/utility.cpp
> --- a/modules/platforms/cpp/odbc/src/utility.cpp (revision
> e18bbbedfa23f4a4c7bcd1f4c48fa881411e5653)
> +++ b/modules/platforms/cpp/odbc/src/utility.cpp (date 1641994995236)
> @@ -136,8 +136,10 @@
> if (!sqlStr || !sqlStrLen)
> return res;
>
> -if (sqlStrLen == SQL_NTS)
> +if (sqlStrLen == SQL_NTS) {
> +std::cout << "Hopla " << sqlStrC << std::endl; // Here we
> go, unexpected.
> res.assign(sqlStrC);
> +}
> else if (sqlStrLen > 0)
> res.assign(sqlStrC, sqlStrLen);
>
> {code}
> Run {{TestStingParamNullLen}} under ASan and get report:
> https://gist.github.com/ivandasch/00fc80c31cb48022eed81a72ff3c4fc6
> To run under sanitizer:
> 1. Add flags
> {code}
> set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -fsanitize=address
> -fno-omit-frame-pointer -fno-sanitize-recover -g")
> {code}
> 2. Run
> {code}
> ✗ JAVA_HOME=/opt/jdk/jdk1.8.0_281
> ASAN_OPTIONS=handle_segv=0:detect_leaks=0:symbolize=1
> IGNITE_NATIVE_TEST_ODBC_CONFIG_PATH=/home/ivandasch/Job/ignite-cpp/modules/platforms/cpp/odbc-test/config
> ASAN_SYMBOLIZER_PATH=/usr/bin/llvm-symbolizer ./odbc-test/ignite-odbc-tests
> -t '*/TestStingParamNullLen'
> {code}
> P.S.
> Seems that this is problem in test, in test we pass not NULL-terminated
> string and forget to add StrLen param at the end
> Current code
> {code}
>ret = SQLBindParameter(stmt, 1, SQL_PARAM_INPUT, SQL_C_CHAR, SQL_VARCHAR,
>paramData.size(), 0, ¶mData[0], paramLen, 0);
> {code}
> Should be
> {code}
> ret = SQLBindParameter(stmt, 1, SQL_PARAM_INPUT, SQL_C_CHAR, SQL_VARCHAR,
>paramData.size(), 0, ¶mData[0], paramLen, ¶mLen);
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (IGNITE-16279) CPP: ODBC Incorrent usage of SQLBindParameter in TestStingParamNullLen cause to heap buffer overflow
[
https://issues.apache.org/jira/browse/IGNITE-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476211#comment-17476211
]
Ivan Daschinsky commented on IGNITE-16279:
--
Fixed in IGNITE-16728
> CPP: ODBC Incorrent usage of SQLBindParameter in TestStingParamNullLen cause
> to heap buffer overflow
>
>
> Key: IGNITE-16279
> URL: https://issues.apache.org/jira/browse/IGNITE-16279
> Project: Ignite
> Issue Type: Bug
> Components: odbc, platforms
>Reporter: Ivan Daschinsky
>Assignee: Ivan Daschinsky
>Priority: Minor
>
> Platform: ubuntu 20.04, UnixODBC 2.3.7
> {code}
> Index: modules/platforms/cpp/odbc/src/utility.cpp
> IDEA additional info:
> Subsystem: com.intellij.openapi.diff.impl.patch.CharsetEP
> <+>UTF-8
> ===
> diff --git a/modules/platforms/cpp/odbc/src/utility.cpp
> b/modules/platforms/cpp/odbc/src/utility.cpp
> --- a/modules/platforms/cpp/odbc/src/utility.cpp (revision
> e18bbbedfa23f4a4c7bcd1f4c48fa881411e5653)
> +++ b/modules/platforms/cpp/odbc/src/utility.cpp (date 1641994995236)
> @@ -136,8 +136,10 @@
> if (!sqlStr || !sqlStrLen)
> return res;
>
> -if (sqlStrLen == SQL_NTS)
> +if (sqlStrLen == SQL_NTS) {
> +std::cout << "Hopla " << sqlStrC << std::endl; // Here we
> go, unexpected.
> res.assign(sqlStrC);
> +}
> else if (sqlStrLen > 0)
> res.assign(sqlStrC, sqlStrLen);
>
> {code}
> Run {{TestStingParamNullLen}} under ASan and get report:
> https://gist.github.com/ivandasch/00fc80c31cb48022eed81a72ff3c4fc6
> To run under sanitizer:
> 1. Add flags
> {code}
> set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -fsanitize=address
> -fno-omit-frame-pointer -fno-sanitize-recover -g")
> {code}
> 2. Run
> {code}
> ✗ JAVA_HOME=/opt/jdk/jdk1.8.0_281
> ASAN_OPTIONS=handle_segv=0:detect_leaks=0:symbolize=1
> IGNITE_NATIVE_TEST_ODBC_CONFIG_PATH=/home/ivandasch/Job/ignite-cpp/modules/platforms/cpp/odbc-test/config
> ASAN_SYMBOLIZER_PATH=/usr/bin/llvm-symbolizer ./odbc-test/ignite-odbc-tests
> -t '*/TestStingParamNullLen'
> {code}
> P.S.
> Seems that this is problem in test, in test we pass not NULL-terminated
> string and forget to add StrLen param at the end
> Current code
> {code}
>ret = SQLBindParameter(stmt, 1, SQL_PARAM_INPUT, SQL_C_CHAR, SQL_VARCHAR,
>paramData.size(), 0, ¶mData[0], paramLen, 0);
> {code}
> Should be
> {code}
> ret = SQLBindParameter(stmt, 1, SQL_PARAM_INPUT, SQL_C_CHAR, SQL_VARCHAR,
>paramData.size(), 0, ¶mData[0], paramLen, ¶mLen);
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (IGNITE-14619) Refactoring of GridDeploymentCommunication
[ https://issues.apache.org/jira/browse/IGNITE-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476202#comment-17476202 ] Denis Chudov commented on IGNITE-14619: --- [~makedonskaya] I left one minor comment, please fix it and proceed to the next step. > Refactoring of GridDeploymentCommunication > -- > > Key: IGNITE-14619 > URL: https://issues.apache.org/jira/browse/IGNITE-14619 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Maria Makedonskaya >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > org.apache.ignite.internal.managers.deployment.GridDeploymentCommunication#sendResourceRequest > uses "while" loop with mutex instead of future, and creates listeners for > discovery events and communication messages for each request. This > complicates the code and may affect class loading performance. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-14619) Refactoring of GridDeploymentCommunication
[ https://issues.apache.org/jira/browse/IGNITE-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Chudov updated IGNITE-14619: -- Reviewer: (was: Denis Chudov) > Refactoring of GridDeploymentCommunication > -- > > Key: IGNITE-14619 > URL: https://issues.apache.org/jira/browse/IGNITE-14619 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Maria Makedonskaya >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > org.apache.ignite.internal.managers.deployment.GridDeploymentCommunication#sendResourceRequest > uses "while" loop with mutex instead of future, and creates listeners for > discovery events and communication messages for each request. This > complicates the code and may affect class loading performance. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-15648) JDBC driver for 3.0: Add integration tests that depend on the data layer.
[ https://issues.apache.org/jira/browse/IGNITE-15648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476168#comment-17476168 ] Yury Gerzhedovich commented on IGNITE-15648: [~korlov], LGTM. Thanks for the contribution! > JDBC driver for 3.0: Add integration tests that depend on the data layer. > -- > > Key: IGNITE-15648 > URL: https://issues.apache.org/jira/browse/IGNITE-15648 > Project: Ignite > Issue Type: Improvement > Components: jdbc, sql >Reporter: Vladimir Ermakov >Assignee: Konstantin Orlov >Priority: Major > Labels: ignite-3 > Time Spent: 1h 20m > Remaining Estimate: 0h > > Subj -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-15329) Atomics should be repairable by Read Repair
[ https://issues.apache.org/jira/browse/IGNITE-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Vinogradov updated IGNITE-15329: -- Fix Version/s: 2.13 > Atomics should be repairable by Read Repair > --- > > Key: IGNITE-15329 > URL: https://issues.apache.org/jira/browse/IGNITE-15329 > Project: Ignite > Issue Type: Sub-task >Reporter: Anton Vinogradov >Assignee: Anton Vinogradov >Priority: Major > Labels: iep-31 > Fix For: 2.13 > > > It's pretty clear that it's impossible to fix atomics with "Read Repair" > atomically since it's impossible to lock entries during the repair process. > Even get from backups has no guarantee to return consistent values under load. > But to fix we must also perform an additional step - cache put. > So, value can be changed between gets, can be changed after gets but before > put, but it still seems to be possible to automize the fix. > Idea is to decide what entry won on the last check attempt and put this value > using the entry processor. > During the entry processor execution, we should check the current node's > value, and if the value is not expected for this node, we should perform put, > but record a concurrent modification event. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Assigned] (IGNITE-16102) Store all RocksDB partitions in a single column family.
[ https://issues.apache.org/jira/browse/IGNITE-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Polovtcev reassigned IGNITE-16102: Assignee: Aleksandr Polovtcev > Store all RocksDB partitions in a single column family. > --- > > Key: IGNITE-16102 > URL: https://issues.apache.org/jira/browse/IGNITE-16102 > Project: Ignite > Issue Type: Improvement >Affects Versions: 3.0.0-alpha3 >Reporter: Ivan Bessonov >Assignee: Aleksandr Polovtcev >Priority: Major > Labels: iep-74, ignite-3 > > Current storage implementation puts each partition in its own column family. > This effectively means that every partition lives in it's own database, > sharing only WAL and some in-memory resources. Given that each column family > has multiple files for LSM trees, the amount of opened file descriptors is > bigger than it needs to be. > Now, the idea is to have a single column family for partitions within a > table. And we should think of possibility of storing several tables in the > same RocksDB instance, for similar reasons. You can think about is as of > cache groups in Ignite 2.x. > There's also an "optimization" to be implemented that is missing in code - > using key hashes as prefixes. > h3. What should be implemented: > First of all, code will be heavily refactored. This will lead to > simplifications in many places. > Otherwise, I see the following list of goals to achieve: > * current implementation allows to derive the list of partitions from the > list of column families. This won't be possible, I suggest storing this list > explicitly in "meta" CF, in any format that'll be convenient during the > implementation > * there should be a way of having compact "tableId" representation. > IgniteUUID or even UUID is too much I think, but it might work as a basis. > This problem should be discussed > * binary representation for keys should now include following information: > ** tableId - fixed-length set of bytes to be used as a prefix > ** partitionId - 2 bytes that will follow the tableId. This layout will > allow making range queries for specific partitions of specific tables > ** key hash - 4 bytes. This one is required to optimize comparison time for > keys. Generally speaking, it's safe to assume that hashes will be mostly > different for different keys, meaning that hashes will be enough to determine > keys inequality > ** actual key payload goes after all these prefixes -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16248) CDC fails if default page size is used in its coniguration
[
https://issues.apache.org/jira/browse/IGNITE-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikolay Izhikov updated IGNITE-16248:
-
Labels: IEP-59 (was: )
> CDC fails if default page size is used in its coniguration
> --
>
> Key: IGNITE-16248
> URL: https://issues.apache.org/jira/browse/IGNITE-16248
> Project: Ignite
> Issue Type: Bug
>Reporter: Mikhail Petrov
>Assignee: Mikhail Petrov
>Priority: Major
> Labels: IEP-59
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Exception:
> {code:java}
> java.lang.IllegalArgumentException: Ouch! Argument is invalid: Page size must
> be between 1kB and 16kB.
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.util.GridArgumentCheck.ensure(GridArgumentCheck.java:110)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory$IteratorParametersBuilder.validate(IgniteWalIteratorFactory.java:663)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory.iterator(IgniteWalIteratorFactory.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeSegment(CdcMain.java:467)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:373)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.ArrayList.forEach(ArrayList.java:1259)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:390)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeWalSegmentsUntilStopped(CdcMain.java:403)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.runX(CdcMain.java:285)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.run(CdcMain.java:229)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.lang.Thread.run(Thread.java:748)
> {code}
> The main reason of failures is that after IGNITE-15558
> IteratorParametersBuilder#pageSize is set in CdcMain#consumeSegment.
> Since DataStorageConfiguration#pageSize default variable is 0,
> IteratorParametersBuilder#validate throws an exception considering that page
> size must be at least 4 kB.
> As a reproducer you can see CDC tests in Ignite Extensions repository -
> https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteExtensions_Tests_Cdc&tab=buildTypeHistoryList&branch_IgniteExtensions_Tests=%3Cdefault%3E
> Or see dedicated reproducer:
> {code:java}
> public class CdcPageSizeTest extends GridCommonAbstractTest {
> /** {@inheritDoc} */
> @Override protected IgniteConfiguration getConfiguration(String
> igniteInstanceName) throws Exception {
> return super.getConfiguration(igniteInstanceName)
> .setDataStorageConfiguration(new DataStorageConfiguration()
> .setCdcEnabled(true)
> .setWalMode(FSYNC)
> .setWalForceArchiveTimeout(5_000)
> .setDefaultDataRegionConfiguration(
> new Data
[jira] [Updated] (IGNITE-16248) CDC fails if default page size is used in its coniguration
[
https://issues.apache.org/jira/browse/IGNITE-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikhail Petrov updated IGNITE-16248:
Issue Type: Bug (was: Test)
> CDC fails if default page size is used in its coniguration
> --
>
> Key: IGNITE-16248
> URL: https://issues.apache.org/jira/browse/IGNITE-16248
> Project: Ignite
> Issue Type: Bug
>Reporter: Mikhail Petrov
>Assignee: Mikhail Petrov
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Exception:
> {code:java}
> java.lang.IllegalArgumentException: Ouch! Argument is invalid: Page size must
> be between 1kB and 16kB.
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.util.GridArgumentCheck.ensure(GridArgumentCheck.java:110)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory$IteratorParametersBuilder.validate(IgniteWalIteratorFactory.java:663)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory.iterator(IgniteWalIteratorFactory.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeSegment(CdcMain.java:467)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:373)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.ArrayList.forEach(ArrayList.java:1259)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:390)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeWalSegmentsUntilStopped(CdcMain.java:403)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.runX(CdcMain.java:285)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.run(CdcMain.java:229)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.lang.Thread.run(Thread.java:748)
> {code}
> The main reason of failures is that after IGNITE-15558
> IteratorParametersBuilder#pageSize is set in CdcMain#consumeSegment.
> Since DataStorageConfiguration#pageSize default variable is 0,
> IteratorParametersBuilder#validate throws an exception considering that page
> size must be at least 4 kB.
> As a reproducer you can see CDC tests in Ignite Extensions repository -
> https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteExtensions_Tests_Cdc&tab=buildTypeHistoryList&branch_IgniteExtensions_Tests=%3Cdefault%3E
> Or see dedicated reproducer:
> {code:java}
> public class CdcPageSizeTest extends GridCommonAbstractTest {
> /** {@inheritDoc} */
> @Override protected IgniteConfiguration getConfiguration(String
> igniteInstanceName) throws Exception {
> return super.getConfiguration(igniteInstanceName)
> .setDataStorageConfiguration(new DataStorageConfiguration()
> .setCdcEnabled(true)
> .setWalMode(FSYNC)
> .setWalForceArchiveTimeout(5_000)
> .setDefaultDataRegionConfiguration(
> new DataRegionConfiguration()
>
[jira] [Comment Edited] (IGNITE-16124) deleteAllById has wrong signature
[
https://issues.apache.org/jira/browse/IGNITE-16124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474409#comment-17474409
]
Andrey Belyaev edited comment on IGNITE-16124 at 1/14/22, 12:53 PM:
PR: [https://github.com/apache/ignite-extensions/pull/94]
TC build:
[https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_RunAllTests?buildTypeTab=overview&branch=pull%2F94%2F&mode=builds#all-projects]
was (Author: JIRAUSER281322):
PR: [https://github.com/apache/ignite-extensions/pull/94]
TC build:
[https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_RunAllTests/6363907]
> deleteAllById has wrong signature
> -
>
> Key: IGNITE-16124
> URL: https://issues.apache.org/jira/browse/IGNITE-16124
> Project: Ignite
> Issue Type: Bug
> Components: extensions
>Reporter: Michael Reiche
>Assignee: Andrey Belyaev
>Priority: Major
>
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata20.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
>
> 2.6.0-RC1
> 2.9.1
>
>
>
> org.apache.ignite
> ignite-spring-data_2.0
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-core
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-indexing
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-spring
> ${ignite.version}
>
>
> org.springframework.data
> spring-data-commons
> ${spring.data.version}
>
>
> If ignite-spring-data is used instead of ingite-spring-data_2.0, the method
> deleteAll is flagged
> java: name clash: deleteAll(java.lang.Iterable com.example.ignite.EmployeeDTO>) in
> org.springframework.data.repository.CrudRepository and
> deleteAll(java.lang.Iterable) in
> org.apache.ignite.springdata.repository.IgniteRepository have the same
> erasure, yet neither overrides the other
> And 2.2-ext gives the following:
> org.apache.ignite
> ignite-spring-data-2.2-ext
> 1.0.0
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata22.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
> package com.example.ignite;
> import org.apache.ignite.springdata.repository.IgniteRepository;
> import org.apache.ignite.springdata.repository.config.RepositoryConfig;
> @RepositoryConfig(cacheName = "myCache")
> public interface EmployeeRepository extends
> IgniteRepository
> { EmployeeDTO getEmployeeDTOById(ID id); }
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (IGNITE-16278) CPP: Add sanitizers (UBSan and ASan at least) and run tests under them
[ https://issues.apache.org/jira/browse/IGNITE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476087#comment-17476087 ] Igor Sapego commented on IGNITE-16278: -- [~ivandasch] looks good to me. Ship it! > CPP: Add sanitizers (UBSan and ASan at least) and run tests under them > -- > > Key: IGNITE-16278 > URL: https://issues.apache.org/jira/browse/IGNITE-16278 > Project: Ignite > Issue Type: Improvement >Reporter: Ivan Daschinsky >Assignee: Ivan Daschinsky >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > > https://github.com/google/sanitizers/wiki -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Resolved] (IGNITE-16301) Update released 2.12.0 packages version
[ https://issues.apache.org/jira/browse/IGNITE-16301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amelchev Nikita resolved IGNITE-16301. -- Resolution: Fixed Cherry-picked into the master. > Update released 2.12.0 packages version > --- > > Key: IGNITE-16301 > URL: https://issues.apache.org/jira/browse/IGNITE-16301 > Project: Ignite > Issue Type: Task >Reporter: Amelchev Nikita >Assignee: Amelchev Nikita >Priority: Major > Fix For: 2.13 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16264) [PageMemoryImpl] PageRestore does not mark the restored page as dirty.
[
https://issues.apache.org/jira/browse/IGNITE-16264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pavel Pereslegin updated IGNITE-16264:
--
Ignite Flags: Release Notes Required (was: Docs Required,Release Notes
Required)
> [PageMemoryImpl] PageRestore does not mark the restored page as dirty.
> --
>
> Key: IGNITE-16264
> URL: https://issues.apache.org/jira/browse/IGNITE-16264
> Project: Ignite
> Issue Type: Bug
> Components: persistence
>Affects Versions: 2.11.1
>Reporter: Fedor Malchikov
>Assignee: Pavel Pereslegin
>Priority: Major
> Attachments: grid.1.node.2.log
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {code:java}
> [15:53:09,313][INFO][main][GridCacheDatabaseSharedManager] Starting binary
> memory restore for: [1587982887, 1586135659, 1586135625, 1588907152,
> 1134507861, 1587059273, -2100569601, 374280889, 374280888, 374280887,
> 374280886, 374280885, 374280884,
> 1587059204][15:53:09,583][INFO][main][CheckpointMarkersStorage] Read
> checkpoint status
> [startMarker=/storage/ssd/prtagent/tiden/sow-220111-155046/test_iep_14/ignite.server.2/work/db/node_1_2/cp/1641905556201-40b99ac3-a6c5-48e6-956b-8b2b0a5804c9-START.bin,
>
> endMarker=/storage/ssd/prtagent/tiden/sow-220111-155046/test_iep_14/ignite.server.2/work/db/node_1_2/cp/1641905556201-40b99ac3-a6c5-48e6-956b-8b2b0a5804c9-END.bin][15:53:09,583][INFO][main][GridCacheDatabaseSharedManager]
> Checking memory state [lastValidPos=FileWALPointer [idx=41, fileOff=734466,
> len=52185], lastMarked=FileWALPointer [idx=41, fileOff=734466, len=52185],
> lastCheckpointId=40b99ac3-a6c5-48e6-956b-8b2b0a5804c9][15:53:09,588][INFO][main][GridCacheDatabaseSharedManager]
> Found last checkpoint marker [cpId=40b99ac3-a6c5-48e6-956b-8b2b0a5804c9,
> pos=FileWALPointer [idx=41, fileOff=734466,
> len=52185]][15:53:09,590][INFO][main][GridCacheDatabaseSharedManager] Binary
> memory state restored at node startup [restoredPtr=FileWALPointer [idx=41,
> fileOff=786651, len=0]][15:53:09,593][INFO][main][FileWriteAheadLogManager]
> Resuming logging to WAL segment
> [file=/storage/ssd/prtagent/tiden/sow-220111-155046/test_iep_14/ignite.server.2/work/db/wal/node_1_2/0001.wal,
> offset=786651, ver=2][15:53:09,611][INFO][main][PageMemoryImpl] Started page
> memory [memoryAllocated=500.0 MiB, pages=124064, tableSize=9.7 MiB,
> replacementSize=15.3 KiB, checkpointBuffer=256.0
> MiB][15:53:09,731][INFO][main][GridCacheProcessor] Started cache in recovery
> mode [name=cache_group_3_088, id=1587982887, dataRegionName=Default_Region,
> mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=3,
> mvcc=false][15:53:09,769][INFO][main][GridCacheProcessor] Started cache in
> recovery mode [name=cache_group_1_028, id=1586135659,
> dataRegionName=Default_Region, mode=PARTITIONED, atomicity=TRANSACTIONAL,
> backups=3, mvcc=false][15:53:09,774][WARNING][main][PageMemoryImpl] Failed to
> read page (data integrity violation encountered, will try to restore using
> existing WAL) [fullPageId=FullPageId [pageId=0002,
> effectivePageId=, grpId=1134507861]]class
> org.apache.ignite.internal.processors.cache.persistence.wal.crc.IgniteDataIntegrityViolationException:
> Failed to read page (CRC validation failed) [id=0002, off=0,
> file=/storage/ssd/prtagent/tiden/sow-220111-155046/test_iep_14/ignite.server.2/work/db/node_1_2/cacheGroup-test_cache_group/index.bin,
> fileSize=24576, savedCrc=93303030, curCrc=93e69aca,
> page=0b00020002000200020003000200010005000500
[jira] [Updated] (IGNITE-16301) Update released 2.12.0 packages version
[ https://issues.apache.org/jira/browse/IGNITE-16301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amelchev Nikita updated IGNITE-16301: - Fix Version/s: 2.13 > Update released 2.12.0 packages version > --- > > Key: IGNITE-16301 > URL: https://issues.apache.org/jira/browse/IGNITE-16301 > Project: Ignite > Issue Type: Task >Reporter: Amelchev Nikita >Assignee: Amelchev Nikita >Priority: Major > Fix For: 2.13 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-16278) CPP: Add sanitizers (UBSan and ASan at least) and run tests under them
[
https://issues.apache.org/jira/browse/IGNITE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476083#comment-17476083
]
Ignite TC Bot commented on IGNITE-16278:
{panel:title=Branch: [pull/9730/head] Base: [master] : No blockers
found!|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}{panel}
{panel:title=Branch: [pull/9730/head] Base: [master] : New Tests
(1061)|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}
{color:#8b}Platform C++ CMake (Win x64 / Debug){color} [[tests
1034|https://ci2.ignite.apache.org/viewLog.html?buildId=6271009]]
* {color:#013220}IgniteThinClientTest: CacheClientTestSuite:
CacheClientGetAndPutIfAbsentComplexKey - PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite: EchoTaskNull -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite:
EchoTaskPrimitives - PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite: EchoTaskObject -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite: EchoTaskGuid -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite: TaskWithTimeout
- PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite:
TaskWithNoFailover - PASSED{color}
* {color:#013220}IgniteThinClientTest: ComputeClientTestSuite:
TaskWithNoResultCache - PASSED{color}
* {color:#013220}IgniteThinClientTest: IgniteClientTestSuite:
IgniteClientConnection - PASSED{color}
* {color:#013220}IgniteThinClientTest: IgniteClientTestSuite:
IgniteClientConnectionFailover - PASSED{color}
* {color:#013220}IgniteThinClientTest: IgniteClientTestSuite:
IgniteClientConnectionLimit - PASSED{color}
... and 1023 new tests
{color:#8b}Platform C++ CMake (Win x64 / Release){color} [[tests
9|https://ci2.ignite.apache.org/viewLog.html?buildId=6271010]]
* {color:#013220}IgniteOdbcTest: SqlTypesTestSuite: TestStringParamNullLen -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
{color:#8b}Platform C++ CMake (Linux){color} [[tests
9|https://ci2.ignite.apache.org/viewLog.html?buildId=6271011]]
* {color:#013220}IgniteOdbcTest: SqlTypesTestSuite: TestStringParamNullLen -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
{color:#8b}Platform C++ CMake (Linux Clang){color} [[tests
9|https://ci2.ignite.apache.org/viewLog.html?buildId=6271012]]
* {color:#013220}IgniteOdbcTest: SqlTypesTestSuite: TestStringParamNullLen -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessin
[jira] [Created] (IGNITE-16301) Update released 2.12.0 packages version
Amelchev Nikita created IGNITE-16301: Summary: Update released 2.12.0 packages version Key: IGNITE-16301 URL: https://issues.apache.org/jira/browse/IGNITE-16301 Project: Ignite Issue Type: Task Reporter: Amelchev Nikita Assignee: Amelchev Nikita -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-16021) Update Apache Ignite 2.12 release notes
[ https://issues.apache.org/jira/browse/IGNITE-16021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476080#comment-17476080 ] Amelchev Nikita commented on IGNITE-16021: -- Cherry-picked to the master. > Update Apache Ignite 2.12 release notes > --- > > Key: IGNITE-16021 > URL: https://issues.apache.org/jira/browse/IGNITE-16021 > Project: Ignite > Issue Type: Task >Reporter: Amelchev Nikita >Assignee: Amelchev Nikita >Priority: Major > Fix For: 2.12 > > Time Spent: 1h 40m > Remaining Estimate: 0h > > Update Apache Ignite 2.12 release notes -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-14365) CDC Documentation
[ https://issues.apache.org/jira/browse/IGNITE-14365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476079#comment-17476079 ] Amelchev Nikita commented on IGNITE-14365: -- Cherry-picked to the 2.12 docs. > CDC Documentation > - > > Key: IGNITE-14365 > URL: https://issues.apache.org/jira/browse/IGNITE-14365 > Project: Ignite > Issue Type: Improvement > Components: documentation >Reporter: Nikolay Izhikov >Assignee: Nikolay Izhikov >Priority: Major > Labels: IEP-59 > Fix For: 2.12 > > Time Spent: 5h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-16290) Non-informative warning on query retry - Query run was already removed
[
https://issues.apache.org/jira/browse/IGNITE-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476073#comment-17476073
]
Yury Gerzhedovich commented on IGNITE-16290:
[~amashenkov], LGTM
> Non-informative warning on query retry - Query run was already removed
> --
>
> Key: IGNITE-16290
> URL: https://issues.apache.org/jira/browse/IGNITE-16290
> Project: Ignite
> Issue Type: Bug
> Components: sql
>Reporter: Andrey Mashenkov
>Assignee: Andrey Mashenkov
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The non-informative warning is printed when SQL query is restarted.
> {noformat}
> [WARN ][pub-#3460][GridReduceQueryExecutor] Query run was already removed:
> 1467
> 2[2021-11-28T05:30:25,813][WARN ][pub-#3460][GridReduceQueryExecutor] Query
> run was already removed: 1468
> 3[2021-11-28T05:30:25,874][WARN ][pub-#3460][GridReduceQueryExecutor] Query
> run was already removed: 1469{noformat}
> Theis happens because we remove query context (ReduceQueryRun) from a map
> twice: when decide to retry the query
> {code:java}
> if (retry) {
> lastRun = runs.remove(qryReqId);
> assert lastRun != null;
> } else { {code}
> then when releasing resources in a finally block.
> {code:java}
> finally {
> if (release) {
> releaseRemoteResources(nodes, r, qryReqId, qry.distributedJoins(),
> mvccTracker); {code}
> Thus, the second try is failed with the log message.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Assigned] (IGNITE-15257) ITNodeTest.testNodeTaskOverload is flaky
[
https://issues.apache.org/jira/browse/IGNITE-15257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Pyatkov reassigned IGNITE-15257:
--
Assignee: Vladislav Pyatkov
> ITNodeTest.testNodeTaskOverload is flaky
>
>
> Key: IGNITE-15257
> URL: https://issues.apache.org/jira/browse/IGNITE-15257
> Project: Ignite
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha2
>Reporter: Ivan Bessonov
>Assignee: Vladislav Pyatkov
>Priority: Blocker
> Labels: ignite-3
>
> Test failed locally:
> {code:java}
> Aug 05, 2021 10:02:29 AM org.apache.ignite.lang.IgniteLogger logInternalAug
> 05, 2021 10:02:29 AM org.apache.ignite.lang.IgniteLogger logInternalINFO:
> >>> Start test method: testNodeTaskOverload()Aug 05, 2021
> 10:02:29 AM org.apache.ignite.lang.IgniteLogger logInternalINFO: Connection
> created [address=/0:0:0:0:0:0:0:0:5003]Aug 05, 2021 10:02:29 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Node joined: ClusterNode
> [id=5f83a413-f3b0-406f-93fd-74ecc2ee1370, name=127.0.1.1:5003,
> address=127.0.1.1:5003]Aug 05, 2021 10:02:29 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Topology snapshot
> [nodes=1] ^-- ClusterNode [id=5f83a413-f3b0-406f-93fd-74ecc2ee1370,
> name=127.0.1.1:5003, address=127.0.1.1:5003]Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Starts FSMCaller
> successfully.Aug 05, 2021 10:02:30 AM org.apache.ignite.lang.IgniteLogger
> logInternalWARNING: No data for snapshot reader
> target/work/ITNodeTest/testNodeTaskOverload_1628146949951/snapshot.Aug 05,
> 2021 10:02:30 AM org.apache.ignite.lang.IgniteLogger logInternalINFO: Node
> init, term=0, lastLogId=LogId [index=0, term=0],
> conf=127.0.1.1:5003, oldConf=.Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Node
> start vote and grant vote self, term=0.Aug 05, 2021
> 10:02:30 AM org.apache.ignite.lang.IgniteLogger logInternalINFO: Save raft
> meta, path=target/work/ITNodeTest/testNodeTaskOverload_1628146949951/meta,
> term=1, votedFor=127.0.1.1:5003, cost time=7 msAug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Node
> become leader of group, term=1,
> conf=127.0.1.1:5003, oldConf=.Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: Start the
> RaftGroupService successfully Aug 05, 2021 10:02:30
> AM org.apache.ignite.lang.IgniteLogger logInternalWARNING: Node
> applyQueue is overload.Status[EBUSY<1009>: Node is
> busy, has too many tasks.]Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalINFO: onLeaderStart:
> term=1.Aug 05, 2021 10:02:30 AM org.apache.ignite.lang.IgniteLogger
> logInternalSEVERE: Node append [2, 2] failed,
> status=Status[EIO<1014>: Corrupted LogStorage].Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger logInternalSEVERE: Encountered an
> error=Status[EBUSY<1009>: LogManager is busy, disk queue overload.] on
> StateMachine org.apache.ignite.raft.jraft.core.MockStateMachine, it's highly
> recommended to implement this method as raft stops working since some error
> occurs, you should figure out the cause and repair or remove this node.Error
> [type=ERROR_TYPE_LOG, status=Status[EBUSY<1009>: LogManager is busy, disk
> queue overload.]] at
> org.apache.ignite.raft.jraft.storage.impl.LogManagerImpl.reportError(LogManagerImpl.java:577)Status[EBUSY<1009>:
> Node is busy, has too many tasks.] at
> org.apache.ignite.raft.jraft.storage.impl.LogManagerImpl.appendEntries(LogManagerImpl.java:332)
> at
> org.apache.ignite.raft.jraft.core.NodeImpl.executeApplyingTasks(NodeImpl.java:1371)
> at
> org.apache.ignite.raft.jraft.core.NodeImpl$LogEntryAndClosureHandler.onEvent(NodeImpl.java:292)
> at
> org.apache.ignite.raft.jraft.core.NodeImpl$LogEntryAndClosureHandler.onEvent(NodeImpl.java:275)
> at
> org.apache.ignite.raft.jraft.disruptor.StripedDisruptor$StripeEntryHandler.onEvent(StripedDisruptor.java:214)
> at
> org.apache.ignite.raft.jraft.disruptor.StripedDisruptor$StripeEntryHandler.onEvent(StripedDisruptor.java:179)
> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:137)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Aug 05, 2021 10:02:30 AM org.apache.ignite.lang.IgniteLogger
> logInternalWARNING: Node got error: Error
> [type=ERROR_TYPE_LOG, status=Status[EBUSY<1009>: LogManager is busy, disk
> queue overload.]].Aug 05, 2021 10:02:30 AM
> org.apache.ignite.lang.IgniteLogger warnWARNING: FSMCaller already in error
> status, ignore new errorError [type=ERROR_TYPE_LOG,
> status=Status[EBUSY<1009>: LogManager is busy, disk queue overload.]] at
> org.apache.ignite.raft.jraft.storage.impl.LogManagerImpl.reportError(LogManagerImpl.java:5
[jira] [Commented] (IGNITE-16277) Query failed with assertion
[
https://issues.apache.org/jira/browse/IGNITE-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476052#comment-17476052
]
Yury Gerzhedovich commented on IGNITE-16277:
[~korlov], LGTM
> Query failed with assertion
> ---
>
> Key: IGNITE-16277
> URL: https://issues.apache.org/jira/browse/IGNITE-16277
> Project: Ignite
> Issue Type: Bug
> Components: sql
>Reporter: Konstantin Orlov
>Assignee: Konstantin Orlov
>Priority: Blocker
> Labels: calcite, calcite2-required, ignite-3
>
> A few tests fails on TC in
> {{org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode#checkState}}.
> Need to investigate and fix the problem.
> {code}
> 2022-01-12 15:13:33:298 +0300
> [WARNING][%ItSortAggregateTest_null_0%calciteQry-2][QueryTaskExecutorImpl]
> Uncaught exception
> class org.apache.ignite.lang.IgniteInternalException: Unexpected exception
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.onMessage(ExchangeServiceImpl.java:236)
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.lambda$start$3(ExchangeServiceImpl.java:81)
> at
> org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.onMessageInternal(MessageServiceImpl.java:154)
> at
> org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.lambda$onMessage$3(MessageServiceImpl.java:124)
> at
> org.apache.ignite.internal.sql.engine.exec.QueryTaskExecutorImpl.lambda$execute$0(QueryTaskExecutorImpl.java:78)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834)
> Caused by: java.lang.AssertionError:
> expThread=%ItSortAggregateTest_null_0%calciteQry-1,
> actThread=%ItSortAggregateTest_null_0%calciteQry-2, qryId=25,
> fragmentId=e6ad99b4-a93a-496b-864c-20f013b71a8b
> at
> org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode.checkState(AbstractNode.java:197)
> at
> org.apache.ignite.internal.sql.engine.exec.rel.Inbox.pushUnordered(Inbox.java:278)
> at org.apache.ignite.internal.sql.engine.exec.rel.Inbox.push(Inbox.java:203)
> at
> org.apache.ignite.internal.sql.engine.exec.rel.Inbox.onBatchReceived(Inbox.java:177)
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.onMessage(ExchangeServiceImpl.java:232)
> ... 7 more
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Created] (IGNITE-16300) .NET6 support
Ali Ferda Arikan created IGNITE-16300:
-
Summary: .NET6 support
Key: IGNITE-16300
URL: https://issues.apache.org/jira/browse/IGNITE-16300
Project: Ignite
Issue Type: New Feature
Components: compute
Affects Versions: 2.11.1
Reporter: Ali Ferda Arikan
We have an ignite cluster with native storage enabled which we use as a
distributed database and compute engine which is embedded in a .net
application.
As we are aware that .NET5 is supported we use that framework.
When we try to upgrade our cluster to use .NET6 we get the below error. It is
hard to tell if it is something else or some minor incompatibility causing an
error somewhere. However, reverting to .NET5 makes the issue disappear. So I
assume we need .NET6 to be officially supported.
{code:java}
Apache.Ignite.Core.Cache.CacheException: 'class
org.apache.ignite.IgniteInterruptedException: Failed to wait for asynchronous
operation permit (thread got interrupted).'JavaException:
javax.cache.CacheException: class org.apache.ignite.IgniteInterruptedException:
Failed to wait for asynchronous operation permit (thread got interrupted).
at
org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1266)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.cacheException(IgniteCacheProxyImpl.java:2084)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.get(IgniteCacheProxyImpl.java:)
at
org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.get(GatewayProtectedCacheProxy.java:688)
at
org.apache.ignite.internal.processors.platform.cache.PlatformCache.processInStreamOutLong(PlatformCache.java:455)
at
org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inStreamOutLong(PlatformTargetProxyImpl.java:67)
at
org.apache.ignite.internal.processors.platform.callback.PlatformCallbackUtils.inLongLongLongObjectOutLong(Native
Method)
at
org.apache.ignite.internal.processors.platform.callback.PlatformCallbackGateway.computeJobExecuteLocal(PlatformCallbackGateway.java:312)
at
org.apache.ignite.internal.processors.platform.compute.PlatformAbstractJob.runLocal(PlatformAbstractJob.java:134)
at
org.apache.ignite.internal.processors.platform.compute.PlatformClosureJob.execute0(PlatformClosureJob.java:94)
at
org.apache.ignite.internal.processors.platform.compute.PlatformAbstractJob.execute(PlatformAbstractJob.java:80)
at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:601)
at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7126)
at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:595)
at
org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:522)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:831)
Caused by: class org.apache.ignite.IgniteInterruptedException: Failed to wait
for asynchronous operation permit (thread got interrupted).
at org.apache.ignite.internal.util.IgniteUtils$3.apply(IgniteUtils.java:919)
at org.apache.ignite.internal.util.IgniteUtils$3.apply(IgniteUtils.java:917)
... 19 more
Caused by: java.lang.InterruptedException
at
java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1047)
at java.base/java.util.concurrent.Semaphore.acquire(Semaphore.java:318)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.asyncOpAcquire(GridCacheAdapter.java:4710)
at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.asyncOp(GridDhtAtomicCache.java:777)
at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.getAsync(GridDhtAtomicCache.java:483)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:4894)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.repairableGet(GridCacheAdapter.java:4860)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.get(GridCacheAdapter.java:1476)
at
org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.get(IgniteCacheProxyImpl.java:1108)
... 16 more{code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (IGNITE-14845) Upgrade H2 or enclose in Ignite classpath
[ https://issues.apache.org/jira/browse/IGNITE-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476050#comment-17476050 ] Nicolas Garcin commented on IGNITE-14845: - I think it would be wiser to upgrade to 2.0.206 as previous versions have a very high vulnerability, see https://mvnrepository.com/artifact/com.h2database/h2. > Upgrade H2 or enclose in Ignite classpath > - > > Key: IGNITE-14845 > URL: https://issues.apache.org/jira/browse/IGNITE-14845 > Project: Ignite > Issue Type: Improvement > Components: h2-limitation >Affects Versions: 2.10 >Reporter: Elias Balasis >Priority: Major > > When using Apache Ignite with SpringBoot or other dependency chains we are > forced to downgrade H2 to 4.1.197 which breaks other relationships besides > making the classpath fragile and less maintainable besides causing runtime > conflicts. > It would be very welcome if H2 could be upgraded to 4.1.200 > Ideally, H2 should be enclosed in Apache Ignite classpath which is the way > GridGain Ignite handles this problem, without a direct dependency on H2 > itself but enclosing H2 instead in internal packages. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16277) Query failed with assertion
[
https://issues.apache.org/jira/browse/IGNITE-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Orlov updated IGNITE-16277:
--
Labels: calcite calcite2-required ignite-3 (was: ignite-3)
> Query failed with assertion
> ---
>
> Key: IGNITE-16277
> URL: https://issues.apache.org/jira/browse/IGNITE-16277
> Project: Ignite
> Issue Type: Bug
> Components: sql
>Reporter: Konstantin Orlov
>Assignee: Konstantin Orlov
>Priority: Blocker
> Labels: calcite, calcite2-required, ignite-3
>
> A few tests fails on TC in
> {{org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode#checkState}}.
> Need to investigate and fix the problem.
> {code}
> 2022-01-12 15:13:33:298 +0300
> [WARNING][%ItSortAggregateTest_null_0%calciteQry-2][QueryTaskExecutorImpl]
> Uncaught exception
> class org.apache.ignite.lang.IgniteInternalException: Unexpected exception
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.onMessage(ExchangeServiceImpl.java:236)
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.lambda$start$3(ExchangeServiceImpl.java:81)
> at
> org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.onMessageInternal(MessageServiceImpl.java:154)
> at
> org.apache.ignite.internal.sql.engine.message.MessageServiceImpl.lambda$onMessage$3(MessageServiceImpl.java:124)
> at
> org.apache.ignite.internal.sql.engine.exec.QueryTaskExecutorImpl.lambda$execute$0(QueryTaskExecutorImpl.java:78)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834)
> Caused by: java.lang.AssertionError:
> expThread=%ItSortAggregateTest_null_0%calciteQry-1,
> actThread=%ItSortAggregateTest_null_0%calciteQry-2, qryId=25,
> fragmentId=e6ad99b4-a93a-496b-864c-20f013b71a8b
> at
> org.apache.ignite.internal.sql.engine.exec.rel.AbstractNode.checkState(AbstractNode.java:197)
> at
> org.apache.ignite.internal.sql.engine.exec.rel.Inbox.pushUnordered(Inbox.java:278)
> at org.apache.ignite.internal.sql.engine.exec.rel.Inbox.push(Inbox.java:203)
> at
> org.apache.ignite.internal.sql.engine.exec.rel.Inbox.onBatchReceived(Inbox.java:177)
> at
> org.apache.ignite.internal.sql.engine.exec.ExchangeServiceImpl.onMessage(ExchangeServiceImpl.java:232)
> ... 7 more
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (IGNITE-15766) CPP thin: Implement continuous query
[ https://issues.apache.org/jira/browse/IGNITE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476043#comment-17476043 ] Pavel Tupitsyn commented on IGNITE-15766: - [~isapego] looks good to me. > CPP thin: Implement continuous query > > > Key: IGNITE-15766 > URL: https://issues.apache.org/jira/browse/IGNITE-15766 > Project: Ignite > Issue Type: Improvement > Components: thin client >Affects Versions: 2.11 >Reporter: Igor Sapego >Assignee: Igor Sapego >Priority: Major > Labels: iep-50 > Time Spent: 3h > Remaining Estimate: 0h > > Need to implement the following proposal for C++ thin client: > https://cwiki.apache.org/confluence/display/IGNITE/IEP-50%3A+Thin+Client+Continuous+Queries -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-15766) CPP thin: Implement continuous query
[ https://issues.apache.org/jira/browse/IGNITE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476038#comment-17476038 ] Igor Sapego commented on IGNITE-15766: -- Fixed review findings. [~ptupitsyn], [~ivandasch] can you take another look guys? > CPP thin: Implement continuous query > > > Key: IGNITE-15766 > URL: https://issues.apache.org/jira/browse/IGNITE-15766 > Project: Ignite > Issue Type: Improvement > Components: thin client >Affects Versions: 2.11 >Reporter: Igor Sapego >Assignee: Igor Sapego >Priority: Major > Labels: iep-50 > Time Spent: 3h > Remaining Estimate: 0h > > Need to implement the following proposal for C++ thin client: > https://cwiki.apache.org/confluence/display/IGNITE/IEP-50%3A+Thin+Client+Continuous+Queries -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (IGNITE-15766) CPP thin: Implement continuous query
[
https://issues.apache.org/jira/browse/IGNITE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476037#comment-17476037
]
Ignite TC Bot commented on IGNITE-15766:
{panel:title=Branch: [pull/9732/head] Base: [master] : No blockers
found!|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}{panel}
{panel:title=Branch: [pull/9732/head] Base: [master] : New Tests
(32)|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}
{color:#8b}Platform C++ CMake (Win x64 / Debug){color} [[tests
8|https://ci.ignite.apache.org/viewLog.html?buildId=6367006]]
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
{color:#8b}Platform C++ CMake (Win x64 / Release){color} [[tests
8|https://ci.ignite.apache.org/viewLog.html?buildId=6367007]]
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
{color:#8b}Platform C++ CMake (Linux Clang){color} [[tests
8|https://ci.ignite.apache.org/viewLog.html?buildId=6367004]]
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
{color:#8b}Platform C++ CMake (Linux){color} [[tests
8|https://ci.ignite.apache.org/viewLog.html?buildId=6367057]]
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetBufferSize - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestGetSetTimeInterval - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestPublicPrivateConstantsConsistence - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite: TestBasic -
PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredQuery - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestLongEventsProcessingDisconnect - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsReceived - PASSED{color}
* {color:#013220}IgniteThinClientTest: ContinuousQueryTestSuite:
TestExpiredEventsNotReceived - PASSED{color}
{panel}
[TeamCity *-> Run :: CPP*
Results|https://ci.ignite.apache.org/viewLog.html?buildId=6367008&buildTypeId=IgniteTests24Java8_RunCpp]
> CPP thin: Implement continuous query
>
>
> Key: IGNITE-15766
> URL: https://issues.apache.org/jira/browse/IGNITE-15766
> Project: Ignite
> Issue Type: Improvement
> Components: thin client
>Affects Versions: 2.11
>Reporter: Igor Sapego
>Assignee: Igor Sapego
>
[jira] [Updated] (IGNITE-16126) [ignite-extensions] Update dependency: log4j to 2.17.1
[ https://issues.apache.org/jira/browse/IGNITE-16126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amelchev Nikita updated IGNITE-16126: - Component/s: extensions > [ignite-extensions] Update dependency: log4j to 2.17.1 > -- > > Key: IGNITE-16126 > URL: https://issues.apache.org/jira/browse/IGNITE-16126 > Project: Ignite > Issue Type: Bug > Components: extensions >Reporter: Sergei Ryzhov >Assignee: Sergei Ryzhov >Priority: Major > > Update dependency: log4j to 2.17.1 > version 2.17.1 does not contain vulnerabilities > https://mvnrepository.com/artifact/org.apache.logging.log4j/log4j-core -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (IGNITE-16248) CDC fails if default page size is used in its coniguration
[
https://issues.apache.org/jira/browse/IGNITE-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikhail Petrov updated IGNITE-16248:
Summary: CDC fails if default page size is used in its coniguration (was:
CDC fails if default page size is used)
> CDC fails if default page size is used in its coniguration
> --
>
> Key: IGNITE-16248
> URL: https://issues.apache.org/jira/browse/IGNITE-16248
> Project: Ignite
> Issue Type: Test
>Reporter: Mikhail Petrov
>Assignee: Mikhail Petrov
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Exception:
> {code:java}
> java.lang.IllegalArgumentException: Ouch! Argument is invalid: Page size must
> be between 1kB and 16kB.
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.util.GridArgumentCheck.ensure(GridArgumentCheck.java:110)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory$IteratorParametersBuilder.validate(IgniteWalIteratorFactory.java:663)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory.iterator(IgniteWalIteratorFactory.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeSegment(CdcMain.java:467)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:373)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.ArrayList.forEach(ArrayList.java:1259)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:390)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.Sink$ChainedReference.end(Sink.java:258)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.consumeWalSegmentsUntilStopped(CdcMain.java:403)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.runX(CdcMain.java:285)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> org.apache.ignite.internal.cdc.CdcMain.run(CdcMain.java:229)
> [22:16:04][org.apache.ignite:ignite-cdc-ext] at
> java.lang.Thread.run(Thread.java:748)
> {code}
> The main reason of failures is that after IGNITE-15558
> IteratorParametersBuilder#pageSize is set in CdcMain#consumeSegment.
> Since DataStorageConfiguration#pageSize default variable is 0,
> IteratorParametersBuilder#validate throws an exception considering that page
> size must be at least 4 kB.
> As a reproducer you can see CDC tests in Ignite Extensions repository -
> https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteExtensions_Tests_Cdc&tab=buildTypeHistoryList&branch_IgniteExtensions_Tests=%3Cdefault%3E
> Or see dedicated reproducer:
> {code:java}
> public class CdcPageSizeTest extends GridCommonAbstractTest {
> /** {@inheritDoc} */
> @Override protected IgniteConfiguration getConfiguration(String
> igniteInstanceName) throws Exception {
> return super.getConfiguration(igniteInstanceName)
> .setDataStorageConfiguration(new DataStorageConfiguration()
> .setCdcEnabled(true)
> .setWalMode(FSYNC)
> .setWalForceArchiveTimeout(5_000)
> .setD
[jira] [Commented] (IGNITE-16124) deleteAllById has wrong signature
[
https://issues.apache.org/jira/browse/IGNITE-16124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476019#comment-17476019
]
Andrey Belyaev commented on IGNITE-16124:
-
[~ashapkin] please review
> deleteAllById has wrong signature
> -
>
> Key: IGNITE-16124
> URL: https://issues.apache.org/jira/browse/IGNITE-16124
> Project: Ignite
> Issue Type: Bug
> Components: extensions
>Reporter: Michael Reiche
>Assignee: Andrey Belyaev
>Priority: Major
>
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata20.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
>
> 2.6.0-RC1
> 2.9.1
>
>
>
> org.apache.ignite
> ignite-spring-data_2.0
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-core
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-indexing
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-spring
> ${ignite.version}
>
>
> org.springframework.data
> spring-data-commons
> ${spring.data.version}
>
>
> If ignite-spring-data is used instead of ingite-spring-data_2.0, the method
> deleteAll is flagged
> java: name clash: deleteAll(java.lang.Iterable com.example.ignite.EmployeeDTO>) in
> org.springframework.data.repository.CrudRepository and
> deleteAll(java.lang.Iterable) in
> org.apache.ignite.springdata.repository.IgniteRepository have the same
> erasure, yet neither overrides the other
> And 2.2-ext gives the following:
> org.apache.ignite
> ignite-spring-data-2.2-ext
> 1.0.0
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata22.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
> package com.example.ignite;
> import org.apache.ignite.springdata.repository.IgniteRepository;
> import org.apache.ignite.springdata.repository.config.RepositoryConfig;
> @RepositoryConfig(cacheName = "myCache")
> public interface EmployeeRepository extends
> IgniteRepository
> { EmployeeDTO getEmployeeDTOById(ID id); }
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Assigned] (IGNITE-16161) Memory leak in BaseQueryContext
[ https://issues.apache.org/jira/browse/IGNITE-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Orlov reassigned IGNITE-16161: - Assignee: Andrey Mashenkov (was: Konstantin Orlov) > Memory leak in BaseQueryContext > --- > > Key: IGNITE-16161 > URL: https://issues.apache.org/jira/browse/IGNITE-16161 > Project: Ignite > Issue Type: Bug > Components: sql >Affects Versions: 3.0.0-alpha3 >Reporter: Vyacheslav Koptilin >Assignee: Andrey Mashenkov >Priority: Blocker > Labels: ignite-3 > Attachments: image-2021-12-20-14-37-02-163.png, image.png > > > BaseQueryContext contains a number of static fields that are used in order to > store references to internal classes. For example, BaseQueryContext.CLUSTER > which indirectly refers to ignite tables (TableImpl instances). > Unfortunately, these references are not cleared even though the corresponding > ignite node is stopped. > The following trace based on a heap dump illustrates the issue: > !image-2021-12-20-14-37-02-163.png! > This issue can be partially mitigated by clearing ring buffers in > StripedDisruptor, but the right way to fix the issue is a proper approach to > handle static collections in BaseQueryContext. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] (IGNITE-16124) deleteAllById has wrong signature
[ https://issues.apache.org/jira/browse/IGNITE-16124 ]
Andrey Belyaev deleted comment on IGNITE-16124:
-
was (Author: JIRAUSER281322):
[~aealeksandrov] please review
> deleteAllById has wrong signature
> -
>
> Key: IGNITE-16124
> URL: https://issues.apache.org/jira/browse/IGNITE-16124
> Project: Ignite
> Issue Type: Bug
> Components: extensions
>Reporter: Michael Reiche
>Assignee: Andrey Belyaev
>Priority: Major
>
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata20.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
>
> 2.6.0-RC1
> 2.9.1
>
>
>
> org.apache.ignite
> ignite-spring-data_2.0
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-core
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-indexing
> ${ignite.version}
>
>
> org.apache.ignite
> ignite-spring
> ${ignite.version}
>
>
> org.springframework.data
> spring-data-commons
> ${spring.data.version}
>
>
> If ignite-spring-data is used instead of ingite-spring-data_2.0, the method
> deleteAll is flagged
> java: name clash: deleteAll(java.lang.Iterable com.example.ignite.EmployeeDTO>) in
> org.springframework.data.repository.CrudRepository and
> deleteAll(java.lang.Iterable) in
> org.apache.ignite.springdata.repository.IgniteRepository have the same
> erasure, yet neither overrides the other
> And 2.2-ext gives the following:
> org.apache.ignite
> ignite-spring-data-2.2-ext
> 1.0.0
> java: name clash: deleteAllById(java.lang.Iterable) in
> org.apache.ignite.springdata22.repository.IgniteRepository and
> deleteAllById(java.lang.Iterable) in
> org.springframework.data.repository.CrudRepository have the same erasure, yet
> neither overrides the other
> package com.example.ignite;
> import org.apache.ignite.springdata.repository.IgniteRepository;
> import org.apache.ignite.springdata.repository.config.RepositoryConfig;
> @RepositoryConfig(cacheName = "myCache")
> public interface EmployeeRepository extends
> IgniteRepository
> { EmployeeDTO getEmployeeDTOById(ID id); }
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (IGNITE-16248) CDC fails if default page size is used
[
https://issues.apache.org/jira/browse/IGNITE-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikhail Petrov updated IGNITE-16248:
Description:
Exception:
{code:java}
java.lang.IllegalArgumentException: Ouch! Argument is invalid: Page size must
be between 1kB and 16kB.
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.util.GridArgumentCheck.ensure(GridArgumentCheck.java:110)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory$IteratorParametersBuilder.validate(IgniteWalIteratorFactory.java:663)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory.iterator(IgniteWalIteratorFactory.java:174)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.consumeSegment(CdcMain.java:467)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:373)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.ArrayList.forEach(ArrayList.java:1259)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:390)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.consumeWalSegmentsUntilStopped(CdcMain.java:403)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.runX(CdcMain.java:285)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.run(CdcMain.java:229)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.lang.Thread.run(Thread.java:748)
{code}
The main reason of failures is that after IGNITE-15558
IteratorParametersBuilder#pageSize is set in CdcMain#consumeSegment.
Since DataStorageConfiguration#pageSize default variable is 0,
IteratorParametersBuilder#validate throws an exception considering that page
size must be at least 4 kB.
As a reproducer you can see CDC tests in Ignite Extensions repository -
https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteExtensions_Tests_Cdc&tab=buildTypeHistoryList&branch_IgniteExtensions_Tests=%3Cdefault%3E
Or see dedicated reproducer:
{code:java}
public class CdcPageSizeTest extends GridCommonAbstractTest {
/** {@inheritDoc} */
@Override protected IgniteConfiguration getConfiguration(String
igniteInstanceName) throws Exception {
return super.getConfiguration(igniteInstanceName)
.setDataStorageConfiguration(new DataStorageConfiguration()
.setCdcEnabled(true)
.setWalMode(FSYNC)
.setWalForceArchiveTimeout(5_000)
.setDefaultDataRegionConfiguration(
new DataRegionConfiguration()
.setPersistenceEnabled(true)
));
}
@Override protected void beforeTest() throws Exception {
super.beforeTest();
cleanPersistenceDir();
}
/** */
@Test
public void test() throws Exception {
startGrid(0);
grid(0).cluster().state(ClusterState.ACTIVE);
CdcConsumer consumer = new CdcConsumer() {
@Override public void start(MetricRegistry mreg) {
}
@Override public boolean onEvents(Iterator events) {
[jira] [Updated] (IGNITE-16248) CDC fails if default page size is used
[
https://issues.apache.org/jira/browse/IGNITE-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikhail Petrov updated IGNITE-16248:
Description:
Exception:
{code:java}
java.lang.IllegalArgumentException: Ouch! Argument is invalid: Page size must
be between 1kB and 16kB.
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.util.GridArgumentCheck.ensure(GridArgumentCheck.java:110)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory$IteratorParametersBuilder.validate(IgniteWalIteratorFactory.java:663)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.processors.cache.persistence.wal.reader.IgniteWalIteratorFactory.iterator(IgniteWalIteratorFactory.java:174)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.consumeSegment(CdcMain.java:467)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:373)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.ArrayList.forEach(ArrayList.java:1259)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:390)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.Sink$ChainedReference.end(Sink.java:258)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.consumeWalSegmentsUntilStopped(CdcMain.java:403)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.runX(CdcMain.java:285)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
org.apache.ignite.internal.cdc.CdcMain.run(CdcMain.java:229)
[22:16:04] [org.apache.ignite:ignite-cdc-ext] at
java.lang.Thread.run(Thread.java:748)
{code}
The main reason of failures is that after IGNITE-15558
IteratorParametersBuilder#pageSize is set in CdcMain#consumeSegment.
Since DataStorageConfiguration#pageSize default variable is 0,
IteratorParametersBuilder#validate throws an exception considering that page
size must be at least 4 kB.
As a reproducer you can see CDC tests in Ignite Extensions repository -
https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteExtensions_Tests_Cdc&tab=buildTypeHistoryList&branch_IgniteExtensions_Tests=%3Cdefault%3E
{code:java}
public class CdcPageSizeTest extends GridCommonAbstractTest {
/** {@inheritDoc} */
@Override protected IgniteConfiguration getConfiguration(String
igniteInstanceName) throws Exception {
return super.getConfiguration(igniteInstanceName)
.setDataStorageConfiguration(new DataStorageConfiguration()
.setCdcEnabled(true)
.setWalMode(FSYNC)
.setWalForceArchiveTimeout(5_000)
.setDefaultDataRegionConfiguration(
new DataRegionConfiguration()
.setPersistenceEnabled(true)
));
}
@Override protected void beforeTest() throws Exception {
super.beforeTest();
cleanPersistenceDir();
}
/** */
@Test
public void test() throws Exception {
startGrid(0);
grid(0).cluster().state(ClusterState.ACTIVE);
CdcConsumer consumer = new CdcConsumer() {
@Override public void start(MetricRegistry mreg) {
}
@Override public boolean onEvents(Iterator events) {
return false;
}
