[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723240#comment-17723240 ] Pavel Pereslegin commented on IGNITE-19488: --- Exception from server log {noformat} Caused by: java.lang.NullPointerException at org.apache.ignite.internal.sql.engine.exec.rel.IndexScanNode.partitionPublisher(IndexScanNode.java:178) at org.apache.ignite.internal.sql.engine.exec.rel.IndexScanNode.lambda$indexPublisher$1(IndexScanNode.java:124) at org.apache.ignite.internal.util.TransformingIterator.next(TransformingIterator.java:50) at org.apache.ignite.internal.util.subscription.ConcatenatedPublisher$ConcatenatedSubscriber.drain(ConcatenatedPublisher.java:137) at org.apache.ignite.internal.util.subscription.ConcatenatedPublisher.subscribe(ConcatenatedPublisher.java:53) at org.apache.ignite.internal.sql.engine.exec.rel.StorageScanNode.requestNextBatch(StorageScanNode.java:238) at org.apache.ignite.internal.sql.engine.exec.rel.StorageScanNode.push(StorageScanNode.java:210) at org.apache.ignite.internal.sql.engine.exec.ExecutionContext.lambda$execute$0(ExecutionContext.java:315) {noformat} > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Priority: Critical > Attachments: logs.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723404#comment-17723404 ] Pavel Pereslegin commented on IGNITE-19488: --- [~lunigorn], please describe the table you created in more detail, and even better, attach a complete reproducer for this issue. > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Priority: Critical > Labels: ignite-3 > Attachments: logs.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723474#comment-17723474 ] Igor commented on IGNITE-19488: --- [~xtern] there is the code to reproduce the error https://github.com/Lunigorn/ignite3test/tree/rows-capacity-test > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Priority: Critical > Labels: ignite-3 > Attachments: logs.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723807#comment-17723807 ] Igor commented on IGNITE-19488: --- If errors in `SELECT count(*)` are ignored then it is possible to insert at least 1 mln rows into one table (test didn't try to insert more). Logs are in attachment. But the error happens pretty frequently. [^logs_with_ignored_erorr.zip] > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Priority: Critical > Labels: ignite-3 > Attachments: logs.zip, logs_with_ignored_erorr.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724226#comment-17724226 ] Pavel Pereslegin commented on IGNITE-19488: --- [~lunigorn], I checked the latest server logs you provided (logs_with_ignored_erorr.zip), there is only the "Queue full" exception (and no NPE exception). That's another issue, and it's already fixed in IGNITE-19278, I think you should take a new version, so that this error does not bother you when testing. > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Priority: Critical > Labels: ignite-3 > Attachments: logs.zip, logs_with_ignored_erorr.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19488) RemoteFragmentExecutionException when inserting more than 30 000 rows into one table
[ https://issues.apache.org/jira/browse/IGNITE-19488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17725739#comment-17725739 ] Evgeny Stanilovsky commented on IGNITE-19488: - This case can`t be reproduced on current main branch, but there is present other (erroneous plan) issue, that fixed in current PR. > RemoteFragmentExecutionException when inserting more than 30 000 rows into > one table > > > Key: IGNITE-19488 > URL: https://issues.apache.org/jira/browse/IGNITE-19488 > Project: Ignite > Issue Type: Bug > Components: jdbc, sql >Reporter: Igor >Assignee: Evgeny Stanilovsky >Priority: Critical > Labels: ignite-3 > Attachments: logs.zip, logs_with_ignored_erorr.zip > > > h1. Steps to reproduce > Ignite 3 main branch commit 45380a6c802203dab0d72bd1eb9fb202b2a345b0 > # Create table with 5 columns > # Insert into table rows by batches 1000 rows each batch. > # Repeat previous step untill exception is thrown. > h1. Expected behaviour > Created more than 30 000 rows. > h1. Actual behaviour > An exception after 29 000 rows are inserted: > {code:java} > Exception while executing query [query=SELECT COUNT(*) FROM > rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > java.sql.SQLException: Exception while executing query [query=SELECT COUNT(*) > FROM rows_capacity_table]. Error message:IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 IGN-CMN-1 > TraceId:24c93463-f078-410a-8831-36b5c549a907 Query remote fragment execution > failed: nodeName=TablesAmountCapacityTest_cluster_0, > queryId=ecd14026-5366-4ee2-b73a-f38757d3ba4f, fragmentId=1561, > originalMessage=IGN-CMN-1 TraceId:24c93463-f078-410a-8831-36b5c549a907 > at > org.apache.ignite.internal.jdbc.proto.IgniteQueryErrorCode.createJdbcSqlException(IgniteQueryErrorCode.java:57) > at > org.apache.ignite.internal.jdbc.JdbcStatement.execute0(JdbcStatement.java:149) > at > org.apache.ignite.internal.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:108) > {code} > Logs are in the attachment. > [^logs.zip] -- This message was sent by Atlassian Jira (v8.20.10#820010)