[jira] [Updated] (IGNITE-25941) .NET: UpsertAll fails on large collections

[Pavel Tupitsyn (Jira)]

 [ 
https://issues.apache.org/jira/browse/IGNITE-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn updated IGNITE-25941:

Ignite Flags: Release Notes Required  (was: Docs Required,Release Notes 
Required)

> .NET: UpsertAll fails on large collections
> --
>
> Key: IGNITE-25941
> URL: https://issues.apache.org/jira/browse/IGNITE-25941
> Project: Ignite
>  Issue Type: Bug
>  Components: platforms ai3, thin clients ai3
>Affects Versions: 3.0
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
>Priority: Critical
>  Labels: ignite-3
> Fix For: 3.1
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Modify *RecordViewBinaryTests* like this:
> {code}
> [TearDown]
> public async Task CleanTable()
> {
> await Client.Sql.ExecuteScriptAsync($"DELETE FROM {Table.Name}");
> }
> [Test]
> public async Task TestUpsertAllMany()
> {
> int count = 12345;
> var tuples = Enumerable.Range(0, count)
> .Select(id => new IgniteTuple { [KeyCol] = (long)id, [ValCol] 
> = $"test{id}" })
> .ToList();
> await TupleView.UpsertAllAsync(null, tuples);
> }
> {code}
> *TestUpsertAllMany* fails:
> {code}
> JetBrains.ReSharper.TestRunner.Logging.TraceListener+AssertionException : 
> _index + count < _buffer.Length
>at JetBrains.ReSharper.TestRunner.Logging.TraceListener.Fail(String 
> message, String detailMessage) in 
> Z:\BuildAgent\work\1b668fe37ef92293\ReSharperTestRunner\src\TestRunner.Utilities\Logging\TraceListener.cs:line
>  33
>at System.Diagnostics.TraceInternal.Fail(String message, String 
> detailMessage)
>at System.Diagnostics.Debug.Fail(String message, String detailMessage)
>at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.Advance(Int32 count) 
> in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  106
>at 
> Apache.Ignite.Internal.Buffers.PooledArrayBuffer.GetSpanAndAdvance(Int32 
> size) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  144
>at 
> Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteExtensionHeader(Byte 
> typeCode, Int32 dataLength) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  249
>at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteBitSet(Int32 
> bitCount) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  230
>at 
> Apache.Ignite.Internal.Table.Serialization.IRecordSerializerHandler`1.Write(MsgPackWriter&
>  writer, Schema schema, T record, Boolean keyOnly, Boolean computeHash) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/IRecordSerializerHandler.cs:line
>  51
>at 
> Apache.Ignite.Internal.Table.Serialization.RecordSerializer`1.WriteMultiple(PooledArrayBuffer
>  buf, Nullable`1 txId, Schema schema, IEnumerator`1 recs, Boolean keyOnly) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/RecordSerializer.cs:line
>  234
>at 
> Apache.Ignite.Internal.Table.RecordView`1.DoMultiRecordOutOpAsync(ClientOp 
> op, ITransaction transaction, IEnumerable`1 recs, Boolean keyOnly, Nullable`1 
> schemaVersionOverride) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  643
>at Apache.Ignite.Internal.Table.RecordView`1.UpsertAllAsync(ITransaction 
> transaction, IEnumerable`1 records) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  182
>at Apache.Ignite.Tests.Table.RecordViewBinaryTests.TestUpsertAllMany() in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite.Tests/Table/RecordViewBinaryTests.cs:line
>  49
>at 
> NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
>at 
> NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter
>  awaiter)
>at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.b__0()
>at 
> NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext
>  context, Action action)
> {code}
> Set count to 7000, different failure (serve

[jira] [Updated] (IGNITE-25941) .NET: UpsertAll fails on large collections

[Pavel Tupitsyn (Jira)]

 [ 
https://issues.apache.org/jira/browse/IGNITE-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn updated IGNITE-25941:

Affects Version/s: 3.0

> .NET: UpsertAll fails on large collections
> --
>
> Key: IGNITE-25941
> URL: https://issues.apache.org/jira/browse/IGNITE-25941
> Project: Ignite
>  Issue Type: Bug
>  Components: platforms ai3, thin clients ai3
>Affects Versions: 3.0
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
>Priority: Critical
>  Labels: ignite-3
> Fix For: 3.1
>
>
> Modify *RecordViewBinaryTests* like this:
> {code}
> [TearDown]
> public async Task CleanTable()
> {
> await Client.Sql.ExecuteScriptAsync($"DELETE FROM {Table.Name}");
> }
> [Test]
> public async Task TestUpsertAllMany()
> {
> int count = 12345;
> var tuples = Enumerable.Range(0, count)
> .Select(id => new IgniteTuple { [KeyCol] = (long)id, [ValCol] 
> = $"test{id}" })
> .ToList();
> await TupleView.UpsertAllAsync(null, tuples);
> }
> {code}
> *TestUpsertAllMany* fails:
> {code}
> JetBrains.ReSharper.TestRunner.Logging.TraceListener+AssertionException : 
> _index + count < _buffer.Length
>at JetBrains.ReSharper.TestRunner.Logging.TraceListener.Fail(String 
> message, String detailMessage) in 
> Z:\BuildAgent\work\1b668fe37ef92293\ReSharperTestRunner\src\TestRunner.Utilities\Logging\TraceListener.cs:line
>  33
>at System.Diagnostics.TraceInternal.Fail(String message, String 
> detailMessage)
>at System.Diagnostics.Debug.Fail(String message, String detailMessage)
>at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.Advance(Int32 count) 
> in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  106
>at 
> Apache.Ignite.Internal.Buffers.PooledArrayBuffer.GetSpanAndAdvance(Int32 
> size) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  144
>at 
> Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteExtensionHeader(Byte 
> typeCode, Int32 dataLength) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  249
>at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteBitSet(Int32 
> bitCount) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  230
>at 
> Apache.Ignite.Internal.Table.Serialization.IRecordSerializerHandler`1.Write(MsgPackWriter&
>  writer, Schema schema, T record, Boolean keyOnly, Boolean computeHash) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/IRecordSerializerHandler.cs:line
>  51
>at 
> Apache.Ignite.Internal.Table.Serialization.RecordSerializer`1.WriteMultiple(PooledArrayBuffer
>  buf, Nullable`1 txId, Schema schema, IEnumerator`1 recs, Boolean keyOnly) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/RecordSerializer.cs:line
>  234
>at 
> Apache.Ignite.Internal.Table.RecordView`1.DoMultiRecordOutOpAsync(ClientOp 
> op, ITransaction transaction, IEnumerable`1 recs, Boolean keyOnly, Nullable`1 
> schemaVersionOverride) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  643
>at Apache.Ignite.Internal.Table.RecordView`1.UpsertAllAsync(ITransaction 
> transaction, IEnumerable`1 records) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  182
>at Apache.Ignite.Tests.Table.RecordViewBinaryTests.TestUpsertAllMany() in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite.Tests/Table/RecordViewBinaryTests.cs:line
>  49
>at 
> NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
>at 
> NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter
>  awaiter)
>at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.b__0()
>at 
> NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext
>  context, Action action)
> {code}
> Set count to 7000, different failure (server side):
> {code}
> Apache.Ignite.IgniteException : Expected Ext, but got Integer (4c)
>   > Apache.Ignite.Ign

[jira] [Updated] (IGNITE-25941) .NET: UpsertAll fails on large collections

[Pavel Tupitsyn (Jira)]

 [ 
https://issues.apache.org/jira/browse/IGNITE-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn updated IGNITE-25941:

Description: 
Modify *RecordViewBinaryTests* like this:
{code}
[TearDown]
public async Task CleanTable()
{
await Client.Sql.ExecuteScriptAsync($"DELETE FROM {Table.Name}");
}

[Test]
public async Task TestUpsertAllMany()
{
int count = 12345;

var tuples = Enumerable.Range(0, count)
.Select(id => new IgniteTuple { [KeyCol] = (long)id, [ValCol] = 
$"test{id}" })
.ToList();

await TupleView.UpsertAllAsync(null, tuples);
}
{code}

*TestUpsertAllMany* fails:
{code}
JetBrains.ReSharper.TestRunner.Logging.TraceListener+AssertionException : 
_index + count < _buffer.Length

   at JetBrains.ReSharper.TestRunner.Logging.TraceListener.Fail(String message, 
String detailMessage) in 
Z:\BuildAgent\work\1b668fe37ef92293\ReSharperTestRunner\src\TestRunner.Utilities\Logging\TraceListener.cs:line
 33
   at System.Diagnostics.TraceInternal.Fail(String message, String 
detailMessage)
   at System.Diagnostics.Debug.Fail(String message, String detailMessage)
   at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.Advance(Int32 count) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
 106
   at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.GetSpanAndAdvance(Int32 
size) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
 144
   at 
Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteExtensionHeader(Byte 
typeCode, Int32 dataLength) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
 249
   at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteBitSet(Int32 
bitCount) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
 230
   at 
Apache.Ignite.Internal.Table.Serialization.IRecordSerializerHandler`1.Write(MsgPackWriter&
 writer, Schema schema, T record, Boolean keyOnly, Boolean computeHash) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/IRecordSerializerHandler.cs:line
 51
   at 
Apache.Ignite.Internal.Table.Serialization.RecordSerializer`1.WriteMultiple(PooledArrayBuffer
 buf, Nullable`1 txId, Schema schema, IEnumerator`1 recs, Boolean keyOnly) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/RecordSerializer.cs:line
 234
   at 
Apache.Ignite.Internal.Table.RecordView`1.DoMultiRecordOutOpAsync(ClientOp op, 
ITransaction transaction, IEnumerable`1 recs, Boolean keyOnly, Nullable`1 
schemaVersionOverride) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
 643
   at Apache.Ignite.Internal.Table.RecordView`1.UpsertAllAsync(ITransaction 
transaction, IEnumerable`1 records) in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
 182
   at Apache.Ignite.Tests.Table.RecordViewBinaryTests.TestUpsertAllMany() in 
/home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite.Tests/Table/RecordViewBinaryTests.cs:line
 49
   at 
NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
   at 
NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter
 awaiter)
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at 
NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext
 context)
   at 
NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext
 context)
   at 
NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.b__0()
   at 
NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext
 context, Action action)
{code}

Set count to 7000, different failure (server side):
{code}
Apache.Ignite.IgniteException : Expected Ext, but got Integer (4c)
  > Apache.Ignite.IgniteException : org.apache.ignite.lang.IgniteException: 
IGN-CMN-65535 Expected Ext, but got Integer (4c) TraceId:43f0cc6e
at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.lambda$mapToPublicException$2(IgniteExceptionMapperUtil.java:88)
at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapCheckingResultIsPublic(IgniteExceptionMapperUtil.java:141)
at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:137)
at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:88)
at 
org.apache.ignite.client.handler.ClientInboundMe

[jira] [Updated] (IGNITE-25941) .NET: UpsertAll fails on large collections

[Pavel Tupitsyn (Jira)]

 [ 
https://issues.apache.org/jira/browse/IGNITE-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Tupitsyn updated IGNITE-25941:

Priority: Critical  (was: Major)

> .NET: UpsertAll fails on large collections
> --
>
> Key: IGNITE-25941
> URL: https://issues.apache.org/jira/browse/IGNITE-25941
> Project: Ignite
>  Issue Type: Bug
>  Components: platforms ai3, thin clients ai3
>Reporter: Pavel Tupitsyn
>Assignee: Pavel Tupitsyn
>Priority: Critical
>  Labels: ignite-3
> Fix For: 3.1
>
>
> Modify *RecordViewBinaryTests* like this:
> {code}
> [TearDown]
> public async Task CleanTable()
> {
> await Client.Sql.ExecuteScriptAsync($"DELETE FROM {Table.Name}");
> }
> [Test]
> public async Task TestUpsertAllMany()
> {
> int count = 12345;
> var tuples = Enumerable.Range(0, count)
> .Select(id => new IgniteTuple { [KeyCol] = (long)id, [ValCol] 
> = $"test{id}" })
> .ToList();
> await TupleView.UpsertAllAsync(null, tuples);
> }
> {code}
> *TestUpsertAllMany* fails:
> {code}
> JetBrains.ReSharper.TestRunner.Logging.TraceListener+AssertionException : 
> _index + count < _buffer.Length
>at JetBrains.ReSharper.TestRunner.Logging.TraceListener.Fail(String 
> message, String detailMessage) in 
> Z:\BuildAgent\work\1b668fe37ef92293\ReSharperTestRunner\src\TestRunner.Utilities\Logging\TraceListener.cs:line
>  33
>at System.Diagnostics.TraceInternal.Fail(String message, String 
> detailMessage)
>at System.Diagnostics.Debug.Fail(String message, String detailMessage)
>at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.Advance(Int32 count) 
> in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  106
>at 
> Apache.Ignite.Internal.Buffers.PooledArrayBuffer.GetSpanAndAdvance(Int32 
> size) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line
>  144
>at 
> Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteExtensionHeader(Byte 
> typeCode, Int32 dataLength) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  249
>at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteBitSet(Int32 
> bitCount) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line
>  230
>at 
> Apache.Ignite.Internal.Table.Serialization.IRecordSerializerHandler`1.Write(MsgPackWriter&
>  writer, Schema schema, T record, Boolean keyOnly, Boolean computeHash) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/IRecordSerializerHandler.cs:line
>  51
>at 
> Apache.Ignite.Internal.Table.Serialization.RecordSerializer`1.WriteMultiple(PooledArrayBuffer
>  buf, Nullable`1 txId, Schema schema, IEnumerator`1 recs, Boolean keyOnly) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/RecordSerializer.cs:line
>  234
>at 
> Apache.Ignite.Internal.Table.RecordView`1.DoMultiRecordOutOpAsync(ClientOp 
> op, ITransaction transaction, IEnumerable`1 recs, Boolean keyOnly, Nullable`1 
> schemaVersionOverride) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  643
>at Apache.Ignite.Internal.Table.RecordView`1.UpsertAllAsync(ITransaction 
> transaction, IEnumerable`1 records) in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line
>  182
>at Apache.Ignite.Tests.Table.RecordViewBinaryTests.TestUpsertAllMany() in 
> /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite.Tests/Table/RecordViewBinaryTests.cs:line
>  49
>at 
> NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
>at 
> NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter
>  awaiter)
>at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext
>  context)
>at 
> NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.b__0()
>at 
> NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext
>  context, Action action)
> {code}
> Set count to 7000, different failure (server side):
> {code}
> Apache.Ignite.IgniteException : Expected Ext, but got Integer (4c)
>   > Apache.Ignite.IgniteException : 
>