Re: Need help for Access Violation

2020-02-07 Thread Anthony
Hello,
The "usrCp" value is
NameValueType
▶ usrCp  const std::string &
Seems that the "cfg.jvmClassPath" was not set properly?

I am not familiar with java environment, should i set some environmental
variable?

Thank you!

Anthony

On Fri, Feb 7, 2020 at 5:20 AM Igor Sapego  wrote:

> Hi
>
> And what is the value of "usrCp" argument?
> For me the code works just fine.
>
> Best Regards,
> Igor
>
>
> On Fri, Feb 7, 2020 at 12:22 AM Anthony  wrote:
>
>> Hello,
>>
>> I am new to ignite C++. I am using windows 10, VS community.
>>
>> I keep getting Access Violation when I am trying to run the following
>> code.
>>
>> #include
>> #include
>> using namespace ignite;
>>
>> int main() {
>> IgniteConfiguration cfg;
>> Ignite node = Ignition::Start(cfg);
>> std::cout << "node started" << std::endl;
>> return 0;
>> }
>>
>> Can anyone help with that?
>>
>> The error was generated from:
>>
>> std::string NormalizeClasspath(const std::string& usrCp)
>> {
>> if (usrCp.empty() || *usrCp.rbegin() == ';')
>> return usrCp;
>>
>> return usrCp + ';';
>> }
>> Following are the error messages:
>>
>> Exception thrown at 0x7FFBADD635D6 (ignite.jni.dll) in Project1.exe:
>> 0xC005: Access violation reading location 0x. occurred
>>
>> Thank you !!
>>
>


Re: Need help for Access Violation

2020-02-07 Thread Igor Sapego
Hi

And what is the value of "usrCp" argument?
For me the code works just fine.

Best Regards,
Igor


On Fri, Feb 7, 2020 at 12:22 AM Anthony  wrote:

> Hello,
>
> I am new to ignite C++. I am using windows 10, VS community.
>
> I keep getting Access Violation when I am trying to run the following code.
>
> #include
> #include
> using namespace ignite;
>
> int main() {
> IgniteConfiguration cfg;
> Ignite node = Ignition::Start(cfg);
> std::cout << "node started" << std::endl;
> return 0;
> }
>
> Can anyone help with that?
>
> The error was generated from:
>
> std::string NormalizeClasspath(const std::string& usrCp)
> {
> if (usrCp.empty() || *usrCp.rbegin() == ';')
> return usrCp;
>
> return usrCp + ';';
> }
> Following are the error messages:
>
> Exception thrown at 0x7FFBADD635D6 (ignite.jni.dll) in Project1.exe:
> 0xC005: Access violation reading location 0x. occurred
>
> Thank you !!
>


Re: Ignite Load Hangs at the end while using DataStreamer

2020-02-07 Thread Ilya Kasnacheev
Hello!

I can see that some data processing is happening in thread dumps, but also
this:

[11:16:11,637][INFO][grid-nio-worker-tcp-comm-2-#26][TcpCommunicationSpi]
Accepted incoming communication connection [locAddr=/172.16.1.7:47100,
rmtAddr=/10.139.0.10:38624]
[11:16:12,686][SEVERE][grid-nio-worker-tcp-comm-2-#26][TcpCommunicationSpi]
Failed to process selector key [ses=GridSelectorNioSessionImpl
[worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=2,
bytesRcvd=430031923, bytesSent=2154539, bytesRcvd0=6974058,
bytesSent0=1976, select=true, super=GridWorker
[name=grid-nio-worker-tcp-comm-2, igniteInstanceName=null, finished=false,
heartbeatTs=1581074171663, hashCode=1764437028, interrupted=false,
runner=grid-nio-worker-tcp-comm-2-#26]]],
writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
inRecovery=GridNioRecoveryDescriptor [acked=384, resendCnt=0, rcvCnt=422,
sentCnt=413, reserved=true, lastAck=416, nodeLeft=false,
node=TcpDiscoveryNode [id=a66a573a-43dc-48d2-8ee5-232e727acbc9,
addrs=[10.139.64.10, 127.0.0.1], sockAddrs=[/10.139.64.10:0, /127.0.0.1:0],
discPort=0, order=19, intOrder=19, lastExchangeTime=1581073961809,
loc=false, ver=2.7.6#20190911-sha1:21f7ca41, isClient=true],
connected=true, connectCnt=0, queueLimit=4096, reserveCnt=1,
pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=384,
resendCnt=0, rcvCnt=422, sentCnt=413, reserved=true, lastAck=416,
nodeLeft=false, node=TcpDiscoveryNode
[id=a66a573a-43dc-48d2-8ee5-232e727acbc9, addrs=[10.139.64.10, 127.0.0.1],
sockAddrs=[/10.139.64.10:0, /127.0.0.1:0], discPort=0, order=19,
intOrder=19, lastExchangeTime=1581073961809, loc=false,
ver=2.7.6#20190911-sha1:21f7ca41, isClient=true], connected=true,
connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false],
super=GridNioSessionImpl [locAddr=/172.16.1.7:47100, rmtAddr=/
10.139.0.10:37846, createTime=1581073963095, closeTime=0, bytesSent=78611,
bytesRcvd=104294928, bytesSent0=561, bytesRcvd0=916098,
sndSchedTime=1581073963095, lastSndTime=1581074171592,
lastRcvTime=1581074171612, readsPaused=false,
filterChain=FilterChain[filters=[GridNioCodecFilter
[parser=o.a.i.i.util.nio.GridDirectParser@672e22f0, directMode=true],
GridConnectionBytesVerifyFilter], accepted=true, markedForClose=false]]]
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:377)
at
org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1282)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2386)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2153)
at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1794)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
at java.lang.Thread.run(Thread.java:748)

[11:16:46,612][INFO][grid-nio-worker-tcp-comm-2-#26][TcpCommunicationSpi]
Received incoming connection from remote node while connecting to this
node, rejecting [locNode=c7e6fc55-d367-43d5-94e9-79ef1d984601,
locNodeOrder=1, rmtNode=a66a573a-43dc-48d2-8ee5-232e727acbc9,
rmtNodeOrder=19]
[11:16:46,928][INFO][grid-nio-worker-tcp-comm-3-#27][TcpCommunicationSpi]
Accepted incoming communication connection [locAddr=/172.16.1.7:47100,
rmtAddr=/10.139.0.10:38900]
[11:16:46,985][INFO][grid-nio-worker-tcp-comm-3-#27][TcpCommunicationSpi]
Received incoming connection from remote node while connecting to this
node, rejecting [locNode=c7e6fc55-d367-43d5-94e9-79ef1d984601,
locNodeOrder=1, rmtNode=a66a573a-43dc-48d2-8ee5-232e727acbc9,
rmtNodeOrder=19]
[11:16:47,301][INFO][grid-nio-worker-tcp-comm-0-#24][TcpCommunicationSpi]
Accepted incoming communication connection [locAddr=/172.16.1.7:47100,
rmtAddr=/10.139.0.10:38902]
[11:16:47,359][INFO][grid-nio-worker-tcp-comm-0-#24][TcpCommunicationSpi]
Received incoming connection from remote node while connecting to this
node, rejecting [locNode=c7e6fc55-d367-43d5-94e9-79ef1d984601,
locNodeOrder=1, rmtNode=a66a573a-43dc-48d2-8ee5-232e727acbc9,
rmtNodeOrder=19]
[11:16:47,675][INFO][grid-nio-worker-tcp-comm-1-#25][TcpCommunicationSpi]
Accepted incoming communication connection [locAddr=/172.16.1.7:47100,
rmtAddr=/10.139.0.10:38904]
[11:16:47,733][INFO][grid-nio-worker-tcp-comm-1-#25][TcpCommunicationSpi]
Received incoming connection from remote node while connecting to this
node, rejecting [locNode=c7e6fc55-d367-43d5-94e9-79ef1d984601,
locNodeOrder=1, rmtNode=a66a573a-43dc-48d2-8ee5-232e727acbc9,
rmtNodeOrder=19]

Serialisation issue.

2020-02-07 Thread adipro
cache = ignite.getOrCreateCache(new CacheConfiguration<>()
.setName("DOCIDS")
.setStoreKeepBinary(true)
.setQueryEntities(Collections.unmodifiableList(new
ArrayList(){{
QueryEntity entity = new QueryEntity();
entity.setKeyType(String.class.getName());
entity.setValueType(DOCIDS_CLASS.class.getName());
entity.setFields(new
LinkedHashMap(){{
put("docid",Long.class.getName());
put("url",String.class.getName());
}});
entity.setIndexes(Collections.unmodifiableList(new
ArrayList(){{
add(new QueryIndex("docid"));
}}));
add(entity);
}}))
.setCacheMode(CacheMode.REPLICATED));

When executing the above statements, we are getting below exception:


Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
serialize object: CacheConfiguration [name=DOCIDS, grpName=null,
memPlcName=null, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=1,
rebalanceTimeout=1, evictPlc=null, evictPlcFactory=null,
onheapCache=false, sqlOnheapCache=false, sqlOnheapCacheMaxSize=0,
evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null,
writeSync=null, storeFactory=null, storeKeepBinary=true, loadPrevVal=false,
aff=null, cacheMode=REPLICATED, atomicityMode=null, backups=0,
invalidate=false, tmLookupClsName=null, rebalanceMode=ASYNC,
rebalanceOrder=0, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2,
maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false,
writeBehindFlushSize=10240, writeBehindFlushFreq=5000,
writeBehindFlushThreadCnt=1, writeBehindBatchSize=512,
writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=null,
rebalanceDelay=0, rebalanceThrottle=0, interceptor=null,
longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true,
nodeFilter=null, sqlSchema=null, sqlEscapeAll=false, cpOnRead=true,
topValidator=null, partLossPlc=IGNORE, qryParallelism=1, evtsDisabled=false,
encryptionEnabled=false]
at
org.apache.ignite.marshaller.jdk.JdkMarshaller.marshal0(JdkMarshaller.java:102)
at
org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(AbstractNodeNameAwareMarshaller.java:69)
at
org.apache.ignite.marshaller.jdk.JdkMarshaller.marshal0(JdkMarshaller.java:116)
at
org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(AbstractNodeNameAwareMarshaller.java:57)
at
org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:10131)
at
org.apache.ignite.internal.processors.cache.GridCacheProcessor$11.applyx(GridCacheProcessor.java:5419)
... 19 more
Caused by: java.io.NotSerializableException:
org.apache.ignite.configuration.IgniteConfiguration
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
at
java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at 
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at
java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at 
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at
java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at 
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at
java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at 
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at
java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
at 
java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
at
java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
at java.util.ArrayList.writeObject(ArrayList.java:766)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at

Re: Ignite Load Hangs at the end while using DataStreamer

2020-02-07 Thread pg31
Thanks Ilya. 

I have changed the Client Side Machine to prefer IPv4 Stack and hence that
error went away. But still the data-streamer-stripes and tcp-comm-worker
threads keep getting stuck. 

I am attaching the logs again. (These contain the thread-dump themselves)
log.zip   



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/