’t get more info now, the cpu issue is gone as now there are very few traffic on our system. For our case,we store data into ignite every 30 seconds. If no query, the cpu should be very low. But yesterday it is a exception. Very strange. shawn.du邮箱：shawn...@neulion.com.cn Signature is customized
yesterday it is a exception. Very strange.
shawn.du
Hi Community,My single-node ignite cluster has started since Apr 23. In past couple weeks, It worked fine. For our case, Ignite server's CPU is very low at most time with exception that there are complex/concurrent queries.event in case of query, ignite server's CPU will be high for
Hi,Is there connection pool concept in ignite client?I notice there are only one TCP connection between my ignite client and server.Currently I don't find any issues with it, but please explain.If a client communicate(put/get/query) with server heavily, does one connection is enough?
r the processing finishes, if it's possible.Denisвс, 8 апр. 2018 г. в 17:53, shawn.du <shawn...@neulion.com.cn>:
Hi,i want to know how costly below case:1 creat a temp tabl/cache dynamically. Table only has 3 or 4 columns.2 insert millions rows data by mapreduce.Each row dat
.
shawn.du
邮箱：shawn...@neulion.com.cn
So, try to investigate if there is a memory leak in your code.On Fri, Mar 30, 2018 at 6:36 AM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi,My Ignite client heap OOM yesterday. This is the first time we encounter this issue.My ignite client colocates within Storm worker process. this i
Hi,My Ignite client heap OOM yesterday. This is the first time we encounter this issue.My ignite client colocates within Storm worker process. this issue cause storm worker restart.I have several questions about it: our ignite version is 2.3.01) if ignite in client mode, it use offh
Hi Denis,Thanks, that's cool! looking forward 2.4.0 release.
ThanksShawn
On 2/28/2018 12:11，Denis Magda wrote：
Hi Shawn,In addition to RDDs, you'll be able to use Data Frames APIs soon with Ignite as stora
Hi, stan,Thanks. I am evaluating igniteRDD. it is cool! I am new to spark, I can get sqlContext by ds.sqlContext.If I want to query all using select, what's the table name?see below in spark-shell, I want to do something like > sc.sql("select * from "). Where is the table name?===
Hi Val,using backup can partially solve my problem, but not always.
ThanksShawn
On 2/25/2018 05:23，vkulichenko wrote：
Shawn,
I doubt this feature makes much sense as it doesn't really add value. If you
Hi,Spark is a compute engine. Ignite also provide compute feature. Also Ignite can integrate with spark.We are using ignite compute map-reduce feature now. It is very fast.I am just curious how spark compares with ignite on computing.it is possible using spark API computing ignite
ode you want to shut down, - shut down the node - upload stored data back to the cluster.It can be done via an external database, for example.If the data set is not huge, you can try to use a new partitioned cache (with node filter/backups) or replicated cache.Thanks.2018-02-23 10:00
Hi,Suppose I have several ignite server nodes which compose a cluster.all data in PARTITIONED mode, and with no backups.It is possible to dismiss a node without restarting and data lose?if possible, what are the steps?
ThanksShawn
Hi,I am trying sqlline in CLI,./sqlline.sh --color=true --verbose=true -u jdbc:ignite:thin://127.0.0.1/I can connect ignite successfully, also command !tables can list all tables.but when I query something, it always fail.
++--
Hi community,I want monitor ignite cluster off heap memory usage. if off heap available memory is less than 1G then alert.
I went through ignite MBean, find ClusterLocalNodeMetricsMXBeanImpl's NonHeapMemoryUsed. The value is too small. I don't think it is. How can I get it?
fixed. Some library is missing.
ThanksShawn
On 12/18/2017 13:20，shawn.du wrote：
Hi,I am using https://github.com/RuedigerMoeller/fast-serialization for ser/des.my code is rather simplepublic
Hi,I am using https://github.com/RuedigerMoeller/fast-serialization for ser/des.my code is rather simplepublic class EncoderSerDes{private static ISerDes serDes = new FstSerDes();public static byte[] serialize(ColumnEncoder encoder) throws Exception{return serDes.
ThanksShawn
On 12/14/2017 10:48，shawn.du wrote：
Hi Denis,after run 20 hours, ignite client can't update cache and threw blow exceptions: Caused by: org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Not enough memory allocated (consider increasing data region size o
:56，Denis Magda wrote：
Shawn, good to hear this,Just in case here is you can find some tips and tricks on memory and garbage collection tuning for Ignite:https://apacheignite.readme.io/docs/durable-memory-tuninghttps://apacheignite.readme.io/docs/jvm-and-system-tuning—DenisOn Dec 12, 2017, at 10:
Thank you Denis,I think OOM is caused by invalid configuration. for I supposed ignite use on-heap memory, I set a very big value for -Xmx -Xms, in this way, memory left for off-heap and other programs is limited. We are run testing now, till now all seems good.
Hi,I upgrade my ignite version from 1.9 to 2.3. In 1.9, We store all data in memory. I know that in ignite 2.0+, ignite use off-heap memory by default.so I change my code like below: config.setOnheapCacheEnabled(true);but after running several hours, my server is crash for OOM.runni
Hi, My ignite server stop to response. Any client can't connect it, and I found dead lock in logs,what's the possible reason for this? I use ignite 1.9.0.Thanks in advance.log===deadlock: truecompleted: 29519967Thread [name="sys-strip
s optional.
[1] https://ignite.apache.org/features/persistence.html
—
Denis
> On Oct 16, 2017, at 7:18 PM, shawn.du wrote:
>
> Hi Denis,
>
> Yes, We do want to limit the RAM to less than 64G. RAM resource is still an expensive resource.
> If we store our data with ignite SQ
SQL works over both tiers transparently for you.
[1] https://ignite.apache.org/features/persistence.html
—
Denis
> On Oct 16, 2017, at 2:19 AM, Alexey Kukushkin wrote:
>
> Cross-sending to the DEV community.
>
> On Mon, Oct 16, 2017 at 12:14 PM, shawn.du > wrote:
> Hi
Hi community,I am trying to implement a connector for presto to connect ignite.
I think it will be a very interest thing to connect ignite and presto.In fact, currently we use ignite and it works very well. but in order to save memory, we build compressed binary data.thus we cannot
Hi Val,I want to do something like below:Ignition.setClientMode(true);Ignite ignite1 = Ignition.start(config1);Ignite ignite2 = Ignition.start(config2);
with above 2 ignite client instance, so that I can query from one and put the query result into the other manually, even with some
Hi,It seems that ignite can't do as the topic describe. I want to do data synchronization manually between two cluster, any suggest?
ThanksShawn
sorry, Ignore this.
ThanksShawn
On 08/11/2017 11:03，shawn.du wrote：
Hi community,I have a ignite server(1.9.0) and a ignite client.Recently my client crashed 4 times. I found it may be caused by
Hi community,I have a ignite server(1.9.0) and a ignite client.Recently my client crashed 4 times. I found it may be caused by server send big data to client. see blow picture. this is AWS Cloud Watch network-out-bytes picture of ignite server. It seems that ignite server do somethi
Hi,I see many NullPointerException in my ignite log. like this:java.lang.NullPointerException[15:41:05,542][SEVERE][pub-#5702%null%][GridJobWorker] Failed to execute job due to unexpected runtime exception [jobId=751a821cc51-a76e994f-a6fc-4483-9063-2a51edb5195e, ses=GridJobSessionImp
20:52，Nikolai Tikhonov wrote：
Hi,Ignite does not accumulate messages which were sent to non-exist topic. Messages will be lost in your case.On Mon, Jun 12, 2017 at 12:30 PM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi,I am trying ignite topic based messaging. I wonder to
Hi,I am trying ignite topic based messaging. I wonder to know ignite behavior in blow case:Client A send a message with topic T1 to ignite server, but there are no topic listeners at this time, after for a while(like 1 or 2 minutes), Client B is online and subscribe topic T1, will c
: * Implementations should not execute any complex logic,* including locking, networking or cache operations,* as it may lead to deadlock, since this method is called* from sensitive synchronization blocks.On Fri, Mar 24, 2017 at 4:16 AM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi
，Andrey Mashenkov wrote：
Hi Shawn,CacheInterceptor should be called once on one node.On Wed, Mar 22, 2017 at 5:11 AM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi,If I have multiple-nodes cluster, and I set up a cache interceptor on a cache. the cache mode is partitio
Hi,If I have multiple-nodes cluster, and I set up a cache interceptor on a cache. the cache mode is partitioned or duplicated. in partition mode, the cache maybe have a backup or not. My question is: when a cache entry is removed, the interceptor will be called once on one node or multi
Hi,see below configuration: java.lang.String com.example.MyClass MyClass is a generic class. T can be Integer/Long/byte[]/String etc simple data type.public class MyClass{ @QuerySqlField p
Hi,I have a cache. there may be thousands of cache entry. Each cache entry may be updated every several seconds. I update them using cache.invoke method which will update cache entry partially.Questions#1 when invoke method return at client side. other client will get the latest data?#2 f
Hi,I have a use case like below:I want to store key-value caches in ignite, but each key-value has a namespace. key are unique in a namespace.Each cache entry has the same data type for both key and value.When query, We always query by key and namespace. sometimes, we query all caches of
On 02/14/2017 11:44，shawn.du wrote：
Thanks Val, I forgot to enable them. I just got example code and run them. Now it works.
ThanksShawn
On 02/14/2017 11:40，vkulichenko wrote：
Hi Shawn,
Hi, Andrey,then do you know how to gracefully shut down ignite servers when write-behind enabled without data lose?
ThanksShawn
On 02/14/2017 14:04，shawn.du wrote：
exactly. Thank you, Andrey
://apacheignite.gridgain.org/v1.8/docs/persistent-store#write-behind-cachingOn Tue, Feb 14, 2017 at 8:40 AM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi,ignite support persist data periodically?see blow use case:we want to implement storm state management using ignite.we maintain
Hi,ignite support persist data periodically?see blow use case:we want to implement storm state management using ignite.we maintain storm stateful object as caches in ignite.for storm used processing message in very low latency, so the stateful object maybe changed very fast.if ignite pers
Thanks Val, I forgot to enable them. I just got example code and run them. Now it works.
ThanksShawn
On 02/14/2017 11:40，vkulichenko wrote：
Hi Shawn,
Did you enable the event (IgniteConfiguration.setIncludeEven
Hi Val,do you mean that when cache is expired, I have to call cache.remove(key) manually in order to call delete in cachestore?I try to implement by remote listener like this:ignite.events().remoteListen(null, new IgnitePredicate(){ @IgniteInstanceResource private Ignite ignite; @LoggerRes
Hi,I want to only register listeners for cacheEvent, but I don't want to specify the particular cache.it is possible?like this code:ignite.events().remoteListen(null, new IgnitePredicate(){ }
ThanksShawn
My code error, BinaryObject deserialize twice.
ThanksShawn
On 02/11/2017 06:26，vkulichenko wrote：
Shawn,
What's the actual issue after you disabled compact footer? Exception?
Incorrect behavior?
-Val
--
View
Hi Val,Thanks for your reply. #1 My Request maybe somewhat different with IGNITE-3699.see below case:Suppose Ignite already have several cache entries. simply, we set each cache entry will expire in one day.at one moment , the caches in ignite will have different expiry time, for they are
Hi,It is possible to set ExpiryPolicy in CacheStore.loadCache method?typically we do something like this:public void loadCache(IgniteBiInClosure, BinaryObject> clo, Object... args){ ... clo.apply(key,value);}
I have a test below code which will throw NullPointerException:public void l
/apache/ignite/configuration/BinaryConfiguration.html#isCompactFooter().On Thu, Feb 9, 2017 at 1:28 PM, shawn.du <shawn...@neulion.com.cn> wrote:
Hi,I implement a cacheStore, this cachestore will persist a binaryObject into bytes and store in MySQL blob. Exceptio
Hi,I implement a cacheStore, this cachestore will persist a binaryObject into bytes and store in MySQL blob. Exceptions occurred when calling loadCache function:binaryObject.deserialize() will throw exceptions like "Cannot find metadata for object with compact footer: -1615140068"If I jus
get it. storeKeepBinary flag will help.
ThanksShawn
On 02/8/2017 13:58，shawn.du wrote：
Hi,I want to persist some data in binary, for I put cache in BinaryObject format like this:BinaryObjectBuilder
Hi,I want to persist some data in binary, for I put cache in BinaryObject format like this:BinaryObjectBuilder builder = ignite.binary().builder(typeName);cache.put(key,builder.build());how can I get or create BinaryMarshaller instance?
On 02/7/2017 09:07，shawn.du wrote：
Hi Val,Thanks very much. CacheInterceptor is the best way.Shawn
On 02/7/2017 08:09，vkulichenko wrote：
Hi Shawn,
Your approach sounds a bit dangerous. Store is called within an entry lock,
which means that if you do a
Hi Val,Thanks very much. CacheInterceptor is the best way.Shawn
On 02/7/2017 08:09，vkulichenko wrote：
Hi Shawn,
Your approach sounds a bit dangerous. Store is called within an entry lock,
which means that if you do a distributed get there, you will likely get
t
thanks Val.
On 02/2/2017 05:27，
vkulichenko
wrote：
Hi Shawn,
Built in expiration is cache expiration, which by definition doesn't touch
database. This means
Hi,
I am looking for a solution for below simple use case:#1 Cache entries are created with expiry policy#2 When restart ignite servers, we can restore the caches which haven't been expired.As far as my knowledge, we need implement a pers
Hi,I think my case is a typical Map-Reduce problem. I go through Ignite Compute API, but I don't see how ignite collocate compute and data when doing map-reduce.I describe my logic here:#1 client issues SQL query to server to get the cache keys. It is a very light task. #2 client sends
thanks dkarachentsev.
在2017年01月03日 18:25，dkarachentsev 写道:Actually no, because Ignite internally will store it as a BinaryObject and
will send to other nodes in a binary format as well, where all string fields
will be unmarshaled without intern().
--
View this
Thanks Val!Now I understood entryprocessor better. as to "error prone", I meant if we follow the document,it will be error prone. For EntryProcessor is just an interface, it doesn't prohibit user to use lamda or anonymous classes.
When
60 matches
Mail list logo
