Size would be very large as stock prices would be streamed every hour
On Tue, Jun 13, 2017 at 12:05 PM, Jörn Franke wrote:
> What is the size of the data?
> For me it looks more that orc or parquet would be enough.
>
> I do not see here specific in-memory requirements.
>
> On 12. Jun 2017, at 0
Hi, Valentine.
Thanks for your response! It's a shame i overlooked DML.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-operate-with-cache-Key-or-cache-AffinityKey-tp13561p13642.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
What is the size of the data?
For me it looks more that orc or parquet would be enough.
I do not see here specific in-memory requirements.
> On 12. Jun 2017, at 09:59, Ishan Jain wrote:
>
> I need to just get the price of a stock which is stored in hdfs with
> timestamp and make a graph with
Hi,
We are performing parallel data loading in memory using multiple
instances of ignite(from kafka to ignite) in single node. While caching CPU
is not getting utilized above 70%. How can we improve this?
Thanks
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.
I need to basically have a sql query remote access from tools like tableau or
zeppelin and have fast mapreduce funtions
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Data-Analysis-and-visualization-tp13614p13639.html
Sent from the Apache Ignite Users mailing li
HI Team,
I have a table TEST with a indexed column COL_A. Does the following query
works ?
select * from Test where COL_A > '1' and COL_A < '2' offset 10 ROWS FETCH
NEXT 20 ROWS ONLY
As per my understanding of distributed systems, the query is sent to all
nodes and gets the 10 records from each
Hi Denis, thanks for answering. That completely cleared out my doubt.
I would like to know one more thing. I was testing with ~1000 (10
million) records with each records of ~1400 bytes. When I was trying to
keep everything on-heap I had to allocate around 15GB to on-heap to store
all these
Hi,
I have configured ignite to use hdfs as the secondary file system and I have
write the content of a dataframe to igfs.
Browsing the hdfs, I can see the files being written to hdfs. But is there
a way
I can look at the content of igfs directly? Would I be able to do that in
ignitevisorcmd ?
Megha,
> Or is it required to give 1 GB to off heap
> memory region with no relation how much I allocate to on-heap.
That’s the correct point.
All the data is stored in off-heap by default. If you give 500 MB to the
off-heap then you’ll get out of memory exception once you go beyond that
bou
I use IgniteMessaging to update status info from inside my compute jobs
so publicThreadPoolSize=1 probably isn't going to work.
In your opinion, would a new CollisionSpi implementation that
synchronized the onCollision method resolve the issue?
On 6/9/2017 5:01 PM, vkulichenko wrote:
Ryan,
Thanks Nikolai..this is what i am doing...not sure if this is too
much..what do you think..the goal is to make sure that a UUID is unique
across the entire application (the problem is each node that is part of the
cluster would be doing this for different entities that it owns)
...
...
System.out.
Thanks Alexey. Got it. Thanks for the helpful responses.
For the other issues w.r.t model generation & spring transaction
integration would it help to share my small POC project on GitHub? I think
these would be very helpful to have fixed. I can also submit a bug request
if needed.
I have some qu
Thanks Nikolai. I am wondering if anyone has done something similar.
Thanks.
Antonio.
On Mon, Jun 12, 2017 at 3:30 AM, Nikolai Tikhonov
wrote:
> Hi, Antonio!
>
> You can implement your own CacheStore which will propagate data to the
> swift. Or do you mean other integration with this product?
Hi,
Can provide more details about your case? Which operations you perform
under grid?
On Fri, Jun 9, 2017 at 1:21 PM, rishi007bansod
wrote:
> Hi,
>For my ignite data caching process i have recorded following
> statistics. In which I have found my CPU utilization is not much(only
> 60-7
Muthu,
>>2. With Ignite/Web Console, if a DB table insert/update/delete operation
were to happen to the database directly is there a way to have that
automatically picked up into the cache (so its always in sync with the DB
tables)?
>> I know this is too much to ask. I ask because we currently hav
I can give you the numbers. I have no idea why server 1 sent so much data to
server 2 and 3.
Server 1
bytes sent = 51096699125 bytes received = 3457376624
Server 2
bytes sent = 3631468045 bytes received = 27549879339
Server 3
bytes sent = 2172264793 bytes received = 23901316825
From: Nikola
Do you have any advice on implementing large records export from ignite ?
I could not use ScanQuery right as my whole application built around Jdbc
driver and writing complex queries in scan query is very difficult.
Thanks
On 10 June 2017 at 18:48, Anil wrote:
> I understand from the code that
Hi,
Ignite does not accumulate messages which were sent to non-exist topic.
Messages will be lost in your case.
On Mon, Jun 12, 2017 at 12:30 PM, shawn.du wrote:
> Hi,
>
> I am trying ignite topic based messaging. I wonder to know ignite behavior
> in blow case:
>
> Client A send a message with
Hi, I am trying to access Ignite-2.0.0 cache metrics. I have loaded one cache
into my cluster of 2 nodes with 1 backup (onHeapEnabled=false)
At an instant of time I am getting below ignite cache size using :
itemCache.size(CachePeekMode.OFFHEAP) = 2645679
itemCache.size(CachePeekMode.PRIMARY) = 2
Hi Libo!
Would you describe your imbalance in percent? Also can you try to upgrade
Ignite to 1.9 and check it?
On Fri, Jun 9, 2017 at 11:05 PM, Libo Yu wrote:
> Hi,
>
>
>
> We have used embedded ignite cache on three application servers which are
> behind a load balancer.
>
> The cache is set t
Hi, Antonio!
You can implement your own CacheStore which will propagate data to the
swift. Or do you mean other integration with this product?
On Sat, Jun 10, 2017 at 9:04 AM, Antonio Si wrote:
> Hi Alexey,
>
> I meant a swift object storage: https://wiki.openstack.org/wiki/Swift
>
> Thanks.
>
Hello,
It looks strange. Could you share full example (how maven project)? Which
version of apache ignite do you use?
On Sat, Jun 10, 2017 at 1:14 PM, Reshma Bochare wrote:
> Same thing works fine if executed at server side
>
>
>
> *From:* Reshma Bochare
> *Sent:* Friday, June 09, 2017 4:21 PM
Muthu,
Yes, you can use IgniteUUID as unique ID generator. What you will use
depends your requirements. IgniteAtomicSequence takes one long and
IgniteUUID takes 3 long. But getting new range sequence is distributed
operation. You need to decied what more critical for your.
On Fri, Jun 9, 2017 at
Hi,I am trying ignite topic based messaging. I wonder to know ignite behavior in blow case:Client A send a message with topic T1 to ignite server, but there are no topic listeners at this time, after for a while(like 1 or 2 minutes), Client B is online and subscribe topic T1, will c
Hi,
Seems that known issue with IBM JDK
http://www-01.ibm.com/support/docview.wss?uid=swg1IV76872. You need to
update on jdk which contains fixes.
On Fri, Jun 9, 2017 at 7:06 PM, Vladimir wrote:
> Hi,
>
> Having no problems on Windows and Linux application suddenly couldn't start
> on IBM AIX w
Hi Denis,
Thanks for your reply. The video was helpful. But I am still not clear on
the fact that if I have 1 GB data, with onHeapCaching enabled if I give my
off heap memory region a maximum size of 500 MB and 1 GB to my heap, then
will this configuration work. Or is it required to give 1 GB to o
I need to just get the price of a stock which is stored in hdfs with
timestamp and make a graph with the prices of that stock over time.
On Mon, Jun 12, 2017 at 1:03 PM, Jörn Franke wrote:
> First you need the user requirements - without them answering your
> questions will be difficult
>
> > On
First you need the user requirements - without them answering your questions
will be difficult
> On 12. Jun 2017, at 07:08, ishan-jain wrote:
>
> I am new to BIG Data .Just been working for a month.
> I have HDFS data of stock prices. I need to perform data analysis(maybe some
> ML) and visual
28 matches
Mail list logo