Hi,
In this case I would recommend to use continuous queries, but trigger
queries from the remote filter. Note that you should execute them
asynchronously in separate threads, without blocking the thread that invokes
the filter. In the current version you will have to manage these threads
manually
Hi,
Can anybody let me know the criteria on which number of partitions are decided
for IgniteRDD ?From the IgniteRDD code, as per getPartitions() implementation
it is dependent upon number of partitions of underlying cachebut I am not aware
how the number of partitions of underlying cache is dec
But in the mean while can I do something to improve these timings - is 4-5 sec
is usual time for start up ?
Regards,Vij
On Thursday, April 28, 2016 6:45 AM, vkulichenko
wrote:
Hi Vij,
Ignite starts full-fledged node on the client side to provide the whole set
of available APIs. This m
My case is that after listening a process of inserting a record into an
ignite cache, do more than 5 SQL querys(such as seclet ... from ... where)
on other ignite caches according to this event.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Continuous-Queries-
Hi Vij,
Ignite starts full-fledged node on the client side to provide the whole set
of available APIs. This makes the startup process a bit heavy, but there is
a room for optimizations. There is a ticket for this that you can track:
https://issues.apache.org/jira/browse/IGNITE-3060
-Val
--
Vie
Hi,
Usually such monitoring is done by the application code, because it depends
in its logic. What are the particular cases when you want to kill a client?
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-Client-Blocks-On-Ignite-Server-Restart-tp4554
Hi Arthi,
I'm a bit confused. You say that the data is in cache after 30 minutes, but
the process finishes only after 3 hours. While debugging this, did you get
any idea what is happening during this additional time?
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.na
Here is the implementation for Ignite which you can use as a reference:
https://github.com/apacheignite/yardstick-ignite. It has IgniteNode class
which is en implementation of BenchmarkServer and a set of benchmarks, each
of them implements BenchmarkDriver.
I just meant that you only need to imple
This is not a bad design, but in most cases is just needed and only
complicates the deployment. If it gives you the performance improvement,
then this is absolutely fine.
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Client-fails-to-connect-joinTimeout-vs
Hi Binti,
thank you for your help.
May I ask how to perform GC on each node?
using code? or command inside CLI?
best regards,
Kevin
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-cache-data-size-problem-tp4449p4635.html
Sent from the Apache Ignite Users
Hi,
Can you please properly subscribe to the mailing list so that the community
can receive email notifications? Here is the instruction:
anas4120 wrote
> I need to access ignite from webapp application (servlet). How can I do
> that ?
You should start a client node within your application usi
Hi,
What do you want me to look at? Do you still have the issue?
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Affinity-is-not-working-for-colocating-in-windows7-tp4535p4633.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi,
Deployment mechanisms in Ignite can be used for computations (tasks and
closures), but not for services. For services you will have to deploy
classes explicitly on all nodes.
-Val
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Gar-file-gives-me-java-lang-C
Hi Amit,
amitpa wrote
> Can Ignite transactions work if Grids are out process?
>
> Why is this document written in Ignite Spring Transaction Manager :-
> >Start an Ignite node with proper configuration in embedded mode?
>
> Can Ignite Transactions work only when Grid is in embedded mode?
>
Hi Amit,
amit2103 wrote
> Why does the Spring Transaction manager of Ignite require the node to be
> embedded.
> Does normal Ignite Transactions work if all nodes are out side the client
> process?
>
> SO if I start a transaction from a client node will it work as expected?
> If it does , I am h
Forgot, out of those requests about 100 objects are the target of 90+% of
requests.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Performance-Issue-Threads-blocking-tp4433p4629.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Thanks Matt,
you nailed the problem. We have scenario where there are a bunch of hot keys
that are accessed concurrently (about 1.2 billion requests/day but
consistently 150 concurrent users and peaks of 10x).
For us, this cache is meant to always be read-only and we never need to copy
as data
Could you explain a bit more? I'm still confused as to what do you mean by
different implementations? Is there some example of performance testing that
I can look into?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Running-gridgain-yardstick-tp4559p4627.html
Se
Thanks for the tip. I'm happy to report that the 1.6 version is considerably
more reliable than 1.5. Although I am still able to break it under/ high
enough levels of contention it is a lot harder to do. Also, it generally
recovers when the client is killed (as opposed to the whole cluster) -
thoug
Kevin, we are facing similar issues. And the reason is not ignite using up
the heap, its the data you load from the database that takes up so much
memory until it makes it to the cache. We see a lot of heap usge after start
up and then if we perform a GC the memory on each node drops by at least 4
Vladimir,
Update - I think I solved the ClassNotFound exception. It looks like the
Ignite installation document for Spark and CDH is outdated and doesn't
contain complete information on integrating Ignite with Spark running in a
'Yarn' (cluster) mode on CDH which I have. This is what I have done a
Thanks Val, we will look at the jvm tuning and see what fits our environment.
That seems really helpful.
Another question you had asked earlier was why do we have more than one JVM
node on one physical machine? Is this a bad design? We are just trying to
start up the grid by loading records from d
Great..Thank you so much.
On Wed, Apr 27, 2016 at 12:15 PM, Pavel Tupitsyn
wrote:
> CI server is being moved, so that url no longer works.
> Here is the latest NuGet build:
> http://149.202.210.143:8111/viewLog.html?buildId=232885&buildTypeId=IgniteTests_IgnitePlatformNetNuGetNe&tab=artifacts
>
CI server is being moved, so that url no longer works.
Here is the latest NuGet build:
http://149.202.210.143:8111/viewLog.html?buildId=232885&buildTypeId=IgniteTests_IgnitePlatformNetNuGetNe&tab=artifacts
- Download Apache.Ignite.1.6.0.nupkg from there to some folder, let's say
"c:\downloads"
- I
Hi Pavel,
You gave me the below link to download latest NuGet for Ignite.NET. Is
that where I get the latest binaries for Ignite.NET from?
By the way, to avoid building from sources manually, you can use NuGet
package built from latest master on our CI server (use guest login):
http://ci.ignit
Yes...Thanks much.
On Wed, Apr 27, 2016 at 11:45 AM, Dmitriy Setrakyan
wrote:
> Murthy,
>
> Is this what you are looking for?
> https://ignite.apache.org/community/contribute.html#nightly-builds
>
> D.
>
> On Wed, Apr 27, 2016 at 8:13 AM, Murthy Kakarlamudi
> wrote:
>
>> Great..Thank you so muc
Argh… sorry, I forgot :(
On Wed, Apr 27, 2016 at 8:48 AM, Pavel Tupitsyn
wrote:
> Dmitriy, nightly builds do not include Ignite.NET.
>
> On Wed, Apr 27, 2016 at 6:45 PM, Dmitriy Setrakyan
> wrote:
>
>> Murthy,
>>
>> Is this what you are looking for?
>> https://ignite.apache.org/community/contri
Dmitriy, nightly builds do not include Ignite.NET.
On Wed, Apr 27, 2016 at 6:45 PM, Dmitriy Setrakyan
wrote:
> Murthy,
>
> Is this what you are looking for?
> https://ignite.apache.org/community/contribute.html#nightly-builds
>
> D.
>
> On Wed, Apr 27, 2016 at 8:13 AM, Murthy Kakarlamudi
> wrot
Guys,
Vlad Jelisavcic has implemented Ignite reentrant lock (
https://issues.apache.org/jira/browse/IGNITE-642). I have finally reviewed
and merged it today.
Vlad, thank you for your efforts! I look forward to next contribution from
you! I have removed origin/ignite-642 branch. Please close PR an
Murthy,
Is this what you are looking for?
https://ignite.apache.org/community/contribute.html#nightly-builds
D.
On Wed, Apr 27, 2016 at 8:13 AM, Murthy Kakarlamudi
wrote:
> Great..Thank you so much Vladimir. While I wait for 1.6 release, can I get
> the latest source, build it to use? Or are t
Great..Thank you so much Vladimir. While I wait for 1.6 release, can I get
the latest source, build it to use? Or are the pre-GA 1.6 binaries
available to download?
Thanks,
Murthy.
On Wed, Apr 27, 2016 at 9:45 AM, Vladimir Ozerov
wrote:
> Murthy,
>
> As per initial issue - I created a ticket an
Vladimir,
Unless I'm missing something there is no console to echo it to since in CDH
all services start by Cloudera Manager. The only console I have is the one I
execute spark-submit in but it doesn't have any Spark nor CDH related
properties.
Thanks
--
View this message in context:
http://a
Hi Michael,
I meant to echo to the console SPARK_CLASSPATH variable which you created
in *spark-env.sh* following recommendations from Ignite docs. We need to
ensure that JCache jar is included into it.
BTW, do you see Ignite jars in " java.class.path" property?
Vladimir.
On Wed, Apr 27, 2016 at
Murthy,
As per initial issue - I created a ticket and fixed the bug causing your
initial problem (*"org.apache.ignite.**IgniteException: Spring application
context resource is not injected"*). The fix will be included into upcoming
Ignite 1.6 release.
Vladimir.
On Wed, Apr 27, 2016 at 11:50 AM,
Vladimir,
I don't see this property. I put the following code at the very beginning of
my main() method:
println(" Props=" + System.getProperties())
The only classpath related property I see is java.class.path which doesn't
contain cache-api-1.0.0.jar despite my changing spark-env.sh as descri
Hi Kevin,
Looks like the topology got broken for some reason. Could you please attach
logs from all nodes so that I can investigate it deeper?
Vladimir.
On Wed, Apr 27, 2016 at 1:46 PM, Zhengqingzheng
wrote:
> Hi there,
>
> When I tried to clear one specific cache, service nodes closed unexpec
added
On Wed, Apr 27, 2016 at 6:03 PM, nikhilknk [via Apache Ignite Users] <
ml-node+s70518n4604...@n6.nabble.com> wrote:
> updated as per your suggestion .please take a look at this issue
>
> --
> If you reply to this email, your message will be added to the discussio
OK thanks Vladimir for confirming !!!
On Wednesday, April 27, 2016 6:09 PM, Vladimir Ozerov
wrote:
Hi Vij,
It is not merged to master yet. We think this will happen in the nearest days.
Vladimir.
On Wed, Apr 27, 2016 at 3:34 PM, vijayendra bhati
wrote:
If I build Ignite from nightly
updated as per your suggestion .please take a look at this issue
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Affinity-is-not-working-for-colocating-in-windows7-tp4535p4604.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi Vij,
It is not merged to master yet. We think this will happen in the nearest
days.
Vladimir.
On Wed, Apr 27, 2016 at 3:34 PM, vijayendra bhati
wrote:
> If I build Ignite from nightly build , would I will be getting working
> ODBC driver with it ?
> I need to integrate it with Tableau.
>
>
If I build Ignite from nightly build , would I will be getting working ODBC
driver with it ?I need to integrate it with Tableau.
Regards,Vij
On Wednesday, April 27, 2016 5:55 PM, Igor Sapego
wrote:
Hi Arthi,
ODBC driver supports rowset binding though currently onlyfetching of a single
Hi,
I am using IgniteRDD to query data from Ignite In memory cache cluster.I have
setup the cluster on AWS. My Spark and Ignite Nodes are running on same AWS
nodes.
>From the logs I can see that it take around 3-5 seconds on every executor to
>establish connection with Ignite Cluster.Is there is
Hi Arthi,
ODBC driver supports rowset binding though currently only
fetching of a single row per call is supported, i.e. SQL_ATTR_ROW_ARRAY_SIZE
attribute can only be set to 1 right now.
Best Regards,
Igor
On Wed, Apr 27, 2016 at 1:56 PM, arthi
wrote:
> Thank You.
>
> Arthi
>
>
>
> --
> View t
Thank You.
Arthi
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/ODBC-Driver-tp4557p4599.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Kevin,
I would say that your assumption - more nodes, faster data load - makes
perfect sense. N nodes will have N threads in total, performing the load.
The problem is that current JDBC POJO store implementation makes this
process not very efficient, because each node iterates over the whole data
It is possible. I think we can send 1.6 for vote as soon as odbc driver
gets finished.
--Yakov
2016-04-27 13:51 GMT+03:00 Tomek W :
> Does it mean that in next week ODBC driver will be available ?
>
> 2016-04-27 5:41 GMT+02:00 arthi :
>
>> Thank you...
>>
>> will this driver support rowset bindi
Thank you Vladimir,
I will try to use the second recommendation first, and let you know the result
asap.
I thought more nodes will result in fast data loading. Because I assume that
each node can load different data simultaneously. Clearly, it is my
misunderstanding about increasing number of
Does it mean that in next week ODBC driver will be available ?
2016-04-27 5:41 GMT+02:00 arthi :
> Thank you...
>
> will this driver support rowset binding of resultset ?
> something like this -
> https://msdn.microsoft.com/en-us/library/ms403318.aspx
>
> Thanks,
> Arthi
>
>
>
> --
> View this me
Hi there,
When I tried to clear one specific cache, service nodes closed unexpected.
visor> cache -clear -c=@c7
[17:26:35] Topology snapshot [ver=62, servers=9, clients=0, CPUs=16,
heap=63.0GB]
[17:26:38,009][SEVERE][tcp-disco-msg-worker-#2%null%][TcpDiscoverySpi]
TcpDiscoverSpi's message worke
Hi Kevin,
My considerations:
1) I see that amount of allocated heap is gradually increases over time.
Can you confirm that you use the configuration with OFFHEAP which you shown
several posts earlier?
2) Why do you have several nodes per host? Our recommended approach is to
have a single node per
Hi Val,
I debugged it. I have 11 nodes in my cluster. I have a partitioned cache,
and it has a affinity co-location defined.
For a cache load of 29786526 values into the partitioned cache, it takes
close to 3 hours. But, when I monitor the cache during loading, the entire
data is into the cache
Thanks Vladimir!
On Wed, Apr 27, 2016 at 2:31 PM, Vladimir Ozerov
wrote:
> Hi,
>
> There should not be any problems with config like this because all
> Organization entries will be located on all nodes in the cluster.
>
> Vladimir.
>
> On Wed, Apr 27, 2016 at 9:47 AM, Kamal C wrote:
>
>> What d
Hi,
Please provide the full stack trace and (if possible) code to reproduce the
problem.
Vladimir.
On Wed, Apr 27, 2016 at 9:26 AM, mortias wrote:
> Hi all,
>
> I'm trying to use a gar file to deploy my project however I get a
> java.lang.ClassNotFoundException
>
> In short, I've created a gar
Hi,
There should not be any problems with config like this because all
Organization entries will be located on all nodes in the cluster.
Vladimir.
On Wed, Apr 27, 2016 at 9:47 AM, Kamal C wrote:
> What do you mean by cache configuration?
>
> If I go with the below configuration, will it create
Hi.
Yes, normally computations are performed on both primary and backup nodes.
Vladimir.
On Wed, Apr 27, 2016 at 10:19 AM, kcheng.mvp wrote:
> Saying cache mode is "PARTITIONED", in this case both primary node and
> backup
> nodes would execute the same piece of code, right?
>
>
>
> --
> View
Hi Michael,
Could you please print resulting value of the SPARK_CLASSPATH variable?
Vladimir.
On Tue, Apr 26, 2016 at 8:55 PM, mdolgonos
wrote:
> Vladimir,
> I verified that the cache jar is in the Cloudera jars directory. All the
> cache packages are also included in the deployment jar-with-d
Hi Murthy,
Please provide configs you used to start clients and servers.
Vladimir.
On Wed, Apr 27, 2016 at 5:45 AM, Murthy Kakarlamudi
wrote:
> Can someone please help how Ignite works for the following use case. The
> server node loads data from Persistent Store into cache upon start up.
> Th
Saying cache mode is "PARTITIONED", in this case both primary node and backup
nodes would execute the same piece of code, right?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Caused-by-class-org-apache-ignite-binary-BinaryInvalidTypeException-tp4311p4585.html
S
Ok val.
On Wed, Apr 27, 2016 at 3:19 AM, vkulichenko
wrote:
> Hi Kamal,
>
> If ignite-log4j module is enabled, Log4JLogger is set into configuration
> automatically. This is actually done because we enable this module
> automatically in the binary build.
>
> ignite-slf4j is always optional, so y
59 matches
Mail list logo
