Re: wrong data from cluster nodes while using left join

[neerajbhatt]

Any update ?



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/wrong-data-from-cluster-nodes-while-using-left-join-tp14782p14865.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: SpringBoot integration with Ignite

[VJ]

Thanks Alex and Rishi.

The shared links gave me the direction and I have successfully done the
integration.


On Thu, Jul 13, 2017 at 6:53 PM, ignite_user2016 
wrote:

> let me know if you need help here, I can help you out further here for
> sure ..
>
> On Wed, Jul 12, 2017 at 5:51 AM, afedotov [via Apache Ignite Users] <[hidden
> email] > wrote:
>
>> Hi,
>>
>> Please check
>> http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-
>> Integration-td11659.html
>> and
>> http://apache-ignite-users.70518.x6.nabble.com/Using-Abstrac
>> tAnnotationConfigDispatcherServletInitializer-td14592.html#a14600
>>
>>
>> Kind regards,
>> Alex.
>>
>> On Wed, Jul 12, 2017 at 12:53 PM, vishal jain [via Apache Ignite Users] 
>> <[hidden
>> email] > wrote:
>>
>>> Hi,
>>>
>>>
>>> How can we integrate apache ignite with SpringBoot application?
>>> I want to use ignite as the distribute cache for our springBoot
>>> application, any pointers/suggestions will help.
>>>
>>> Thanks,
>>> VJ
>>>
>>>
>>>
>>> --
>>> If you reply to this email, your message will be added to the discussion
>>> below:
>>> http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-in
>>> tegration-with-Ignite-tp14715.html
>>> To start a new topic under Apache Ignite Users, email [hidden email]
>>> 
>>> To unsubscribe from Apache Ignite Users, click here.
>>> NAML
>>> 
>>>
>>
>>
>>
>> --
>> If you reply to this email, your message will be added to the discussion
>> below:
>> http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-
>> integration-with-Ignite-tp14715p14717.html
>> To start a new topic under Apache Ignite Users, email [hidden email]
>> 
>> To unsubscribe from Apache Ignite Users, click here.
>> NAML
>> 
>>
>
>
>
> --
> Rishi Yagnik
>
> --
> View this message in context: Re: SpringBoot integration with Ignite
> 
> Sent from the Apache Ignite Users mailing list archive
>  at Nabble.com.
>

Define Cache Size - Queries

[Gracelin Priya]

Hi,

Can someone please help to clarify the below queries?

How to define the size of a cache in gridgain?. My host has got 40 GB memory. I 
want to allocate 20GB to Gridgain cache so that it should not consume memory 
above that. Is that possible? How to do it?

If there are three nodes in a gridgain cluster, should the cache size be same 
in all the three nodes or can it be defined differently in each node.


Thanks,
Priya

Re: getting exception while running the odbc examples

[Rahul.S]

no i didn't



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/getting-exception-while-running-the-odbc-examples-tp14755p14861.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Group By on Scan query

[Guilherme Melo]

Thank you Andrei I'll give that a try.

On 14 Jul 2017 12:56 a.m., "Andrey Mashenkov" 
wrote:

Hi Guilherme,

ScanQuery doesn't supports aggregation.
You can try to use SqlFieldsQuery for it or run map-reduce task that will
run local ScanQueries on map phase.

On Thu, Jul 13, 2017 at 4:21 PM, Guilherme Melo  wrote:

> Hello,
> I have been reading, and I have not figured out if it is possible to
> perforn agregation on a scan query, I am aware I can use the stream api to
> do a few things once I've gotten the results, but I was wondering if there
> was some internal mechanism to do this, like a reduce step.
>
> Cheers,
>
> Guilherme Melo
> www.gmelo.org
>



-- 
Best regards,
Andrey V. Mashenkov

Re: KeySize for each partition

[Raja]

Thank you very much Andrey



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/KeySize-for-each-partition-tp14783p14818.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Upcoming Apache Ignite Events

[Denis Magda]

Folks,

Check up our the news page [1]! We’re approaching cool meetups and webinars to 
be conducted by our community members. Take an action - sign up and attend! And 
if you have anything to share the world about Ignite reach me out ;)

* Webinar: Distributed ACID Transactions in Apache Ignite by Akmal, July 19, 
2017 (https://t.co/v2ng4LPfF7 )

* Meetup: An Intro to Apache Ignite, the Memory-centric Distributed Platform by 
Akmal in London, July 26, 2017 
(https://www.meetup.com/Brighton-Java/events/241395191/ 
)

* Meetup: Diving into the internals of Apache Ignite's memory architecture by 
Denis in Silicon Valley, Jul 27, 2017 
(https://www.meetup.com/Bay-Area-In-Memory-Computing/events/241381155/ 
)

* Webinar: Building Consistent and Highly Available Distributed Systems with 
Apache® Ignite™ by Val, August 02, 2017 (goo.gl/rpoZ9k )

[1] https://ignite.apache.org/news.html 

—
Denis

Re: Can java code look up cache in server without Ignition.start(cfg)

[StartCoding]

Hi Val,

Thanks for the response.

The scenario is I will start the client and at some point the machine is
 getting stuck (due to high cpu utilisation) and I need to kill the entire
servers and client to regain my system. At this time I use the Visor App to
kill the instances one by one. But As I kill the client I it makes the
entire Weblogic server down. I dont know if there would be another scenario
where I need to kill the client in future. But if there is a case to kill
the client after day end of the day or so what is the safe way to do it?

Thanks
Saji

On Mon, Jul 10, 2017 at 9:00 PM, vkulichenko [via Apache Ignite Users] <
ml+s70518n14601...@n6.nabble.com> wrote:

> Hi Saji,
>
> Kill command kill the process, it's designed more for standalone server
> nodes rather than embedded clients. What is the condition when you may want
> to stop the client?
>
> -Val
>
> --
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-ignite-users.70518.x6.nabble.com/Can-java-
> code-look-up-cache-in-server-without-Ignition-start-cfg-tp9008p14601.html
> To unsubscribe from Can java code look up cache in server without
> Ignition.start(cfg), click here
> 
> .
> NAML
> 
>



-- 
Thanks and Regards
Saji




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Can-java-code-look-up-cache-in-server-without-Ignition-start-cfg-tp9008p14816.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: KeySize for each partition

[Andrey Mashenkov]

Hi Raja,

Please, take a look at IgniteCache.sizeLong(int partition, CachePeekMode...
peekModes)
and  IgniteCache.localSizeLong(int partition, CachePeekMode...
peekModes) methods

On Thu, Jul 13, 2017 at 4:12 PM, Raja  wrote:

> Hi,
>
> Wonder if there is anyway in ignite to find what is the key-size for each
> partition?
>
>
> Thank you
> Raja
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/KeySize-for-each-partition-tp14783.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>



-- 
Best regards,
Andrey V. Mashenkov

Re: Group By on Scan query

[Andrey Mashenkov]

Hi Guilherme,

ScanQuery doesn't supports aggregation.
You can try to use SqlFieldsQuery for it or run map-reduce task that will
run local ScanQueries on map phase.

On Thu, Jul 13, 2017 at 4:21 PM, Guilherme Melo  wrote:

> Hello,
> I have been reading, and I have not figured out if it is possible to
> perforn agregation on a scan query, I am aware I can use the stream api to
> do a few things once I've gotten the results, but I was wondering if there
> was some internal mechanism to do this, like a reduce step.
>
> Cheers,
>
> Guilherme Melo
> www.gmelo.org
>



-- 
Best regards,
Andrey V. Mashenkov

Re: Provide persistence settings inline for Cassandra KeyValuePersistenceSettings?

[ezhuravlev]

Hi,

It's possible to provide settings with String:








Evgenii



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Provide-persistence-settings-inline-for-Cassandra-KeyValuePersistenceSettings-tp14724p14802.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite not conneting to remote node if Using FQDN

[ezhuravlev]

Hi,

Could you provide your config files and logs?

Evgenii



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Ignite-not-conneting-to-remote-node-if-Using-FQDN-tp14634p14801.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Using Python library to run HDFS with Ignite

[Mikhail Cherkasov]

Hi,

Did you specify:

  
fs.igfs.impl
org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem
  
  
fs.AbstractFileSystem.igfs.impl
org.apache.ignite.hadoop.fs.v2.IgniteHadoopFileSystem
  

in core-site.xml? may be hadoop find this fs implementation automatically
in lib dir, I'm note sure about this.

Any way Hadoop uses special implementation of file
system(IgniteHadoopFileSystem) to work with IGFS,
so I don't think that we have this implementation for python.

Thanks,
Mikhail.

On Mon, Jul 10, 2017 at 6:32 PM, nsemichev  wrote:

> I configured HDFS Client on Ubuntu 16.04 and I can successfully run this
> command:
> hdfs --config /etc/hadoop/conf/ dfs -ls /
> The config parameter takes the file core-site.xml from etc/hadoop/conf/
>
> From core-site.xml
>
> 
> fs.default.name
> igfs://igfs@10.200.10.1:10500
> 
>
> Then I tried using Python hdfs3 library which uses libhdfs3.
>
> >>> from hdfs3 import HDFileSystem
> >>> hdfs = HDFileSystem(host='10.200.10.1', port=10500)
>
> When I run this code, I get the following error message:
> ConnectionError: Connection Failed: HdfsRpcException: Failed to invoke RPC
> call "getFsStats" on server "10.200.10.1:10500"
>
> I opened an issue here: https://github.com/dask/hdfs3/issues/123
>
> It seems like it should work; has anyone tried using hdfs3 Python library
> or
> some other Python libraries to work with Ignite?
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Using-Python-library-to-run-HDFS-
> with-Ignite-tp14595.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>



-- 
Thanks,
Mikhail.

Re: Cache loader factory with peer class enabled mode

[dkarachentsev]

Hi,

Peer class loading was designed for compute tasks deployment, it's not
applicable for configuration classes or cache entries. So you have to copy
that classes to all nodes.

Thanks!
-Dmitry.



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Cache-loader-factory-with-peer-class-enabled-mode-tp14622p14799.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: how does write request send to new node when rebalancing before affinity changed?

[dkarachentsev]

Hi,

Cache requests will continue going to old nodes unless re-balancing
finished. After re-balancing new affinity mappings applied and discarded the
old ones, so you request only actual data. In details, before sending
request to node, requester checks a last valid topology version, and gets
affinity mapping from history by this version.

Thanks!
-Dmitry.



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/how-does-write-request-send-to-new-node-when-rebalancing-before-affinity-changed-tp14537p14798.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite PlugingProvider

[luqmanahmad]

Any help on this class would be highly appreciated

org.apache.ignite.plugin.PluginProvider#initExtensions -
org.apache.ignite.plugin.ExtensionRegistry



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Ignite-PlugingProvider-tp14640p14797.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: SpringBoot integration with Ignite

[ignite_user2016]

let me know if you need help here, I can help you out further here for sure
..

On Wed, Jul 12, 2017 at 5:51 AM, afedotov [via Apache Ignite Users] <
ml+s70518n14717...@n6.nabble.com> wrote:

> Hi,
>
> Please check
> http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-Integration-
> td11659.html
> and
> http://apache-ignite-users.70518.x6.nabble.com/Using-
> AbstractAnnotationConfigDispatcherServletInitializer-td14592.html#a14600
>
>
> Kind regards,
> Alex.
>
> On Wed, Jul 12, 2017 at 12:53 PM, vishal jain [via Apache Ignite Users] 
> <[hidden
> email] > wrote:
>
>> Hi,
>>
>>
>> How can we integrate apache ignite with SpringBoot application?
>> I want to use ignite as the distribute cache for our springBoot
>> application, any pointers/suggestions will help.
>>
>> Thanks,
>> VJ
>>
>>
>>
>> --
>> If you reply to this email, your message will be added to the discussion
>> below:
>> http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-
>> integration-with-Ignite-tp14715.html
>> To start a new topic under Apache Ignite Users, email [hidden email]
>> 
>> To unsubscribe from Apache Ignite Users, click here.
>> NAML
>> 
>>
>
>
>
> --
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-ignite-users.70518.x6.nabble.com/
> SpringBoot-integration-with-Ignite-tp14715p14717.html
> To start a new topic under Apache Ignite Users, email
> ml+s70518n1...@n6.nabble.com
> To unsubscribe from Apache Ignite Users, click here
> 
> .
> NAML
> 
>



-- 
Rishi Yagnik




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/SpringBoot-integration-with-Ignite-tp14715p14785.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Group By on Scan query

[Guilherme Melo]

Hello,
I have been reading, and I have not figured out if it is possible to
perforn agregation on a scan query, I am aware I can use the stream api to
do a few things once I've gotten the results, but I was wondering if there
was some internal mechanism to do this, like a reduce step.

Cheers,

Guilherme Melo
www.gmelo.org

KeySize for each partition

[Raja]

Hi,

Wonder if there is anyway in ignite to find what is the key-size for each
partition?


Thank you
Raja



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/KeySize-for-each-partition-tp14783.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

wrong data from cluster nodes while using left join

[neerajbhatt]

Hi All

We have created cluster groups for each node of a cluster (so that we can
give time out for each node (cluster group), in case query fails in a node
we can get a partial result )

We have couple of partitioned caches (with backup as 1) and we are sending a
query with left join
id is available in all the caches R, I , C and D and there are other filter
criteria on other fields of R , I , C and D


SELECT distinct r.id , r.rank  FROM A.R as r  
LEFT JOIN  B.I as T ON r.id = T.id
LEFT JOIN C.C as cat ON cat.id = T.id
LEFT JOIN D.D as img  ON img.id = T.id
WHERE cat.categoryId != '1' AND  T.itemType = '1'  AND T.rating= '0' 
AND T.reviews='0' AND T.downloads='0' AND  img.imageId='1'  AND
r.geoId='144' 
order by rank desc limit 3

This query returns  fast ( around 10 ms) but it is giving results ( ids) 
from cluster group B (node B) too when none of the caches in B have those
ids. The log file in each node (cluster group shows same ids)

If we just use where clause instead of left join the query performance is
decreased significantly (10 second)

Is it because of left join? but in case of left join too when data is not in
caches for a particular node, how the data is being fetched for those ids




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/wrong-data-from-cluster-nodes-while-using-left-join-tp14782.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: getting exception while running the odbc examples

[Igor Sapego]

Hello,

Have you modified example in any way?

Best Regards,
Igor

On Thu, Jul 13, 2017 at 12:31 PM, Rahul.S  wrote:

> Hi Ignite Team,
> i was wondering to use the odbc in the ignite so i gave a small try to use
> the examples in the path
> "/opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/
> cpp/examples/odbc-example",
> for the above i followed all the notes that were mentioned but it got
> complied but while running i got the this segmentation fault :
> [ignite@localhost odbc-example]$ ./ignite-odbcexample
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> #  SIGBUS (0x7) at pc=0x7fa81e11dc03, pid=2752, tid=0x7fa8301ea740
> #
> # JRE version:  (8.0_131-b11) (build )
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # j  java.lang.Object.()V+0
> #
> # Core dump written. Default location:
> /opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/
> cpp/examples/odbc-example/core
> or core.2752
> #
> # An error report file with more information is saved as:
> #
> /opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/
> cpp/examples/odbc-example/hs_err_pid2752.log
> #
> # If you would like to submit a bug report, please visit:
> #   http://bugreport.java.com/bugreport/crash.jsp
> #
> Aborted (core dumped)
>
>
> Please do help!!
>
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/getting-exception-while-running-the-
> odbc-examples-tp14755.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

getting exception while running the odbc examples

[Rahul.S]

Hi Ignite Team,
i was wondering to use the odbc in the ignite so i gave a small try to use
the examples in the path
"/opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/cpp/examples/odbc-example",
 
for the above i followed all the notes that were mentioned but it got
complied but while running i got the this segmentation fault :
[ignite@localhost odbc-example]$ ./ignite-odbcexample
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGBUS (0x7) at pc=0x7fa81e11dc03, pid=2752, tid=0x7fa8301ea740
#
# JRE version:  (8.0_131-b11) (build )
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode
linux-amd64 compressed oops)
# Problematic frame:
# j  java.lang.Object.()V+0
#
# Core dump written. Default location:
/opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/cpp/examples/odbc-example/core
or core.2752
#
# An error report file with more information is saved as:
#
/opt/ignite/apache-ignite-fabric-2.0.0-bin/platforms/cpp/examples/odbc-example/hs_err_pid2752.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#
Aborted (core dumped)


Please do help!!




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/getting-exception-while-running-the-odbc-examples-tp14755.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Data not loading with Ignite DataStreamer

[Aiden]

Hi,

Hello, i tried putting allowOverwrite=true. And yet i'm getting the same
exception as mentioned above. As for writeBehind and writeThrough,
writeBehind doesn't work without writeThrough being enabled. Atleast when i
tested it like that, any update in cache was not being reflected in the
db(This was when i was using loadCache() to load data from db to cache).
Still thanks for your suggestion. Do let me know if u come up with something
else, because i'm totally stuck here.



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Data-not-loading-with-Ignite-DataStreamer-tp14589p14754.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Execute Custom function in H2 Console

[Lucky]

Hi:

As some reason,I must utilize custom function in query sql .

Just like this: select myId('myRule'),sname from tableA 

I have define the custom function 'myid' with java code .

And it  work running on client node.  

But when I run the sql  in H2 Console, it got the wrong message: function 
'myId' not found.
Do it support in H2 console ?





 





 

Define Cache Size - Queries

[Gracelin Priya]

How to define the size of a cache in gridgain?. My host has got 40 GB memory. I 
want to allocate 20GB to Gridgain cache so that it should not consume memory 
above that. Is that possible? How to do it?

If there are three nodes in a gridgain cluster, should the cache size be same 
in all the three nodes or can it be defined differently in each node.

Thanks,
Priya

Re: Data not loading with Ignite DataStreamer

[Evgenii Zhuravlev]

Hi,

answered you on SO:
https://stackoverflow.com/questions/45029434/ignite-datastreamer-not-loading-data/45075192#45075192

Evgenii

2017-07-11 9:32 GMT+03:00 Aiden <1994hsekar1...@gmail.com>:

> Hello Humphrey,
>
> I don't think that is the issue here. Still i checked with ur suggestion,
> but the same exception is coming in the server logs(the exception is shown
> in the previous mail).
>
> I'm just not able to understand what i'm doing wrong here. Still thanks for
> ur suggestions.
>
>
> Aiden
>
>
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Data-not-loading-with-Ignite-
> DataStreamer-tp14589p14616.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Gridgain Stat Data

[Gracelin Priya]

Hello,

How to get the stat data from gridgain cluster? I would like to collect the 
following information from gridgain

1. What is the defined cache size for a cache?
2. What is the used cache size ie how much cache size is occupied with data and 
how much left over is there?

Priya

Re: ignite can not find other ignite clients with attched config xml

[ezhuravlev]

Hi,

Please provide logs from Ignite nodes, so we could investigate them.

Evgenii



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/ignite-can-not-find-other-ignite-clients-with-attched-config-xml-tp14613p14749.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.