Re: Access a cache loaded by DataStreamer with SQL

Hello! I think you need to have different types for keys too. Regards, -- Ilya Kasnacheev ср, 20 мар. 2019 г. в 21:00, Mike Needham : > I guess I am not understanding how to build this for multiple tables in a > cache that can be loaded using the datastreamer and are queryable from > DBeaver

Re: Access a cache loaded by DataStreamer with SQL

I guess I am not understanding how to build this for multiple tables in a cache that can be loaded using the datastreamer and are queryable from DBeaver or tableau. I changed the code to be IgniteCache testCache = ignite.getOrCreateCache(new CacheConfiguration<>("MAIN")

Re: Access a cache loaded by DataStreamer with SQL

Hello! I don't understand what you are doing here. Why do you have two employee tables here? What is desired table structure? Regards, -- Ilya Kasnacheev ср, 20 мар. 2019 г. в 16:44, Mike Needham : > I have that part, what I dont understand is how I can create multiple > "Tables" within a Cac

Re: Access a cache loaded by DataStreamer with SQL

I have that part, what I dont understand is how I can create multiple "Tables" within a Cache(Schema)? I have the following code that is using a simple Employee Class. IgniteCache testCache = ignite.getOrCreateCache(new CacheConfiguration<>("MAIN") .setIndexedTypes(Long.cl

Re: Access a cache loaded by DataStreamer with SQL

Hello! Please take a look at https://apacheignite.readme.io/docs/cache-queries#section-query-configuration-by-annotations Regards, -- Ilya Kasnacheev вт, 19 мар. 2019 г. в 20:25, Mike Needham : > Do you have an example of how that could be done. I am struggling to > figure out how to set thi

Re: Access a cache loaded by DataStreamer with SQL

Do you have an example of how that could be done. I am struggling to figure out how to set this up. On Mon, Mar 18, 2019 at 2:00 AM Ilya Kasnacheev wrote: > Hello! > > The best approach is to use .setIndexedTypes() instead of > setQueryEntities(), and annotate complex types in question with > @

Re: Access a cache loaded by DataStreamer with SQL

Hello! The best approach is to use .setIndexedTypes() instead of setQueryEntities(), and annotate complex types in question with @QuerySqlField. This way you can then pour those types into cache and it will work transparently. Regards, -- Ilya Kasnacheev пт, 15 мар. 2019 г. в 18:28, Mike Needh

Re: Access a cache loaded by DataStreamer with SQL

Perfect, now the next question is how would you do this for a more complex object/table? Either one defined in a separate object or via SQL DDL? On Fri, Mar 15, 2019 at 9:05 AM Ilya Kasnacheev wrote: > Hello! > > You will have to specify schema name (or cache name?) in ALLCAPS when > creating c

Re: Access a cache loaded by DataStreamer with SQL

Hello! You will have to specify schema name (or cache name?) in ALLCAPS when creating cache. Regards, -- Ilya Kasnacheev пт, 15 мар. 2019 г. в 16:45, Mike Needham : > I see. did not have the "person" for the schema. Is there a way to not > have the quotes around that? > > On Fri, Mar 15, 20

Re: Access a cache loaded by DataStreamer with SQL

I see. did not have the "person" for the schema. Is there a way to not have the quotes around that? On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev wrote: > Hello! > > Definitely works for me in DBeaver with this exact code: > > < > http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbe

Re: Access a cache loaded by DataStreamer with SQL

Hello! Definitely works for me in DBeaver with this exact code: Some of DBeaver's introspection does not work but statements are solid. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Access a cache loaded by DataStreamer with SQL

OK, that appears to be part of the way, but they caches are not queryable from any SQL tools like Tableau or DBeaver. What am i missing? On Fri, Mar 15, 2019 at 5:29 AM Ilya Kasnacheev wrote: > Hello! > > Yes, I understand your confusuion here. > > Take a look at following elaborate snippet: >

Re: Access a cache loaded by DataStreamer with SQL

Hello! Yes, I understand your confusuion here. Take a look at following elaborate snippet: package org.apache.ignite.examples; import java.util.Collections; import java.util.LinkedHashMap; import org.apache.ignite.Ignite; import org.apache.ignite.IgniteCache; import org.apache.ignite.IgniteDataS

Re: Access a cache loaded by DataStreamer with SQL

Hi, Here is the code I am using package org.apache.ignite.examples; import java.util.Collections; import org.apache.ignite.Ignite; import org.apache.ignite.IgniteCache; import org.apache.ignite.IgniteDataStreamer; import org.apache.ignite.Ignition; import org.apache.ignite.cache.QueryEntity; impo

Re: Access a cache loaded by DataStreamer with SQL

Hello! Can you perhaps post your config and code? Much easier than writing my own boilerplate. Regards, -- Ilya Kasnacheev пт, 8 мар. 2019 г. в 00:36, Mike Needham : > Would it be possible for someone to provide a sample that uses the > DataStreamer for multiple large caches and the resulting

Re: Access a cache loaded by DataStreamer with SQL

Would it be possible for someone to provide a sample that uses the DataStreamer for multiple large caches and the resulting caches are queryable from ODBC tools like Tableau and DBeaver? I can get one to work, but cannot get the cache naming to work for a second one. On Thu, Mar 7, 2019 at 7:53 A

Re: Access a cache loaded by DataStreamer with SQL

Hello! JDBC with SET STREAMING ON should work reasonably well. You could also use CacheStore. With .Net I guess you will have to stick to DataStreamer & learn how to integrate it with Indexing properly. Or use JDBC from .Net. Regards, -- Ilya Kasnacheev чт, 7 мар. 2019 г. в 16:31, Mike Needha

Re: Access a cache loaded by DataStreamer with SQL

Is that the most efficient way to load millions of rows from a database table into a cache? I guess I am not seeing how this would work for millions of rows in the source database. That also appears to be a JAVA only solution and it would be preferable to have it be usable for .NET as well as java

Re: Access a cache loaded by DataStreamer with SQL

Hello! What prevents you from reading rows from DB and feeding them to JDBC prepared statement? Regards, -- Ilya Kasnacheev чт, 7 мар. 2019 г. в 15:51, Mike Needham : > And what if the data is already in a database table? I do not want to > read from the table to write to a file to load a ca

Re: Access a cache loaded by DataStreamer with SQL

And what if the data is already in a database table? I do not want to read from the table to write to a file to load a cache. On Tue, Mar 5, 2019 at 4:06 AM Ilya Kasnacheev wrote: > Hello! > > The preferred approach is to use Thin JDBC client: > https://apacheignite-sql.readme.io/docs/jdbc-driv

Re: Access a cache loaded by DataStreamer with SQL

Hello! The preferred approach is to use Thin JDBC client: https://apacheignite-sql.readme.io/docs/jdbc-driver Regards, -- Ilya Kasnacheev пн, 4 мар. 2019 г. в 19:39, Mike Needham : > Thanks for the links, If SET STREAMING ON is the preferred method, how > would you do this in code rather tha

Re: Access a cache loaded by DataStreamer with SQL

Thanks for the links, If SET STREAMING ON is the preferred method, how would you do this in code rather than from a file with all the insert statements. On Mon, Mar 4, 2019 at 1:44 AM Ilya Kasnacheev wrote: > Hello! > > You can see at this page: > https://apacheignite-sql.readme.io/docs/sql-and

Re: Access a cache loaded by DataStreamer with SQL

Hello! You can see at this page: https://apacheignite-sql.readme.io/docs/sql-and-key-value-usage And then substitite cache.put() with addData() and cache name will be SQL_PUBLIC_{table name in caps} There are not many examples since this is being discouraged in favor of SET STREAMING ON, actuall

Re: Access a cache loaded by DataStreamer with SQL

Hi Mike, You can find a simple example of loading data with data streamer and querying it with SQL in a following gist [1]. It is possible but somehow tricky to load table created by DDL using data streamer. Perhaps, SQL COPY could be handy for you [2]. It uses data streamer under the hood. [1]

Re: Access a cache loaded by DataStreamer with SQL

I have looked at the documentation and the code samples and nothing is doing what I am trying to do. I want to be able to use the datastreamer to load 3 or 4 TABLES in a cache for an application that we use. If I create the tables using a create table syntax how do attach a datastreamer to the di

Re: Access a cache loaded by DataStreamer with SQL

Hello! I have linked the documentation page, there are also some code examples in distribution. Regards, -- Ilya Kasnacheev чт, 28 февр. 2019 г. в 17:10, Mike Needham : > Is there any examples that show the steps to do this correctly? I > stumbled upon this but have no idea if it is the best

Re: Access a cache loaded by DataStreamer with SQL

Is there any examples that show the steps to do this correctly? I stumbled upon this but have no idea if it is the best way to do this On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev wrote: > Hello! > > There's no restriction on cache name but setting it up for the first time > may be tricky in

Re: Access a cache loaded by DataStreamer with SQL

Hello! There's no restriction on cache name but setting it up for the first time may be tricky indeed. Regards, -- Ilya Kasnacheev ср, 27 февр. 2019 г. в 19:48, needbrew99 : > OK, was able to get it working. Apparently the cache name has to be PUBLIC > and it will create a table based on the

Re: Access a cache loaded by DataStreamer with SQL

OK, was able to get it working. Apparently the cache name has to be PUBLIC and it will create a table based on the object definition that I have. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Access a cache loaded by DataStreamer with SQL

I have looked at the docs and it is not clear to me how to set-up a queryable table that can be loaded with a datastreamer. If I want to use the datastreamer and still have it queryable from a third party tool like Tableau what would I need to set-up. I tried one thing and it showed up in the DBe

Re: Access a cache loaded by DataStreamer with SQL

Hello! Please refer to this page: https://apacheignite.readme.io/docs/indexes In short, you can use CREATE TABLE or GetOrCreateCache indexedTypes+annotations or QueryEntities. All of those are compatible with DataStreamer as long as type name and field/column names match. By default caches do no

Access a cache loaded by DataStreamer with SQL

Hi All, I have a cache that I have loaded using the DataStreamer and can confirm there is a cache created by using the ignitevisor utility with the cache command. I cannot query it from any JDBC tools and am not sure why. Do I need to use a CREATE TABLE syntax in order for this to work instead