Re: 10G loading file to fuseki
After creating the TDB files in the correct folder with either tdbloader or
tdbloader2, it should also work to "create" the dataset in Fuseki2 UI with
a matching name, that avoids having to make the default configuration and
Fuseki2 will use your existing TDB files.
However, the default configuration does not have any reasoning enabled;
that should be the same for your smaller dataset made using only the UI.
On 19 Jan 2017 7:29 pm, "A. Soroka" wrote:
> Your procedure seems reasonable. I still don't understand what you mean by
> "I can query the small Lexo database but not the LinkedCT one." What
> exactly are you doing to send queries?
>
> Please show the configuration you added for your new dataset.
>
> ---
> A. Soroka
> The University of Virginia Library
> > On Jan 19, 2017, at 2:24 PM, Reihaneh Amini
> wrote:
> >
> > Sure!
> > Thanks for helping!
> >
> > 1. TDB laoding:
> >
> > public static void main(String[] args) {
> >
> > String file = "./linkedct-live-dump-latest.nt"; //source 10 GB
> file
> > String directory;
> > directory = "./Data";
> > //target TDB files
> >
> > Dataset dataset = TDBFactory.createDataset(directory);
> >
> > Model model = dataset.getNamedModel("http://nameFile";);
> >
> > TDBLoader.loadModel(model, file );
> >
> >
> > }
> >
> > I loaded the big file by using TDB model and finally after 10 hours of
> > execution, it gave me the Data folder that contains 28 files with .dat
> and
> > .idn suffix.
> >
> > 2. I have a directory that I downloaded from download part of
> fuseki-server
> > naming: "apache-jena-fuseki-2.4.1". It contains a batch file that by
> > running that file from command-line I get access to the server by
> > localhost/3030.
> > When I get access to the server and upload a small dataset (<100mb) there
> > named "Lexo", automatically that dataset will be appeared in the
> > "apache-jena-fuseki-2.4.1/run/databases/lexo". That dataset contains the
> > .dat and .idn files.
> >
> > So, by doing the reverse process. First I read my big dataset by step
> one.
> > Then I save these generated files into
> > "apache-jena-fuseki-2.4.1/run/databases/LinkedCT" path under "LinkedCT"
> > folder.
> >
> > 3. I run the server again and now both databases appear in the server. (
> I
> > also took care of creating a config file for this new dataset in
> > "Configuration" folder.
> >
> > 4. this seems normal from my perspective.
> > C:\Programs\apache-jena-fuseki-2.4.1>fuseki-server
> > Picked up _JAVA_OPTIONS: -Xms2048m -Xmx4096m
> > [2017-01-19 10:23:59] Server INFO Fuseki 2.4.1
> > [2017-01-19 10:23:59] Config INFO
> > FUSEKI_HOME=C:\Programs\apache-jena-fuseki-2.4.1\.
> > [2017-01-19 10:23:59] Config INFO
> > FUSEKI_BASE=C:\Programs\apache-jena-fuseki-2.4.1\run
> > [2017-01-19 10:23:59] ServletINFO Initializing Shiro environment
> > [2017-01-19 10:23:59] Config INFO Shiro file:
> > file://C:\Programs\apache-jena-fuseki-2.4.1\run\shiro.ini
> > [2017-01-19 10:23:59] Config INFO Configuration file:
> > C:\Programs\apache-jena-fuseki-2.4.1\run\config.ttl
> > [2017-01-19 10:23:59] riot WARN [line: 5, col: 9 ] Bad IRI:
> > Code:
> > 4/UNWISE_CHARACTER in PATH: The character matches no grammar rules of
> > URIs/IRIs. These characters are permitted in RDF URI References, XML
> system
> > identifiers, and XML Schema anyURIs.
> > [2017-01-19 10:24:00] Config INFO Load configuration:
> > file:///C:/Programs/apache-jena-fuseki-2.4.1/run/configuration/Lexvo.ttl
> > [2017-01-19 10:24:01] Config INFO Load configuration:
> > file:///C:/Programs/apache-jena-fuseki-2.4.1/run/
> configuration/LinkedCT.ttl
> > [2017-01-19 10:24:04] Config INFO Register: /Lexvo
> > [2017-01-19 10:24:04] Config INFO Register: /LinkedCT
> > [2017-01-19 10:24:04] Server INFO Started 2017/01/19 10:24:04 EST on
> > port 3030
> >
> >
> >
> > 5. When I go to the server, I can query the small Lexo database but not
> the
> > LinkedCT one.
> >
> >
> > Regards,
> > Reihan
> >
> >
> >
> > On Thu, Jan 19, 2017 at 1:40 PM, A. Soroka wrote:
> >
> >>> However, the reasoner probably is not working because I cannot query
> the
> >> data!
> >>
> >> This isn't really an effective report of a problem. Can you describe
> what
> >> you did (including the exact sequence of steps you followed to do the
> >> load), what you then did to query, what you expected to get, and what
> you
> >> actually got?
> >>
> >> ---
> >> A. Soroka
> >> The University of Virginia Library
> >>
> >>
> >>
> >>> On Jan 19, 2017, at 12:03 PM, Reihaneh Amini >
> >> wrote:
> >>>
> >>> I load the data by TDB loader and then upload them into the server with
> >> no
> >>> problem this time. However, the reasoner probably is not working
> because
> >> I
> >>> cannot query the data!
> >>>
> >>> By loading by TDB I got several .dat and .idn file which I loaded them
> to
> >>> fuseki server.
> >>>
> >>> Any suggestion?
> >>>
> >>> Regards,
> >>> Reihan
> >>>
> >>> On
Re: 10G loading file to fuseki
Your procedure seems reasonable. I still don't understand what you mean by "I
can query the small Lexo database but not the LinkedCT one." What exactly are
you doing to send queries?
Please show the configuration you added for your new dataset.
---
A. Soroka
The University of Virginia Library
> On Jan 19, 2017, at 2:24 PM, Reihaneh Amini wrote:
>
> Sure!
> Thanks for helping!
>
> 1. TDB laoding:
>
> public static void main(String[] args) {
>
> String file = "./linkedct-live-dump-latest.nt"; //source 10 GB file
> String directory;
> directory = "./Data";
> //target TDB files
>
> Dataset dataset = TDBFactory.createDataset(directory);
>
> Model model = dataset.getNamedModel("http://nameFile";);
>
> TDBLoader.loadModel(model, file );
>
>
> }
>
> I loaded the big file by using TDB model and finally after 10 hours of
> execution, it gave me the Data folder that contains 28 files with .dat and
> .idn suffix.
>
> 2. I have a directory that I downloaded from download part of fuseki-server
> naming: "apache-jena-fuseki-2.4.1". It contains a batch file that by
> running that file from command-line I get access to the server by
> localhost/3030.
> When I get access to the server and upload a small dataset (<100mb) there
> named "Lexo", automatically that dataset will be appeared in the
> "apache-jena-fuseki-2.4.1/run/databases/lexo". That dataset contains the
> .dat and .idn files.
>
> So, by doing the reverse process. First I read my big dataset by step one.
> Then I save these generated files into
> "apache-jena-fuseki-2.4.1/run/databases/LinkedCT" path under "LinkedCT"
> folder.
>
> 3. I run the server again and now both databases appear in the server. ( I
> also took care of creating a config file for this new dataset in
> "Configuration" folder.
>
> 4. this seems normal from my perspective.
> C:\Programs\apache-jena-fuseki-2.4.1>fuseki-server
> Picked up _JAVA_OPTIONS: -Xms2048m -Xmx4096m
> [2017-01-19 10:23:59] Server INFO Fuseki 2.4.1
> [2017-01-19 10:23:59] Config INFO
> FUSEKI_HOME=C:\Programs\apache-jena-fuseki-2.4.1\.
> [2017-01-19 10:23:59] Config INFO
> FUSEKI_BASE=C:\Programs\apache-jena-fuseki-2.4.1\run
> [2017-01-19 10:23:59] ServletINFO Initializing Shiro environment
> [2017-01-19 10:23:59] Config INFO Shiro file:
> file://C:\Programs\apache-jena-fuseki-2.4.1\run\shiro.ini
> [2017-01-19 10:23:59] Config INFO Configuration file:
> C:\Programs\apache-jena-fuseki-2.4.1\run\config.ttl
> [2017-01-19 10:23:59] riot WARN [line: 5, col: 9 ] Bad IRI:
> Code:
> 4/UNWISE_CHARACTER in PATH: The character matches no grammar rules of
> URIs/IRIs. These characters are permitted in RDF URI References, XML system
> identifiers, and XML Schema anyURIs.
> [2017-01-19 10:24:00] Config INFO Load configuration:
> file:///C:/Programs/apache-jena-fuseki-2.4.1/run/configuration/Lexvo.ttl
> [2017-01-19 10:24:01] Config INFO Load configuration:
> file:///C:/Programs/apache-jena-fuseki-2.4.1/run/configuration/LinkedCT.ttl
> [2017-01-19 10:24:04] Config INFO Register: /Lexvo
> [2017-01-19 10:24:04] Config INFO Register: /LinkedCT
> [2017-01-19 10:24:04] Server INFO Started 2017/01/19 10:24:04 EST on
> port 3030
>
>
>
> 5. When I go to the server, I can query the small Lexo database but not the
> LinkedCT one.
>
>
> Regards,
> Reihan
>
>
>
> On Thu, Jan 19, 2017 at 1:40 PM, A. Soroka wrote:
>
>>> However, the reasoner probably is not working because I cannot query the
>> data!
>>
>> This isn't really an effective report of a problem. Can you describe what
>> you did (including the exact sequence of steps you followed to do the
>> load), what you then did to query, what you expected to get, and what you
>> actually got?
>>
>> ---
>> A. Soroka
>> The University of Virginia Library
>>
>>
>>
>>> On Jan 19, 2017, at 12:03 PM, Reihaneh Amini
>> wrote:
>>>
>>> I load the data by TDB loader and then upload them into the server with
>> no
>>> problem this time. However, the reasoner probably is not working because
>> I
>>> cannot query the data!
>>>
>>> By loading by TDB I got several .dat and .idn file which I loaded them to
>>> fuseki server.
>>>
>>> Any suggestion?
>>>
>>> Regards,
>>> Reihan
>>>
>>> On Thu, Jan 19, 2017 at 11:33 AM, A. Soroka wrote:
>>>
Using the UI is not a good idea for this. You would do _much_ better
either to work Osma's suggestion or to use the command-line tools.
---
A. Soroka
The University of Virginia Library
> On Jan 19, 2017, at 11:32 AM, Reihaneh Amini >>
wrote:
>
> Hi Andy,
>
> Thanks for your advice!
> I am using UI.
>
> Do you mean I can still use UI if I split the data?
> By splitting you mean the simple splitting, right?
>
>
> Reihan
>>>
>>>
>>> --
>>> Regards,
>>> -Reihan
>>
>>
>
>
> --
> Regards,
> -Reihan
Re: 10G loading file to fuseki
Sure!
Thanks for helping!
1. TDB laoding:
public static void main(String[] args) {
String file = "./linkedct-live-dump-latest.nt"; //source 10 GB file
String directory;
directory = "./Data";
//target TDB files
Dataset dataset = TDBFactory.createDataset(directory);
Model model = dataset.getNamedModel("http://nameFile";);
TDBLoader.loadModel(model, file );
}
I loaded the big file by using TDB model and finally after 10 hours of
execution, it gave me the Data folder that contains 28 files with .dat and
.idn suffix.
2. I have a directory that I downloaded from download part of fuseki-server
naming: "apache-jena-fuseki-2.4.1". It contains a batch file that by
running that file from command-line I get access to the server by
localhost/3030.
When I get access to the server and upload a small dataset (<100mb) there
named "Lexo", automatically that dataset will be appeared in the
"apache-jena-fuseki-2.4.1/run/databases/lexo". That dataset contains the
.dat and .idn files.
So, by doing the reverse process. First I read my big dataset by step one.
Then I save these generated files into
"apache-jena-fuseki-2.4.1/run/databases/LinkedCT" path under "LinkedCT"
folder.
3. I run the server again and now both databases appear in the server. ( I
also took care of creating a config file for this new dataset in
"Configuration" folder.
4. this seems normal from my perspective.
C:\Programs\apache-jena-fuseki-2.4.1>fuseki-server
Picked up _JAVA_OPTIONS: -Xms2048m -Xmx4096m
[2017-01-19 10:23:59] Server INFO Fuseki 2.4.1
[2017-01-19 10:23:59] Config INFO
FUSEKI_HOME=C:\Programs\apache-jena-fuseki-2.4.1\.
[2017-01-19 10:23:59] Config INFO
FUSEKI_BASE=C:\Programs\apache-jena-fuseki-2.4.1\run
[2017-01-19 10:23:59] ServletINFO Initializing Shiro environment
[2017-01-19 10:23:59] Config INFO Shiro file:
file://C:\Programs\apache-jena-fuseki-2.4.1\run\shiro.ini
[2017-01-19 10:23:59] Config INFO Configuration file:
C:\Programs\apache-jena-fuseki-2.4.1\run\config.ttl
[2017-01-19 10:23:59] riot WARN [line: 5, col: 9 ] Bad IRI:
Code:
4/UNWISE_CHARACTER in PATH: The character matches no grammar rules of
URIs/IRIs. These characters are permitted in RDF URI References, XML system
identifiers, and XML Schema anyURIs.
[2017-01-19 10:24:00] Config INFO Load configuration:
file:///C:/Programs/apache-jena-fuseki-2.4.1/run/configuration/Lexvo.ttl
[2017-01-19 10:24:01] Config INFO Load configuration:
file:///C:/Programs/apache-jena-fuseki-2.4.1/run/configuration/LinkedCT.ttl
[2017-01-19 10:24:04] Config INFO Register: /Lexvo
[2017-01-19 10:24:04] Config INFO Register: /LinkedCT
[2017-01-19 10:24:04] Server INFO Started 2017/01/19 10:24:04 EST on
port 3030
5. When I go to the server, I can query the small Lexo database but not the
LinkedCT one.
Regards,
Reihan
On Thu, Jan 19, 2017 at 1:40 PM, A. Soroka wrote:
> > However, the reasoner probably is not working because I cannot query the
> data!
>
> This isn't really an effective report of a problem. Can you describe what
> you did (including the exact sequence of steps you followed to do the
> load), what you then did to query, what you expected to get, and what you
> actually got?
>
> ---
> A. Soroka
> The University of Virginia Library
>
>
>
> > On Jan 19, 2017, at 12:03 PM, Reihaneh Amini
> wrote:
> >
> > I load the data by TDB loader and then upload them into the server with
> no
> > problem this time. However, the reasoner probably is not working because
> I
> > cannot query the data!
> >
> > By loading by TDB I got several .dat and .idn file which I loaded them to
> > fuseki server.
> >
> > Any suggestion?
> >
> > Regards,
> > Reihan
> >
> > On Thu, Jan 19, 2017 at 11:33 AM, A. Soroka wrote:
> >
> >> Using the UI is not a good idea for this. You would do _much_ better
> >> either to work Osma's suggestion or to use the command-line tools.
> >>
> >> ---
> >> A. Soroka
> >> The University of Virginia Library
> >>
> >>> On Jan 19, 2017, at 11:32 AM, Reihaneh Amini >
> >> wrote:
> >>>
> >>> Hi Andy,
> >>>
> >>> Thanks for your advice!
> >>> I am using UI.
> >>>
> >>> Do you mean I can still use UI if I split the data?
> >>> By splitting you mean the simple splitting, right?
> >>>
> >>>
> >>> Reihan
> >>
> >>
> >
> >
> > --
> > Regards,
> > -Reihan
>
>
--
Regards,
-Reihan
Re: 10G loading file to fuseki
> However, the reasoner probably is not working because I cannot query the data! This isn't really an effective report of a problem. Can you describe what you did (including the exact sequence of steps you followed to do the load), what you then did to query, what you expected to get, and what you actually got? --- A. Soroka The University of Virginia Library > On Jan 19, 2017, at 12:03 PM, Reihaneh Amini wrote: > > I load the data by TDB loader and then upload them into the server with no > problem this time. However, the reasoner probably is not working because I > cannot query the data! > > By loading by TDB I got several .dat and .idn file which I loaded them to > fuseki server. > > Any suggestion? > > Regards, > Reihan > > On Thu, Jan 19, 2017 at 11:33 AM, A. Soroka wrote: > >> Using the UI is not a good idea for this. You would do _much_ better >> either to work Osma's suggestion or to use the command-line tools. >> >> --- >> A. Soroka >> The University of Virginia Library >> >>> On Jan 19, 2017, at 11:32 AM, Reihaneh Amini >> wrote: >>> >>> Hi Andy, >>> >>> Thanks for your advice! >>> I am using UI. >>> >>> Do you mean I can still use UI if I split the data? >>> By splitting you mean the simple splitting, right? >>> >>> >>> Reihan >> >> > > > -- > Regards, > -Reihan
Re: 10G loading file to fuseki
I load the data by TDB loader and then upload them into the server with no problem this time. However, the reasoner probably is not working because I cannot query the data! By loading by TDB I got several .dat and .idn file which I loaded them to fuseki server. Any suggestion? Regards, Reihan On Thu, Jan 19, 2017 at 11:33 AM, A. Soroka wrote: > Using the UI is not a good idea for this. You would do _much_ better > either to work Osma's suggestion or to use the command-line tools. > > --- > A. Soroka > The University of Virginia Library > > > On Jan 19, 2017, at 11:32 AM, Reihaneh Amini > wrote: > > > > Hi Andy, > > > > Thanks for your advice! > > I am using UI. > > > > Do you mean I can still use UI if I split the data? > > By splitting you mean the simple splitting, right? > > > > > > Reihan > > -- Regards, -Reihan
Re: 10G loading file to fuseki
Using the UI is not a good idea for this. You would do _much_ better either to work Osma's suggestion or to use the command-line tools. --- A. Soroka The University of Virginia Library > On Jan 19, 2017, at 11:32 AM, Reihaneh Amini wrote: > > Hi Andy, > > Thanks for your advice! > I am using UI. > > Do you mean I can still use UI if I split the data? > By splitting you mean the simple splitting, right? > > > Reihan
10G loading file to fuseki
Hi Andy, Thanks for your advice! I am using UI. Do you mean I can still use UI if I split the data? By splitting you mean the simple splitting, right? Reihan
