Hi Fabian, Can you add *fetchSize:100000* in JDBC Extractor to see if works?
Lvc@ On 19 January 2015 at 11:26, Fabian Renner <[email protected]> wrote: > Sure. > > this is the ETL json: > Currently I am not really sure, if the DBF Driver (search for "caigen") is > responsible for the 1000 row limit. > > I really don't know... > > { > "config": { > "log": "debug" > }, > "extractor": { > "jdbc": { "driver": "com.caigen.sql.dbf.DBFDriver", > "url": > "jdbc:dbf:/D:/Daten/Dev/testDev/OrientTest/src/main/resources/db", > "userName": "", > "userPassword": "", > "query": "select * from zzzTable" } > }, > "transformers": [ > { "vertex": { "class": "Customer" } }, > { "edge": { "class": "yyy", "direction" : "out", > "joinFieldName": "XXX", > "lookup":"Config.valuexy"} } > ], > "loader": { > "orientdb": { > "dbURL": "remote:localhost/databases/importTest", > "dbUser": "admin", > "dbPassword": "admin", > "dbAutoCreate": true, > "tx": false, > "dbType": "graph", > "classes": [ > {"name": "Customer", "extends": "V"}, > {"name": "yyy", "extends": "E"} > ] > } > } > } > > > Am Samstag, 17. Januar 2015 00:21:33 UTC+1 schrieb Lvc@: >> >> Hi, >> there is no wired limit about 1k records. Could you post your ETL json >> here? Try also playing with "fetchSize" parameter in JDBC extractor. >> >> Lvc@ >> >> On 16 January 2015 at 10:26, Fabian Renner <[email protected]> wrote: >> >>> Hey, >>> >>> I like OrientDB a lot. >>> >>> I'm on version v2.0-rc2 >>> >>> >>> My problem is, I'm importing with ETL from JDBC. The first table has >>> 30000 entries, but the info is: >>> "END ETL PROCESSOR >>> + extracted 2.001 records (864 records/sec) - 2.001 records -> loaded >>> 1.000 vertices (433 vertices/sec) Total time: 2785ms [0 warnings, 0 errors]" >>> >>> How can I import the whole thing? Strange >>> >>> Thanks for your support >>> Fabian >>> >>> -- >>> >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "OrientDB" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > > --- > You received this message because you are subscribed to the Google Groups > "OrientDB" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
