Re: [Neo4j] Importing data from oracle to neo4j
Very interesting - I like! Would love to play around with it. Thanks for the tip Rick! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Wed, Oct 12, 2011 at 10:37 PM, Rick Otten wrote: > Another approach might be to adapt SymmetricDS -- > http://symmetricds.codehaus.org/ -- to feed data from your Oracle (or other > JDBC accessible Relational database) into Neo4j - live, as the data changes. > > I've been wanting a SymmetricDS interface to Neo4j for a while. Let me know > if you get one working! > > > -Original Message- > From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On > Behalf Of Peter Neubauer > Sent: Tuesday, October 11, 2011 6:47 AM > To: Neo4j user discussions > Subject: Re: [Neo4j] Importing data from oracle to neo4j > > Hi there, > yes, the utility is converting m:n into relationships, see > https://github.com/peterneubauer/sql-import and > https://github.com/peterneubauer/sql-import/blob/master/src/test/java/com/neo4j/sqlimport/InsertTest.java > fro an eample. > > Let me know if that helps! > > Cheers, > > /peter neubauer > > GTalk: neubauer.peter > Skype peter.neubauer > Phone +46 704 106975 > LinkedIn http://www.linkedin.com/in/neubauer > Twitter http://twitter.com/peterneubauer > > http://www.neo4j.org - Your high performance graph database. > http://startupbootcamp.org/ - Öresund - Innovation happens HERE. > http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > > > > On Sat, Oct 8, 2011 at 11:14 PM, Michael Hunger > wrote: >> What is your use-case for importing the DWH data? >> >> How are you going to model the data of the DWH in neo4j. How does the >> domain-model look like? >> >> BI data is normally denormalized. So for creating a good graph structure it >> would be sensible to normalize it during the import. >> >> 10k rows is not that much. You can import them using the normal neo4j >> transactional facilities in a few seconds. >> For building up your graph model you probably want to index your data or >> create category nodes to access certain parts of your domain model. >> >> Peter wrote a tool to import relational data into neo4j but that was >> normalized data where each table was represented by a certain type of node >> in the graph and foreign key relationships were converted to graph >> relationships. I don't know if that also handled m:n connection tables >> efficiently by converting them to relationships too. >> >> HTH >> >> Michael >> >> Am 08.10.2011 um 23:05 schrieb jiteshks: >> >>> I am very new to neo4j.So I don't know all of its features.I am >>> reading its documentation to understand how it works. >>> >>> My project's requirement is to import the data from a data warehouse( >>> which is an oracle db) once every month.We are thinking of >>> implementing neo4j in our project which means we will have to read >>> the data from oracle db and put it into neo4j. >>> There will be around 1 lakh rows(10^5) to be fetched from oracle >>> db.What is the fast/efficient way of doing it? >>> >>> Thanks! >>> >>> -- >>> View this message in context: >>> http://neo4j-community-discussions.438527.n3.nabble.com/Importing-dat >>> a-from-oracle-to-neo4j-tp3406024p3406024.html >>> Sent from the Neo4j Community Discussions mailing list archive at >>> Nabble.com. >>> ___ >>> Neo4j mailing list >>> User@lists.neo4j.org >>> https://lists.neo4j.org/mailman/listinfo/user >> >> ___ >> Neo4j mailing list >> User@lists.neo4j.org >> https://lists.neo4j.org/mailman/listinfo/user >> > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Importing data from oracle to neo4j
Another approach might be to adapt SymmetricDS -- http://symmetricds.codehaus.org/ -- to feed data from your Oracle (or other JDBC accessible Relational database) into Neo4j - live, as the data changes. I've been wanting a SymmetricDS interface to Neo4j for a while. Let me know if you get one working! -Original Message- From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] On Behalf Of Peter Neubauer Sent: Tuesday, October 11, 2011 6:47 AM To: Neo4j user discussions Subject: Re: [Neo4j] Importing data from oracle to neo4j Hi there, yes, the utility is converting m:n into relationships, see https://github.com/peterneubauer/sql-import and https://github.com/peterneubauer/sql-import/blob/master/src/test/java/com/neo4j/sqlimport/InsertTest.java fro an eample. Let me know if that helps! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sat, Oct 8, 2011 at 11:14 PM, Michael Hunger wrote: > What is your use-case for importing the DWH data? > > How are you going to model the data of the DWH in neo4j. How does the > domain-model look like? > > BI data is normally denormalized. So for creating a good graph structure it > would be sensible to normalize it during the import. > > 10k rows is not that much. You can import them using the normal neo4j > transactional facilities in a few seconds. > For building up your graph model you probably want to index your data or > create category nodes to access certain parts of your domain model. > > Peter wrote a tool to import relational data into neo4j but that was > normalized data where each table was represented by a certain type of node in > the graph and foreign key relationships were converted to graph > relationships. I don't know if that also handled m:n connection tables > efficiently by converting them to relationships too. > > HTH > > Michael > > Am 08.10.2011 um 23:05 schrieb jiteshks: > >> I am very new to neo4j.So I don't know all of its features.I am >> reading its documentation to understand how it works. >> >> My project's requirement is to import the data from a data warehouse( >> which is an oracle db) once every month.We are thinking of >> implementing neo4j in our project which means we will have to read >> the data from oracle db and put it into neo4j. >> There will be around 1 lakh rows(10^5) to be fetched from oracle >> db.What is the fast/efficient way of doing it? >> >> Thanks! >> >> -- >> View this message in context: >> http://neo4j-community-discussions.438527.n3.nabble.com/Importing-dat >> a-from-oracle-to-neo4j-tp3406024p3406024.html >> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. >> ___ >> Neo4j mailing list >> User@lists.neo4j.org >> https://lists.neo4j.org/mailman/listinfo/user > > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Importing data from oracle to neo4j
Hi there, yes, the utility is converting m:n into relationships, see https://github.com/peterneubauer/sql-import and https://github.com/peterneubauer/sql-import/blob/master/src/test/java/com/neo4j/sqlimport/InsertTest.java fro an eample. Let me know if that helps! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sat, Oct 8, 2011 at 11:14 PM, Michael Hunger wrote: > What is your use-case for importing the DWH data? > > How are you going to model the data of the DWH in neo4j. How does the > domain-model look like? > > BI data is normally denormalized. So for creating a good graph structure it > would be sensible to normalize it during the import. > > 10k rows is not that much. You can import them using the normal neo4j > transactional facilities in a few seconds. > For building up your graph model you probably want to index your data or > create category nodes to access certain parts of your domain model. > > Peter wrote a tool to import relational data into neo4j but that was > normalized data where each table was represented by a certain type of node in > the graph and foreign key relationships were converted to graph > relationships. I don't know if that also handled m:n connection tables > efficiently by converting them to relationships too. > > HTH > > Michael > > Am 08.10.2011 um 23:05 schrieb jiteshks: > >> I am very new to neo4j.So I don't know all of its features.I am reading its >> documentation to understand how it works. >> >> My project's requirement is to import the data from a data warehouse( which >> is an oracle db) once every month.We are thinking of implementing neo4j in >> our project which means we will have to read the data from oracle db and put >> it into neo4j. >> There will be around 1 lakh rows(10^5) to be fetched from oracle db.What is >> the fast/efficient way of doing it? >> >> Thanks! >> >> -- >> View this message in context: >> http://neo4j-community-discussions.438527.n3.nabble.com/Importing-data-from-oracle-to-neo4j-tp3406024p3406024.html >> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. >> ___ >> Neo4j mailing list >> User@lists.neo4j.org >> https://lists.neo4j.org/mailman/listinfo/user > > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Importing data from oracle to neo4j
What is your use-case for importing the DWH data? How are you going to model the data of the DWH in neo4j. How does the domain-model look like? BI data is normally denormalized. So for creating a good graph structure it would be sensible to normalize it during the import. 10k rows is not that much. You can import them using the normal neo4j transactional facilities in a few seconds. For building up your graph model you probably want to index your data or create category nodes to access certain parts of your domain model. Peter wrote a tool to import relational data into neo4j but that was normalized data where each table was represented by a certain type of node in the graph and foreign key relationships were converted to graph relationships. I don't know if that also handled m:n connection tables efficiently by converting them to relationships too. HTH Michael Am 08.10.2011 um 23:05 schrieb jiteshks: > I am very new to neo4j.So I don't know all of its features.I am reading its > documentation to understand how it works. > > My project's requirement is to import the data from a data warehouse( which > is an oracle db) once every month.We are thinking of implementing neo4j in > our project which means we will have to read the data from oracle db and put > it into neo4j. > There will be around 1 lakh rows(10^5) to be fetched from oracle db.What is > the fast/efficient way of doing it? > > Thanks! > > -- > View this message in context: > http://neo4j-community-discussions.438527.n3.nabble.com/Importing-data-from-oracle-to-neo4j-tp3406024p3406024.html > Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Importing data from oracle to neo4j
I am very new to neo4j.So I don't know all of its features.I am reading its documentation to understand how it works. My project's requirement is to import the data from a data warehouse( which is an oracle db) once every month.We are thinking of implementing neo4j in our project which means we will have to read the data from oracle db and put it into neo4j. There will be around 1 lakh rows(10^5) to be fetched from oracle db.What is the fast/efficient way of doing it? Thanks! -- View this message in context: http://neo4j-community-discussions.438527.n3.nabble.com/Importing-data-from-oracle-to-neo4j-tp3406024p3406024.html Sent from the Neo4j Community Discussions mailing list archive at Nabble.com. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
