A Ha..today I try to import my sample data into DC/OS ,and it works well. Then I try want to import the data in your github https://github.com/arangodb-helper/pokec-import ,unfortunately, it failed. Here is is my script and logs:
*arangoimp --server.endpoint tcp://10.2.0.141:1026 --file profiles.json --type json --collection "profiles" --create-collection truearangoimp --server.endpoint tcp://10.2.0.141.:1026 --from-collection-prefix profiles --to-collection-prefix profiles --file relations.tsv --type tsv --collection "relations" --create-collection true --create-collection-type edge* and the step 1 passed ,step 2 failed Connected to ArangoDB 'http+tcp://10.2.0.141:1026', version 3.1.10, database: '_system', username: 'root' ---------------------------------------- database: _system collection: relations create: yes source filename: relations.tsv file type: tsv separator: connect timeout: 50 request timeout: 12000 ---------------------------------------- Starting TSV import... 2017-02-17T07:12:37Z [239] INFO processed 31096832 bytes (3%) of input file 2017-02-17T07:12:59Z [239] INFO processed 62193664 bytes (6%) of input file 2017-02-17T07:13:25Z [239] INFO processed 93290496 bytes (9%) of input file 2017-02-17T07:14:04Z [239] INFO processed 124387328 bytes (12%) of input file 2017-02-17T07:14:30Z [239] INFO processed 155484160 bytes (15%) of input file 2017-02-17T07:14:58Z [239] INFO processed 186580992 bytes (18%) of input file 2017-02-17T07:15:31Z [239] INFO processed 217645056 bytes (21%) of input file 2017-02-17T07:15:54Z [239] INFO processed 248741888 bytes (24%) of input file 2017-02-17T07:16:19Z [239] INFO processed 279838720 bytes (27%) of input file 2017-02-17T07:17:03Z [239] INFO processed 310935552 bytes (30%) of input file 2017-02-17T07:17:32Z [239] INFO processed 342032384 bytes (33%) of input file 2017-02-17T07:19:02Z [239] INFO processed 373129216 bytes (36%) of input file 2017-02-17T07:20:35Z [239] ERROR error message: timeout in cluster operation Did you know how to fix this? 在 2017年2月17日星期五 UTC+8上午12:39:03，[email protected]写道： > > Hmmm...Do you have some logs of the job? > > Am Donnerstag, 16. Februar 2017 17:24:29 UTC+1 schrieb Feng Wang: >> >> I am sorry to tell that there still some error when I create profiles >> (document) and a relations (edge), and I re-run the job, in the collection >> 'profiles' the data was successful imported while the collection >> 'relations' was empty >> >> >> <https://lh3.googleusercontent.com/-eRKXoWv5_lU/WKXQ9S6WrbI/AAAAAAAACmw/nc1Dq7TzN4MSqYJg-oeQlv-ScfMURXPHwCLcB/s1600/Selection_011.png> >> >> >> <https://lh3.googleusercontent.com/-MERmVbh_1nw/WKXQ6ZjSdjI/AAAAAAAACms/QkaoXzG5STso48o3X4UP-DZUFrWorI44wCLcB/s1600/Selection_010.png> >> >> >> >> I have faced this problem in my local computer when I want to import >> data in to an edge collection with Web-UI icon " upload documents from json >> or csv file " In my PC, I finally use "arangoimp " >> to import data from csv. >> >> 在 2017年2月16日星期四 UTC+8下午11:53:09，[email protected]写道： >>> >>> Ah yes...I think the example needs the collections beforehand (i.e. it >>> only imports the data and doesn't create the collections). >>> >>> Please create a profiles (document) and a relations (edge) collection. >>> >>> Sorry...Been a while I have been using this. Maybe it is a better idea >>> to create the collection in the import script ;) >>> >>> Am Donnerstag, 16. Februar 2017 16:36:37 UTC+1 schrieb Feng Wang: >>>> >>>> hi , thanks for your help and I did as you write :creating a job with >>>> the following JSON: >>>> and got filed job run state.... >>>> >>>> >>>> >>>> { >>>> "id": "pokec-import", >>>> "run": { >>>> "cmd": "/import.sh tcp://10.2.0.141:1026 <http://10.0.2.11:1026/>", >>>> "cpus": 1, >>>> "mem": 128, >>>> "disk": 0, >>>> "docker": { >>>> "image": "arangodb/pokec-import" >>>> } >>>> } >>>> } >>>> >>>> >>>> here is my endpoint pic: >>>> >>>> >>>> <https://lh3.googleusercontent.com/-FjUkea8Kizk/WKXGzQFsN2I/AAAAAAAACmU/F9XILjCAwLINMnAZxLt7Efe5amMCpF9cgCLcB/s1600/Selection_009.png> >>>> >>>> >>>> >>>> >>>> Is there any thing wrong with my job json?? >>>> >>>> >>>> 在 2017年2月16日星期四 UTC+8下午11:00:06，[email protected]写道： >>>>> >>>>> Hi, >>>>> >>>>> these are the internal IP addresses of the coordinators. To do an >>>>> import I would recommend deploying a job to DC/OS. >>>>> >>>>> Here is an example we are using internally: >>>>> >>>>> https://github.com/arangodb-helper/pokec-import >>>>> https://hub.docker.com/r/arangodb/pokec-import/ >>>>> >>>>> You can deploy it via the Jobs tab in DC/OS by creating a job with the >>>>> following JSON: >>>>> >>>>> { >>>>> "id": "pokec-import", >>>>> "run": { >>>>> "cmd": "/import.sh tcp://10.0.2.11:1026", >>>>> "cpus": 1, >>>>> "mem": 128, >>>>> "disk": 0, >>>>> "docker": { >>>>> "image": "arangodb/pokec-import" >>>>> } >>>>> } >>>>> } >>>>> >>>>> Please adjust the endpoint in the cmd to your needs :) >>>>> >>>>> This is more or less the quick and dirty way because we are hardcoding >>>>> the coordinator. We have created a small tutorial on how we would build a >>>>> fully resilient application on DC/OS using ArangoDB as its backend: >>>>> >>>>> https://docs.arangodb.com/3.1/cookbook/Cloud/DcosFullExample.html >>>>> >>>>> In this setup you would use >>>>> >>>>> tcp://arangodb-proxy.marathon.mesos:8529 >>>>> >>>>> as the endpoint and not have to care about a specific arangodb >>>>> endpoint.e >>>>> >>>>> Hope that helps! >>>>> >>>>> Kind regards, >>>>> >>>>> Andreas Streichardt >>>>> >>>>> Am Donnerstag, 16. Februar 2017 15:55:37 UTC+1 schrieb Feng Wang: >>>>>> >>>>>> Hello community, >>>>>> I have install ArangoDB3 in DC/OS , and the STATE is 'Healthy' . I >>>>>> open the service and the panel like this: >>>>>> >>>>>> >>>>>> >>>>>> <https://lh3.googleusercontent.com/-tGfjLVFnGrw/WKW9LuWV_CI/AAAAAAAACmE/bMzQDbI82noLy2gwPVUb4mQbWm70SBmbACLcB/s1600/Selection_008.png> >>>>>> >>>>>> >>>>>> I also run 'docker ps' on both two Endpoints,and see some images are >>>>>> running such as : >>>>>> arangodb/arangodb-mesos:3.1....master.mesos:5000/arangodb/arangodb-mesos-framework:3.1-build1 >>>>>> >>>>>> I want to know : >>>>>> 1. how can I use arangoimp to import data >>>>>> 2. which docker image process should I attach. >>>>>> >>>>>> thx >>>>>> >>>>> -- You received this message because you are subscribed to the Google Groups "ArangoDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
