Re: ES2Hadoop and Hadoop2ES

2015-03-05 Thread Mark Walkom
No, you cannot do it in a single job.

On 6 March 2015 at 02:44, Phil gib  wrote:

> Hello,
>
> My SW context : 5 nodes running ES 1.4 + 1 node running ES 1.3
>
> i need to  read node ES 1.4  ( One index + all data indexed) and   write
> it to  nodeES 1.3 .
> i have a  java code that do the job but it firstly writes to HDFS and then
> i need a second job
> that read  HDFS and send to ES 1.3
>
> i was wondering if iit was possible to do all in one without storing on
> HDFS
> by interfacing both in the same job and  java code
> ES doc mentions  ( but within the same job)  :
>
> es.resource.read (defaults to es.resource) Elasticsearch resource used
> for reading (but not writing) data. Useful when reading and writing data to
> different Elasticsearch indices within the *same* job.
> es.resource.write
>
> PS: i tried without success the backup/restore possibility from ES
>
> Best R
> Phil
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elasticsearch+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/elasticsearch/1e3f6b01-0f9c-480e-8b87-6d509e2a9ba0%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8fpZyAJuZm0VMFDjEnmp9%3DK5r8Y2j-xoTue%2BHL49aW-A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


ES2Hadoop and Hadoop2ES

2015-03-05 Thread Phil gib
Hello,

My SW context : 5 nodes running ES 1.4 + 1 node running ES 1.3

i need to  read node ES 1.4  ( One index + all data indexed) and   write it 
to  nodeES 1.3 .
i have a  java code that do the job but it firstly writes to HDFS and then 
i need a second job
that read  HDFS and send to ES 1.3

i was wondering if iit was possible to do all in one without storing on 
HDFS  
by interfacing both in the same job and  java code 
ES doc mentions  ( but within the same job)  : 

es.resource.read (defaults to es.resource) Elasticsearch resource used for 
reading (but not writing) data. Useful when reading and writing data to 
different Elasticsearch indices within the *same* job. 
es.resource.write

PS: i tried without success the backup/restore possibility from ES

Best R
Phil

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/1e3f6b01-0f9c-480e-8b87-6d509e2a9ba0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.