Re: HadoopInputFormatIO - HBase - Flink runner

2017-05-10 Thread Seshadri Raghunathan
e/src/main/java/org/apache/beam/sdk/io/hbase/HBaseIO.java > > If that does not work for some reason... I do not believe anyone has used > HBase with that connector yet. Give it a whirl and let us know when you run > into issues! > > Thanks, > Dan > > On Wed, May 10,

HadoopInputFormatIO - HBase - Flink runner

2017-05-10 Thread Seshadri Raghunathan
Hi, I am looking for some sample code / reference on how to read data from HBase using HadoopInputFormatIO for Flink runner. Something similar to https://github.com/apache/beam/blob/master/sdks/java/io/hadoop/jdk1.8-tests/src/test/java/org/apache/beam/sdk/io/hadoop/inputformat/integration/tests/

Slack channel invite pls

2017-05-04 Thread Seshadri Raghunathan
Hi , Please add me to the Slack channel in the next possible cycle. sesh...@gmail.com Thanks, Seshadri

Re: Http sink - Does it make sense?

2017-05-04 Thread Seshadri Raghunathan
Hi Josh, If you are looking for RestIO, I saw some discussions earlier in the group. This JIRA has more details on it - https://issues.apache.org/jira/browse/BEAM-1946 Hope that helps ! Regards, Seshadri On Thu, May 4, 2017 at 9:19 AM, Josh wrote: > Hi all, > > I'm computing some counts in a

how to enforce dependency among transforms in a piepline

2017-04-19 Thread Seshadri Raghunathan
Hi, I am trying to do something like below : PCollection pc1=; pc1.apply(TextIO.Write.to("gs://BucketA/fileA.txt")) PCollection pc2=TextIO.Read.from("gs://BucketA/fileA.txt") When I execute the above in a pipeline, I get an error when I try to read from the GS bucket- java.lang.IllegalStateE