I was missing dependency from beam-sdks-java-io-google-cloud-platform. Quite strange Dataflow didn't show any errors.
On 2019/05/22 19:24:56, Lukasz Cwik <[email protected]> wrote: > Have you tried following the troubleshooting your pipeline guide[1]? > Have you tried to reach out to Google Cloud support with an example job id? > > 1: > https://cloud.google.com/dataflow/docs/guides/troubleshooting-your-pipeline > > On Wed, May 22, 2019 at 12:16 PM [email protected] < > [email protected]> wrote: > > > Hi all, > > I would like to use the streaming engine in my project to see if > > performance improves. > > in order to that I upgraded my project dependencies from > > google-cloud-dataflow-java-sdk-all 2.5.0 to beam-sdks-java-core 2.12.0. I > > also added a dependency from beam-runners-google-cloud-dataflow-java. > > Code was unchanged. > > Unfortunately this doesn't seem to work. Also a very simple pipeline > > reading from a bucket and writing in BigTable hangs not showing any element > > added and not writing any log line. > > > > Thanks > > > > >
