Child jobs not kicking off using SparkRunner in cluster mode

2019-01-03 Thread Shrijit Pillai
Here's the mvn dependency tree:- https://gist.github.com/shrijitpillai/f06797238cf6db9bf350e6a835fb34d6 Cluster mode yarn log https://gist.github.com/shrijitpillai/2f1963ece26c152a2d68bc6ae8913fea Can somebody help in identifying what is that I'm missing here? Thanks, Shrijit Pillai

Re: Joining bounded and unbounded data not working using non-global window

2018-12-12 Thread Shrijit Pillai
> pattern Calling external service, (ref below) > > > > Ref : > > https://cloud.google.com/blog/products/gcp/guide-to-common-cloud-dataflow-use-case-patterns-part-1 > > > > Cheers > > > > Reza > > > > On Tue, 11 Dec 2018 at 00:12, Shrijit Pillai

Joining bounded and unbounded data not working using non-global window

2018-12-10 Thread Shrijit Pillai
Hello, I'm trying to join an unbounded data source and a bounded one using CoGroupByKey. The bounded data source is HBase and the unbounded one is Kafka. The co-group works if the global window strategy is used but not with a non-global one. I've tried the accumulatingFiredPanes mode(using the