np. I think this dependency should be included as default. Sent a PR to fix this: https://github.com/apache/beam/pull/7213
On Wed, Dec 5, 2018 at 7:10 AM Sai Inampudi <sai.inamp...@gmail.com> wrote: > That did it, thanks for the help Ruoyun, I did forget to pull in the > dependency in my pom! bad mistake :) > > On 2018/12/05 05:24:29, Ruoyun Huang <ruo...@google.com> wrote: > > This should work. but maybe try adding a section like this to your > pom.xml > > file: > > > > <profile> > > > > <id>portable-runner</id> > > > > <activation> > > > > <activeByDefault>true</activeByDefault> > > > > </activation> > > > > <!-- Makes the PortableRunner available when running a pipeline. > --> > > > > <dependencies> > > > > <dependency> > > > > <groupId>org.apache.beam</groupId> > > > > <artifactId>beam-runners-reference-java</artifactId> > > > > <version>${beam.version}</version> > > > > <scope>runtime</scope> > > > > </dependency> > > > > </dependencies> > > > > </profile> > > > > > > Note that PortableRunner has major features still in development. It > > currently can only run sample pipeline without file output. There are > > active efforts on it though. > > > > > > > > > > > > On Tue, Dec 4, 2018 at 2:21 PM Sai Inampudi <sai.inamp...@gmail.com> > wrote: > > > > > Thanks for the help Ankur and Ruoyun, appreciate it. I went through the > > > wiki and I am still facing the same issue as before (where it complains > > > about the following: > > > java.lang.IllegalArgumentException: Unknown 'runner' specified > > > 'PortableRunner', supported pipeline runners [DirectRunner, > FlinkRunner, > > > SparkRunner, TestFlinkRunner, TestSparkRunner]) > > > > > > I am probably doing a naive mistake but I am not sure where, below is > > > everything I have done thus far: > > > * Confirmed I have met the prerequisities in the wiki > > > * Docker is installed and working without sudo > > > * gradle target for the java container works > > > > > > * Successfully started the JobServer (for now, I didn't bother with the > > > flink job server and instead just kicked off the reference job server) > by > > > running the following > > > * ./gradlew :beam-runners-reference-job-server:run > > > * Confirmed that the JobService started at 8099 port > > > * Started ReferenceRunnerJobService at localhost:8099 > > > <============-> 98% EXECUTING [22m 43s] > > > > :beam-runners-reference-job-server:run > > > > IDLE > > > > > > * My code itself is being managed via maven, so I made sure to pull in > the > > > latest 2.10.0-SNAPSHOT dependencies as per > > > https://repository.apache.org/content/repositories/snapshots/ > > > > > > * The pipeline is kicked off with the following options: > > > * --runner=PortableRunner --jobEndpoint=localhost:8099 > > > --streaming=true > > > * Running the pipeline results in the following error > > > * java.lang.IllegalArgumentException: Unknown 'runner' > > > specified 'PortableRunner', supported pipeline runners [DirectRunner, > > > FlinkRunner, SparkRunner, TestFlinkRunner, TestSparkRunner] > > > > > > > > > > > > I am sure I am missing something basic but I was hoping I could get > ideas > > > on what it might be? > > > > > > > > > > -- > > ================ > > Ruoyun Huang > > > -- ================ Ruoyun Huang