Flink 1.2 Proper Packaging of flink-table with SBT

2017-03-07 Thread Justin Yan
Hello! We are attempting to use the Flink Table API, but are running into a few issues. We initially started with our dependencies looking something like this: libraryDependencies ++= Seq( "org.apache.flink" %% "flink-scala" % "1.2.0" % "provided", "org.apache.flink" %% "flink-clients" % "1.

Re: Flink 1.2 Proper Packaging of flink-table with SBT

2017-03-07 Thread Justin Yan
Of course, 15 minutes after I give up and decide to email the mailing list, I figure it out - my flink App was using the CollectionsEnvironment and not the proper RemoteEnvironment. It is still the case, however, that the `flink-table` JAR built by the standard commands doesn't include the depende

Re: Flink 1.2 Proper Packaging of flink-table with SBT

2017-03-08 Thread Timo Walther
Hi Justin, thank you for reporting your issues. I never tried the Table API with SBT but `flink-table` should not declare dependencies to core modules, this is only done in `test` scope, maybe you have to specify the right scope manually? You are right, the mentioned Jira should be fixed asap,

Re: Flink 1.2 Proper Packaging of flink-table with SBT

2017-03-08 Thread Justin Yan
Hi Timo, Regarding the dependency issue, looking at flink-table's pom.xml, I believe the issue is the dependency on flink-streaming-scala, which then transitively depends on almost all of the core flink modules. If it had not been for the aforementioned JIRA issue about OOM errors, I probably wou