Re: Tips to fix IDEA strange problem after updating master code

2017-07-03 Thread Ted Yu
Looks like the picture didn't go thru. Mind using third party site ? Thanks On Mon, Jul 3, 2017 at 8:56 PM, Jark Wu wrote: > Hi devs, > > Yesterday, I updated the master code which include [FLINK-7030]: Build > with scala-2.11 by default. After that, I entered a strange

Tips to fix IDEA strange problem after updating master code

2017-07-03 Thread Jark Wu
Hi devs, Yesterday, I updated the master code which include [FLINK-7030]: Build with scala-2.11 by default. After that, I entered a strange problem with IDEA that many classes can't be found, and the project can't be built/compiled (in IDEA), but maven install worked good. After a series of

[jira] [Created] (FLINK-7083) Adapt WebRuntimeMonitor to work with Flip-6 architecture

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7083: Summary: Adapt WebRuntimeMonitor to work with Flip-6 architecture Key: FLINK-7083 URL: https://issues.apache.org/jira/browse/FLINK-7083 Project: Flink Issue

[jira] [Created] (FLINK-7082) Flip-6: Generic entry point for Flink sessions

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7082: Summary: Flip-6: Generic entry point for Flink sessions Key: FLINK-7082 URL: https://issues.apache.org/jira/browse/FLINK-7082 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7081) Deploy Mesos framework with job

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7081: Summary: Deploy Mesos framework with job Key: FLINK-7081 URL: https://issues.apache.org/jira/browse/FLINK-7081 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7080) Deploy Yarn cluster with job

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7080: Summary: Deploy Yarn cluster with job Key: FLINK-7080 URL: https://issues.apache.org/jira/browse/FLINK-7080 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7079) Refactor ClusterDescriptor to support cluster deployment with job

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7079: Summary: Refactor ClusterDescriptor to support cluster deployment with job Key: FLINK-7079 URL: https://issues.apache.org/jira/browse/FLINK-7079 Project: Flink

[jira] [Created] (FLINK-7077) Implement task release to support dynamic scaling

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7077: Summary: Implement task release to support dynamic scaling Key: FLINK-7077 URL: https://issues.apache.org/jira/browse/FLINK-7077 Project: Flink Issue Type:

[jira] [Created] (FLINK-7076) Add support for dynamic container allocation to ResourceManager

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7076: Summary: Add support for dynamic container allocation to ResourceManager Key: FLINK-7076 URL: https://issues.apache.org/jira/browse/FLINK-7076 Project: Flink

[jira] [Created] (FLINK-7075) Implement Flip-6 standalone mode

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7075: Summary: Implement Flip-6 standalone mode Key: FLINK-7075 URL: https://issues.apache.org/jira/browse/FLINK-7075 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-7074) Add entry point for TaskManagerRunner

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7074: Summary: Add entry point for TaskManagerRunner Key: FLINK-7074 URL: https://issues.apache.org/jira/browse/FLINK-7074 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7072) Create RESTful cluster endpoint

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7072: Summary: Create RESTful cluster endpoint Key: FLINK-7072 URL: https://issues.apache.org/jira/browse/FLINK-7072 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7071) Create RESTful client

2017-07-03 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7071: Summary: Create RESTful client Key: FLINK-7071 URL: https://issues.apache.org/jira/browse/FLINK-7071 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP proposal for Model Serving over Flink

2017-07-03 Thread Robert Metzger
Big +1 from my side on getting this effort started. Users have asked for this and I would like to see some progress there. Did anybody submit a talk about the ML efforts to Flink Forward Berlin this year? On Fri, Jun 30, 2017 at 6:04 PM, Fabian Hueske wrote: > Yes, I know

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Ted Yu
Currently StreamExecutionEnvironment exposes Kryo thru the following: import com.esotericsoftware.kryo.Serializer; I think shading is possible since we can declare the Serializer class to come from shaded Kryo namespace. On Mon, Jul 3, 2017 at 9:25 AM, Aljoscha Krettek

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Aljoscha Krettek
Is it even possible to shade Kryo with it being in the public API? I don’t think it is (without looking into this to deeply, though). > On 3. Jul 2017, at 17:23, Chesnay Schepler wrote: > > I would tackle Kryo later as it is exposed through the API >

Re: Problem to deploy of flink program in cluster

2017-07-03 Thread 郭健
Hi Simone, the output of your app is on the task manager in cluster mode, not in client side. 发自我的 iPad 在 2017年7月3日,23:12,simone sguazza > 写道: Hi, I'm a student and I using flink v1.2.1 to develop a workflow to analyze data

Re: [DISCUSS] Long-term plan for build times

2017-07-03 Thread Ted Yu
Have we considered using tool(s) such as nailgun ? https://www.lightbend.com/blog/zinc-and-incremental-compilation Cheers On Mon, Jul 3, 2017 at 7:42 AM, Chesnay Schepler wrote: > Hello, > > I want to start a discussion on how we plan to deal with ever-increasing > build

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Chesnay Schepler
I would tackle Kryo later as it is exposed through the API (StreamExecutionEnvironment#addDefaultKryoSerializer) which will make the shading process more difficult than for the modules that are done so far. Technically this doesn't prevent us from adding a flink-shaded-kryo2/3 module right

Problem to deploy of flink program in cluster

2017-07-03 Thread simone sguazza
Hi, I'm a student and I using flink v1.2.1 to develop a workflow to analyze data coming from kafka v0.10. At the moment everything work fine, from eclipse I can export the runnable jar with dependencies and with "sudo java -jar flinkApp.jar" I can run the flink application on ubuntu server.

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Stephan Ewen
Other non-Hadoop dependencies that I think are important are the Kryo dependencies. Do we want them in the first release, or tackle them later? Specifically, I think we need - flink-shaded-kryo2 which includes kryo2 plus chill in the version we currently use - flink-shaded-kryo3 which

[jira] [Created] (FLINK-7070) Rework ScalaShellITCase#testSubmissionOfExternalLibraryStream

2017-07-03 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7070: --- Summary: Rework ScalaShellITCase#testSubmissionOfExternalLibraryStream Key: FLINK-7070 URL: https://issues.apache.org/jira/browse/FLINK-7070 Project: Flink

[jira] [Created] (FLINK-7069) Catch exceptions for each reporter separately

2017-07-03 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7069: --- Summary: Catch exceptions for each reporter separately Key: FLINK-7069 URL: https://issues.apache.org/jira/browse/FLINK-7069 Project: Flink Issue

[jira] [Created] (FLINK-7068) change BlobService sub-classes for permanent and transient BLOBs

2017-07-03 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7068: -- Summary: change BlobService sub-classes for permanent and transient BLOBs Key: FLINK-7068 URL: https://issues.apache.org/jira/browse/FLINK-7068 Project: Flink

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Fabian Hueske
Thanks for working on this Chesnay. I think releasing flink-shaded and integrating it in the build before touching the Hadoop dependencies it sounds like a good plan. +1 Cheers, Fabian 2017-07-03 14:32 GMT+02:00 Chesnay Schepler : > Hello, > > I would like to kick off the

Re: [DISCUSS] First release of flink-shaded

2017-07-03 Thread Aljoscha Krettek
+1 Sounds good! I have followed the process on the various issues and the new shaded repository and the changes seem straightforward (more or less ;-)) > On 3. Jul 2017, at 14:32, Chesnay Schepler wrote: > > Hello, > > I would like to kick off the first release of

[DISCUSS] First release of flink-shaded

2017-07-03 Thread Chesnay Schepler
Hello, I would like to kick off the first release of flink-shaded. In the current state the release would include shaded dependencies for asm, guava and netty. All changes required for the integration into Flink have been prepared and tested locally and on yarn. In order for these changes

[jira] [Created] (FLINK-7067) Cancel with savepoint does not restart checkpoint scheduler on failure

2017-07-03 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-7067: -- Summary: Cancel with savepoint does not restart checkpoint scheduler on failure Key: FLINK-7067 URL: https://issues.apache.org/jira/browse/FLINK-7067 Project: Flink

[jira] [Created] (FLINK-7066) Kafka integration tests failing in "airplane mode"

2017-07-03 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-7066: - Summary: Kafka integration tests failing in "airplane mode" Key: FLINK-7066 URL: https://issues.apache.org/jira/browse/FLINK-7066 Project: Flink Issue

[jira] [Created] (FLINK-7065) separate the flink-streaming-java module from flink-clients

2017-07-03 Thread Xu Pingyong (JIRA)
Xu Pingyong created FLINK-7065: -- Summary: separate the flink-streaming-java module from flink-clients Key: FLINK-7065 URL: https://issues.apache.org/jira/browse/FLINK-7065 Project: Flink

[jira] [Created] (FLINK-7064) test instability in WordCountMapreduceITCase

2017-07-03 Thread Nico Kruber (JIRA)
hive.travis-ci.org/jobs/248822552/log.txt?X-Amz-Expires=29=20170703T092943Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170703/us-east-1/s3/aws4_request=host=08fc0358d0d322d0df94a899438f2f1b2585335a71f76ef550e435373b54656a * https://transfer.sh/UnZaV/17392.9.tar.gz further incarnations of the same er

[jira] [Created] (FLINK-7063) test instability in OperatorStateBackendTest.testSnapshotAsyncCancel

2017-07-03 Thread Nico Kruber (JIRA)
txt?X-Amz-Expires=30=20170703T092940Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170703/us-east-1/s3/aws4_request=host=f468cd238236d7038a1e12086dd4a0e3ba538d93c883790d180e4c63b973a5f2 * https://transfer.sh/MHawk/17392.5.tar.gz -- This message was sent by Atlassian JIRA (v6.4.14#64029)