[jira] [Created] (FLINK-6876) The comment of DataStream#assignTimestampsAndWatermarks is incorrect

2017-06-08 Thread Dian Fu (JIRA)
Dian Fu created FLINK-6876: -- Summary: The comment of DataStream#assignTimestampsAndWatermarks is incorrect Key: FLINK-6876 URL: https://issues.apache.org/jira/browse/FLINK-6876 Project: Flink

Save the flink KeyStream to oracle db table

2017-06-08 Thread Meera nyjen
Hi, I have started using flink recently in my application. i am trying to save a transformed data stream to an oracle db. I was currently using writeascsv(filepath), to save the data to a file. When i say data, it is the kafka message. This kafka message is a file name. I used kafka consumer to

答复: About flink 1.3.0 release packages.

2017-06-08 Thread Zhangrucong
Hi Ted: I modify the link http://archive.apache.org/dist/flink/flink-1.2.1/ to http://archive.apache.org/dist/flink/flink-1.3.0/ The http://archive.apache.org/dist/flink/flink-1.3.0/ is exist. But there is no link in downloads html to redirect there. Thanks a lot! 发件人: Zhangrucong 发送时间:

re: About flink 1.3.0 release packages.

2017-06-08 Thread Zhangrucong
Hi Ted: Thanks a lot. I could not see multiple choices under: http://www.apache.org/dyn/closer.lua/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz when the flink 1.3.0 version to archive? Do you know? Thanks! 发件人: Ted Yu [mailto:yuzhih...@gmail.com] 发送时间: 2017年6月8日 21:05 收件人:

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Haohui Mai
+1 There are several high impacts security vulnerabilities in JDK 7 and will not be addressed. As a result we completely moved away from JDK 7. +1 on separating the tasks of supporting Scala 2.12 and JDK 8 in two steps. On Thu, Jun 8, 2017 at 9:53 AM Greg Hogan wrote: >

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Greg Hogan
Is this not two different issues? - adding builds for Scala 2.12 - upgrading to Java version 1.8 It may be time to switch, but I haven’t seen anything in FLINK-5005 which prevents simply adding Scala 2.12 to our supported build matrix and continuing to build 2.10 / 2.11 against Java 1.7. Greg

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Flavio Pompermaier
We're not using Java 7 anymore from last year already. So +1 to upgrade to java 8 from Okkam On 8 Jun 2017 5:39 pm, "Robert Metzger" wrote: > Hi all, > > as promised in March, I want to revive this discussion! > > Our users are begging for Scala 2.12 support [1], migration

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Robert Metzger
Hi all, as promised in March, I want to revive this discussion! Our users are begging for Scala 2.12 support [1], migration to Akka 2.4 would solve a bunch of shading / dependency issues (Akka 2.4 will remove Akka's protobuf dependency [2][3]) and generally Java 8's new language features all

Re: FlinkML on slack

2017-06-08 Thread Robert Metzger
I'm happy to see efforts towards machine learning on Apache Flink within the community! I think its okay to have a GitHub repository for the ML stuff, but there are some rules by the ASF you have to follow: https://www.apache.org/foundation/marks/faq/#products As immediate steps, I would remove

[jira] [Created] (FLINK-6875) Remote DataSet API job submission timing out

2017-06-08 Thread Francisco Rosa (JIRA)
Francisco Rosa created FLINK-6875: - Summary: Remote DataSet API job submission timing out Key: FLINK-6875 URL: https://issues.apache.org/jira/browse/FLINK-6875 Project: Flink Issue Type: Bug

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
@Ted Yu sure. On Thu, Jun 8, 2017 at 5:18 PM, Ted Yu wrote: > Hi Stavros, > Can you add me as well ? > > Thanks > > On Wed, Jun 7, 2017 at 12:56 PM, Stavros Kontopoulos < > st.kontopou...@gmail.com> wrote: > > > Hi all, > > > > We took the initiative to create the

Re: Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Mu Kong
Hi Till Rohrmann, Thanks for the prompt response! Limiting the number of open connections to the HDFS would be great. I created an issue here in JIRA: https://issues.apache.org/jira/browse/FLINK-6873 Best regards, Mu On Thu, Jun 8, 2017 at 7:06 PM, Till Rohrmann wrote:

[jira] [Created] (FLINK-6873) Limit the number of open writers in file system connector

2017-06-08 Thread Mu Kong (JIRA)
Mu Kong created FLINK-6873: -- Summary: Limit the number of open writers in file system connector Key: FLINK-6873 URL: https://issues.apache.org/jira/browse/FLINK-6873 Project: Flink Issue Type:

Re: FlinkML on slack

2017-06-08 Thread Ted Yu
Hi Stavros, Can you add me as well ? Thanks On Wed, Jun 7, 2017 at 12:56 PM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a channel for model-serving >

Re: FlinkML on slack

2017-06-08 Thread Roberto Bentivoglio
Hi Pat, I've sent you the invitation. Best, Roberto On 8 June 2017 at 15:46, Pattarawat Chormai wrote: > Hi Stavros, > > Could you please also send me an invitation? > > Best, > Pat > > > On Jun 8, 2017, at 11:46 AM, Stavros Kontopoulos < > st.kontopou...@gmail.com>

[jira] [Created] (FLINK-6872) Add MissingOverride to checkstyle

2017-06-08 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-6872: - Summary: Add MissingOverride to checkstyle Key: FLINK-6872 URL: https://issues.apache.org/jira/browse/FLINK-6872 Project: Flink Issue Type: New Feature

Re: FlinkML on slack

2017-06-08 Thread Pattarawat Chormai
Hi Stavros, Could you please also send me an invitation? Best, Pat > On Jun 8, 2017, at 11:46 AM, Stavros Kontopoulos > wrote: > > @Till done. I am thinking that slack is a bit inconvenient with the > self-invite restriction, people often use >

[jira] [Created] (FLINK-6871) Obsolete instruction for changing scala version for build

2017-06-08 Thread William Saar (JIRA)
William Saar created FLINK-6871: --- Summary: Obsolete instruction for changing scala version for build Key: FLINK-6871 URL: https://issues.apache.org/jira/browse/FLINK-6871 Project: Flink Issue

Re: About flink 1.3.0 release packages.

2017-06-08 Thread Ted Yu
Do you not see multiple choices under: http://www.apache.org/dyn/closer.lua/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz If not, try using the following link: http://www-us.apache.org/dist/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz Or this:

[jira] [Created] (FLINK-6870) Combined batch and stream TableSource can not produce same time attributes

2017-06-08 Thread Timo Walther (JIRA)
Timo Walther created FLINK-6870: --- Summary: Combined batch and stream TableSource can not produce same time attributes Key: FLINK-6870 URL: https://issues.apache.org/jira/browse/FLINK-6870 Project:

Re: Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Till Rohrmann
Hi Mu Kong, I think this is a problem with how the BucketingSink works. It keeps for each file a writer which has an open file stream. I think we should limit the number of open writers such that we don't run into the problem of too many open file handles/open HDFS connections. Could you open a

Re: [DISCUSS]: Integrating Flink Table API & SQL with CEP

2017-06-08 Thread Till Rohrmann
Thanks for sharing your ideas with the community. I really like the design document and think that it's a good approach to follow Oracle's SQL extension for pattern matching. Looking forward to having support for SQL with CEP capabilities :-) Cheers, Till On Thu, Jun 8, 2017 at 8:57 AM, Jark Wu

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
@Till done. I am thinking that slack is a bit inconvenient with the self-invite restriction, people often use https://github.com/rauchg/slackinas as a workaround. I raised the question on slack if it makes sense to move to gitter or stay with slack for now (as any in the slack team can also send

Re: FlinkML on slack

2017-06-08 Thread Till Rohrmann
HI Stavros, could you also send me an invite. Thanks. Cheers, Till On Thu, Jun 8, 2017 at 11:28 AM, Aljoscha Krettek wrote: > Thanks! > > > On 8. Jun 2017, at 11:21, Stavros Kontopoulos > wrote: > > > > Hi Aljoscha, > > > > Slack is invite only

Re: FlinkML on slack

2017-06-08 Thread Aljoscha Krettek
Thanks! > On 8. Jun 2017, at 11:21, Stavros Kontopoulos > wrote: > > Hi Aljoscha, > > Slack is invite only to the best of my knowledge, I just sent you an > invitation. > > Best, > Stavros > > > On Thu, Jun 8, 2017 at 11:31 AM, Aljoscha Krettek

Re: FlinkML on slack

2017-06-08 Thread Stavros Kontopoulos
Hi Aljoscha, Slack is invite only to the best of my knowledge, I just sent you an invitation. Best, Stavros On Thu, Jun 8, 2017 at 11:31 AM, Aljoscha Krettek wrote: > Hi, > > Is the slack invite based? If yes, could you please send me one? > > Best, > Aljoscha > > > On

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-08 Thread Aljoscha Krettek
Yes, there is a workaround, as mentioned in the other thread: https://lists.apache.org/thread.html/eb7e256146fbe069a4210e1690fac5d3453208fab61515ab1a2f6bf7@%3Cuser.flink.apache.org%3E

Re: FlinkML on slack

2017-06-08 Thread Aljoscha Krettek
Hi, Is the slack invite based? If yes, could you please send me one? Best, Aljoscha > On 7. Jun 2017, at 21:56, Stavros Kontopoulos > wrote: > > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-08 Thread Till Rohrmann
There should be an easy work-around for this problem. Start a standalone cluster and run the queries against this cluster. But I also see that it might be annoying for users who used to do it differently. The basic question here should be whether we want the users to use the LocalFlinkMiniCluster

Got exception: unable to create new native thread when use BucketingSink writing to HDFS

2017-06-08 Thread Mu Kong
Hi all, I am new to flink. I tried to start a cluster over 3 servers, and the process speed was GREAT. However, after several hours' streaming, I got this error: *java.lang.OutOfMemoryError: unable to create new native thread* From: at

[jira] [Created] (FLINK-6869) Scala serializers do not have the serialVersionUID specified

2017-06-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6869: -- Summary: Scala serializers do not have the serialVersionUID specified Key: FLINK-6869 URL: https://issues.apache.org/jira/browse/FLINK-6869 Project:

Re: [DISCUSS]: Integrating Flink Table API & SQL with CEP

2017-06-08 Thread Jark Wu
Hi @Kostas, @Fabian, thank you for your support. @Fabian, I totally agree with you that we should focus on SQL first. Let's keep Table API in mind and discuss that later. Regarding to the orderBy() clause, I'm not sure about that. I think it makes sense to make it required in streaming

[jira] [Created] (FLINK-6868) Using `scala.binary.version` for `flink-streaming-scala` in `Cassandra Connector`

2017-06-08 Thread Benedict Jin (JIRA)
Benedict Jin created FLINK-6868: --- Summary: Using `scala.binary.version` for `flink-streaming-scala` in `Cassandra Connector` Key: FLINK-6868 URL: https://issues.apache.org/jira/browse/FLINK-6868

[jira] [Created] (FLINK-6867) Elasticsearch 1.x IT test still instable due to embedded node instability

2017-06-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6867: -- Summary: Elasticsearch 1.x IT test still instable due to embedded node instability Key: FLINK-6867 URL: https://issues.apache.org/jira/browse/FLINK-6867