[jira] [Created] (FLINK-5386) Refacturing Window Clause

[sunjincheng (JIRA)]

sunjincheng created FLINK-5386:
--

 Summary: Refacturing Window Clause
 Key: FLINK-5386
 URL: https://issues.apache.org/jira/browse/FLINK-5386
 Project: Flink
  Issue Type: Improvement
  Components: Table API & SQL
Reporter: sunjincheng
Assignee: sunjincheng






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (FLINK-5385) Add a help function to create Row

[Jark Wu (JIRA)]

Jark Wu created FLINK-5385:
--

 Summary: Add a help function to create Row
 Key: FLINK-5385
 URL: https://issues.apache.org/jira/browse/FLINK-5385
 Project: Flink
  Issue Type: Improvement
  Components: Core
Reporter: Jark Wu
Assignee: Jark Wu


Currently, it is trivial to create a Row, for example:

{code:java}
Row row = new Row(3);
row.setField(0, "hello");
row.setField(1, true);
row.setField(2, 1L);
{code}

It would be nice to have a help method {{of}} to create a Row, such as:

{code:java}
Row row = Row.of("hello", true, 1L);
{code}






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[RESULT] [VOTE] Release Apache Flink 1.1.4 (RC4)

[Ufuk Celebi]

This vote has passed with 3 binding and 1 non-binding +1 votes. Thanks
to everyone who was involved. I'll go ahead and finalize and package
this release.

+1s:
Gyula Fora (binding)
Stephan Ewen (binding)
Robert Metzger (binding)
Tzu-Li (Gordon) Tai (non-binding)

There are no 0s or -1s.

On Wed, Dec 21, 2016 at 3:13 PM, Tzu-Li (Gordon) Tai
 wrote:
> +1 (unbinding)
>
> - Assured Kinesis connector works properly across different / older AWS EMR 
> versions with simple job (randomly tested in version 5.0.3, 4.8.2, 4.7.2, 4.5)
> - Ran Java & Scala quickstart examples (in local IDE mode, cluster mode and 
> multi-node cluster)
>
>
> On December 21, 2016 at 9:38:26 PM, Robert Metzger (rmetz...@apache.org) 
> wrote:
>
> +1 to release.
>
> I tested the RC with my misbehaved job for a longer period of time, and
> everything went okay (every now and then I had a segfault from rocks).
> I also created a savepoint and restored from it.
> The files in the staging repo look good.
>
> On Tue, Dec 20, 2016 at 9:43 PM, Stephan Ewen  wrote:
>
>> +1 from my side
>>
>> - No relevant changes to dependencies (other than minor version bumps)
>> - No updates to LICENSE and NOTICE necessary
>> - Ran a local build on Linux with Hadoop 2.4 and Scala 2.10, all tests
>> pass
>> - Started standalone cluster and ran several examples - log output looks
>> good
>>
>> On Tue, Dec 20, 2016 at 10:44 AM, Gyula Fóra  wrote:
>>
>> > I have built and ran the tests for the latest RC, so I carry my +1 vote
>> > from the previous thread
>> >
>> > Gyula
>> >
>> > Ufuk Celebi  ezt írta (időpont: 2016. dec. 19., H,
>> 16:16):
>> >
>> > > Dear Flink community,
>> > >
>> > > Please vote on releasing the following candidate as Apache Flink
>> version
>> > > 1.1.4.
>> > >
>> > > The commit to be voted on:
>> > > 8fb0fc8 (http://git-wip-us.apache.org/repos/asf/flink/commit/8fb0fc8)
>> > >
>> > > Branch:
>> > > release-1.1.4-rc4
>> > > (
>> > > https://git1-us-west.apache.org/repos/asf/flink/repo?p=flink
>> > .git;a=shortlog;h=refs/heads/release-1.1.4-rc4
>> > > )
>> > >
>> > > The release artifacts to be voted on can be found at:
>> > > http://people.apache.org/~uce/flink-1.1.4-rc4/
>> > >
>> > > The release artifacts are signed with the key with fingerprint
>> 9D403309:
>> > > http://www.apache.org/dist/flink/KEYS
>> > >
>> > > The staging repository for this release can be found at:
>> > > https://repository.apache.org/content/repositories/orgapacheflink-1110
>> > >
>> > > -
>> > >
>> > > The voting time is reduced to at least two days and the vote passes if
>> > > a majority of at least three +1 PMC votes are cast. The vote ends
>> > > earliest on Wednesday, December 21st, 2016, at 4 PM (CET)/7 AM (PST).
>> > >
>> > > I reduced the voting time, because the changes since the last RC are
>> > > minimal. Please object if you are against this and we can extend it to
>> > > the regular three days.
>> > >
>> > > [ ] +1 Release this package as Apache Flink 1.1.4
>> > > [ ] -1 Do not release this package, because ...
>> > >
>> >
>>

[jira] [Created] (FLINK-5384) clean up jira issues

[Anton Solovev (JIRA)]

Anton Solovev created FLINK-5384:


 Summary: clean up jira issues
 Key: FLINK-5384
 URL: https://issues.apache.org/jira/browse/FLINK-5384
 Project: Flink
  Issue Type: Improvement
Reporter: Anton Solovev
Assignee: Anton Solovev
Priority: Minor


must be closed:
https://issues.apache.org/jira/browse/FLINK-37 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-87 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-481 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-605 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-639 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-650 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-735 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-456 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-788 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-796 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-805 -> from stratosphere ;
https://issues.apache.org/jira/browse/FLINK-867 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-879 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-1166 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-1946 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2119 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2157 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2220 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2319 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2363 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2399 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2428 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2472 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2480 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2609 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2823 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3155 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3331 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3964 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4653 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4717 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4829 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-5016 -> closed on github;

should be discassed before:
https://issues.apache.org/jira/browse/FLINK-1055 ;
https://issues.apache.org/jira/browse/FLINK-1098 -> create other issue to add a 
colectEach();
https://issues.apache.org/jira/browse/FLINK-1100 ;
https://issues.apache.org/jira/browse/FLINK-1146 ;
https://issues.apache.org/jira/browse/FLINK-1335 -> maybe rename?;
https://issues.apache.org/jira/browse/FLINK-1439 ;
https://issues.apache.org/jira/browse/FLINK-1447 -> firefox problem?;
https://issues.apache.org/jira/browse/FLINK-1521 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-1538 -> gsoc2015, is it solved?;
https://issues.apache.org/jira/browse/FLINK-1541 -> gsoc2015, is it solved?;
https://issues.apache.org/jira/browse/FLINK-1723 -> almost done? ;
https://issues.apache.org/jira/browse/FLINK-1814 ;
https://issues.apache.org/jira/browse/FLINK-1858 -> is QA bot deleted?;
https://issues.apache.org/jira/browse/FLINK-1926 -> all subtasks done;

https://issues.apache.org/jira/browse/FLINK-2023 -> does not block Scala Graph 
API;
https://issues.apache.org/jira/browse/FLINK-2032 -> all subtasks done;
https://issues.apache.org/jira/browse/FLINK-2108 -> almost done? ;
https://issues.apache.org/jira/browse/FLINK-2309 -> maybe it's worth to merge 
with https://issues.apache.org/jira/browse/FLINK-2316 ? 
;https://issues.apache.org/jira/browse/FLINK-3109 -> its PR is stuck;
https://issues.apache.org/jira/browse/FLINK-3154 -> must be addressed as part 
of a bigger initiative;
https://issues.apache.org/jira/browse/FLINK-3297 -> solved as third party lib;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

clean up jira

[Anton Solovev]

Hi folks

I found a lot of non-relevant issues:

https://issues.apache.org/jira/browse/FLINK-37 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-87 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-481 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-605 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-639 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-650 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-735 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-456 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-788 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-796 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-805 -> from stratosphere ;
https://issues.apache.org/jira/browse/FLINK-867 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-879 -> from stratosphere;
https://issues.apache.org/jira/browse/FLINK-1055 ;
https://issues.apache.org/jira/browse/FLINK-1098 -> create other issue to add a 
colectEach();
https://issues.apache.org/jira/browse/FLINK-1100 ;
https://issues.apache.org/jira/browse/FLINK-1166 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-1146 ;
https://issues.apache.org/jira/browse/FLINK-1335 -> maybe rename?;
https://issues.apache.org/jira/browse/FLINK-1439 ;
https://issues.apache.org/jira/browse/FLINK-1447 -> firefox problem?;
https://issues.apache.org/jira/browse/FLINK-1521 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-1538 -> gsoc2015, is it solved?;
https://issues.apache.org/jira/browse/FLINK-1541 -> gsoc2015, is it solved?;
https://issues.apache.org/jira/browse/FLINK-1723 -> almost done? ;
https://issues.apache.org/jira/browse/FLINK-1814 ;
https://issues.apache.org/jira/browse/FLINK-1858 -> is QA bot deleted?;
https://issues.apache.org/jira/browse/FLINK-1926 -> all subtasks done;
https://issues.apache.org/jira/browse/FLINK-1946 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2023 -> does not block Scala Graph 
API;
https://issues.apache.org/jira/browse/FLINK-2032 -> all subtasks done;
https://issues.apache.org/jira/browse/FLINK-2108 -> almost done? ;
https://issues.apache.org/jira/browse/FLINK-2119 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2157 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2220 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2309 -> maybe it's worth to merge 
with https://issues.apache.org/jira/browse/FLINK-2316 ? ;
https://issues.apache.org/jira/browse/FLINK-2319 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2363 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2399 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2428 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2472 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2480 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2609 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-2823 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3109 -> its PR is stuck;
https://issues.apache.org/jira/browse/FLINK-3154 -> must be addressed as part 
of a bigger initiative;
https://issues.apache.org/jira/browse/FLINK-3155 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3297 -> solved as third party lib;
https://issues.apache.org/jira/browse/FLINK-3331 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-3613 -> close this in favor of 
https://issues.apache.org/jira/browse/FLINK-4604 ;
https://issues.apache.org/jira/browse/FLINK-3827 -> need check status again
https://issues.apache.org/jira/browse/FLINK-3964 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4195 -> is it solved with 
https://issues.apache.org/jira/browse/FLINK-4170 ?
https://issues.apache.org/jira/browse/FLINK-4653 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4338 -> all subtasks done;
https://issues.apache.org/jira/browse/FLINK-4717 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4829 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-4834 -> all subtasks done;
https://issues.apache.org/jira/browse/FLINK-4837 -> solved on Bahir side;
https://issues.apache.org/jira/browse/FLINK-5016 -> closed on github;
https://issues.apache.org/jira/browse/FLINK-5175 -> closed on github, but for 
version 2.0;


Or I I'm wrong, some issues steel is relevant, or maybe I missed something, 
correct me please
What should we do with it? Should we close?

[jira] [Created] (FLINK-5382) Taskmanager log download button causes 404

[Robert Metzger (JIRA)]

Robert Metzger created FLINK-5382:
-

 Summary: Taskmanager log download button causes 404
 Key: FLINK-5382
 URL: https://issues.apache.org/jira/browse/FLINK-5382
 Project: Flink
  Issue Type: Bug
  Components: Webfrontend
Affects Versions: 1.2.0
Reporter: Robert Metzger


The "download logs" button when viewing the TaskManager logs in the web UI 
leads to a 404 page.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (FLINK-5381) Scrolling in some web interface pages doesn't work (taskmanager details, jobmanager config)

[Robert Metzger (JIRA)]

Robert Metzger created FLINK-5381:
-

 Summary: Scrolling in some web interface pages doesn't work 
(taskmanager details, jobmanager config)
 Key: FLINK-5381
 URL: https://issues.apache.org/jira/browse/FLINK-5381
 Project: Flink
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Robert Metzger


It seems that scrolling in the web interface doesn't work anymore on some pages 
in the 1.2 release branch.

Example pages: 
- When you click the "JobManager" tab
- The TaskManager logs page





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (FLINK-5380) Number of outgoing records not reported in web interface

[Robert Metzger (JIRA)]

Robert Metzger created FLINK-5380:
-

 Summary: Number of outgoing records not reported in web interface
 Key: FLINK-5380
 URL: https://issues.apache.org/jira/browse/FLINK-5380
 Project: Flink
  Issue Type: Bug
  Components: Webfrontend
Affects Versions: 1.2.0
Reporter: Robert Metzger


The web frontend does not report any outgoing records in the web frontend.
The amount of data in MB is reported correctly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release Apache Flink 1.1.4 (RC4)

[Tzu-Li (Gordon) Tai]

+1 (unbinding)

- Assured Kinesis connector works properly across different / older AWS EMR 
versions with simple job (randomly tested in version 5.0.3, 4.8.2, 4.7.2, 4.5)
- Ran Java & Scala quickstart examples (in local IDE mode, cluster mode and 
multi-node cluster)


On December 21, 2016 at 9:38:26 PM, Robert Metzger (rmetz...@apache.org) wrote:

+1 to release.  

I tested the RC with my misbehaved job for a longer period of time, and  
everything went okay (every now and then I had a segfault from rocks).  
I also created a savepoint and restored from it.  
The files in the staging repo look good.  

On Tue, Dec 20, 2016 at 9:43 PM, Stephan Ewen  wrote:  

> +1 from my side  
>  
> - No relevant changes to dependencies (other than minor version bumps)  
> - No updates to LICENSE and NOTICE necessary  
> - Ran a local build on Linux with Hadoop 2.4 and Scala 2.10, all tests  
> pass  
> - Started standalone cluster and ran several examples - log output looks  
> good  
>  
> On Tue, Dec 20, 2016 at 10:44 AM, Gyula Fóra  wrote:  
>  
> > I have built and ran the tests for the latest RC, so I carry my +1 vote  
> > from the previous thread  
> >  
> > Gyula  
> >  
> > Ufuk Celebi  ezt írta (időpont: 2016. dec. 19., H,  
> 16:16):  
> >  
> > > Dear Flink community,  
> > >  
> > > Please vote on releasing the following candidate as Apache Flink  
> version  
> > > 1.1.4.  
> > >  
> > > The commit to be voted on:  
> > > 8fb0fc8 (http://git-wip-us.apache.org/repos/asf/flink/commit/8fb0fc8)  
> > >  
> > > Branch:  
> > > release-1.1.4-rc4  
> > > (  
> > > https://git1-us-west.apache.org/repos/asf/flink/repo?p=flink  
> > .git;a=shortlog;h=refs/heads/release-1.1.4-rc4  
> > > )  
> > >  
> > > The release artifacts to be voted on can be found at:  
> > > http://people.apache.org/~uce/flink-1.1.4-rc4/  
> > >  
> > > The release artifacts are signed with the key with fingerprint  
> 9D403309:  
> > > http://www.apache.org/dist/flink/KEYS  
> > >  
> > > The staging repository for this release can be found at:  
> > > https://repository.apache.org/content/repositories/orgapacheflink-1110  
> > >  
> > > -  
> > >  
> > > The voting time is reduced to at least two days and the vote passes if  
> > > a majority of at least three +1 PMC votes are cast. The vote ends  
> > > earliest on Wednesday, December 21st, 2016, at 4 PM (CET)/7 AM (PST).  
> > >  
> > > I reduced the voting time, because the changes since the last RC are  
> > > minimal. Please object if you are against this and we can extend it to  
> > > the regular three days.  
> > >  
> > > [ ] +1 Release this package as Apache Flink 1.1.4  
> > > [ ] -1 Do not release this package, because ...  
> > >  
> >  
>  

[jira] [Created] (FLINK-5379) Flink CliFrontend does not return when not logged in with kerberos

[Robert Metzger (JIRA)]

Robert Metzger created FLINK-5379:
-

 Summary: Flink CliFrontend does not return when not logged in with 
kerberos
 Key: FLINK-5379
 URL: https://issues.apache.org/jira/browse/FLINK-5379
 Project: Flink
  Issue Type: Bug
  Components: Client
Affects Versions: 1.2.0
Reporter: Robert Metzger


In pre 1.2 versions, Flink immediately fails when trying to deploy it on YARN 
and the current user is not kerberos authenticated:

{code}
Error while deploying YARN cluster: Couldn't deploy Yarn cluster
java.lang.RuntimeException: Couldn't deploy Yarn cluster
at 
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:384)
at 
org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:591)
at 
org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:465)
Caused by: 
org.apache.flink.yarn.AbstractYarnClusterDescriptor$YarnDeploymentException: In 
secure mode. Please provide Kerberos credentials in order to authenticate. You 
may use kinit to authenticate and request a TGT from the Kerberos server.
at 
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:371)
... 2 more
{code}

In 1.2, the following happens:
{code}
2016-12-21 13:51:29,925 INFO  org.apache.hadoop.yarn.client.RMProxy 
- Connecting to ResourceManager at 
my-cluster-2wv1.c.sorter-757.internal/10.240.0.24:8032
2016-12-21 13:51:30,153 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
2016-12-21 13:51:30,154 WARN  org.apache.hadoop.ipc.Client  
- Exception encountered while connecting to the server : 
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: 
No valid credentials provided (Mechanism level: Failed to find any Kerberos 
tgt)]
2016-12-21 13:51:30,154 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate 
failed [Caused by GSSException: No valid credentials provided (Mechanism level: 
Failed to find any Kerberos tgt)]
2016-12-21 13:52:00,171 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
2016-12-21 13:52:00,172 WARN  org.apache.hadoop.ipc.Client  
- Exception encountered while connecting to the server : 
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: 
No valid credentials provided (Mechanism level: Failed to find any Kerberos 
tgt)]
2016-12-21 13:52:00,172 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate 
failed [Caused by GSSException: No valid credentials provided (Mechanism level: 
Failed to find any Kerberos tgt)]
2016-12-21 13:52:30,188 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
2016-12-21 13:52:30,189 WARN  org.apache.hadoop.ipc.Client  
- Exception encountered while connecting to the server : 
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: 
No valid credentials provided (Mechanism level: Failed to find any Kerberos 
tgt)]
2016-12-21 13:52:30,189 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate 
failed [Caused by GSSException: No valid credentials provided (Mechanism level: 
Failed to find any Kerberos tgt)]
2016-12-21 13:53:00,203 WARN  org.apache.hadoop.security.UserGroupInformation   
- PriviledgedActionException as:longrunning (auth:KERBEROS) 
cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
2016-12-21 13:53:00,204 WARN  org.apache.hadoop.ipc.Client  
- Exception encountered while connecting to the 

Re: [VOTE] Release Apache Flink 1.1.4 (RC4)

[Robert Metzger]

+1 to release.

I tested the RC with my misbehaved job for a longer period of time, and
everything went okay (every now and then I had a segfault from rocks).
I also created a savepoint and restored from it.
The files in the staging repo look good.

On Tue, Dec 20, 2016 at 9:43 PM, Stephan Ewen  wrote:

> +1 from my side
>
>   - No relevant changes to dependencies (other than minor version bumps)
>   - No updates to LICENSE and NOTICE necessary
>   - Ran a local build on Linux with Hadoop 2.4 and Scala 2.10, all tests
> pass
>   - Started standalone cluster and ran several examples - log output looks
> good
>
> On Tue, Dec 20, 2016 at 10:44 AM, Gyula Fóra  wrote:
>
> > I have built and ran the tests for the latest RC, so I carry my +1 vote
> > from the previous thread
> >
> > Gyula
> >
> > Ufuk Celebi  ezt írta (időpont: 2016. dec. 19., H,
> 16:16):
> >
> > > Dear Flink community,
> > >
> > > Please vote on releasing the following candidate as Apache Flink
> version
> > > 1.1.4.
> > >
> > > The commit to be voted on:
> > > 8fb0fc8 (http://git-wip-us.apache.org/repos/asf/flink/commit/8fb0fc8)
> > >
> > > Branch:
> > > release-1.1.4-rc4
> > > (
> > > https://git1-us-west.apache.org/repos/asf/flink/repo?p=flink
> > .git;a=shortlog;h=refs/heads/release-1.1.4-rc4
> > > )
> > >
> > > The release artifacts to be voted on can be found at:
> > > http://people.apache.org/~uce/flink-1.1.4-rc4/
> > >
> > > The release artifacts are signed with the key with fingerprint
> 9D403309:
> > > http://www.apache.org/dist/flink/KEYS
> > >
> > > The staging repository for this release can be found at:
> > > https://repository.apache.org/content/repositories/orgapacheflink-1110
> > >
> > > -
> > >
> > > The voting time is reduced to at least two days and the vote passes if
> > > a majority of at least three +1 PMC votes are cast. The vote ends
> > > earliest on Wednesday, December 21st, 2016, at 4 PM (CET)/7 AM (PST).
> > >
> > > I reduced the voting time, because the changes since the last RC are
> > > minimal. Please object if you are against this and we can extend it to
> > > the regular three days.
> > >
> > > [ ] +1 Release this package as Apache Flink 1.1.4
> > > [ ] -1 Do not release this package, because ...
> > >
> >
>

Re: [jira] [Created] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

[Jark Wu]

Hi Sednoh,

It seems that the Travis error has nothing to do with the code you changed. 


- Jark Wu 

> 在 2016年12月21日，下午7:32，Hung Chang  写道：
> 
> Hi Flink developers,
> 
> Travis CI shows error when I send PR
> https://github.com/apache/flink/pull/3036, but I don't find the issue
> reading the log.
> Does anyone know what I should do to fix it?
> 
> test:
> https://travis-ci.org/apache/flink/jobs/185728861
> 
> full log:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/185728861/log.txt
> 
> 
> Best,
> 
> Sednoh
> 
> 
> 
> 
> --
> View this message in context: 
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/jira-Created-FLINK-5368-Let-Kafka-consumer-show-something-when-it-fails-to-read-one-topic-out-of-topt-tp15047p15079.html
> Sent from the Apache Flink Mailing List archive. mailing list archive at 
> Nabble.com.

[jira] [Created] (FLINK-5378) Update Scopt version to 3.5.0

[JIRA]

Lorenz Bühmann created FLINK-5378:
-

 Summary: Update Scopt version to 3.5.0
 Key: FLINK-5378
 URL: https://issues.apache.org/jira/browse/FLINK-5378
 Project: Flink
  Issue Type: Wish
Affects Versions: 1.1.3, 1.2.0, 1.3.0
Reporter: Lorenz Bühmann
Priority: Trivial


Is it possible to increase the Scopt version to 3.5.0? This version does also 
support comma-separated lists of arguments.
I'm using this in my project and indeed I can use Maven to use the latest Scopt 
version. But, once I want to deploy an uber-Jar to Flink, it obviously fails 
because of two different versions of Scopt in the classpath - one in my 
uber-Jar (Scopt 3.5.0) and the one shipped with Flink distribution (Scopt 
3.2.0).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [jira] [Created] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

[Hung Chang]

Hi Flink developers,

Travis CI shows error when I send PR
https://github.com/apache/flink/pull/3036, but I don't find the issue
reading the log.
Does anyone know what I should do to fix it?

test:
https://travis-ci.org/apache/flink/jobs/185728861

full log:
https://s3.amazonaws.com/archive.travis-ci.org/jobs/185728861/log.txt


Best,

Sednoh




--
View this message in context: 
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/jira-Created-FLINK-5368-Let-Kafka-consumer-show-something-when-it-fails-to-read-one-topic-out-of-topt-tp15047p15079.html
Sent from the Apache Flink Mailing List archive. mailing list archive at 
Nabble.com.

[jira] [Created] (FLINK-5377) Improve savepoint docs

[Ufuk Celebi (JIRA)]

Ufuk Celebi created FLINK-5377:
--

 Summary: Improve savepoint docs
 Key: FLINK-5377
 URL: https://issues.apache.org/jira/browse/FLINK-5377
 Project: Flink
  Issue Type: Improvement
  Components: Documentation
Affects Versions: 1.1.3, 1.2.0
Reporter: Ufuk Celebi
Assignee: Ufuk Celebi


The savepoint docs are very detailed and focus on the internals. They should 
better convey what users have to take care of.

The following questions should be answered:
What happens if I add a new operator that requires state to my flow?
What happens if I delete an operator that has state to my flow?
What happens if I reorder stateful operators in my flow?
What happens if I add or delete or reorder operators that have no state in my 
flow?
Should I apply .uid to all operators in my flow?
Should I apply .uid to only the operators that have state?




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Stream Iterations

[Ufuk Celebi]

The delta iterations are a batch-only feature.

Did you try the DataStream#iterate?

https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/streaming/index.html#iterations

On Mon, Dec 19, 2016 at 5:35 AM, Govindarajan Srinivasaraghavan
 wrote:
> Hi All,
>
> I have a use case for which I need some suggestions. It's a streaming
> application with kafka source and then groupBy, keyBy and perform some
> calculations. The output of each calculation has to be a side input for the
> next calculation and also it needs to be sent to a sink.
>
> Right now I'm achieving this by storing the result state in memory and also
> save it in redis cache. I was looking at delta iterations in flink
> documentation. It would great if someone can help me understand if I can
> achieve this using iterations or any other api. Thanks in advance.
>
> Regards,
> Govind