Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Flavio Pompermaier
probably I can't test that before Tuesday..I think we can talk about that at the Berlin meeting if you cannot debug it :/ On Nov 14, 2014 11:41 PM, "Stephan Ewen" wrote: > Hi! > > I still believe it is an issue of the class loader. To test that, can you > remove the HBase jar file from the Flink

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Stephan Ewen
Hi! I still believe it is an issue of the class loader. To test that, can you remove the HBase jar file from the Flink lib directory, and make it part of the job jar? (Either as a fat jar, or by creating a "lib" folder inside your job jar file and putting the hbase.jar into that folder) That way

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Flavio Pompermaier
I think that it's not standard..usually you need to specify the table name but everything in *-site.xml files should be automatically load at runtime as for all other framework like mapreduce or spark. Don't you think?why Flink behaves differently within the configure method? On Nov 14, 2014 9:26 P

[jira] [Created] (FLINK-1245) Introduce TypeHints for Java API operators

2014-11-14 Thread Timo Walther (JIRA)
Timo Walther created FLINK-1245: --- Summary: Introduce TypeHints for Java API operators Key: FLINK-1245 URL: https://issues.apache.org/jira/browse/FLINK-1245 Project: Flink Issue Type: Improvemen

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Aljoscha Krettek
I like :D On Fri, Nov 14, 2014 at 3:39 PM, Hermann Gábor wrote: > Congratulations, Vasia! :) > > On Fri, Nov 14, 2014 at 3:31 PM, Vasiliki Kalavri > wrote: > >> Thank you everyone! It's a great honor :)) I'm very happy ^^ >> >> On 14 November 2014 15:03, Stephan Ewen wrote: >> >> > Nice to have

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Fabian Hueske
What exactly is required to configure the TableInputFormat? Would it be easier and more flexible to just set the hostname of the HBase master, the table name, etc, directly as strings in the InputFormat? 2014-11-14 15:34 GMT+01:00 Flavio Pompermaier : > Both from shell with run command and from w

Re: [flink-graph] Tests failing on Windows

2014-11-14 Thread Markus Holzemer
Hi, usually the Windows Tests fail because some file URIs are hard-coded in Linux style. Perhaps you can do a quick fix yourself otherwise I can have a look at the issue as soon as I find the time. Best, Markus Am 14.11.2014 10:16 schrieb "Dániel Bali" : > Hi! > > It's the snapshot version. > > R

Re: [flink-graph] Tests failing on Windows

2014-11-14 Thread Dániel Bali
Hi! It's the snapshot version. Regards, Daniel 2014-11-14 18:09 GMT+01:00 Stephan Ewen : > Hi! > > Just to make sure: The latest version means the latest snapshot version > (0.8-incubating-SNAPSHOT), or the latest release version (0.7.0) ? > > Stephan > > > On Fri, Nov 14, 2014 at 5:48 PM, Dáni

Re: [flink-graph] Tests failing on Windows

2014-11-14 Thread Stephan Ewen
Hi! Just to make sure: The latest version means the latest snapshot version (0.8-incubating-SNAPSHOT), or the latest release version (0.7.0) ? Stephan On Fri, Nov 14, 2014 at 5:48 PM, Dániel Bali wrote: > Hello! > > I have a fork of flink-graph >

[flink-graph] Tests failing on Windows

2014-11-14 Thread Dániel Bali
Hello! I have a fork of flink-graph and some of the tests fail on Windows, even though they pass on Ubuntu. Is there anybody using Flink on Windows who could take a look at this? The test that fails is TestMapVertices. The first 2 cases always pass a

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Hermann Gábor
Congratulations, Vasia! :) On Fri, Nov 14, 2014 at 3:31 PM, Vasiliki Kalavri wrote: > Thank you everyone! It's a great honor :)) I'm very happy ^^ > > On 14 November 2014 15:03, Stephan Ewen wrote: > > > Nice to have you on board, Vasia! > > > > On Fri, Nov 14, 2014 at 3:01 PM, Fabian Hueske >

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Flavio Pompermaier
Both from shell with run command and from web client On Nov 14, 2014 2:32 PM, "Fabian Hueske" wrote: > > In this case, the initialization happens when the InputFormat is > instantiated at the submission client and the Table info is serialized as > part of the InputFormat and shipped out to all Tas

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Vasiliki Kalavri
Thank you everyone! It's a great honor :)) I'm very happy ^^ On 14 November 2014 15:03, Stephan Ewen wrote: > Nice to have you on board, Vasia! > > On Fri, Nov 14, 2014 at 3:01 PM, Fabian Hueske wrote: > > > Welcome Vasia! Great to have you in the team! :-) > > > > 2014-11-14 14:57 GMT+01:00 Ch

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Stephan Ewen
Nice to have you on board, Vasia! On Fri, Nov 14, 2014 at 3:01 PM, Fabian Hueske wrote: > Welcome Vasia! Great to have you in the team! :-) > > 2014-11-14 14:57 GMT+01:00 Chiwan Park : > > > Congrats, Vasia!! > > > > — > > Chiwan Park (Sent with iPhone) > > > > > On Nov 14, 2014, at 10:52 PM, Ko

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Fabian Hueske
Welcome Vasia! Great to have you in the team! :-) 2014-11-14 14:57 GMT+01:00 Chiwan Park : > Congrats, Vasia!! > > — > Chiwan Park (Sent with iPhone) > > > On Nov 14, 2014, at 10:52 PM, Kostas Tzoumas > wrote: > > > > Hi everyone, > > > > In the PPMC we have voted to add Vasia Kalavri as a new c

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Chiwan Park
Congrats, Vasia!! — Chiwan Park (Sent with iPhone) > On Nov 14, 2014, at 10:52 PM, Kostas Tzoumas wrote: > > Hi everyone, > > In the PPMC we have voted to add Vasia Kalavri as a new committer to Flink. > > Vasia, welcome! > > Kostas

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Gyula Fora
Congrats and welcome! :) > On 14 Nov 2014, at 14:52, Kostas Tzoumas wrote: > > Hi everyone, > > In the PPMC we have voted to add Vasia Kalavri as a new committer to Flink. > > Vasia, welcome! > > Kostas

AW: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Markl, Volker, Prof. Dr.
Congrats, Vasia! -Ursprüngliche Nachricht- Von: Kostas Tzoumas [mailto:ktzou...@apache.org] Gesendet: Freitag, 14. November 2014 14:53 An: dev@flink.incubator.apache.org Betreff: [ANNOUNCE] Welcome Vasia Kalavri as a new committer Hi everyone, In the PPMC we have voted to add Vasia Kal

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Sebastian Schelter
Well deserved, welcome!!! On 11/14/2014 02:52 PM, Kostas Tzoumas wrote: Hi everyone, In the PPMC we have voted to add Vasia Kalavri as a new committer to Flink. Vasia, welcome! Kostas

[ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Kostas Tzoumas
Hi everyone, In the PPMC we have voted to add Vasia Kalavri as a new committer to Flink. Vasia, welcome! Kostas

Re: Flink Maven Configuration

2014-11-14 Thread Stephan Ewen
I think that basically destroys the guava shading, because the guava classes are not in "com.google.guava", rather than in "com.google.common" and "com.google.thirdparty"... The excludes you defined refer to what code goes into the shaded jar, not what is relocated. If you define the excludes in t

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Fabian Hueske
In this case, the initialization happens when the InputFormat is instantiated at the submission client and the Table info is serialized as part of the InputFormat and shipped out to all TaskManagers for execution. However, if the initialization is done within configure it happens on each TaskManage

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Flavio Pompermaier
The strange thing us that everything works if I create HTable outside configure().. On Nov 14, 2014 10:32 AM, "Stephan Ewen" wrote: > I think that this is a case where the wrong classloader is used: > > If the HBase classes are part of the flink lib directory, they are loaded > with the system cl

Re: Flink Maven Configuration

2014-11-14 Thread Sebastian Kunert
Thanks for your answer. I did already take a look at the documentation. We have the following code snippet in our pom in flink-shade. com.google.guava:guava com.google org.apache.flink.shaded.com.google I first thought that the includes specify a whitelist of the packages to be relocated

[jira] [Created] (FLINK-1244) setCombinable() clunky to use

2014-11-14 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1244: --- Summary: setCombinable() clunky to use Key: FLINK-1244 URL: https://issues.apache.org/jira/browse/FLINK-1244 Project: Flink Issue Type: Wish

Re: HBase 0.98 addon for Flink 0.8

2014-11-14 Thread Stephan Ewen
I think that this is a case where the wrong classloader is used: If the HBase classes are part of the flink lib directory, they are loaded with the system class loader. When they look for anything in the classpath, they will do so with the system classloader. You configuration is in the user code

Re: Flink Maven Configuration

2014-11-14 Thread Stephan Ewen
Hey Sebastian! I think there are two approaches: - You can either shade the protobuf Classes as well - or you can exclude the ptotobuf namespace from shading. Have a look at the shade plugin docs. Stephan Am 14.11.2014 09:49 schrieb "Sebastian Kunert" : > Hi Guys, > > I am currently worki

Flink Maven Configuration

2014-11-14 Thread Sebastian Kunert
Hi Guys, I am currently working on integrating Flink with Mesos. Therefore I currently reuse the flink-yarn uberjar assembly to build a jar that contains all the classes I need. Now I have a dependency on a Google Protobuf class. I added protobuf as a dependency to my module and it is also contain