Although you run
`ds.map(blahblah).sortPartition(blahblah).mapPartition(blahblah).distinct()`,
DataSet ds is not changed.
You should receive the result of transformation.
So if you modify the code to `intermediateResult = blahblah; result =
intermediateResult.collect();`, the test works.
Regar
No worries! Thanks for @Stephan for catching it =)
- Henry
On Tue, Jun 23, 2015 at 6:36 AM, Maximilian Michels wrote:
> Ah yes, thanks for correcting, Stephan. Sorry for overlooking you, Henry.
>
> On Tue, Jun 23, 2015 at 3:31 PM, Stephan Ewen wrote:
>
>> I think you forgot Henry's vote.
>>
>>
Hi,
I worked on rewriting flink-test according to
https://issues.apache.org/jira/browse/FLINK-2275
In "org.apache.flink.test.javaApiOperators.SortPartitionITCase" I hit
something strange. When I rewrite the code slightly differently, the
test passes or fails and I have no idea why.
The following
Matthias J. Sax created FLINK-2275:
--
Summary: Migrate test from package
'org.apache.flink.test.javaApiOperators'
Key: FLINK-2275
URL: https://issues.apache.org/jira/browse/FLINK-2275
Project: Flink
Hi.
FLINK-2021 and FLINK-2066 are good issue to start contributing to Flink. :)
You can choose any issues which you want.
If you want contribute the issues, assign the issues to you in JIRA. If you
don’t have permission,
just comment in JIRA, then we’ll give the permission to you.
As you know,
Hi Ufuk.
Thanks for the welcome! I have also checked those pages and will revisit
them until it is carved into my brain. :)
I found a couple of issues that seem to be a good shot, namely:
https://issues.apache.org/jira/browse/FLINK-2066
https://issues.apache.org/jira/browse/FLINK-2021
Theodore Vasiloudis created FLINK-2274:
--
Summary: Add a histogram method for DataSet[Double] in DataSetUtils
Key: FLINK-2274
URL: https://issues.apache.org/jira/browse/FLINK-2274
Project: Flink
Till Rohrmann created FLINK-2273:
Summary: Register special Writable Kryo serializer
Key: FLINK-2273
URL: https://issues.apache.org/jira/browse/FLINK-2273
Project: Flink
Issue Type: Improveme
+1
On Tue, Jun 23, 2015 at 3:16 PM, Robert Metzger wrote:
> +1
>
>
>
> On Tue, Jun 23, 2015 at 11:31 AM, Fabian Hueske wrote:
>
> > +1
> >
> > 2015-06-22 17:44 GMT+02:00 Stephan Ewen :
> >
> > > +1
> > >
> > > On Fri, Jun 19, 2015 at 10:48 AM, Matthias J. Sax <
> > > mj...@informatik.hu-berlin.
The Apache Flink community is pleased to announce the availability of the
0.9.0 release.
Apache Flink is an open source platform for scalable batch and stream data
processing. Flink’s core consists of a streaming dataflow engine that
provides data distribution, communication, and fault tolerance f
We should ping the Zeppelin guys to update their Flink dependency.
On Wed, Jun 24, 2015 at 2:34 PM, Maximilian Michels wrote:
> I'm so happy we have pushed it out :) It took a while but I think we can be
> very pleased with the result.
>
> I will post an announcement to the user/dev and the Apac
I'm so happy we have pushed it out :) It took a while but I think we can be
very pleased with the result.
I will post an announcement to the user/dev and the Apache announce mailing
list.
On Wed, Jun 24, 2015 at 2:26 PM, Chiwan Park wrote:
> Great! We should post the announcement mail to user m
We were experiencing different kinds of issues with Flink on Hadoop 2.4. When
rebuilding Flink with Hadoop 2.4 dependencies all issues went away. Would be
great if one could download binaries for different hadoop versions.
--
View this message in context:
http://apache-flink-mailing-list-archi
Great! We should post the announcement mail to user mailing list :)
Regards,
Chiwan Park
> On Jun 24, 2015, at 9:22 PM, Stephan Ewen wrote:
>
> Great that this release is out, finally :-)
>
> On Wed, Jun 24, 2015 at 2:19 PM, Maximilian Michels wrote:
>
>> I've published the announcement:
>>
Great that this release is out, finally :-)
On Wed, Jun 24, 2015 at 2:19 PM, Maximilian Michels wrote:
> I've published the announcement:
>
> http://flink.apache.org/news/2015/06/24/announcing-apache-flink-0.9.0-release.html
>
> Let me know if anything is not right. Otherwise, please spread the
Are you sure that the plugin dependencies are of type jar and not of type
bundle?
I remember that eclipse projects that are OSGI plugins are not managed as a
normal jar by maven usually..
On Wed, Jun 24, 2015 at 1:45 PM, santosh_rajaguru wrote:
> Yes, i am packaging all the dependencies to a Fat
I've published the announcement:
http://flink.apache.org/news/2015/06/24/announcing-apache-flink-0.9.0-release.html
Let me know if anything is not right. Otherwise, please spread the word!
Cheers,
Max
On Wed, Jun 24, 2015 at 1:59 PM, Maximilian Michels wrote:
> Thanks for your feedback. We man
Thanks for your feedback. We managed to improve the initial document quite
a bit. The thing about the known issues is that it might give a false
impression to people reading the release announcement because the real
issues we are working on, can hardly be summarized by a couple of JIRA
issues. Of c
Theodore Vasiloudis created FLINK-2272:
--
Summary: Move vision and roadmap for FlinkML from docs to the wiki
Key: FLINK-2272
URL: https://issues.apache.org/jira/browse/FLINK-2272
Project: Flink
+1 for the different Hadoop versions.
For the version without Hadoop binaries we should check whether the Hadoop
interfaces are compatible across the different versions. But if this is the
case, then also +1 for that.
On Wed, Jun 24, 2015 at 12:14 PM, Stephan Ewen wrote:
> big +1 from me as wel
Yes, i am packaging all the dependencies to a Fat jar.
--
View this message in context:
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Running-Flink-Job-with-dependencies-tp6653p6669.html
Sent from the Apache Flink Mailing List archive. mailing list archive at
Nabble.com.
Hi,
thank you Max for the nice document!
Can we please add FLINK-2271 to the list of known issues?
-Vasia.
On 24 June 2015 at 13:08, Stephan Ewen wrote:
> I like the announcement now.
>
> Would like to add a note to Gelly and Flink ML that these are early
> versions of the libraries, that they
+1, if users require it it is serious
On Wed, 24 Jun 2015 at 12:14 Stephan Ewen wrote:
> big +1 from me as well!
>
> On Wed, Jun 24, 2015 at 12:05 PM, Ufuk Celebi wrote:
>
> > I think this is a very good idea and very urgent (because of the issues
> > you outlined and for the user experience of
Vasia Kalavri created FLINK-2271:
Summary: PageRank gives wrong results with weighted graph input
Key: FLINK-2271
URL: https://issues.apache.org/jira/browse/FLINK-2271
Project: Flink
Issue Ty
I like the announcement now.
Would like to add a note to Gelly and Flink ML that these are early
versions of the libraries, that they are subject to changes and not yet
performance optimized.
On Wed, Jun 24, 2015 at 1:07 PM, Stephan Ewen wrote:
> I reworked the text on streaming fault tolerance
I reworked the text on streaming fault tolerance.
I think the release announcement needs to be about the core
points/improvements, rather than have many exact details. We post a link
for details for those interested in the details.
On Wed, Jun 24, 2015 at 11:32 AM, Aljoscha Krettek
wrote:
> I
Stephan Ewen created FLINK-2270:
---
Summary: Error in KafkaSource Documentation
Key: FLINK-2270
URL: https://issues.apache.org/jira/browse/FLINK-2270
Project: Flink
Issue Type: Bug
Comp
big +1 from me as well!
On Wed, Jun 24, 2015 at 12:05 PM, Ufuk Celebi wrote:
> I think this is a very good idea and very urgent (because of the issues
> you outlined and for the user experience of *not* having to compile your
> own version). Big +1.
>
> On 24 Jun 2015, at 11:45, Robert Metzger
This looks like the Eclipse classes are not part of the JAR. Are you
packing a fat JAR, or do you put the Eclipse dependencies in the classpath?
On Wed, Jun 24, 2015 at 11:53 AM, Robert Metzger
wrote:
> Maybe you have to provide the name of the main class with the "-c" command:
> ./bin/flink run
I think this is a very good idea and very urgent (because of the issues you
outlined and for the user experience of *not* having to compile your own
version). Big +1.
On 24 Jun 2015, at 11:45, Robert Metzger wrote:
> Hi,
>
> I am aware of at least two Flink users which were facing various iss
Maybe you have to provide the name of the main class with the "-c" command:
./bin/flink run -c my.package.Class
wrote:
> Hi,
>
> I am trying to run a Flink job, which uses the eclipse extension mechanism,
> from command prompt as well as from the webclient. The job runs
> successfully
> from ecli
Theodore Vasiloudis created FLINK-2269:
--
Summary: Add Receiver operating characteristic (ROC) curve
evaluation
Key: FLINK-2269
URL: https://issues.apache.org/jira/browse/FLINK-2269
Project: Flink
Hi,
I am aware of at least two Flink users which were facing various issues
with HDFS when using Flink.
*Issues observed:*
- HDFS client trying to connect to the standby Namenode
"org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException):
Operation category READ is not support
Robert Metzger created FLINK-2268:
-
Summary: Provide Flink binary release without Hadoop
Key: FLINK-2268
URL: https://issues.apache.org/jira/browse/FLINK-2268
Project: Flink
Issue Type: Impro
Theodore Vasiloudis created FLINK-2267:
--
Summary: Support multi-class scoring for binary classification
scores
Key: FLINK-2267
URL: https://issues.apache.org/jira/browse/FLINK-2267
Project: Flink
I fixed a typo in the state checkpoint text: "In case *of *recovery".
On Wed, 24 Jun 2015 at 10:34 Maximilian Michels wrote:
> Thanks for your contributions. Now that the release artifacts are published
> on the Maven repositories, I would like to get out the release
> announcement. If nobody ha
Hi,
I am trying to run a Flink job, which uses the eclipse extension mechanism,
from command prompt as well as from the webclient. The job runs successfully
from eclipse as a java application when i configure the classpath to include
the dependencies.
However, how to do that while running from web
Thanks for reply Ufuk.
After a full redeployment, meaning copying all the build-target folder
instead of just updating the build-target/lib folder on the workers,
the problem disappeared.
I have concluded from experience that any change involving
serialization of objects has implications beyond
Robert Metzger created FLINK-2266:
-
Summary: Building Flink for a specific HDP version fails
Key: FLINK-2266
URL: https://issues.apache.org/jira/browse/FLINK-2266
Project: Flink
Issue Type: B
Thanks for your contributions. Now that the release artifacts are published
on the Maven repositories, I would like to get out the release
announcement. If nobody has anything to add, I will do a final pass and
publish the announcement.
On Tue, Jun 23, 2015 at 3:22 PM, Stephan Ewen wrote:
> I al
Stephan Ewen created FLINK-2265:
---
Summary: Tachyon Tests sometimes fail with pre-mature process
exists
Key: FLINK-2265
URL: https://issues.apache.org/jira/browse/FLINK-2265
Project: Flink
Issu
I agree lets separate these topics from each other so we can get faster
resolution.
There is already a state discussion in the thread we started with Paris.
On Wed, Jun 24, 2015 at 9:24 AM Kostas Tzoumas wrote:
> I agree with supporting out-of-order out of the box :-), even if this means
> a ma
I agree with supporting out-of-order out of the box :-), even if this means
a major refactoring. This is the right time to refactor the streaming API
before we pull it out of beta. I think that this is more important than new
features in the streaming API, which can be prioritized once the API is o
43 matches
Mail list logo
