+1 as well and nice catch with the exception.
On 03 Nov 2014, at 14:32, Aljoscha Krettek wrote:
> +1
>
> Yes, this seems like a very good idea and the Environment is very
> lightweight, so this would not worsen performance.
>
> On Mon, Nov 3, 2014 at 11:19 PM, Stephan Ewen wrote:
>> We implem
+1
Yes, this seems like a very good idea and the Environment is very
lightweight, so this would not worsen performance.
On Mon, Nov 3, 2014 at 11:19 PM, Stephan Ewen wrote:
> We implement the "context dependent switching" of the execution
> environments (cluster / local / test) with static varia
Stephan Ewen created FLINK-1207:
---
Summary: Switch ContextEnvironment to Environment factory
Key: FLINK-1207
URL: https://issues.apache.org/jira/browse/FLINK-1207
Project: Flink
Issue Type: Bug
We implement the "context dependent switching" of the execution
environments (cluster / local / test) with static variables in the
ExecutionEnvironment.
That means that these environments are potentially shared between multiple
threads that run programs (also in case where they run one after the o
Stephan Ewen created FLINK-1206:
---
Summary: Add option to the web client to specify default
parallelism for a program
Key: FLINK-1206
URL: https://issues.apache.org/jira/browse/FLINK-1206
Project: Flink
Stephan Ewen created FLINK-1205:
---
Summary: LibraryCacheManager should track execution IDs of library
registrations
Key: FLINK-1205
URL: https://issues.apache.org/jira/browse/FLINK-1205
Project: Flink
Márton Balassi created FLINK-1204:
-
Summary: Fix streaming example builds to provide self-contained
jars
Key: FLINK-1204
URL: https://issues.apache.org/jira/browse/FLINK-1204
Project: Flink
Dear podling,
This email was sent by an automated system on behalf of the Apache Incubator
PMC.
It is an initial reminder to give you plenty of time to prepare your quarterly
board report.
The board meeting is scheduled for Wed, 19 November 2014, 10:30 am PST. The
report
for your podling wil
Stephan Ewen created FLINK-1203:
---
Summary: ClassCast exceptions in parallel tests (Surefire Bug?)
Key: FLINK-1203
URL: https://issues.apache.org/jira/browse/FLINK-1203
Project: Flink
Issue Type
Hey,
I have made a small prototype for a map-operator
env.fromElements(1, 2, 3)
.map((i) -> new Tuple2()).returns("Tuple2")
.print();
you can find my solution here:
https://github.com/twalthr/incubator-flink/commit/3ce2d3c86cf2457e02986f7a2d858304bbefea58
Actually, I like this solution mos
Thanks for the detailed answer. So if I run a job from my machine I'll have
to download all the scanned data in a table..right?
Always regarding the GenericTableOutputFormat it is not clear to me how to
proceed..
I saw in the hadoop compatibility addon that it is possible to have such
compatibilit
Hi Flavio
let me try to answer your last question on the user's list (to the best of
my HBase knowledge).
"I just wanted to known if and how regiom splitting is handled. Can you
explain me in detail how Flink and HBase works?what is not fully clear to
me is when computation is done by region serve
Stephan Ewen created FLINK-1202:
---
Summary: Failed file outputs should remove partially complete files
Key: FLINK-1202
URL: https://issues.apache.org/jira/browse/FLINK-1202
Project: Flink
Issue
Hi!
The way of passing parameters through the configuration is very old (the
original HBase format dated back to that time). I would simply make the
HBase format take those parameters through the constructor.
Greetings,
Stephan
On Mon, Nov 3, 2014 at 10:59 AM, Flavio Pompermaier
wrote:
> The
The problem is that I also removed the GenericTableOutputFormat because
there is an incompatibility between hadoop1 and hadoop2 for class
TaskAttemptContext and TaskAttemptContextImpl..
then it would be nice if the user doesn't have to worry about passing
pact.hbase.jtkey and pact.job.id parameters
Kostas Tzoumas created FLINK-1201:
-
Summary: Graph API for Flink
Key: FLINK-1201
URL: https://issues.apache.org/jira/browse/FLINK-1201
Project: Flink
Issue Type: New Feature
Repo
It is fine to remove it, in my opinion.
On Mon, Nov 3, 2014 at 10:11 AM, Flavio Pompermaier
wrote:
> That is one class I removed because it was using the deprecated API
> GenericDataSink..I can restore them but the it will be a good idea to
> remove those warning (also because from what I unders
That is one class I removed because it was using the deprecated API
GenericDataSink..I can restore them but the it will be a good idea to
remove those warning (also because from what I understood the Record APIs
are going to be removed).
On Mon, Nov 3, 2014 at 9:51 AM, Fabian Hueske wrote:
> I'm
Hi Flavio!
The link is broken, but it is also part of the outdates docs.
The current ones are the 0.7 docs under
http://flink.incubator.apache.org/docs/0.7-incubating/
Stephan
On Mon, Nov 3, 2014 at 9:55 AM, Fabian Hueske wrote:
> There is no HBaseOutputFormat (and nothing equivalent) as far
There is no HBaseOutputFormat (and nothing equivalent) as far as I can see.
The only thing we had was the GenericTableOutputFormat which was
implemented against the deprecated Java Record API.
We would need to adapt the GenericTableOutputFormat to the new API.
2014-11-03 9:51 GMT+01:00 Fabian Hues
Ah, sorry. That's the one you removed ;-)
2014-11-03 9:51 GMT+01:00 Fabian Hueske :
> I'm not familiar with the HBase connector code, but are you maybe looking
> for the GenericTableOutputFormat?
>
> 2014-11-03 9:44 GMT+01:00 Flavio Pompermaier :
>
>> | was trying to modify the example setting hb
I'm not familiar with the HBase connector code, but are you maybe looking
for the GenericTableOutputFormat?
2014-11-03 9:44 GMT+01:00 Flavio Pompermaier :
> | was trying to modify the example setting hbaseDs.output(new
> HBaseOutputFormat()); but I can't see any HBaseOutputFormat class..maybe we
| was trying to modify the example setting hbaseDs.output(new
HBaseOutputFormat()); but I can't see any HBaseOutputFormat class..maybe we
shall use another class?
On Mon, Nov 3, 2014 at 9:39 AM, Flavio Pompermaier
wrote:
> Maybe that's something I could add to the HBase example and that could be
Maybe that's something I could add to the HBase example and that could be
better documented in the Wiki.
Since we're talking about the wiki..I was looking at the Java API (
http://flink.incubator.apache.org/docs/0.6-incubating/java_api_guide.html)
and the link to the KMeans example is not working
Ah ok, perfect! That was the reason why I removed it :)
On Mon, Nov 3, 2014 at 9:10 AM, Stephan Ewen wrote:
> You do not really need a HBase data sink. You can call "DataSet.output(new
> HBaseOutputFormat())"
>
> Stephan
> Am 02.11.2014 23:05 schrieb "Flavio Pompermaier" :
>
> > Just one last th
You do not really need a HBase data sink. You can call "DataSet.output(new
HBaseOutputFormat())"
Stephan
Am 02.11.2014 23:05 schrieb "Flavio Pompermaier" :
> Just one last thing..I removed the HbaseDataSink because I think it was
> using the old APIs..can someone help me in updating that class?
>
26 matches
Mail list logo
