[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293217#comment-14293217 ]
ASF GitHub Bot commented on FLINK-377: -------------------------------------- Github user zentol commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-71611872 Tests run on travis (they don't right now because fabian merged something that changes the CSVInputFormat constructor, which breaks stuff on my end) but see: https://travis-ci.org/zentol/incubator-flink/jobs/48334902 and search for "Running org.apache.flink.languagebinding.api.java.python.PythonPlanBinderTest" putting it under flink-python means splitting it from the generic interface, right? that would be necessary in the long run anyway, so I'm all for it. @dan-blanchard the generic interface is not just for python. it does reduce the amount of code you have to write in java by a pretty high amount. but It sets up some requirements, most prominently example support for binary data, memory-mapped files and sockets, though it would be possible to provide different options here. It is difficult for me to assess how difficult it would be; the generic and python part were coded and evolved simultaneously, and when something didn't fit i could just change it to do so. I think it's very likely that when someone wants to add another language we'll have to revisit a few things, but it provides at a good starting point. > Create a general purpose framework for language bindings > -------------------------------------------------------- > > Key: FLINK-377 > URL: https://issues.apache.org/jira/browse/FLINK-377 > Project: Flink > Issue Type: Improvement > Reporter: GitHub Import > Labels: github-import > Fix For: pre-apache > > > A general purpose API to run operators with arbitrary binaries. > This will allow to run Stratosphere programs written in Python, JavaScript, > Ruby, Go or whatever you like. > We suggest using Google Protocol Buffers for data serialization. This is the > list of languages that currently support ProtoBuf: > https://code.google.com/p/protobuf/wiki/ThirdPartyAddOns > Very early prototype with python: > https://github.com/rmetzger/scratch/tree/learn-protobuf (basically testing > protobuf) > For Ruby: https://github.com/infochimps-labs/wukong > Two new students working at Stratosphere (@skunert and @filiphaase) are > working on this. > The reference binding language will be for Python, but other bindings are > very welcome. > The best name for this so far is "stratosphere-lang-bindings". > I created this issue to track the progress (and give everybody a chance to > comment on this) > ---------------- Imported from GitHub ---------------- > Url: https://github.com/stratosphere/stratosphere/issues/377 > Created by: [rmetzger|https://github.com/rmetzger] > Labels: enhancement, > Assignee: [filiphaase|https://github.com/filiphaase] > Created at: Tue Jan 07 19:47:20 CET 2014 > State: open -- This message was sent by Atlassian JIRA (v6.3.4#6332)