Hi Flavio,
thanks for your help. With Flink 1.2.0 and avro 1.8.1 it works fine for me too
as long as I run it from the IDE. As soon as I submit it as a job to the
cluster I get the described dependency issues.
* If I use the Flink 1.2.0 binary and just add Flink as a Maven dependency to
my pro
Hi Lukas,
a colleague of mine issued a PR to update the code of that example (
https://github.com/FelixNeutatz/parquet-flinktacular/pull/2).
We updated avro to 1.8.1 and the example worked fine (we didn't test on the
cluster yet).
Let me know if it does help..
Best,
Flavio
On Tue, Apr 25, 2017 a
Thanks for your suggestions.
@Flavio
This is very similar to the code I use and yields basically the same problems.
The examples are based on flink-1.0-SNAPSHOT and avro-1.7.6. which is more than
three years old. Do you have a working setup with newer version of avro and
flink?
@Jörn
I tried t
I started from this guide:
https://github.com/FelixNeutatz/parquet-flinktacular
Best,
Flavio
On 24 Apr 2017 6:36 pm, "Jörn Franke" wrote:
> Why not use a parquet only format? Not sure why you need an
> avtoparquetformat.
>
> On 24. Apr 2017, at 18:19, Lukas Kircher
> wrote:
>
> Hello,
>
> I a
Why not use a parquet only format? Not sure why you need an avtoparquetformat.
> On 24. Apr 2017, at 18:19, Lukas Kircher
> wrote:
>
> Hello,
>
> I am trying to read Parquet files from HDFS and having problems. I use Avro
> for schema. Here is a basic example:
>
> public static void main(Str
Hello,
I am trying to read Parquet files from HDFS and having problems. I use Avro for
schema. Here is a basic example:
public static void main(String[] args) throws Exception {
ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
Job job = Job.getInstance();
H
