[
https://issues.apache.org/jira/browse/PARQUET-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Udit Joshi updated PARQUET-1587:
--------------------------------
Description:
*Problem :-* Parquet Writer doesn't support to write list of Groups directly
into hadoop.
Cause of Problem :- Suitable classes are not available
Constructors are not visible
*All possible solution which i tried -*
* ParquetWriter
* ParquetFileWriter
* ExampleParquetWriter
* ParquetRecordWriter
*Gradle dependency*
{quote}compile group: 'org.apache.parquet', name: 'parquet-hadoop', version:
'1.10.1'
{quote}
*Is there any way to writer parquet file into Hadoop with GroupSupport?*
*Problem description*
I am trying to create the object of {color:#d04437}ParquetWriter{color} class
which accepts the argument (OutputFile, Mode, WriteSupport,
CompressionCodecName, int, boolean, Configuration, int, ParquetProperties). But
this constructor has default access modifier. I can't able to access it.
I also used {color:#d04437}ParquetFileWriter{color} class but it doesn't show
any group support.
{color:#205081}*ParquetWriter*{color}
*!image-2019-05-31-10-41-45-674.png!*
*{color:#205081}ParquetFileWriter{color}*
{code:java}
ParquetFileWriter writer = new
ParquetFileWriter(HadoopOutputFile.fromPath(writePathFile, configuration),
schema, Mode.CREATE, DEFAULT_BLOCK_SIZE, MAX_PADDING_SIZE_DEFAULT) ;
writer.start();{code}
It creates to create parquet file in hadoop but can't facilitates to write
List of Groups in parquet file
*{color:#205081}ExampleParquetWriter{color}*
{code:java}
ParquetWriter<Group> writer =
ExampleParquetWriter.builder(writePathFile).withConf(configuration).withType(getSchema()).build();
System.out.println("Number of groups to write:" + groups.size());
for (Group g : groups) {
writer.write(g);
} {code}
Doesn't support for writing parquet file in hadoop
was:
*Problem :-*
I am trying to create the object of {color:#d04437}ParquetWriter{color} class
which accepts the argument (OutputFile, Mode, WriteSupport,
CompressionCodecName, int, boolean, Configuration, int, ParquetProperties). But
this constructor has default access modifier. I can't able to access it.
I also used {color:#d04437}ParquetFileWriter{color} class but it doesn't show
any group support.
*Gradle dependency*
{quote}compile group: 'org.apache.parquet', name: 'parquet-hadoop', version:
'1.10.1'
{quote}
*Is there any way to writer parquet file into Hadoop with GroupSupport?*
*ParquetWriter*
*!image-2019-05-31-10-41-45-674.png!*
ParquetFileWriter
{code:java}
ParquetFileWriter writer = new
ParquetFileWriter(HadoopOutputFile.fromPath(writePathFile, configuration),
schema, Mode.CREATE, DEFAULT_BLOCK_SIZE, MAX_PADDING_SIZE_DEFAULT) ;
writer.start();{code}
It creates the file in parquet file in hadoop but can't facilates to write
List of Groups in parquet file
ExampleParquetWriter
{code:java}
ParquetWriter<Group> writer =
ExampleParquetWriter.builder(writePathFile).withConf(configuration).withType(getSchema()).build();
System.out.println("Number of groups to write:" + groups.size());
for (Group g : groups) {
writer.write(g);
} {code}
Doesn't support for writing in hadoop
> Parquet Writer doesn't support to write list of Groups directly into hadoop
> ---------------------------------------------------------------------------
>
> Key: PARQUET-1587
> URL: https://issues.apache.org/jira/browse/PARQUET-1587
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.10.1
> Reporter: Udit Joshi
> Priority: Blocker
> Attachments: image-2019-05-31-10-41-45-674.png
>
>
> *Problem :-* Parquet Writer doesn't support to write list of Groups directly
> into hadoop.
> Cause of Problem :- Suitable classes are not available
> Constructors are not visible
> *All possible solution which i tried -*
> * ParquetWriter
> * ParquetFileWriter
> * ExampleParquetWriter
> * ParquetRecordWriter
> *Gradle dependency*
> {quote}compile group: 'org.apache.parquet', name: 'parquet-hadoop', version:
> '1.10.1'
> {quote}
>
> *Is there any way to writer parquet file into Hadoop with GroupSupport?*
>
> *Problem description*
> I am trying to create the object of {color:#d04437}ParquetWriter{color} class
> which accepts the argument (OutputFile, Mode, WriteSupport,
> CompressionCodecName, int, boolean, Configuration, int, ParquetProperties).
> But this constructor has default access modifier. I can't able to access it.
> I also used {color:#d04437}ParquetFileWriter{color} class but it doesn't
> show any group support.
>
> {color:#205081}*ParquetWriter*{color}
> *!image-2019-05-31-10-41-45-674.png!*
> *{color:#205081}ParquetFileWriter{color}*
> {code:java}
> ParquetFileWriter writer = new
> ParquetFileWriter(HadoopOutputFile.fromPath(writePathFile, configuration),
> schema, Mode.CREATE, DEFAULT_BLOCK_SIZE, MAX_PADDING_SIZE_DEFAULT) ;
> writer.start();{code}
>
> It creates to create parquet file in hadoop but can't facilitates to write
> List of Groups in parquet file
>
> *{color:#205081}ExampleParquetWriter{color}*
> {code:java}
> ParquetWriter<Group> writer =
> ExampleParquetWriter.builder(writePathFile).withConf(configuration).withType(getSchema()).build();
>
> System.out.println("Number of groups to write:" + groups.size());
> for (Group g : groups) {
> writer.write(g);
> } {code}
> Doesn't support for writing parquet file in hadoop
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
