[ 
https://issues.apache.org/jira/browse/AVRO-3266?focusedWorklogId=782636&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-782636
 ]

ASF GitHub Bot logged work on AVRO-3266:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 18/Jun/22 15:55
            Start Date: 18/Jun/22 15:55
    Worklog Time Spent: 10m 
      Work Description: RyanSkraba commented on PR #1618:
URL: https://github.com/apache/avro/pull/1618#issuecomment-1159487773

   Here is the [discussion on the mailing 
list](https://lists.apache.org/thread/tmxsrw63rpp32mzygqov6kpd379vg3yj).
   
   > Anything I can look at?
   
   A good starting point for perf (in Java) is 
https://github.com/apache/avro/blob/master/lang/java/perf/README.md 

Issue Time Tracking
-------------------

    Worklog Id:     (was: 782636)
    Time Spent: 4h  (was: 3h 50m)

> Output stream incompatible with MagicS3GuardCommitter
> -----------------------------------------------------
>
>                 Key: AVRO-3266
>                 URL: https://issues.apache.org/jira/browse/AVRO-3266
>             Project: Apache Avro
>          Issue Type: Bug
>          Components: java
>            Reporter: Michiel de Jong
>            Assignee: Emil Ejbyfeldt
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 1.11.1
>
>          Time Spent: 4h
>  Remaining Estimate: 0h
>
> Avro's output stream can not be used in combination with the 
> MagicS3GuardCommitter
> {code:java}
> Error: java.lang.ClassCastException: class 
> org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to 
> class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
> The reason for this problem is that 
> AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter 
> to a FileOutputCommitter.
> It can be solved by casting to a PathOutputCommitter instead (which is a 
> superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to