Yes. The only thing I can’t control is this line: https://github.com/apache/beam/pull/8130/files#diff-04fef9e0550df0b0c4e1cd0264406eb5L608
On Sat, May 4, 2019 at 04:46 Valentyn Tymofieiev <valen...@google.com> wrote: > HI Chengxuan, > > We will try to include this change in the next release. As I said, you > could also set use_fastavro=true in your pipeline code without having to > wait for the change the makes this flag set to true by default. > > Thanks, Valentyn > > > *From:*Chengxuan Wang <wcxz...@gmail.com> > *Date:*Sat, May 4, 2019, 3:28 AM > *To:* <user@beam.apache.org> > > Hi Valentyn, >> >> Thanks a lot. By following https://github.com/apache/beam/pull/8130 , I >> made changes in my apache beam package locally, now my test can pass. This >> line >> https://github.com/apache/beam/pull/8130/files#diff-04fef9e0550df0b0c4e1cd0264406eb5L608 >> is >> important. >> >> Is there a way to accelerate the release of this change? The reason I ask >> is couple of my team's customers only use python3. :( So we may lose >> customers without this change. >> >> please let me know. >> >> Thanks, >> Chengxuan >> >> Valentyn Tymofieiev <valen...@google.com> 于2019年5月3日周五 下午7:45写道： >> >>> Correction: we are making fastavro a default option on Python 3 only for >>> now. You can follow https://github.com/apache/beam/pull/8130 for >>> updates on that. >>> >>> *From:*Valentyn Tymofieiev <valen...@google.com> >>> *Date:*Fri, May 3, 2019, 10:41 PM >>> *To:* <user@beam.apache.org> >>> >>> Hi, >>>> >>>> Unfortunately, Avro library currently doesn't work well with Python 3. >>>> Could you try using fastavro in your pipeline and report back if that >>>> helped to resolve your issue? We are also making fastavro a default option, >>>> likely starting from 2.13.0. You could use fastavro as follows >>>> >>>> (sent from Phone, apologies for possible errors): >>>> >>>> WriteToAvro( >>>> ..., >>>> use_fastavro=True >>>> ) >>>> >>>> >>>> >>>> >>>> *From:*Chengxuan Wang <wcxz...@gmail.com> >>>> *Date:*Fri, May 3, 2019, 8:30 PM >>>> *To:* <user@beam.apache.org> >>>> >>>> Hi, >>>>> I am trying to create a PTransform to combine avro schemas. But I met >>>>> `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)`, >>>>> I think It is related to >>>>> https://github.com/apache/avro/blob/master/lang/py3/avro/schema.py#L1058 . >>>>> Because avro didn't implement __ne__, it will use __eq__ delegated. >>>>> >>>>> Then I saw there is `without_default` method in CombineGlobally, so I >>>>> add that. Now I get `xception: Attempting to map key 'b' to value >>>>> <avro.schema.Field object at 0x7f71b435ec50> in ImmutableDict {} [while >>>>> running 'WriteToAvro/_WriteToAvroWithNoSchema/WriteBundles']`. >>>>> >>>>> Does anyone have this problem before? I am using python3 with >>>>> apache-beam 2.12.0(the latest one)? >>>>> >>>>> It works fine under python2, but can't work under python3. >>>>> >>>>> Thanks, >>>>> Chengxuan >>>>> >>>>
