Re: Error writing apache beam code on my local machine

2019-12-04 Thread Wes McKinney
You probably want to open an issue with Apache Beam.

What happens when you run

python -c "import pyarrow"

?

On Wed, Dec 4, 2019 at 3:26 PM Andrew Ukiwa  wrote:
>
> Dear Sirs
>
> I am runing apache beam code on my machine and I keep getting this error
>
> "
>
> AttributeError: module 'pyarrow' has no attribute 'compat'"
>
>
> Please can you help, I am stuck.  The code I am runing is as follows
>
> from __future__ import print_function
> import apache_beam as beam
> from apache_beam.options.pipeline_options import PipelineOptions
> with beam.Pipeline(options=PipelineOptions()) as p:
>  lines = p | 'Create' >> beam.Create(['cat dog', 'snake cat', 'dog'])
>  counts = (
>  lines
>  | 'Split' >> (beam.FlatMap(lambda x: x.split(' '))
>.with_output_types(unicode))
>  | 'PairWithOne' >> beam.Map(lambda x: (x, 1))
>  | 'GroupAndSum' >> beam.CombinePerKey(sum)
>  )
>  counts | 'Print' >> beam.ParDo(lambda w, c: print('%s: %s' % (w, c)))
>
> lines.run()
>


Re: Error writing apache beam code on my local machine

2019-12-04 Thread Andrew Ukiwa
Dear Sirs

I am runing apache beam code on my machine and I keep getting this error

"

AttributeError: module 'pyarrow' has no attribute 'compat'"


Please can you help, I am stuck.  The code I am runing is as follows

from __future__ import print_function
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
with beam.Pipeline(options=PipelineOptions()) as p:
     lines = p | 'Create' >> beam.Create(['cat dog', 'snake cat', 'dog'])
     counts = (
     lines
     | 'Split' >> (beam.FlatMap(lambda x: x.split(' '))
   .with_output_types(unicode))
     | 'PairWithOne' >> beam.Map(lambda x: (x, 1))
     | 'GroupAndSum' >> beam.CombinePerKey(sum)
     )
     counts | 'Print' >> beam.ParDo(lambda w, c: print('%s: %s' % (w, c)))

lines.run()