Re: Pandas 2 Timeline Estimate

2023-07-12 Thread Robert Bradshaw via user
Contributions welcome! I don't think we're at the point we can stop supporting Pandas 1.x though, so we'd have to do it in such a way as to support both. On Wed, Jul 12, 2023 at 4:53 PM XQ Hu via user wrote: > https://github.com/apache/beam/issues/27221#issuecomment-1603626880 > > This tracks th

Re: Pandas 2 Timeline Estimate

2023-07-12 Thread XQ Hu via user
https://github.com/apache/beam/issues/27221#issuecomment-1603626880 This tracks the progress. On Wed, Jul 12, 2023 at 7:37 PM Adlae D'Orazio wrote: > Hello, > > I am currently trying to use Interactive Beam to run my pipelines through > a Jupyter notebook, but I > have internal packages dependi

Pandas 2 Timeline Estimate

2023-07-12 Thread Adlae D'Orazio
Hello, I am currently trying to use Interactive Beam to run my pipelines through a Jupyter notebook, but I have internal packages depending on Pandas 2. When I install interactive beam, it overrides these dependencies. I was wondering whether there's a timeframe for moving Beam to Pandas 2.v2? I k

Re: Does beam spark runner support yarn-cluster mode

2023-07-12 Thread Kai Jiang
Yeah, I think you could check this document out. https://beam.apache.org/documentation/runners/spark/#running-on-dataproc-cluster-yarn-backed Spark runner shall support running on yarn-cluster mode. On Tue, Jul 11, 2023 at 7:58 PM Jeff Zhang wrote: > Hi all, > > I didn't find much material about