Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-17 Thread shane knapp
es? >> >>> >>> -------------- >>> *From:* shane knapp >>> *Sent:* Friday, June 14, 2019 10:23:56 AM >>> *To:* Bryan Cutler >>> *Cc:* Dongjoon Hyun; Holden Karau; Hyukjin Kwon; dev >>> *Subject:* Re: [DISCUSS]

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-15 Thread Hyukjin Kwon
es? >> >>> >>> -------------- >>> *From:* shane knapp >>> *Sent:* Friday, June 14, 2019 10:23:56 AM >>> *To:* Bryan Cutler >>> *Cc:* Dongjoon Hyun; Holden Karau; Hyukjin Kwon; dev >>> *Subject:* Re: [DISCUSS]

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Bryan Cutler
- > *From:* Holden Karau > *Sent:* Friday, June 14, 2019 11:06:15 AM > *To:* Felix Cheung > *Cc:* Bryan Cutler; Dongjoon Hyun; Hyukjin Kwon; dev; shane knapp > *Subject:* Re: [DISCUSS] Increasing minimum supported version of Pandas > > Are there other Python dependencie

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Felix Cheung
How about pyArrow? From: Holden Karau Sent: Friday, June 14, 2019 11:06:15 AM To: Felix Cheung Cc: Bryan Cutler; Dongjoon Hyun; Hyukjin Kwon; dev; shane knapp Subject: Re: [DISCUSS] Increasing minimum supported version of Pandas Are there other Python

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Holden Karau
gt;>>> Dongjoon. >>>>>> >>>>>> On Fri, Jun 14, 2019 at 4:24 AM Holden Karau >>>>>> wrote: >>>>>> >>>>>>> I’m +1 for upgrading, although since this is probably the last easy >>>>>&

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Felix Cheung
; Hyukjin Kwon; dev Subject: Re: [DISCUSS] Increasing minimum supported version of Pandas excellent. i shall not touch anything. :) On Fri, Jun 14, 2019 at 10:22 AM Bryan Cutler mailto:cutl...@gmail.com>> wrote: Shane, I think 0.24.2 is probably more common right now, so if we were to pic

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread shane knapp
rau >>>>> wrote: >>>>> >>>>>> I’m +1 for upgrading, although since this is probably the last easy >>>>>> chance we’ll have to bump version numbers easily I’d suggest 0.24.2 >>>>>> >>>>>> >>&g

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Bryan Cutler
;>> >>>>> On Fri, Jun 14, 2019 at 4:38 AM Hyukjin Kwon >>>>> wrote: >>>>> >>>>>> I am +1 to go for 0.23.2 - it brings some overhead to test PyArrow >>>>>> and pandas combinations. Spark 3 should be good time

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread shane knapp
obably the last easy >>>> chance we’ll have to bump version numbers easily I’d suggest 0.24.2 >>>> >>>> >>>> On Fri, Jun 14, 2019 at 4:38 AM Hyukjin Kwon >>>> wrote: >>>> >>>>> I am +1 to go for 0.23.2 - it brings

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Bryan Cutler
t; pandas combinations. Spark 3 should be good time to increase. >>>> >>>> 2019년 6월 14일 (금) 오전 9:46, Bryan Cutler 님이 작성: >>>> >>>>> Hi All, >>>>> >>>>> We would like to discuss increasing the minimum supported ver

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread shane knapp
to test PyArrow and >>> pandas combinations. Spark 3 should be good time to increase. >>> >>> 2019년 6월 14일 (금) 오전 9:46, Bryan Cutler 님이 작성: >>> >>>> Hi All, >>>> >>>> We would like to discuss increasing the minimum supported version

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Dongjoon Hyun
4:38 AM Hyukjin Kwon wrote: > >> I am +1 to go for 0.23.2 - it brings some overhead to test PyArrow and >> pandas combinations. Spark 3 should be good time to increase. >> >> 2019년 6월 14일 (금) 오전 9:46, Bryan Cutler 님이 작성: >> >>> Hi All, >>> >

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-14 Thread Holden Karau
park 3 should be good time to increase. > > 2019년 6월 14일 (금) 오전 9:46, Bryan Cutler 님이 작성: > >> Hi All, >> >> We would like to discuss increasing the minimum supported version of >> Pandas in Spark, which is currently 0.19.2. >> >> Pandas 0.19.2

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-13 Thread Hyukjin Kwon
I am +1 to go for 0.23.2 - it brings some overhead to test PyArrow and pandas combinations. Spark 3 should be good time to increase. 2019년 6월 14일 (금) 오전 9:46, Bryan Cutler 님이 작성: > Hi All, > > We would like to discuss increasing the minimum supported version of > Pandas in

[DISCUSS] Increasing minimum supported version of Pandas

2019-06-13 Thread Bryan Cutler
Hi All, We would like to discuss increasing the minimum supported version of Pandas in Spark, which is currently 0.19.2. Pandas 0.19.2 was released nearly 3 years ago and there are some workarounds in PySpark that could be removed if such an old version is not required. This will help to keep