amol- commented on pull request #11624:
URL: https://github.com/apache/arrow/pull/11624#issuecomment-972769840
> A slightly related silly question: how does the performance compare to
pandas at this stage?
Not a real benchmark, but in the current very rough form it seems to be
mostly comparable.
```
>>> table = pyarrow.csv.read_csv("yellowtaxi.csv")
>>> timeit.timeit(lambda: table.group_by("VendorID").aggregate([("sum",
"trip_distance")]), number=1)
2.626802896999993
```
VS
```
>>> df = pandas.read_csv("yellowtaxi.csv")
>>> timeit.timeit(lambda: df.groupby("VendorID").aggregate({"trip_distance":
["sum"]}), number=1)
2.3642018030000003
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
