Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889867688
##
parquet/src/file/metadata.rs:
##
@@ -223,6 +223,7 @@ pub struct RowGroupMetaData {
num_rows: i64,
total_byte_size: i64,
schema_descr: SchemaDescPtr,
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889861992
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,472 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
codecov-commenter commented on PR #2702:
URL:
https://github.com/apache/arrow-datafusion/pull/2702#issuecomment-1147067806
#
[Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2702?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_
github-actions[bot] commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1147061211
Revision: debbd3e4a290e4cbe9975b46ef8a5839e29a81b1
Submitted crossbow builds: [ursacomputing/crossbow @
actions-5dfae3fa6a](https://github.com/ursacomputing/crossbow/bra
kou commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1147060454
@github-actions crossbow submit java-jars
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
kou commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1147060381
No problem. :-)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsub
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889827232
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,472 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
kou commented on PR #13292:
URL: https://github.com/apache/arrow/pull/13292#issuecomment-1147046948
I've fixed R failures but new R failures are happen. The new failures are
also happen on master:
https://github.com/apache/arrow/runs/6747296145?check_suite_focus=true
It seems that du
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889821082
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,472 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889820667
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,472 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
REASY commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1147041598
@kou seems like I messed up with rebase/force-push, I can see you had to fix
the errors again, sorry.
--
This is an automated message from the Apache Git Service.
To respond to the messag
codecov-commenter commented on PR #1798:
URL: https://github.com/apache/arrow-rs/pull/1798#issuecomment-1147026395
#
[Codecov](https://codecov.io/gh/apache/arrow-rs/pull/1798?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+S
kazuk opened a new pull request, #1798:
URL: https://github.com/apache/arrow-rs/pull/1798
add command line tool for convert csv to parquet.
# Which issue does this PR close?
Closes #1797 .
# Rationale for this change
# What changes are included in
kazuk opened a new issue, #1797:
URL: https://github.com/apache/arrow-rs/issues/1797
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
A clear and concise description of what the problem is. Ex. I'm always
frustrated when [...]
cyb70289 commented on code in PR #13244:
URL: https://github.com/apache/arrow/pull/13244#discussion_r889794635
##
cpp/cmake_modules/ThirdpartyToolchain.cmake:
##
@@ -2234,16 +2234,22 @@ if((NOT ARROW_SIMD_LEVEL STREQUAL "NONE") OR (NOT
ARROW_RUNTIME_SIMD_LEVEL STREQ
else()
AssHero commented on issue #2145:
URL:
https://github.com/apache/arrow-datafusion/issues/2145#issuecomment-1146984550
I think we can check whether the data types are supported in hash join or
not. If not supported, we can use cross join instead, and we can support more
data types later in
kou merged PR #13307:
URL: https://github.com/apache/arrow/pull/13307
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.or
kou commented on PR #13307:
URL: https://github.com/apache/arrow/pull/13307#issuecomment-1146983525
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mai
AssHero opened a new pull request, #2702:
URL: https://github.com/apache/arrow-datafusion/pull/2702
# Which issue does this PR close?
Closes #2145
# Rationale for this change
Before generating the hash join logical plan, make sure the data types in
equal conditions are sup
kou commented on PR #13244:
URL: https://github.com/apache/arrow/pull/13244#issuecomment-1146974625
> (Can we build a Docker image in the CI job when we don't have
`ghcr.io/ursacomputing/arrow:python-*` image?)
In other words, why we specify `--no-build` option for Windows jobs?
kou commented on PR #13244:
URL: https://github.com/apache/arrow/pull/13244#issuecomment-1146973126
@kszucs I want to update vcpkg's version but it causes `wheel-windows-*`
jobs failures. e.g.:
https://github.com/ursacomputing/crossbow/runs/6719159641?check_suite_focus=true#step:6:13
github-actions[bot] commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1146971134
Revision: 6ba22ed36390cafae66906b1e9e6c5090c9e1896
Submitted crossbow builds: [ursacomputing/crossbow @
actions-97b278922c](https://github.com/ursacomputing/crossbow/bra
zhangyingmath opened a new issue, #13316:
URL: https://github.com/apache/arrow/issues/13316
```tbl = pa.Table.from_arrays([pa.array([1,2]), pa.array([1.0, 2.0])],
names=['f', 'g'])
df1 = tbl.to_pandas(split_blocks=True)
df1.loc[0, 'f'] = 100
-
kou commented on PR #13157:
URL: https://github.com/apache/arrow/pull/13157#issuecomment-1146970433
@github-actions crossbow submit java-jars
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the s
kou commented on code in PR #13244:
URL: https://github.com/apache/arrow/pull/13244#discussion_r889780669
##
cpp/cmake_modules/ThirdpartyToolchain.cmake:
##
@@ -2234,16 +2234,22 @@ if((NOT ARROW_SIMD_LEVEL STREQUAL "NONE") OR (NOT
ARROW_RUNTIME_SIMD_LEVEL STREQ
else()
set(A
djnavarro commented on PR #12154:
URL: https://github.com/apache/arrow/pull/12154#issuecomment-1146910405
@rok Awesome! I'll rebase and update the lubridate bindings asap. Yay!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
nealrichardson merged PR #13312:
URL: https://github.com/apache/arrow/pull/13312
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arro
codecov-commenter commented on PR #1796:
URL: https://github.com/apache/arrow-rs/pull/1796#issuecomment-1146881007
#
[Codecov](https://codecov.io/gh/apache/arrow-rs/pull/1796?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+S
viirya opened a new pull request, #1796:
URL: https://github.com/apache/arrow-rs/pull/1796
# Which issue does this PR close?
Closes #1783.
# Rationale for this change
# What changes are included in this PR?
# Are there any user-facing chan
andygrove commented on PR #59:
URL: https://github.com/apache/arrow-ballista/pull/59#issuecomment-1146874637
I ran the integration tests (`./dev/integration-tests.sh`) and they ran
without issue, so that gives me confidence that no regressions are introduced
here.
--
This is an automated
andygrove commented on code in PR #59:
URL: https://github.com/apache/arrow-ballista/pull/59#discussion_r889731148
##
ballista/rust/core/proto/ballista.proto:
##
@@ -622,6 +622,37 @@ enum JoinSide{
///
tustvold commented on issue #1783:
URL: https://github.com/apache/arrow-rs/issues/1783#issuecomment-1146873675
Thanks for the report, I'll bash this one out before the next release unless
someone else picks it up 😀
--
This is an automated message from the Apache Git Service.
To respond to
thinkharderdev commented on code in PR #59:
URL: https://github.com/apache/arrow-ballista/pull/59#discussion_r889722012
##
ballista/rust/core/proto/ballista.proto:
##
@@ -622,6 +622,37 @@ enum JoinSide{
//
andygrove commented on code in PR #59:
URL: https://github.com/apache/arrow-ballista/pull/59#discussion_r889718557
##
ballista/rust/core/proto/ballista.proto:
##
@@ -622,6 +622,37 @@ enum JoinSide{
///
datapythonista opened a new pull request, #1795:
URL: https://github.com/apache/arrow-rs/pull/1795
# Which issue does this PR close?
None
# Rationale for this change
Just fixing couple of minor typos in
https://docs.rs/arrow/latest/arrow/index.html#memory-and-buffers
codecov-commenter commented on PR #1794:
URL: https://github.com/apache/arrow-rs/pull/1794#issuecomment-1146855155
#
[Codecov](https://codecov.io/gh/apache/arrow-rs/pull/1794?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+S
viirya opened a new pull request, #1794:
URL: https://github.com/apache/arrow-rs/pull/1794
# Which issue does this PR close?
Closes #1793.
# Rationale for this change
# What changes are included in this PR?
# Are there any user-facing chan
viirya opened a new issue, #1793:
URL: https://github.com/apache/arrow-rs/issues/1793
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
In V4, only null types have no validity bitmap. So in V4 message, IPC writer
should still wr
thinkharderdev commented on PR #59:
URL: https://github.com/apache/arrow-ballista/pull/59#issuecomment-1146851519
cc @andygrove @yahoNanJing @Ted-Jiang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
thinkharderdev opened a new pull request, #59:
URL: https://github.com/apache/arrow-ballista/pull/59
# Which issue does this PR close?
Closes #39
Posting this draft PR for review and feedback but there are some more TODO
items still in progress (mostly around cleanup a
github-actions[bot] commented on PR #13307:
URL: https://github.com/apache/arrow/pull/13307#issuecomment-1146842582
Revision: e94f7ecde6285576b98c47991f54a50d8237bc0d
Submitted crossbow builds: [ursacomputing/crossbow @
actions-52476e28be](https://github.com/ursacomputing/crossbow/bra
kou commented on PR #13307:
URL: https://github.com/apache/arrow/pull/13307#issuecomment-1146842451
@github-actions crossbow submit almalinux-* amazon-linux-* centos-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use th
waynexia commented on PR #2648:
URL:
https://github.com/apache/arrow-datafusion/pull/2648#issuecomment-1146836673
>`datafusion-contrib` is not under Apache governance so there is more
freedom there to move fast when prototyping. You can merge your own PRs for
example while you are the only
codecov-commenter commented on PR #2701:
URL:
https://github.com/apache/arrow-datafusion/pull/2701#issuecomment-1146825389
#
[Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2701?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_
codecov-commenter commented on PR #2700:
URL:
https://github.com/apache/arrow-datafusion/pull/2700#issuecomment-1146817032
#
[Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2700?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_
andygrove commented on issue #2683:
URL:
https://github.com/apache/arrow-datafusion/issues/2683#issuecomment-1146816350
I now plan on working on this after the 9.0.0 release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
andygrove opened a new pull request, #2701:
URL: https://github.com/apache/arrow-datafusion/pull/2701
# Which issue does this PR close?
N/A
# Rationale for this change
The `core/logical_plan` module is now redundant and mostly consists of
re-exports. `Defaul
andygrove commented on PR #58:
URL: https://github.com/apache/arrow-ballista/pull/58#issuecomment-1146815286
@thinkharderdev @yahoNanJing @realno @Ted-Jiang fyi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
andygrove opened a new pull request, #2700:
URL: https://github.com/apache/arrow-datafusion/pull/2700
# Which issue does this PR close?
N/A
# Rationale for this change
Some tests got left behind during the recent refactoring
# What changes are included
datapythonista commented on issue #1613:
URL: https://github.com/apache/arrow-rs/issues/1613#issuecomment-1146809855
I'm planning to work on this. What I'd personally do, is to have many small
examples of increasing complexity. So, besides examples and recipes, it can be
used as a tutorial,
cyb70289 commented on code in PR #13244:
URL: https://github.com/apache/arrow/pull/13244#discussion_r889692916
##
cpp/cmake_modules/ThirdpartyToolchain.cmake:
##
@@ -2234,16 +2234,22 @@ if((NOT ARROW_SIMD_LEVEL STREQUAL "NONE") OR (NOT
ARROW_RUNTIME_SIMD_LEVEL STREQ
else()
github-actions[bot] commented on PR #13307:
URL: https://github.com/apache/arrow/pull/13307#issuecomment-1146800854
Revision: f13deda865d4735a632e5896f57e8633dfff7d68
Submitted crossbow builds: [ursacomputing/crossbow @
actions-3c3046a807](https://github.com/ursacomputing/crossbow/bra
kou commented on PR #13307:
URL: https://github.com/apache/arrow/pull/13307#issuecomment-1146800691
@github-actions crossbow submit almalinux-* amazon-linux-* centos-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use th
andygrove commented on PR #58:
URL: https://github.com/apache/arrow-ballista/pull/58#issuecomment-1146800436
Thank you for the contribution @nl5887. Having a Python repl as part of
Ballista will make it much more accessible.
Because this builds on the `datafusion-python` module which
andygrove merged PR #2686:
URL: https://github.com/apache/arrow-datafusion/pull/2686
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@
codecov-commenter commented on PR #2699:
URL:
https://github.com/apache/arrow-datafusion/pull/2699#issuecomment-1146775508
#
[Codecov](https://codecov.io/gh/apache/arrow-datafusion/pull/2699?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_
korowa opened a new pull request, #2699:
URL: https://github.com/apache/arrow-datafusion/pull/2699
# Which issue does this PR close?
Closes #2698.
# Rationale for this change
Defined ordering of `SortMergeJoin` output may be helpful for query
planner/optimiz
tustvold commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889668210
##
parquet/src/file/metadata.rs:
##
@@ -223,6 +223,7 @@ pub struct RowGroupMetaData {
num_rows: i64,
total_byte_size: i64,
schema_descr: SchemaDescPtr,
korowa opened a new issue, #2698:
URL: https://github.com/apache/arrow-datafusion/issues/2698
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
Existing `SortMergeJoin` creates output batches [in following
sequence](https://gith
nevi-me merged PR #1789:
URL: https://github.com/apache/arrow-rs/pull/1789
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apac
nevi-me closed issue #1788: Rust IPC Read should be able to read V4 UnionType
Array
URL: https://github.com/apache/arrow-rs/issues/1788
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
viirya commented on PR #1789:
URL: https://github.com/apache/arrow-rs/pull/1789#issuecomment-1146761003
Thanks @nevi-me
Yes, if specifying `metadata_version` as V4, the ipc writer also need to
write validity buffer for UnionType Array. Currently it doesn't, although it
doesn't affec
nl5887 opened a new pull request, #58:
URL: https://github.com/apache/arrow-ballista/pull/58
# Rationale for this change
This will introduce the ballista python module, similar to the datafusion
python module.
--
This is an automated message from the Apache Git Service.
To respond to
Ted-Jiang opened a new issue, #1792:
URL: https://github.com/apache/arrow-rs/issues/1792
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
A clear and concise description of what the problem is. Ex. I'm always
frustrated when [...]
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889659815
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,474 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889658973
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,474 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
Ted-Jiang commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889658890
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,474 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreement
viirya commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889658426
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,474 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.
viirya commented on code in PR #1791:
URL: https://github.com/apache/arrow-rs/pull/1791#discussion_r889658333
##
parquet/src/file/page_index/range.rs:
##
@@ -0,0 +1,474 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.
Ted-Jiang commented on code in PR #2694:
URL: https://github.com/apache/arrow-datafusion/pull/2694#discussion_r889657737
##
datafusion/core/src/physical_plan/limit.rs:
##
@@ -176,17 +184,18 @@ impl ExecutionPlan for GlobalLimitExec {
fn statistics(&self) -> Statistics {
70 matches
Mail list logo
