ion-elgreco commented on issue #5882:
URL: https://github.com/apache/arrow-rs/issues/5882#issuecomment-2288543613
@tustvold It seems pyarrow fetches 4 files in parallel:
```rust
[python/src/filesystem.rs:362:9] (&path, &size) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-0.parquet",
},
Some(
620044497,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-0.parquet",
},
Some(
65536,
),
)
[python/src/filesystem.rs:362:9] (&path, &size) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
620155928,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
65536,
),
)
[python/src/filesystem.rs:362:9] (&path, &size) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-2.parquet",
},
Some(
620114967,
),
)
[python/src/filesystem.rs:362:9] (&path, &size) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-3.parquet",
},
Some(
620122700,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-2.parquet",
},
Some(
65536,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-3.parquet",
},
Some(
65536,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-0.parquet",
},
Some(
401745,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
401786,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-2.parquet",
},
Some(
401778,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
33242725,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-3.parquet",
},
Some(
401785,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-2.parquet",
},
Some(
33248200,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
32602849,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-0.parquet",
},
Some(
33231119,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-1.parquet",
},
Some(
33227648,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-2.parquet",
},
Some(
32612159,
),
)
[python/src/filesystem.rs:471:9] (&self.path, &nbytes) = (
Path {
raw:
"product_line_code=DUMMY/100-f1cafe66-476f-4818-8199-5c5a4a6eb4ef-0.parquet",
},
Some(
32593580,
),
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
