dongsupkim-onepredict commented on issue #1506:
URL:
https://github.com/apache/iceberg-python/issues/1506#issuecomment-2647162855
The result I found is that the number of data entries differs when the data
count is not 100,000, compared to when the data entries count is 100,000. After
logging the plan_files in the DataScan class, I found that when the number of
data entries is incorrect, the number of manifests remains the same, but the
data entries count differs. This issue seems to occur when applying the
row_filter; when the row_filter is not applied, there is no discrepancy in the
data count when loading the data. My assumption is that, in the code below,
some data files are missing from the data_entries.
```
executor = ExecutorFactory.get_or_create()
for manifest_entry in chain(
*executor.map(
lambda args: _open_manifest(*args),
[
(
self.io,
manifest,
partition_evaluators[manifest.partition_spec_id],
metrics_evaluator,
)
for manifest in manifests
if self._check_sequence_number(min_sequence_number, manifest)
],
)
):
data_file = manifest_entry.data_file
if data_file.content == DataFileContent.DATA:
data_entries.append(manifest_entry)
elif data_file.content == DataFileContent.POSITION_DELETES:
positional_delete_entries.add(manifest_entry)
elif data_file.content == DataFileContent.EQUALITY_DELETES:
raise ValueError("PyIceberg does not yet support equality deletes:
https://github.com/apache/iceberg/issues/6568";)
else:
raise ValueError(f"Unknown DataFileContent ({data_file.content}):
{manifest_entry}")
```
```Snapshot: Operation.APPEND: id=4677529714979006141,
parent_id=201109056551926719, schema_id=0
Manifests len: 113 Manifests: [ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], Mani
festFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[]]
Min Sequence Number: 1
Data Entries len: 114. Data Entries: [ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], Manif
estEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[]]
File Tasks len: 114. File Tasks: [FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494051700), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494056472), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494097685), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494600352), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494205073), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493709376), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494206456), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=495978549), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=495143131), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=496414231), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=496241356), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494682275), FileScanTask(file=DataFil
e[], delete_files=set(), start=0, length=494579508),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=496929028),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494002896),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495953229),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494633379),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495099941),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=497853121),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495267863),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495068906),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494998529),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494602737),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=491990187),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494744208),
FileScan
Task(file=DataFile[], delete_files=set(), start=0, length=495596341),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493177401),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494960184),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493198863),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492132433),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495936814),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493357419),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494253435),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493071088),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495534769),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494249197),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493625103),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492
580150), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493170884), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492250552), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492710609), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495966115), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492119992), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494052438), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493245637), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492392459), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492209909), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494422601), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493919972), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493767913), FileScanTask(file=DataFile[], delete_files=set(), st
art=0, length=492967329), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=494959553), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=494982541), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492626831), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=495498075), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=496873598), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492702108), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=491681274), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493541736), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492991649), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493836095), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493324863), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=495288308), FileScanTask(file=DataFile[], delet
e_files=set(), start=0, length=494510377), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493685060), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493637131), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493938751), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493530497), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494363032), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=496402461), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493114075), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493263706), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494223956), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=492738400), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493210430), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=492770903), FileScanTask(file=
DataFile[], delete_files=set(), start=0, length=495216511),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=491954928),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=496378306),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494000374),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495560515),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494177912),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494393945),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=491712214),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493859774),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492780030),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492608286),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493536200),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493279408), F
ileScanTask(file=DataFile[], delete_files=set(), start=0, length=494332941),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493560668),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495232338),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493209136),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492658968),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492748284),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494629418),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492349376),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494546714),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494420128),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493249615),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493594036),
FileScanTask(file=DataFile[], delete_files=set(), start=0, len
gth=493955308), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492567219), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494869323), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492964213), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492422583), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492943989), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494295241), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492392903), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492940530), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492881720), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495319222), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494580686), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495754650)]
2025-02-10 16:21:12 - pyiceberg.io.pyarrow - INFO - Number of tasks: 114
Number of Futures: 114
2025-02-10 16:22:27 - pyiceberg.io.pyarrow - INFO - total_row_count: 100000,
len(tables): 114 len(completed_futures): 114
2025-02-10 16:22:27 - pyiceberg.io.pyarrow - INFO - [(0, 186), (1, 303), (2,
861), (3, 832), (4, 849), (5, 922), (6, 933), (7, 911), (8, 903), (9, 859),
(10, 882), (11, 898), (12, 890), (13, 809), (14, 855), (15, 908), (16, 929),
(17, 852), (18, 898), (19, 857), (20, 935), (21, 840), (22, 849), (23, 853),
(24, 893), (25, 929), (26, 877), (27, 905), (28, 917), (29, 904), (30, 868),
(31, 883), (32, 857), (33, 896), (34, 905), (35, 899), (36, 885), (37, 878),
(38, 855), (39, 921), (40, 891), (41, 933), (42, 830), (43, 857), (44, 887),
(45, 909), (46, 883), (47, 903), (48, 860), (49, 907), (50, 878), (51, 937),
(52, 870), (53, 884), (54, 877), (55, 926), (56, 891), (57, 861), (58, 920),
(59, 922), (60, 880), (61, 892), (62, 922), (63, 885), (64, 854), (65, 882),
(66, 892), (67, 870), (68, 881), (69, 876), (70, 844), (71, 858), (72, 921),
(73, 948), (74, 898), (75, 910), (76, 852), (77, 971), (78, 899), (79, 887),
(80, 915), (81, 874), (82, 906), (83, 930), (84, 874), (85, 872), (86, 8
71), (87, 877), (88, 891), (89, 820), (90, 877), (91, 876), (92, 928), (93,
859), (94, 878), (95, 884), (96, 954), (97, 856), (98, 924), (99, 859), (100,
914), (101, 892), (102, 889), (103, 886), (104, 882), (105, 915), (106, 862),
(107, 907), (108, 886), (109, 837), (110, 910), (111, 963), (112, 926), (113,
872)]
2025-02-10 16:22:27 - pyiceberg.io.pyarrow - INFO - [(0,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-1-c508ad15-6f68-483c-894b-129b961e8156.parquet'),
(1,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-2-c508ad15-6f68-483c-894b-129b961e8156.parquet'),
(2,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fa728784-c111-4700-baeb-31cc9a2fece6.parquet'),
(3,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-47b83244-e7e3-4acc-a0b0-4dae26159e4d.parquet'),
(4,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-154b77e9-93a1-4704-a29a-b1b4d867a91c.parquet'),
(5,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-26ef8d83-fced-4341-ade6-debd45b7825e.parquet'),
(6,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4cb0153f-ada5-4561-8e9a-23c05c952ffc.parquet'),
(7,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3f0fae07-e85e-4ec3-aae3-9e5a0236c078.parquet'),
(8,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3bacb33d-d0f4-430a-9cb9-b50ef45df203.parquet'),
(9,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5a9d5e3a-dc33-444e-81aa-d599b7013ff2.parquet'),
(10,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-115bbe80-3f6e-4e4a-9c34-72415a8e6a3b.parquet'),
(11,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f8f993a8-21d5-427e-bdd3-2b6e15b53b93.parquet'),
(12, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54
d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-398056ba-8209-49ab-aa40-c6ba8cdf4851.parquet'),
(13,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7999a954-8e8e-4327-b80a-5eebe266d4bc.parquet'),
(14,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-22aebdbb-b657-4b65-a625-664ec2d6c8ae.parquet'),
(15,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4353a200-da2d-4c72-b5f1-b9fc97027821.parquet'),
(16,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-e125ae14-6f93-4360-9900-16bacda26ab2.parquet'),
(17,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-10f203a4-d51a-49d7-80d7-ae62d2088b4f.parquet'),
(18,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/
00000-3-61ea8271-2b5f-47af-904d-e0cce3c9b85e.parquet'), (19,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-22682f0d-fa15-466e-aab5-fb5ec480f5e8.parquet'),
(20,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-dba18d34-0681-4c70-874c-13b30c5e0d36.parquet'),
(21,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cb901733-d90f-4184-b663-6f4b9b32e5ff.parquet'),
(22,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5d997148-4e17-42ab-8528-af9c0ac04676.parquet'),
(23,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-8b4152c8-0f89-48ae-a615-698b31cef113.parquet'),
(24,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-1f058136-be92-49eb-bc54-68b9c52ee0fb.parq
uet'), (25,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-18f2e5fe-e616-4a98-845c-b9dd43035f16.parquet'),
(26,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d64f525e-bbc5-43e4-895e-a48b52949e3d.parquet'),
(27,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-1a5bf16a-31bd-42ac-b403-90effa2f8ffa.parquet'),
(28,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a136a8ea-049b-410b-ac31-6b29e32c8711.parquet'),
(29,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5a09ba4f-04b8-4a9a-a725-56ad5254cb8b.parquet'),
(30,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9b688cf9-1e37-4913-bb94-3474b6c5a6f8.parquet'),
(31, 's3a://warehouse-75e51f17-ed4b-4698-a
b25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-83bd54e7-9db2-4534-9391-2428a3776787.parquet'),
(32,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f7555549-c2d6-4f5b-9ae8-07f1d231ae12.parquet'),
(33,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-20c34aed-e40b-4ba9-93e4-38918521b3ff.parquet'),
(34,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-efc8ef61-b1f0-42f8-92a7-1104c71b237b.parquet'),
(35,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-38bcdac5-aa65-4e4b-ac8c-4de41c9ef4f6.parquet'),
(36,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-806a44fd-0947-41ff-9d67-82fe504d8269.parquet'),
(37,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shu
ffled/data/00000-3-ec939eaf-dbbb-47e3-a9fc-afb1bfc59b64.parquet'), (38,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-b7b0d26c-5950-452d-bf22-0f8f99fca685.parquet'),
(39,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7e01167a-4178-4bde-89f3-676bdc5e00a5.parquet'),
(40,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a6222844-8bd3-493e-a717-315517029a01.parquet'),
(41,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-55673760-7640-48b4-ac00-f83e2f44d363.parquet'),
(42,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a9c9e8a3-ab8d-45ff-8741-0f3422d9959f.parquet'),
(43,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-61520735-bc3f-4c9a-a7da-ec0941
c80e63.parquet'), (44,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f84d5db8-4527-48f8-bb77-c688d50614d9.parquet'),
(45,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4fb926a7-ebd7-4ac4-8508-53c62d89a0de.parquet'),
(46,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-034bf6b6-0e21-4bba-9c61-391a26140ab4.parquet'),
(47,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-52336eb9-efc8-4a80-957a-3fd1c6f5b683.parquet'),
(48,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-66dac5a1-eef5-4b97-a900-bbb2d30e9f97.parquet'),
(49,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ab4f163a-df21-4f22-b926-3c7e97108134.parquet'),
(50, 's3a://warehouse-75e51f17-
ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-bdd64a81-79ae-4b12-a4b0-51d60c0feae5.parquet'),
(51,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6cd11078-bba2-43db-ad8c-db4d558b7c49.parquet'),
(52,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9c9ba866-0cf0-4fac-97e2-77b8b5d9b9ed.parquet'),
(53,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5db618a7-01fc-4b5a-b23a-ff12e30cba7e.parquet'),
(54,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7de9bd18-f32d-4b9b-96c4-75ca70561452.parquet'),
(55,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-75cf8119-cb74-4e64-b101-960ef30e876f.parquet'),
(56,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_sliprat
io_data_shuffled/data/00000-3-108dc4e0-cf66-4a02-99cf-a0aa501341b9.parquet'),
(57,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2496fe41-c505-4028-8bb6-add8e5ba043a.parquet'),
(58,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fee54ffa-70e2-4458-9a8d-8dc9ade52be0.parquet'),
(59,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5d7d8b89-0122-4050-aa85-278c2a6657ae.parquet'),
(60,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7ceeebb5-dcd9-40cb-abc8-db4e0c51fddd.parquet'),
(61,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-99536e9a-b99d-4aee-9dd7-83dd738445d7.parquet'),
(62,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ea7a6f2c-26fa-4e74-
a75f-1576806f2c02.parquet'), (63,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9b7a2975-b7cd-45ac-95ae-402b068cf109.parquet'),
(64,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-05f2e047-e910-4960-b624-e9c9a9f9c149.parquet'),
(65,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2676f91c-9d83-4d8e-8149-482993634a17.parquet'),
(66,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-814bfe90-afba-421d-975d-1b56c20fa705.parquet'),
(67,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5dbca4bb-00d6-4576-b9d2-09092d281680.parquet'),
(68,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6b0ea0bd-9a73-419a-b77f-13fcde1d97fb.parquet'),
(69, 's3a://warehous
e-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-c283c84c-c5ec-4e34-92e1-67a7ed8fcbb0.parquet'),
(70,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3273ff0c-e796-4783-8b61-78b6c0811ceb.parquet'),
(71,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6a71883d-7eed-494d-948e-21473bf7558c.parquet'),
(72,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ff3c5c2c-70f2-46d6-9feb-f722cce140ad.parquet'),
(73,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-e79fc024-63a2-4ac3-ac36-0e963d791c28.parquet'),
(74,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3478d8e1-ad0f-4804-9532-b988786fcef0.parquet'),
(75, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim
/dl_slipratio_data_shuffled/data/00000-3-c77722fc-c454-4e43-9685-5ffa528f64f0.parquet'),
(76,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-54851863-94f0-4523-862e-b42792ae039b.parquet'),
(77,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0eb01eaa-2098-4e69-951a-a0cd921accb4.parquet'),
(78,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f51bc6e4-be69-460e-9267-c4009d9035a4.parquet'),
(79,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fb5db770-ab80-4fa5-8721-dbf73f558612.parquet'),
(80,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a50fc127-99bc-4d0b-b60b-64433b0917c4.parquet'),
(81,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-876251aa
-79cb-4848-881a-99a145be3ec8.parquet'), (82,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a5e1c4ac-7e02-4967-85d7-22099b2701ed.parquet'),
(83,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-06b9baf6-2dd3-4313-be4f-fc752c1f43ff.parquet'),
(84,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d3661587-2956-4036-af22-2fc882e125a5.parquet'),
(85,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-43cba3f5-279d-463e-bd35-011c5686003b.parquet'),
(86,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7602f1d5-42fa-4378-9d39-ac5fb3508588.parquet'),
(87,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-80968fe3-cc21-48b0-9f01-bb3c071cfed3.parquet'),
(88, 's3a
://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f27512c5-187c-45a5-9fb7-25b7239129a5.parquet'),
(89,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-74356529-5e11-4ef7-8abc-769cae5fc764.parquet'),
(90,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-83442492-99d2-420e-b39c-81b9c3253aac.parquet'),
(91,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-964fc0f0-1645-44e3-80e2-79c41c1b9192.parquet'),
(92,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-34e98b88-a126-485f-b210-5029672447e5.parquet'),
(93,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9c7df36e-c16e-42bc-9afc-ef26de89164c.parquet'),
(94, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979
/data_dykim/dl_slipratio_data_shuffled/data/00000-3-28c2aecc-973b-46bb-9de2-8fe6d8cb1e4d.parquet'),
(95,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-68afddfb-8cb2-42ea-b7bb-181cc333cdf5.parquet'),
(96,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d1f823c5-e7c5-40dd-9092-cde14ae9b2bd.parquet'),
(97,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0e7d7c53-d9d5-4788-b54f-d350547ddea9.parquet'),
(98,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cc51b67a-243e-4d26-ae7c-c169baa177ac.parquet'),
(99,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-356b61cd-2116-445d-8fcf-eaa67ea562cd.parquet'),
(100,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/0000
0-3-27d10a83-709f-448e-9945-67a7f469421c.parquet'), (101,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-55c3e5e0-e842-447d-adac-54c75bb9eb6b.parquet'),
(102,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-c126d91b-84de-4d3d-b73d-d39f3df6e628.parquet'),
(103,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0faaa7d5-4d55-4de7-89c9-45e51294ec6a.parquet'),
(104,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-07519a00-425d-46d2-a961-ed0d109b7962.parquet'),
(105,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5e8b5d7e-c8ab-4763-b1cf-36d4cfd145b3.parquet'),
(106,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a8b3da1a-6a64-4f5f-a421-6919c1c91e86.pa
rquet'), (107,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2979538f-3296-4a32-8fee-acddef8d2c2f.parquet'),
(108,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-438fe9af-d4c7-468c-bfd1-fcfa73c5cec4.parquet'),
(109,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cc8d53c6-cb3e-4bbe-8749-e7d2a7e19476.parquet'),
(110,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2cae4cca-02bc-415d-9d88-e57f25642512.parquet'),
(111,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-95717779-0b60-4102-8c6c-6fbea83e7da0.parquet'),
(112,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6ad05d43-ab26-41f8-87a7-4b5da1443e33.parquet'),
(113, 's3a://warehouse-75e51f17-ed
4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d5593775-a617-47ca-a55c-4c2ca7c1fa67.parquet')]
Snapshot: Operation.APPEND: id=4677529714979006141,
parent_id=201109056551926719, schema_id=0
Manifests len: 113 Manifests: [ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], Mani
festFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[], ManifestFile[],
ManifestFile[], ManifestFile[], ManifestFile[]]
Min Sequence Number: 1
Data Entries len: 113. Data Entries: [ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], Manif
estEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[], ManifestEntry[], ManifestEntry[], ManifestEntry[],
ManifestEntry[]]
File Tasks len: 113. File Tasks: [FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494051700), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494056472), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494097685), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494600352), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494205073), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493709376), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494206456), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=495978549), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=495143131), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=496241356), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494682275), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494579508), FileScanTask(file=DataFil
e[], delete_files=set(), start=0, length=496929028),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494002896),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495953229),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494633379),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495099941),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=497853121),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495267863),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495068906),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494998529),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494602737),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=491990187),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494744208),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495596341),
FileScan
Task(file=DataFile[], delete_files=set(), start=0, length=493177401),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494960184),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493198863),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492132433),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495936814),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493357419),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494253435),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493071088),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495534769),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494249197),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493625103),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492580150),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493
170884), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492250552), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492710609), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495966115), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492119992), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494052438), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493245637), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492392459), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492209909), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494422601), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493919972), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=493767913), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492967329), FileScanTask(file=DataFile[], delete_files=set(), st
art=0, length=494959553), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=494982541), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492626831), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=495498075), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=496873598), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492702108), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=491681274), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493541736), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=492991649), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493836095), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=493324863), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=495288308), FileScanTask(file=DataFile[], delete_files=set(),
start=0, length=494510377), FileScanTask(file=DataFile[], delet
e_files=set(), start=0, length=493685060), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493637131), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493938751), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493530497), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494363032), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=496402461), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493114075), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493263706), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=494223956), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=492738400), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=493210430), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=492770903), FileScanTask(file=DataFile[],
delete_files=set(), start=0, length=495216511), FileScanTask(file=
DataFile[], delete_files=set(), start=0, length=491954928),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=496378306),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494000374),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495560515),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494177912),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494393945),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=491712214),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493859774),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492780030),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492608286),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493536200),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493279408),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494332941), F
ileScanTask(file=DataFile[], delete_files=set(), start=0, length=493560668),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=495232338),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493209136),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492658968),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492748284),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494629418),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=492349376),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494546714),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=494420128),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493249615),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493594036),
FileScanTask(file=DataFile[], delete_files=set(), start=0, length=493955308),
FileScanTask(file=DataFile[], delete_files=set(), start=0, len
gth=492567219), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494869323), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492964213), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492422583), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492943989), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494295241), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492392903), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492940530), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=492881720), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495319222), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=494580686), FileScanTask(file=DataFile[], delete_files=set(), start=0,
length=495754650)]
2025-02-10 16:22:29 - pyiceberg.io.pyarrow - INFO - Number of tasks: 113
Number of Futures: 113
2025-02-10 16:23:42 - pyiceberg.io.pyarrow - INFO - total_row_count: 99141,
len(tables): 113 len(completed_futures): 113
2025-02-10 16:23:42 - pyiceberg.io.pyarrow - INFO - [(0, 186), (1, 303), (2,
861), (3, 832), (4, 849), (5, 922), (6, 933), (7, 911), (8, 903), (9, 882),
(10, 898), (11, 890), (12, 809), (13, 855), (14, 908), (15, 929), (16, 852),
(17, 898), (18, 857), (19, 935), (20, 840), (21, 849), (22, 853), (23, 893),
(24, 929), (25, 877), (26, 905), (27, 917), (28, 904), (29, 868), (30, 883),
(31, 857), (32, 896), (33, 905), (34, 899), (35, 885), (36, 878), (37, 855),
(38, 921), (39, 891), (40, 933), (41, 830), (42, 857), (43, 887), (44, 909),
(45, 883), (46, 903), (47, 860), (48, 907), (49, 878), (50, 937), (51, 870),
(52, 884), (53, 877), (54, 926), (55, 891), (56, 861), (57, 920), (58, 922),
(59, 880), (60, 892), (61, 922), (62, 885), (63, 854), (64, 882), (65, 892),
(66, 870), (67, 881), (68, 876), (69, 844), (70, 858), (71, 921), (72, 948),
(73, 898), (74, 910), (75, 852), (76, 971), (77, 899), (78, 887), (79, 915),
(80, 874), (81, 906), (82, 930), (83, 874), (84, 872), (85, 871), (86, 8
77), (87, 891), (88, 820), (89, 877), (90, 876), (91, 928), (92, 859), (93,
878), (94, 884), (95, 954), (96, 856), (97, 924), (98, 859), (99, 914), (100,
892), (101, 889), (102, 886), (103, 882), (104, 915), (105, 862), (106, 907),
(107, 886), (108, 837), (109, 910), (110, 963), (111, 926), (112, 872)]
2025-02-10 16:23:42 - pyiceberg.io.pyarrow - INFO - [(0,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-1-c508ad15-6f68-483c-894b-129b961e8156.parquet'),
(1,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-2-c508ad15-6f68-483c-894b-129b961e8156.parquet'),
(2,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fa728784-c111-4700-baeb-31cc9a2fece6.parquet'),
(3,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-47b83244-e7e3-4acc-a0b0-4dae26159e4d.parquet'),
(4,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-154b77e9-93a1-4704-a29a-b1b4d867a91c.parquet'),
(5,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-26ef8d83-fced-4341-ade6-debd45b7825e.parquet'),
(6,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4cb0153f-ada5-4561-8e9a-23c05c952ffc.parquet'),
(7,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3f0fae07-e85e-4ec3-aae3-9e5a0236c078.parquet'),
(8,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3bacb33d-d0f4-430a-9cb9-b50ef45df203.parquet'),
(9,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-115bbe80-3f6e-4e4a-9c34-72415a8e6a3b.parquet'),
(10,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f8f993a8-21d5-427e-bdd3-2b6e15b53b93.parquet'),
(11,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-398056ba-8209-49ab-aa40-c6ba8cdf4851.parquet'),
(12, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54
d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7999a954-8e8e-4327-b80a-5eebe266d4bc.parquet'),
(13,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-22aebdbb-b657-4b65-a625-664ec2d6c8ae.parquet'),
(14,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4353a200-da2d-4c72-b5f1-b9fc97027821.parquet'),
(15,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-e125ae14-6f93-4360-9900-16bacda26ab2.parquet'),
(16,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-10f203a4-d51a-49d7-80d7-ae62d2088b4f.parquet'),
(17,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-61ea8271-2b5f-47af-904d-e0cce3c9b85e.parquet'),
(18,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/
00000-3-22682f0d-fa15-466e-aab5-fb5ec480f5e8.parquet'), (19,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-dba18d34-0681-4c70-874c-13b30c5e0d36.parquet'),
(20,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cb901733-d90f-4184-b663-6f4b9b32e5ff.parquet'),
(21,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5d997148-4e17-42ab-8528-af9c0ac04676.parquet'),
(22,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-8b4152c8-0f89-48ae-a615-698b31cef113.parquet'),
(23,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-1f058136-be92-49eb-bc54-68b9c52ee0fb.parquet'),
(24,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-18f2e5fe-e616-4a98-845c-b9dd43035f16.parq
uet'), (25,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d64f525e-bbc5-43e4-895e-a48b52949e3d.parquet'),
(26,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-1a5bf16a-31bd-42ac-b403-90effa2f8ffa.parquet'),
(27,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a136a8ea-049b-410b-ac31-6b29e32c8711.parquet'),
(28,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5a09ba4f-04b8-4a9a-a725-56ad5254cb8b.parquet'),
(29,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9b688cf9-1e37-4913-bb94-3474b6c5a6f8.parquet'),
(30,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-83bd54e7-9db2-4534-9391-2428a3776787.parquet'),
(31, 's3a://warehouse-75e51f17-ed4b-4698-a
b25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f7555549-c2d6-4f5b-9ae8-07f1d231ae12.parquet'),
(32,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-20c34aed-e40b-4ba9-93e4-38918521b3ff.parquet'),
(33,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-efc8ef61-b1f0-42f8-92a7-1104c71b237b.parquet'),
(34,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-38bcdac5-aa65-4e4b-ac8c-4de41c9ef4f6.parquet'),
(35,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-806a44fd-0947-41ff-9d67-82fe504d8269.parquet'),
(36,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ec939eaf-dbbb-47e3-a9fc-afb1bfc59b64.parquet'),
(37,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shu
ffled/data/00000-3-b7b0d26c-5950-452d-bf22-0f8f99fca685.parquet'), (38,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7e01167a-4178-4bde-89f3-676bdc5e00a5.parquet'),
(39,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a6222844-8bd3-493e-a717-315517029a01.parquet'),
(40,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-55673760-7640-48b4-ac00-f83e2f44d363.parquet'),
(41,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a9c9e8a3-ab8d-45ff-8741-0f3422d9959f.parquet'),
(42,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-61520735-bc3f-4c9a-a7da-ec0941c80e63.parquet'),
(43,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f84d5db8-4527-48f8-bb77-c688d5
0614d9.parquet'), (44,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-4fb926a7-ebd7-4ac4-8508-53c62d89a0de.parquet'),
(45,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-034bf6b6-0e21-4bba-9c61-391a26140ab4.parquet'),
(46,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-52336eb9-efc8-4a80-957a-3fd1c6f5b683.parquet'),
(47,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-66dac5a1-eef5-4b97-a900-bbb2d30e9f97.parquet'),
(48,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ab4f163a-df21-4f22-b926-3c7e97108134.parquet'),
(49,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-bdd64a81-79ae-4b12-a4b0-51d60c0feae5.parquet'),
(50, 's3a://warehouse-75e51f17-
ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6cd11078-bba2-43db-ad8c-db4d558b7c49.parquet'),
(51,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9c9ba866-0cf0-4fac-97e2-77b8b5d9b9ed.parquet'),
(52,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5db618a7-01fc-4b5a-b23a-ff12e30cba7e.parquet'),
(53,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7de9bd18-f32d-4b9b-96c4-75ca70561452.parquet'),
(54,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-75cf8119-cb74-4e64-b101-960ef30e876f.parquet'),
(55,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-108dc4e0-cf66-4a02-99cf-a0aa501341b9.parquet'),
(56,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_sliprat
io_data_shuffled/data/00000-3-2496fe41-c505-4028-8bb6-add8e5ba043a.parquet'),
(57,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fee54ffa-70e2-4458-9a8d-8dc9ade52be0.parquet'),
(58,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5d7d8b89-0122-4050-aa85-278c2a6657ae.parquet'),
(59,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7ceeebb5-dcd9-40cb-abc8-db4e0c51fddd.parquet'),
(60,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-99536e9a-b99d-4aee-9dd7-83dd738445d7.parquet'),
(61,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ea7a6f2c-26fa-4e74-a75f-1576806f2c02.parquet'),
(62,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9b7a2975-b7cd-45ac-
95ae-402b068cf109.parquet'), (63,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-05f2e047-e910-4960-b624-e9c9a9f9c149.parquet'),
(64,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2676f91c-9d83-4d8e-8149-482993634a17.parquet'),
(65,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-814bfe90-afba-421d-975d-1b56c20fa705.parquet'),
(66,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5dbca4bb-00d6-4576-b9d2-09092d281680.parquet'),
(67,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6b0ea0bd-9a73-419a-b77f-13fcde1d97fb.parquet'),
(68,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-c283c84c-c5ec-4e34-92e1-67a7ed8fcbb0.parquet'),
(69, 's3a://warehous
e-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3273ff0c-e796-4783-8b61-78b6c0811ceb.parquet'),
(70,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6a71883d-7eed-494d-948e-21473bf7558c.parquet'),
(71,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-ff3c5c2c-70f2-46d6-9feb-f722cce140ad.parquet'),
(72,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-e79fc024-63a2-4ac3-ac36-0e963d791c28.parquet'),
(73,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-3478d8e1-ad0f-4804-9532-b988786fcef0.parquet'),
(74,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-c77722fc-c454-4e43-9685-5ffa528f64f0.parquet'),
(75, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim
/dl_slipratio_data_shuffled/data/00000-3-54851863-94f0-4523-862e-b42792ae039b.parquet'),
(76,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0eb01eaa-2098-4e69-951a-a0cd921accb4.parquet'),
(77,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f51bc6e4-be69-460e-9267-c4009d9035a4.parquet'),
(78,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-fb5db770-ab80-4fa5-8721-dbf73f558612.parquet'),
(79,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a50fc127-99bc-4d0b-b60b-64433b0917c4.parquet'),
(80,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-876251aa-79cb-4848-881a-99a145be3ec8.parquet'),
(81,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a5e1c4ac
-7e02-4967-85d7-22099b2701ed.parquet'), (82,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-06b9baf6-2dd3-4313-be4f-fc752c1f43ff.parquet'),
(83,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d3661587-2956-4036-af22-2fc882e125a5.parquet'),
(84,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-43cba3f5-279d-463e-bd35-011c5686003b.parquet'),
(85,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-7602f1d5-42fa-4378-9d39-ac5fb3508588.parquet'),
(86,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-80968fe3-cc21-48b0-9f01-bb3c071cfed3.parquet'),
(87,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-f27512c5-187c-45a5-9fb7-25b7239129a5.parquet'),
(88, 's3a
://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-74356529-5e11-4ef7-8abc-769cae5fc764.parquet'),
(89,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-83442492-99d2-420e-b39c-81b9c3253aac.parquet'),
(90,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-964fc0f0-1645-44e3-80e2-79c41c1b9192.parquet'),
(91,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-34e98b88-a126-485f-b210-5029672447e5.parquet'),
(92,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-9c7df36e-c16e-42bc-9afc-ef26de89164c.parquet'),
(93,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-28c2aecc-973b-46bb-9de2-8fe6d8cb1e4d.parquet'),
(94, 's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979
/data_dykim/dl_slipratio_data_shuffled/data/00000-3-68afddfb-8cb2-42ea-b7bb-181cc333cdf5.parquet'),
(95,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d1f823c5-e7c5-40dd-9092-cde14ae9b2bd.parquet'),
(96,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0e7d7c53-d9d5-4788-b54f-d350547ddea9.parquet'),
(97,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cc51b67a-243e-4d26-ae7c-c169baa177ac.parquet'),
(98,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-356b61cd-2116-445d-8fcf-eaa67ea562cd.parquet'),
(99,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-27d10a83-709f-448e-9945-67a7f469421c.parquet'),
(100,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/0000
0-3-55c3e5e0-e842-447d-adac-54c75bb9eb6b.parquet'), (101,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-c126d91b-84de-4d3d-b73d-d39f3df6e628.parquet'),
(102,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-0faaa7d5-4d55-4de7-89c9-45e51294ec6a.parquet'),
(103,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-07519a00-425d-46d2-a961-ed0d109b7962.parquet'),
(104,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-5e8b5d7e-c8ab-4763-b1cf-36d4cfd145b3.parquet'),
(105,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-a8b3da1a-6a64-4f5f-a421-6919c1c91e86.parquet'),
(106,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2979538f-3296-4a32-8fee-acddef8d2c2f.pa
rquet'), (107,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-438fe9af-d4c7-468c-bfd1-fcfa73c5cec4.parquet'),
(108,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-cc8d53c6-cb3e-4bbe-8749-e7d2a7e19476.parquet'),
(109,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-2cae4cca-02bc-415d-9d88-e57f25642512.parquet'),
(110,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-95717779-0b60-4102-8c6c-6fbea83e7da0.parquet'),
(111,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-6ad05d43-ab26-41f8-87a7-4b5da1443e33.parquet'),
(112,
's3a://warehouse-75e51f17-ed4b-4698-ab25-a288f54d4979/data_dykim/dl_slipratio_data_shuffled/data/00000-3-d5593775-a617-47ca-a55c-4c2ca7c1fa67.parquet')]
!!!!!!!!!!!! len(arr) = 99141```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
