[
https://issues.apache.org/jira/browse/FLINK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jane Chan updated FLINK-27558:
------------------------------
Description:
When
{code:java}
TableStoreFactory.onCompactTable
{code}
gets called, the planned manifest entries need to be injected back into the
enriched options, and we need a new key to represent it.
The explained plan should be like
{code}
== Abstract Syntax Tree ==
LogicalSink(table=[default_catalog.default_database.T0], fields=[f0, f1, f2],
hints=[[[OPTIONS options:{num-sorted-run.compaction-trigger=2,
path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/,
compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane
Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane
Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger
Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger
Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The
Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and
Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride
and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
+- LogicalTableScan(table=[[default_catalog, default_database, T0]],
hints=[[[OPTIONS inheritPath:[] options:{num-sorted-run.compaction-trigger=2,
path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/,
compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane
Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane
Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger
Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger
Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The
Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and
Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride
and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
{code}
was:
When
{code:java}
TableStoreFactory.onCompactTable
{code}
gets called, the planned manifest entries need to be injected back into the
enriched options, and we need a new key to represent it.
> Introduce a new optional option for TableStoreFactory to represent planned
> manifest entries
> -------------------------------------------------------------------------------------------
>
> Key: FLINK-27558
> URL: https://issues.apache.org/jira/browse/FLINK-27558
> Project: Flink
> Issue Type: Sub-task
> Components: Table Store
> Affects Versions: table-store-0.2.0
> Reporter: Jane Chan
> Assignee: Jane Chan
> Priority: Major
> Labels: pull-request-available
> Fix For: table-store-0.2.0
>
>
> When
> {code:java}
> TableStoreFactory.onCompactTable
> {code}
> gets called, the planned manifest entries need to be injected back into the
> enriched options, and we need a new key to represent it.
> The explained plan should be like
> {code}
> == Abstract Syntax Tree ==
> LogicalSink(table=[default_catalog.default_database.T0], fields=[f0, f1, f2],
> hints=[[[OPTIONS options:{num-sorted-run.compaction-trigger=2,
> path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/,
>
> compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane
> Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane
> Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger
> Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger
> Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The
> Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and
> Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride
> and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
> +- LogicalTableScan(table=[[default_catalog, default_database, T0]],
> hints=[[[OPTIONS inheritPath:[] options:{num-sorted-run.compaction-trigger=2,
> path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/,
>
> compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane
> Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane
> Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger
> Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger
> Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The
> Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and
> Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride
> and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
