aglinxinyuan opened a new issue, #4363:
URL: https://github.com/apache/texera/issues/4363

   ### Feature Summary
   
   Add a new Dataset Selector operator that allows users to select a dataset 
version and output one tuple per file in that version.
   
   The output should use Texera’s existing dataset file path format, for 
example:
   
   ```
   /ownerEmail/dataset1/v1/file1.csv
   /ownerEmail/dataset1/v1/file2.csv
   /ownerEmail/dataset1/v1/file3.csv
   ```
   
   This would make it easier to connect dataset-managed files to downstream 
file-based operators without manually selecting files one by one.
   
   ### Proposed Solution or Design
   
   Introduce a new source operator named Dataset Selector.
   
   - In the property panel, users select a dataset and a dataset version.
   - The operator enumerates all files in the selected dataset version.
   - The operator outputs one tuple per file path using Texera’s dataset path 
format.
   - The operator should remain invalid until a dataset version is selected.
   - The output should be directly consumable by downstream operators that 
accept file path strings.
   
   ### Impact / Priority
   
   (P2)Medium – useful enhancement
   
   ### Affected Area
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to