GitHub user CRZbulabula added a comment to the discussion: Support for Timestral and Tirex-2 in AINode
Thanks for opening #19272 and #19273 and clarifying the deployment approach. Deferring the Timestral download until an explicit `LOAD MODEL` addresses the unsolicited startup download, and the inactive/activating states make the proposed lifecycle easier to assess. I am reviewing the implementation details in the PRs and will keep code-specific feedback there. The weights' licensing conditions still apply, though. Please link the [exact checkpoint license](https://huggingface.co/mistralai/Timestral-209M/blob/main/LICENSE) in the user-facing setup instructions and explain the revenue restriction before users initiate the download; executing `LOAD MODEL` does not itself establish eligibility. Keeping the weights outside our distributions and the feature optional gives us a concrete proposal to assess under the [ASF optional-dependency policy](https://www.apache.org/legal/resolved.html#optional), but we should resolve whether this download workflow is acceptable with the PMC/ASF Legal before treating that question as settled. The existing Moirai2 behavior should be reviewed separately as well. Thanks also for clarifying that jitCast can use existing extension points without DataNode source changes. Could you share a minimal adapter/invocation example and the exact JDK, TornadoVM backend dependencies, and JVM flags used? jitCast currently targets Java 22, so the deployment requirements still need to be explicit alongside IoTDB's Java 17 baseline. GPU memory ownership, cancellation, and resource cleanup are worth testing when inference shares the database process. For the performance study, a comparison of embedded jitCast, co-located AINode, and remote AINode with matching checkpoints, precision, and workloads would be particularly useful. Warmed-up inference latency together with the impact on concurrent reads and writes would help separate execution-engine gains from data-transfer savings. GitHub link: https://github.com/apache/iotdb/discussions/19270#discussioncomment-19611765 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
