JingsongLi commented on a change in pull request #10452: [FLINK-15035][table-planner-blink] Introduce unknown memory setting to table in blink planner URL: https://github.com/apache/flink/pull/10452#discussion_r354681473
########## File path: flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/nodes/exec/BatchExecNode.scala ########## @@ -32,4 +33,13 @@ trait BatchExecNode[T] extends ExecNode[BatchPlanner, T] with Logging { */ def getDamBehavior: DamBehavior + def setManagedMemoryWeight[X]( + transformation: Transformation[X], memoryBytes: Long): Transformation[X] = { + // Using Bytes can easily overflow + // Using MebiBytes to cast to int + // Careful about zero + val memoryMB = Math.max(1, (memoryBytes >> 20).toInt) Review comment: Yeah, It's a bit hacky, looks like we create these hacky code to work around runtime default value. Because our current `ManagedMemoryWeight` settings are very large. So I think default 1 is very small and is not a serious problem, so I prefer just check in `ExecutorUtils#setBatchProperties`, and warn log when weight is default 1. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services