Github user dawidwys commented on a diff in the pull request:
https://github.com/apache/flink/pull/5580#discussion_r171181348
--- Diff:
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java
---
@@ -1829,6 +1830,28 @@ public void registerCachedFile(String filePath,
String name) {
* @param executable flag indicating whether the file should be
executable
*/
public void registerCachedFile(String filePath, String name, boolean
executable) {
- this.cacheFile.add(new Tuple2<>(name, new
DistributedCache.DistributedCacheEntry(filePath, executable)));
+ registerCachedFile(filePath, name, executable, false);
}
+
+ /**
+ * Registers a file at the distributed cache under the given name. The
file will be accessible
+ * from any user-defined function in the (distributed) runtime under a
local path. If upload is true files will
+ * be distributed via {@link BlobServer} otherwise Files should be
local files (as long as all relevant workers
+ * have access to it), or files in a distributed file system. The
runtime will copy the files temporarily to a
+ * local cache, if needed.
+ *
+ * <p>The {@link org.apache.flink.api.common.functions.RuntimeContext}
can be obtained inside UDFs via
+ * {@link
org.apache.flink.api.common.functions.RichFunction#getRuntimeContext()} and
provides access
+ * {@link org.apache.flink.api.common.cache.DistributedCache} via
+ * {@link
org.apache.flink.api.common.functions.RuntimeContext#getDistributedCache()}.
+ *
+ * @param filePath The path of the file
+ * @param name The name under which the file is registered.
+ * @param executable flag indicating whether the file should be
executable
+ * @param upload flag indicating if the file should be distributed via
BlobServer
+ */
+ public void registerCachedFile(String filePath, String name, boolean
executable, boolean upload) {
--- End diff --
What behaviour do you suggest sending all local files through Blob and
serving files from DFS as before?
---
