damccorm commented on issue #28773:
URL: https://github.com/apache/beam/issues/28773#issuecomment-1743497439

   Fixes I've gotten working so far:
   
   > 1. Main session isn't saved correctly, leading to dependencies not being 
available at runtime. When save_main_session is specified, it fails because its 
not able to correctly pickle the file
   
   1. Add save_main_session flag
   2. Update requirements.txt to use tensorflow_hub instead of tensorflow-hub
   3. Put the colab auth + dependency in a function and then invoke that 
function so that it doesn't get automatically imported when the main session is 
loaded.
   
   > 2. Relies on load_model function from an example, should just inline it
   
   Inlined function
   
   > 3. Models are saved in unusable format and thus can't be loaded
   
   Instead of downloading directly, for each model type do something like:
   
   ```
   model = tf.keras.applications.resnet.ResNet152()
   model.save('/path/to/model/resnet152_weights_tf_dim_ordering_tf_kernels.h5')
   ```
   
   > 4. It looks like the model updates aren't actually propagating through as 
well... e.g. 
https://pantheon.corp.google.com/dataflow/jobs/us-central1/2023-10-02_10_40_00-5726123037803609215
   
   Not sure yet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to