[jira] [Updated] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread ASF GitHub Bot (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-46131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated SPARK-46131:
---
Labels: pull-request-available  (was: )

> Install torchvision for Python 3.12 build
> -
>
> Key: SPARK-46131
> URL: https://issues.apache.org/jira/browse/SPARK-46131
> Project: Spark
>  Issue Type: Sub-task
>  Components: Project Infra
>Affects Versions: 4.0.0
>Reporter: Hyukjin Kwon
>Priority: Major
>  Labels: pull-request-available
>
> {code}
> ==
> ERROR [0.001s]: test_end_to_end_run_distributedly 
> (pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorDistributedUnitTestsOnConnect.test_end_to_end_run_distributedly)
> --
> Traceback (most recent call last):
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 495, in test_end_to_end_run_distributedly
> train_fn = create_training_function(self.mnist_dir_path)
>^
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 60, in create_training_function
> from torchvision import transforms, datasets
> ModuleNotFoundError: No module named 'torchvision'
> ==
> ERROR [0.001s]: test_end_to_end_run_locally 
> (pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsIIOnConnect.test_end_to_end_run_locally)
> --
> Traceback (most recent call last):
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 402, in test_end_to_end_run_locally
> train_fn = create_training_function(self.mnist_dir_path)
>^
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 60, in create_training_function
> from torchvision import transforms, datasets
> ModuleNotFoundError: No module named 'torchvision'
> ==
> ERROR [0.001s]: test_end_to_end_run_locally 
> (pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsOnConnect.test_end_to_end_run_locally)
> --
> Traceback (most recent call last):
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 402, in test_end_to_end_run_locally
> train_fn = create_training_function(self.mnist_dir_path)
>^
>   File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
> line 60, in create_training_function
> from torchvision import transforms, datasets
> ModuleNotFoundError: No module named 'torchvision'
> --
> Ran 23 tests in 50.860s
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread Hyukjin Kwon (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-46131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-46131:
-
Description: 
{code}
==
ERROR [0.001s]: test_end_to_end_run_distributedly 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorDistributedUnitTestsOnConnect.test_end_to_end_run_distributedly)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 495, in test_end_to_end_run_distributedly
train_fn = create_training_function(self.mnist_dir_path)
   ^
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 60, in create_training_function
from torchvision import transforms, datasets
ModuleNotFoundError: No module named 'torchvision'

==
ERROR [0.001s]: test_end_to_end_run_locally 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsIIOnConnect.test_end_to_end_run_locally)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 402, in test_end_to_end_run_locally
train_fn = create_training_function(self.mnist_dir_path)
   ^
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 60, in create_training_function
from torchvision import transforms, datasets
ModuleNotFoundError: No module named 'torchvision'

==
ERROR [0.001s]: test_end_to_end_run_locally 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsOnConnect.test_end_to_end_run_locally)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 402, in test_end_to_end_run_locally
train_fn = create_training_function(self.mnist_dir_path)
   ^
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 60, in create_training_function
from torchvision import transforms, datasets
ModuleNotFoundError: No module named 'torchvision'

--
Ran 23 tests in 50.860s
{code}

  was:
{code}
==
ERROR [0.001s]: test_end_to_end_run_distributedly 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorDistributedUnitTestsOnConnect.test_end_to_end_run_distributedly)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 495, in test_end_to_end_run_distributedly
train_fn = create_training_function(self.mnist_dir_path)
   ^
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 60, in create_training_function
from torchvision import transforms, datasets
ModuleNotFoundError: No module named 'torchvision'

==
ERROR [0.001s]: test_end_to_end_run_locally 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsIIOnConnect.test_end_to_end_run_locally)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 402, in test_end_to_end_run_locally
train_fn = create_training_function(self.mnist_dir_path)
   ^
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 60, in create_training_function
from torchvision import transforms, datasets
ModuleNotFoundError: No module named 'torchvision'

==
ERROR [0.001s]: test_end_to_end_run_locally 
(pyspark.ml.tests.connect.test_parity_torch_distributor.TorchDistributorLocalUnitTestsOnConnect.test_end_to_end_run_locally)
--
Traceback (most recent call last):
  File "/__w/spark/spark/python/pyspark/ml/torch/tests/test_distributor.py", 
line 402, in test_end_to_end_run_locally
train_fn = create_training_function(self.mnist_dir_path)