[ https://issues.apache.org/jira/browse/SPARK-44963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-44963: ---------------------------------- Summary: Make PySpark (pyspark-ml module) tests passing without any optional dependency (was: Make PySpark (pyspark-ml module) tests passing without any dependency) > Make PySpark (pyspark-ml module) tests passing without any optional dependency > ------------------------------------------------------------------------------ > > Key: SPARK-44963 > URL: https://issues.apache.org/jira/browse/SPARK-44963 > Project: Spark > Issue Type: Improvement > Components: PySpark, Tests > Affects Versions: 4.0.0 > Reporter: Hyukjin Kwon > Priority: Major > > {code} > ./python/run-tests --python-executables=python3 --modules=pyspark-ml > ... > Starting test(python3): pyspark.ml.tests.test_model_cache (temp output: > /Users/hyukjin.kwon/workspace/forked/spark/python/target/f6f88c1e-0cb2-43e6-980e-47f1cdb9b463/python3__pyspark.ml.tests.test_model_cache__zij05l1u.log) > Traceback (most recent call last): > File > "/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py", > line 196, in _run_module_as_main > return _run_code(code, main_globals, None, > File > "/Users/hyukjin.kwon/miniconda3/envs/vanilla-3.10/lib/python3.10/runpy.py", > line 86, in _run_code > exec(code, run_globals) > File > "/Users/hyukjin.kwon/workspace/forked/spark/python/pyspark/ml/tests/test_functions.py", > line 18, in <module> > import pandas as pd > ModuleNotFoundError: No module named 'pandas' > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org