Got Error Creating permanent view in Postgresql through Pyspark code

2023-01-04 Thread Vajiha Begum S A
I have tried to Create a permanent view in Postgresql DB through Pyspark code, but I have received the below error message. Kindly help me to create a permanent view table in the database.How shall create permanent view using Pyspark code. Please do reply. *Error Message::* *Exception has occurred

Error using SPARK with Rapid GPU

2022-11-30 Thread Vajiha Begum S A
Hi, I'm using an Ubuntu system with the NVIDIA Quadro K1200 with GPU memory 20GB Installed - CUDF 22.10.0 jar file, Rapid 4 Spark 2.12-22.10.0 jar file, CUDA Toolkit 11.8.0 Linux version., JAVA 8 I'm running only single server, Master is localhost I'm trying to run pyspark code through spark submi

Error - using Spark with GPU

2022-11-30 Thread Vajiha Begum S A
spark-submit /home/mwadmin/Documents/test.py 22/11/30 14:59:32 WARN Utils: Your hostname, mwadmin-HP-Z440-Workstation resolves to a loopback address: 127.0.1.1; using ***.***.**.** instead (on interface eno1) 22/11/30 14:59:32 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address U

Unable to use GPU with pyspark in windows

2022-11-23 Thread Vajiha Begum S A
Hi Sean Owen, I'm using windows system with the NVIDIA Quadro K1200. GPU memory 20GB, Intel Core: 8 core installed - CUDAF 0.14 jar file, Rapid 4 Spark 2.12-22.10.0 jar file, CUDA Toolkit 11.8.0 windows version. Also installed- WSL 2.0 ( since I'm using windows system) I'm running only single ser

Pyspark ML model Save Error

2022-11-16 Thread Vajiha Begum S A
Hi, This is Vajiha, Senior Research Analyst. I'm working for Predictive Analysis with Pyspark ML models. It's quite good working with the features of spark in python. Though I'm having issues saving the pyspark trained ML models. I have read many articles,stack overflow and spark forum comments and