Hello Everyone, I have developed a web application (say abc) in Python using web.py. I want to deploy it on the Spark Cluster. Since this application is a project with dependencies therefore I have made a zip file of the project (abc.zip) to be deployed on the cluster. In the project abc I have to execute application.py file which has the main method to start my web application. The command to execute the project is :
bin/spark-submit --master spark://master:7077 --py-files abc.zip application.py The structure of the project abc is that it has a data folder which has a file data.txt. The other python files in the project abc access that data.txt. On executing the above command and then opening the browser to access the developed web application results in an error of "data/data.txt not found" when actually it is present. I have been trying this for long. but everytime it shows the same error. Can anybody help me in this case. Plz let me know if any other info is required. Thanks & Regards, Anjali