Sayak Ghosh created SPARK-14240:
-----------------------------------
Summary: PySpark Standalone Application hangs without any Error
message
Key: SPARK-14240
URL: https://issues.apache.org/jira/browse/SPARK-14240
Project: Spark
Issue Type: Bug
Components: Deploy, PySpark
Affects Versions: 1.6.0
Reporter: Sayak Ghosh
I am relatively new to Spark and wrote a simple script using python and spark
SQL. My problem is that it is perfectly allright at the starting phase of the
execution but gradually it slowed down and at the end of the last phase the
whole application hangs
Here is my code snippet -
{ hivectx.registerDataFrameAsTable(aggregatedDataV1,"aggregatedDataV1")
q1 = "SELECT *, (Total_Sale/Sale_Weeks) as Average_Sale_Per_SaleWeek,
(Total_Weeks/Sale_Weeks) as Velocity FROM aggregatedDataV1"
aggregatedData = hivectx.sql(q1)
aggregatedData.show(100)
}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
