ill possible to reconstruct the
UI of a finished application through Spark’s history server, provided that
the application’s event logs exist."
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p21379.html
Sent from t
Where is the history server running? Is it running on the same node as the
logs directory.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p21374.html
Sent from the Apache Spark User List mailing list archive at
Perhaps you need to set this in your spark-defaults.conf so that¹s it¹s
already set when your slave/worker processes start.
-Joe
On 1/25/15, 6:50 PM, "ilaxes" wrote:
>Hi,
>
>I've a similar problem. I want to see the detailed logs of Completed
>Applications so I've set in my program :
>set("spar
ICATION_COMPLETE*
EVENT_LOG_1*
SPARK_VERSION_1.1.0*
I use spark 1.1.0 on a standalone cluster with 3 nodes.
Any suggestion to solve the problem ?
Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p21358.html
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p13055.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> -
://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p13055.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@sp
to all the nodes).
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p13055.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
gt; to the link, it appears that the history server is required only in mesos or
> yarn mode, not in standalone mode.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-w
appears that the history server is required only in mesos or
yarn mode, not in standalone mode.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12834.html
Sent from the Apache Spark User List mailing list archive at
runs on my local machine but not for the apps that run on
> our cluster, although in both cases I am using spark 1.0.1 in standalone
> mode. Do I need to do any additional configuration to enable this history
> on the cluster?
>
> thanks
>
>
>
>
> --
> View this messa
I am using spark 1.0.1 in standalone
mode. Do I need to do any additional configuration to enable this history
on the cluster?
thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12792.html
Sent from the Apach
tion. I guess we need to capture the "application detail UI" screen
> before the app run completes or find a way to extract this info by parsing
> the Json log file in /tmp/spark-events.
>
> thanks
>
>
>
> --
> Vi
y to extract this info by parsing
the Json log file in /tmp/spark-events.
thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12187.html
Sent from the Apache Spark User List mailing l
n other modes, you will need to use the
> history server instead.
>
> Does this make sense?
> Andrew
>
>
> 2014-08-14 18:08 GMT-07:00 SK :
>
> More specifically, as indicated by Patrick above, in 1.0+, apps will have
>> persistent state so that the UI can be reloaded. Is
so that the UI can be reloaded. Is there a way to enable
> this feature in 1.0.1?
>
> thanks
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-applicat
More specifically, as indicated by Patrick above, in 1.0+, apps will have
persistent state so that the UI can be reloaded. Is there a way to enable
this feature in 1.0.1?
thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application
p://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12156.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apac
ill disappear from the list if you
> restart Spark completely, even though they'll still be stored in the log
> folder.
>
>
> Best regards,
> Simon
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.
restart Spark completely, even though they'll still be stored in the log
folder.
Best regards,
Simon
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12150.html
Sent from the Apache Spark User Lis
my Spark program.
thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-tp3490p12144.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
This will be a feature in Spark 1.0 but is not yet released. In 1.0 Spark
applications can persist their state so that the UI can be reloaded after
they have completed.
- Patrick
On Sun, Mar 30, 2014 at 10:30 AM, David Thomas wrote:
> Is there a way to see 'Application Detail UI' page (at mast
Is there a way to see 'Application Detail UI' page (at master:4040) for
completed applications? Currently, I can see that page only for running
applications, I would like to see various numbers for the application after
it has completed.
22 matches
Mail list logo
