Re: Aggregation of Streaming UI Statistics for multiple jobs

You can explore the rest API - https://spark.apache.org/docs/2.0.2/monitoring.html#rest-api On Sun, May 27, 2018 at 10:18 AM, skmishra wrote: > Hi, > > I am working on a streaming use case where I need to run multiple spark > streaming applications at the same time

Re: Big data visualization

Yes Amin Spark is primarily being used for ETL. Once you transform , you can store it in any nosql DBs that support use case. The BI dashboard app can further connect to the nosql DB for reports and visualization. HTH Deepak. On Mon, May 28, 2018, 05:47 amin mohebbi

Big data visualization

 I am working on analytic application using Apache Spark to store and analyze data. Spark might be used as a ETL application to aggregate  different metrics and then join with the aggregated metrics. The data sources are flat files that are coming from two different sources(interval meter data

Spark AsyncEventQueue doubt

Hi, I'm getting the below ERROR and WARN when running a little heavy calculation on a dataset - To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use > setLogLevel(newLevel). > 2018-05-27 12:51:11 ERROR AsyncEventQueue:70 - Dropping event from queue > appStatus. This likely means