Re: covid 19 Data [DISCUSSION]

[Shamshad Ansari]

Does any one know of any source to get chest X-rays or CT scan of COVID-19
patients?
Thank you.
--Sam

On Sun, Apr 12, 2020 at 3:30 PM jane thorpe 
wrote:

> Hi,
>
> Three weeks a phD guy proposed to start a project  to use Apache Spark
> to help the WHO with predictive analysis  using COVID -19 data.
>
>
> I have located the daily updated data.
> It can be found here
> https://github.com/CSSEGISandData/COVID-19.
>
> I was wondering if Apache Spark is up to the job of handling BIG DATA of
> this  size
> or would it be better to use WEKA.
>
> Please discuss which product is more suitable ?
>
>
> Jane
> janethor...@aol.com
>

Re: [spark standalone mode] force spark to launch driver in a specific worker in cluster mode

[Shamshad Ansari]

spark.driver.host (local hostname) Hostname or IP address for the driver.
This is used for communicating with the executors and the standalone Master.




On Fri, Jul 26, 2019 at 12:43 AM Latha Appanna 
wrote:

> Hello,
>
> I'm looking for ways to configure spark-master to launch *driver* in a
> specific  spark-worker in *cluster* deploy mode.  Say, I have master1,
> worker1 and worker2. I want spark-master to always launch driver in worker2
> in deploymode cluster and in spark standalone mode. Please let me know what
> spark configurations need to be set to achieve this.
>
>
> Thanks & Regards,
> Latha
>
>

How to get loss per iteration in Spark MultilayerPerceptronClassificationModel?

[Shamshad Ansari]

Hello All,
Apache Spark ML's LogisticRegressionModel has summary().objectHistory()
method. Is there any such method available for
MultilayerPerceptronClassificationModel? If not, what’s a way to get loss
per iteration? Any help is greatly appreaciated. Thank you.

[Spark ML] Using GBTClassifier in OneVsRest

[ansari]

It appears as if the inheritance hierarchy doesn't allow GBTClassifiers to be
used as the binary classifier in a OneVsRest trainer. Is there a simple way
to use gradient-boosted trees for multiclass (not binary) problems?

Specifically, it complains that GBTClassifier doesn't inherit from
Classifier[_, _, _].

I'm using Spark 2.0.1:

val gbt = new GBTClassifier()
  .setLabelCol("indexedLabel")
  .setFeaturesCol("features")
  .setMaxIter(10)
  .setMaxDepth(10)
 
val ovr = new OneVsRest().
setClassifier(gbt)

fails saying

error: type mismatch;
 found   : org.apache.spark.ml.classification.GBTClassifier
 required: org.apache.spark.ml.classification.Classifier[_, _, _]
   setClassifier(gbt)



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-ML-Using-GBTClassifier-in-OneVsRest-tp27933.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org