How to get loss per iteration in Spark MultilayerPerceptronClassificationModel?

2019-07-20 Thread Shamshad Ansari
Hello All, Apache Spark ML's LogisticRegressionModel has summary().objectHistory() method. Is there any such method available for MultilayerPerceptronClassificationModel? If not, what’s a way to get loss per iteration? Any help is greatly appreaciated. Thank you.

Re: Spark SaveMode

2019-07-20 Thread Mich Talebzadeh
JDBC read from Oracle table requires Oracle jdbc driver ojdbc6.jar or higher. ojdbc6.jar works for 11 and 12c added as --jars /ojdbc6.jar Example with parallel read (4 connections) to Oracle with ID being your PK in Oracle table var _ORACLEserver= "jdbc:oracle:thin:@rhes564:1521:mydb12" var

Re: Spark SaveMode

2019-07-20 Thread Mich Talebzadeh
This behaviour is governed by the underlying RDBMS for bulk insert, where it either commits or roll backs. You can insert new rows into an staging table in Oracle (which is common in ETL) and then insert/select into Oracle table in shell routine. The other way is to use JDBC in Spark to read