Hi all,
I was able to get H-2-O running from WSO2-ML UI. It can take a given file
and train a deeplearning algorithm and produce the model.
However, I get the following error after the training process. The error is
due to the inability to deserialize the DeepLearningModel (H-2-O class)
Though the serialization happens, deserialization produce the following
error.
I have already posted this on their google group and awaiting a response.
[2015-07-01 09:48:14,490] ERROR
{org.wso2.carbon.ml.core.impl.MLModelHandler} -
Failed to build the model [id] 52
org.wso2.carbon.ml.core.exceptions.MLModelBuilderException: An error
occurred wh
ile building supervised machine learning model: An error occurred while
building
stacked autoencoders model: Job aborted due to stage failure: Task 0 in
stage 1
.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1,
local
host): java.io.InvalidClassException: hex.deeplearning.DeepLearning; no
valid co
nstructor
at
java.io.ObjectStreamClass$ExceptionInfo.newInvalidClassException(Obje
ctStreamClass.java:150)
at
java.io.ObjectStreamClass.checkDeserialize(ObjectStreamClass.java:768
)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
775)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:19
93)
at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)
at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1
801)
at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
at
org.apache.spark.serializer.JavaDeserializationStream.readObject(Java
Serializer.scala:68)
at
org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSe
rializer.scala:94)
at
org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:57)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:617)
at java.lang.Thread.run(Thread.java:745)
Driver stacktrace:
at
org.wso2.carbon.ml.core.spark.algorithms.DeeplearningModel.buildModel
(DeeplearningModel.java:94)
at
org.wso2.carbon.ml.core.impl.MLModelHandler$ModelBuilder.run(MLModelH
andler.java:588)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:617)
at java.lang.Thread.run(Thread.java:745)
On Tue, Jun 30, 2015 at 2:34 PM, Thushan Ganegedara <thu...@gmail.com>
wrote:
> Thank you very much
>
> It works now.
>
> On Tue, Jun 30, 2015 at 11:35 AM, Nirmal Fernando <nir...@wso2.com> wrote:
>
>> Hi Thushan,
>>
>> Here you go;
>> https://github.com/wso2/carbon-ml/commit/959c89e2fbfe04ec4c49290fd68ac08ae8718e6a
>>
>> context.getFacts().getDatasetURL()
>>
>> On Tue, Jun 30, 2015 at 5:12 AM, Thushan Ganegedara <thu...@gmail.com>
>> wrote:
>>
>>> Hello all,
>>>
>>> It seems H-2-O takes data as a file (.csv format) But in wso2-ml data is
>>> passed as JavaRDD<LabeledPoint> to train method.
>>>
>>> So clearly there's going to be an inconsistency between deeplearning and
>>> other algorithms.
>>>
>>> I already posted the question in the h-2-o google group. They have said
>>> it's theoritically possible to pass data to h-2-o in the code itself.
>>> However, they haven't come out with a specific solution there. So I'm
>>> waiting on that.
>>>
>>> Is there a way to directly access the file within the classifier (or
>>> maybe pass the file to the classifier), if that option becomes the last
>>> resort for this task?
>>>
>>> Thank you
>>>
>>> --
>>> Regards,
>>>
>>> Thushan Ganegedara
>>> School of IT
>>> University of Sydney, Australia
>>>
>>
>>
>>
>> --
>>
>> Thanks & regards,
>> Nirmal
>>
>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>> Mobile: +94715779733
>> Blog: http://nirmalfdo.blogspot.com/
>>
>>
>>
>
>
> --
> Regards,
>
> Thushan Ganegedara
> School of IT
> University of Sydney, Australia
>
--
Regards,
Thushan Ganegedara
School of IT
University of Sydney, Australia
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
