Re: HMM investigations

2011-07-24 Thread Svetlomir Kasabov
quirements about what exactly are you trying to predict, the cause and effect relationship etc. That information can help model the problem in a way which is more amenable to Mahout's HMM trainers. On Sun, Jul 24, 2011 at 3:44 PM, Svetlomir Kasabov< skasa...@smail.inf.fh-brs.de> wrote:

Re: HMM investigations

2011-07-24 Thread Svetlomir Kasabov
1,0 88,00,9659090909090909 22.Dez.10,_04:33:00 25 no 88,0135,0 88,01,0 22.Dez.10,_04:34:00 Am 24.07.2011 21:15, schrieb Ted Dunning: I remember this problem. Is it possible for you to post some sample data? On Sun, Jul 24, 2011 at 12:08 PM, Svetlomir Kasa

Re: HMM investigations

2011-07-24 Thread Svetlomir Kasabov
Thanks, Ted, yes, I will prepare it and post it in c.a. 10 minutes. Am 24.07.2011 21:15, schrieb Ted Dunning: I remember this problem. Is it possible for you to post some sample data? On Sun, Jul 24, 2011 at 12:08 PM, Svetlomir Kasabov< skasa...@smail.inf.fh-brs.de> wrote: Hello aga

Re: HMM investigations

2011-07-24 Thread Svetlomir Kasabov
Hello again and thanks for the replies of both of you, I really apreciate them. The most important think is, that you try helping and how you do this is irrelevant :). I didn't feel angry/insulted. Yes, X1 and X2 are two independent hidden sequences, like BP -- BP -- BP (Blood Pressure) HR

HMM investigations

2011-07-24 Thread Svetlomir Kasabov
Hello, I consider using Mahout's implementation for Hidden Markov model (HMM) for prediction, but I want to clarify some important questions before using it: 1. I've read some literature about HMMs and in some sorces is written, that HMMs can also handle continiuous values as input (and not

Re: Wald's Test / parameter significance tests (Logistic Regression)

2011-07-22 Thread Svetlomir Kasabov
here is a pretty easy way to get average log likelihood out of these learning algorithms and the differences in these are (roughly) the log-likelihood ratio that you are talking about. Which other algorithms could I use for this ? Many thanks and best regards, Svetlomir Kasabov.

Wald's Test / parameter significance tests (Logistic Regression)

2011-07-21 Thread Svetlomir Kasabov
Hello, I plan using Mahout's OnlineLogisticRegression for probability estimation. I have extracted many parametes for my classification situation and I want to test how each of them affects the target variable. Can I use Mahout to check this significance (for example using Wald's test or Logl

Logistic Regression: number of positives and negatives

2011-07-11 Thread Svetlomir Kasabov
Hello, I plan using logistic regression for predicting the probability that a patient will be given a drug Y. The problem is, that patients don't get that drug so often and I have many more training examples with Y=0 than examples with Y=1. Do you think I should keep the number of negative e

Re: how do I choose appropriate OnlineLogisticRegression parameters for modelling this?

2011-07-05 Thread Svetlomir Kasabov
Hello, the answer of Vijay's question would be insteresting to me too, since I should use OnlineLogisticRegression in order to calculate probabilities (as far as I see, there are no probability calculation functions in AdaptiveLogisticRegression). So, for example, how to determine 'number of

Sequence / Temporal Learning using Mahout's classifier

2011-07-01 Thread Svetlomir Kasabov
Hello, I plan performing sequence/temporal learning using one of Mahout's classifier (probably OnlineLogisticRegression, since I need probabilities as outcome). For example, we have this data: tXY --- T1 xT1 Y1 T2 xT2

Re: Test

2011-06-18 Thread Svetlomir Kasabov
Test successful ;) Am 18.06.2011 17:23, schrieb Ken Williams: Test

Re: Probabilities in Bayesian classifier

2011-06-16 Thread Svetlomir Kasabov
on to be calibrated either. Those outputs are much more like probabilities, but they still have some issues. On Wed, Jun 15, 2011 at 6:56 PM, Svetlomir Kasabov< skasa...@smail.inf.fh-brs.de> wrote: unfortunately, Mahout's Naive Bayes implemention can't calculate probabilities.

Re: Probabilities in Bayesian classifier

2011-06-15 Thread Svetlomir Kasabov
Hello Steven, I've asked this question too: http://mail-archives.apache.org/mod_mbox/mahout-user/201105.mbox/%3cbanlktinyohrcynt0xzrpoqqg3zkepvk...@mail.gmail.com%3E unfortunately, Mahout's Naive Bayes implemention can't calculate probabilities. You are now probably really astonished - I could

Re: Logistic Regression + Time Series

2011-06-14 Thread Svetlomir Kasabov
soon or not. Thats's why I want to ask you if it is possible to use Mahout in connection with time series ? Do you see any potential problems / risks ? Many thanks and best regards! Svetlomir Kasabov. -- Svetlomir Dimitrov Kasabov This message was sent using IMP, the Internet Messaging Program.

CsvRecordFactory usage recomendation

2011-06-11 Thread Svetlomir Kasabov
Hello, I have a question: I have seen, that some of the mahout examples use the class CsvRecordFactory.java for parsing training and test examples. Would you recommend this class also for actual usage in production? This would mean, that I should create a CSV file from my real data (in my cas

Re: Logistic Regression + Time Series

2011-06-06 Thread Svetlomir Kasabov
s / risks ? Many thanks and best regards! Svetlomir Kasabov. -- Svetlomir Dimitrov Kasabov This message was sent using IMP, the Internet Messaging Program. -- Yee Yang Li Hector http://hectorgon.blogspot.com/ (tech + travel) http://hectorgon.com (book reviews)

Re: LogisticModelParameters#saveTo(OutputStream) generates an empty file

2011-06-06 Thread Svetlomir Kasabov
That also utterly kills reload performance. On Mon, Jun 6, 2011 at 7:34 AM, Svetlomir Kasabov< skasa...@smail.inf.fh-brs.de> wrote: Can't we simply use XML encoder to persist the model as XML? :

Re: LogisticModelParameters#saveTo(OutputStream) generates an empty file

2011-06-06 Thread Svetlomir Kasabov
ion style? The LogisticModelParameters style is fairly limited insofar as what it can do. On Thu, Jun 2, 2011 at 5:01 PM, Svetlomir Kasabov< skasa...@smail.inf.fh-brs.de> wrote: Hello, since I updated my trunk version of Mahout today, I get an empty file for the model when executing this code: /Out

LogisticModelParameters#saveTo(OutputStream) generates an empty file

2011-06-02 Thread Svetlomir Kasabov
Hello, since I updated my trunk version of Mahout today, I get an empty file for the model when executing this code: /OutputStream modelOutput = new FileOutputStream(LOGISTIC_MODEL); try { this.lmp.saveTo(modelOutput); } finally { modelOutput.close(); }

Logistic Regression + non-CSV examples

2011-06-02 Thread Svetlomir Kasabov
Hello, I have looked at the donut-example for Logistic Regression and have noticed, that a CSV file is used for the training and the test examples. My problem is, that my test examples are usually POJOs ( Plain Old Java Objects, which have usually nothing to do with the CSV format). In other

Logistic Regression: Coeffcients Calculation

2011-05-30 Thread Svetlomir Kasabov
more literature references about how the learning process happens ? Thanks a lot and best regards, Svetlomir Kasabov.