The code below uses prediction in the roc_auc_score, which is not correct.
I don't see where you isolate the splits.
Maybe go on the stackoverflow code review site with you full code.
If you find the results not reproducible, it is very likely that your
two code paths don't match.
From the code y
Hi Andy,
Yes, when I run the cross_val_score using the same seed then the outcomes are
the same. So that is all working as expected. However, the problems arise when
using the permutation in the code below. When mapping the function across the
500 seeds, I am getting out some very high scores f
Hi Tim.
I think it is highly unlikely that splits are not reproducible, and that
this is caused by parallelization.
If you run ``cross_val_score`` twice with the same seed, the outcomes
are exactly the same, right?
How are you trying and failing to reproduce the scores?
Best,
Andy
On 01/19/20
Hi Andy,
*This is actually the second time that I sending this reply as I don't think
that it got to the mailing list, and I cannot see it in the archives.*
Yes, I’m back to receiving the emails now. I noticed that in the previous
thread, there was some message about the website being down? But
Dear Joel,
Thanks for the reply here. Apologies for the later delay, but I have not been
receiving the email updates, and I only noticed your reply when I looked on the
archive.
My problem has now arisen in a smaller dataset with only 125 features (small in
genetics) and 7633 samples. Again I
