I just dumped and loaded a fairly large tree (~40000 nodes; from bench_sgd_covertype.py) with cPickle, both operations performed in less than 1 sec (w/ and w/o HIGHTEST_PROTOCOL).
Brian: how large are your trees (are they complete binary trees?) best, Peter 2011/10/26 Peter Prettenhofer <[email protected]>: > brian, try to save the tree using:: > > cPickle.dump(tree, f, cPickle.HIGHEST_PROTOCOL) > > if this doesn't solve the issue we should reconsider Gaels array > representation. > > best, > peter > > Am 26.10.2011 14:37 schrieb "Andreas Mueller" <[email protected]>: >> >> > My question is; is there a way to improve the performance of loading >> > classifiers, either using different pickle options (of which I don't >> > know any, but there may be) >> > >> > >> Just to be sure, you used the latest pickling format, right? >> cPickle uses the oldest one by default afaik. >> >> >> ------------------------------------------------------------------------------ >> The demand for IT networking professionals continues to grow, and the >> demand for specialized networking skills is growing even more rapidly. >> Take a complimentary Learning@Cisco Self-Assessment and learn >> about Cisco certifications, training, and career opportunities. >> http://p.sf.net/sfu/cisco-dev2dev >> _______________________________________________ >> Scikit-learn-general mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general > -- Peter Prettenhofer ------------------------------------------------------------------------------ The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
