Hi Shannon,
I think most jobs don't delete their temporary files. Having a
command-line flag should be fine.
On 11.03.2013 18:11, Shannon Quinn wrote:
> I have a load of fixes in the pipeline for the spectral clustering
> algorithms. The work on Eigencuts is extensive and still ongoing, so
> while I will post those tickets, the fixes wi,ll likely not make it for 0.8.
>
> SpectralKmeans, however, has numerous fixes that are ready to go. Before
> I post and commit them, I would like some input on the following items:
>
> 1: We added the option to use SSVD in place of the Lanczos solver. Would
> it be acceptable to have a command-line flag to specify the solver to use?
> 2: Lots of temporary files are generated by the numerous MR jobs chained
> together. Is there a rule of thumb for whether or not to delete these
> intermediate files after running the whole job? Right now I have a
> command-line flag to indicate whether they should be removed or not.
>
> Thanks!
>
> Shannon
