KMeans module requests the largest possible region
Mantis Issue 383, reported by jmalik, assigned to jmalik, created: 2011-07-13
Reported on otb-users
The largest possible region is requested when saving output of KMeans module.
In the module execution :
- quicklook generation is OK
- sample list generation OK
- KMeans tree generation is OK
- Configuration of the functors for classification is OK
- Two outputs generated and appears in the MVD tree.
- When trying to save them, the largest possible region is requested.
But the filter used are "simple" functor-based filter so they should support streaming out-of-the-box...
Forcing the requested region to a (0,0) sized region after the quicklook generation does not do the trick.
1327049779 - julienmUsing a QB XS product as input to the kmeans, the multiband output is streamed, but the label image is not (it's size is ~100MB).
The problem is that it does not take into account the pipeline ahead . Both Writer and WriterMVC module use ImageFileWriter instead of StreamingImageFileWriter, making Monteverdi memory unfriendly when using long pipeline. (otb::ImageFileWriter does not use the memory-adaptive splitters).
Also Monteverdi does not benefit from the new streaming strategy adaptive to tile size.
1327049958 - julienmAnd about the bug status : I don't reproduce it. KMeans module does not actually require the largest possible region systematically. It only does when the writer does, and ImageFileWriter has a lot more chances to require it than StreamingImageFileWriter.
1327051071 - julienmRelated fix here : http://hg.orfeo-toolbox.org/Monteverdi/rev/d2d9cc66ff35
Writer and WriterMVC module now use StreamingImageFileWriter.
Experimental here : http://dash.