I have been tasked to draw samples from very large raw data sets for triage analysis. I am to provide multiple sampling methods. Drawing a random sample of N records is one method. A second method is to draw a fixed sample of 1,032 records from stratified defined date boundaries in a set. The latter is of interest because raw data can substantially change structure or even format at points in time, and we need to be able to sample within those data boundaries.
Can anyone offer a link to an example of how nifi may be used to draw samples randomly and/or in a systematic way from raw data collections?
