lina <lina.lastn...@gmail.com> wrote: > I need to extract the data for downstream analysis. after that, these > data can be removed.
Do you need all the data present at the same time to extract it? Obviously you won't need as much storage if you can analyse/extract it in sections. > On Wed, Jul 12, 2023 at 2:24 PM Jerome BENOIT > <sphericaltrian...@rezozer.net> wrote: > > > Hello, > > > > On 12/07/2023 13:48, lina wrote: > > > Currently I do not have a plan to keep the data, once the data > > > finished > > analyzing, I can just remove it. > > > > Do you want a `scratch space` [1] ? > > What can be also interesting to know is whether you can compress > > your data. > > > > Best wishes, > > Jerome > > > > [1] https://en.wikipedia.org/wiki/Scratch_space > > > > > > > > On Wed, Jul 12, 2023 at 12:26 PM Dan Ritter > > > <d...@randomstring.org > > <mailto:d...@randomstring.org>> wrote: > > > > > > lina wrote: > > > > Dear all, > > > > > > > > My computer only has 2 TB data storage capacity, > > > > > > > > I want to have 100 TB capacity to store/analyze data. > > > > > > > > I am thinking of adding 5 hard drives, each is 18TB, and > > > > then > > merge them > > > > into one volume? > > > > or get a file server? > > > > What is the best option for me, and what is the budget? > > > > > > Two questions: > > > > > > - do you have a backup plan in mind, or will you accept the > > > loss of all data? > > > > > > - how fast does new data come in, and how long do you need to > > > keep it around? > > > > > > -dsr- > > > > >