Re: [prometheus-users] Does Prometheus support Netapp Trident NFS storage backend?

[Ben Kochie]

Last I remember, most of the issues are around file locking and atomic
operations.

Agent mode with WAL-only should be less of an issue, except possibly fsyncs.

Either way, depending on NFS is a bad idea from a reliability perspective,
as your monitoring system now depends on the network and storage server to
properly alert.

Like Stuart says, would you run your SQL servers over NFS?

On Tue, May 31, 2022 at 7:38 PM tejaswini vadlamudi 
wrote:

> What do you mean by not meeting desired performance characteristics? Is it
> the write conflicts, file/block size limiations, etc.. eventually over
> time, or is it with a high ingestion load?
> Do we have similar problems if we deploy Prometheus in Agent mode (data
> streamed to a remote location) but still need WAL storage to handle
> receiver connection failures?
>
> Thanks, Teja
> On Tuesday, May 31, 2022 at 5:41:11 PM UTC+2 Stuart Clark wrote:
>
>> On 2022-05-31 15:45, tejaswini vadlamudi wrote:
>> > Hi Stuart,
>> >
>> > I forgot to ask the most important question on this topic :-)
>> > Could you explain the reason for not supporting NFS based storage in
>> > Prometheus?
>> >
>>
>> At its core Prometheus contains a high performance time-series database.
>> Network filesystems just don't have the same performance characteristics
>> or features as a direct local disk. It is similar to not expecting
>> support for storing a MySQL/Oracle/MSSQL/etc. database on a network
>> storage system - it might technically work, but you are likely to
>> encounter problems at some point, and you are unlikely to recenive any
>> free/paid support in that architecture.
>>
>> --
>> Stuart Clark
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to prometheus-users+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/prometheus-users/993b1dc3-120d-4ec7-84d1-e99387e30e15n%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/CABbyFmqms4_rJyOx3dm7E3jqC-n4U_CGSekNoK%3DU%2BqTP0aDuvA%40mail.gmail.com.

Re: [prometheus-users] Does Prometheus support Netapp Trident NFS storage backend?

[tejaswini vadlamudi]

What do you mean by not meeting desired performance characteristics? Is it 
the write conflicts, file/block size limiations, etc.. eventually over 
time, or is it with a high ingestion load?
Do we have similar problems if we deploy Prometheus in Agent mode (data 
streamed to a remote location) but still need WAL storage to handle 
receiver connection failures?

Thanks, Teja
On Tuesday, May 31, 2022 at 5:41:11 PM UTC+2 Stuart Clark wrote:

> On 2022-05-31 15:45, tejaswini vadlamudi wrote:
> > Hi Stuart,
> > 
> > I forgot to ask the most important question on this topic :-)
> > Could you explain the reason for not supporting NFS based storage in
> > Prometheus?
> > 
>
> At its core Prometheus contains a high performance time-series database. 
> Network filesystems just don't have the same performance characteristics 
> or features as a direct local disk. It is similar to not expecting 
> support for storing a MySQL/Oracle/MSSQL/etc. database on a network 
> storage system - it might technically work, but you are likely to 
> encounter problems at some point, and you are unlikely to recenive any 
> free/paid support in that architecture.
>
> -- 
> Stuart Clark
>

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/993b1dc3-120d-4ec7-84d1-e99387e30e15n%40googlegroups.com.

Re: [prometheus-users] Does Prometheus support Netapp Trident NFS storage backend?

[Stuart Clark]

On 2022-05-31 15:45, tejaswini vadlamudi wrote:

Hi Stuart,

I forgot to ask the most important question on this topic :-)
Could you explain the reason for not supporting NFS based storage in
Prometheus?



At its core Prometheus contains a high performance time-series database. 
Network filesystems just don't have the same performance characteristics 
or features as a direct local disk. It is similar to not expecting 
support for storing a MySQL/Oracle/MSSQL/etc. database on a network 
storage system - it might technically work, but you are likely to 
encounter problems at some point, and you are unlikely to recenive any 
free/paid support in that architecture.


--
Stuart Clark

--
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/83d885d70a47b03fb24f22374c3d6618%40Jahingo.com.

Re: [prometheus-users] Does Prometheus support Netapp Trident NFS storage backend?

[tejaswini vadlamudi]

Hi Stuart,

I forgot to ask the most important question on this topic :-) 
Could you explain the reason for not supporting NFS based storage in 
Prometheus?

Thanks,
Teja
On Wednesday, May 4, 2022 at 11:02:54 PM UTC+2 tejaswini vadlamudi wrote:

> Thanks Stuart, now I understand support in Prometheus project.
> Though renowned storage vendors claim full compliance and seem to work 
> with Prometheus data, it is better to stay away from it.
>
> Cheers, Teja
> On Tuesday, May 3, 2022 at 9:53:52 PM UTC+2 Stuart Clark wrote:
>
>> On 03/05/2022 01:34, tejaswini vadlamudi wrote:
>> > Prometheus documentation recommends to avoid NFS storage backends. But 
>> > a few users over internet claim support for NFS based storage from 
>> > Netapp in Prometheus. Just checking for opinions and feedback if this 
>> > storage backend is compatible enough for regular Prometheus operations.
>> >
>> NFS isn't a supported option for Prometheus. Prometheus can do a lot of 
>> I/O and therefore network storage often doesn't work all that well. You 
>> can also have issues if the filesystem isn't fully POSIX compliant.
>>
>> Just because it isn't supported doesn't mean it won't work. However 
>> there are issues that people find, and if you do find those the 
>> recommendation would always be to switch the filesystem to something 
>> local. So basically you'd be fairly on your own if you did have problems.
>>
>> -- 
>> Stuart Clark
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to prometheus-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/4799f7e1-376c-4772-8ab3-8abfaa0e0d21n%40googlegroups.com.