[prometheus-developers] Multithreading in prometheus
Hello experts, Aditya this side. I am a student, and have just started exploring prometheus. So please bear with me, if my doubts seems obvious to you. Did prometheus use multithreading to scrape targets? -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/dc130094-71d7-45af-9cc9-1597b6c6fbdc%40googlegroups.com.
Re: [prometheus-developers] cpu utilization
Hey Ben, thanks for replying. Is there any flag in prometheus to control this CPU usage or we have to depend on node-exporter metrics only. Can you give some areas we should look into once CPU starts taking too much time for prometheus work. Like what could be the possible reasons for sudden increase? On Friday, February 21, 2020 at 1:41:28 PM UTC+5:30, Ben Kochie wrote: > > Prometheus is meant to be run once to monitor many services on many nodes. > In a typical non-containerized environment, people generally dedicate a > node to it. > > As Stuart says, it depends on your rate of ingestion. It also depends on > the query and rule load. But typically you should be able handle 200,000 > samples per second per CPU. > > On Fri, Feb 21, 2020 at 6:26 AM adi garg > > wrote: > >> Thanks Stuart. Is it possible to control prometheus once its cpu usage >> starts to get over and starts affecting the other processes? >> >> On Thursday, February 20, 2020 at 4:01:07 PM UTC+5:30, Stuart Clark wrote: >>> >>> That will very much depend on what you are planning on doing. >>> >>> The more jobs you scrape and the shorter scrape interval or more metrics >>> will use more cpu. >>> >>> Equally more queries and more complex queries over longer time periods >>> would use more cpu. >>> >>> On 20 February 2020 08:51:55 GMT, adi garg wrote: >>>> >>>> Hello experts, Can you please share some insights on what percentage >>>> of cpu is taken by prometheus generally. And will it effect the other >>>> processes running on the system? >>>> >>>> Regards, >>>> Aditya Garg >>>> >>>> >>> -- >>> Sent from my Android device with K-9 Mail. Please excuse my brevity. >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "Prometheus Developers" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to prometheus-developers+unsubscr...@googlegroups.com >> . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/prometheus-developers/2d49ccba-f4e0-49db-990d-cc460bedcd56%40googlegroups.com >> >> <https://groups.google.com/d/msgid/prometheus-developers/2d49ccba-f4e0-49db-990d-cc460bedcd56%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/a3615bbc-fb26-473d-9ffe-d84b8ce35a7b%40googlegroups.com.
Re: [prometheus-developers] cpu utilization
Thanks Stuart. Is it possible to control prometheus once its cpu usage starts to get over and starts affecting the other processes? On Thursday, February 20, 2020 at 4:01:07 PM UTC+5:30, Stuart Clark wrote: > > That will very much depend on what you are planning on doing. > > The more jobs you scrape and the shorter scrape interval or more metrics > will use more cpu. > > Equally more queries and more complex queries over longer time periods > would use more cpu. > > On 20 February 2020 08:51:55 GMT, adi garg > wrote: >> >> Hello experts, Can you please share some insights on what percentage of >> cpu is taken by prometheus generally. And will it effect the other >> processes running on the system? >> >> Regards, >> Aditya Garg >> >> > -- > Sent from my Android device with K-9 Mail. Please excuse my brevity. > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/2d49ccba-f4e0-49db-990d-cc460bedcd56%40googlegroups.com.
[prometheus-developers] cpu utilization
Hello experts, Can you please share some insights on what percentage of cpu is taken by prometheus generally. And will it effect the other processes running on the system? Regards, Aditya Garg -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/55b82921-f65b-4828-ae0a-b38dcfe638ea%40googlegroups.com.
Re: [prometheus-developers] Is there any way to give memory specifications by ourselves in prometheus?
Thanks Stuart. Is it possible to restart the prometheus without data loss from that point? On Thursday, February 20, 2020 at 1:39:03 PM UTC+5:30, Stuart Clark wrote: > > If you are meaning the disk storage, Prometheus would stop working and you > might also encounter some corruption. > > You can control disk usage by setting the retention period or by setting > the maximum space to remain available. > > I'd strongly suggest putting the storage on a separate mount and also > using the node exporter with alerts to ensure you don't run out of space. > > On 20 February 2020 05:18:03 GMT, adi garg > wrote: >> >> Thanks Julius and Julien. Awesome answers. This is related to RAM, but >> what will happen if the secondary storage is not sufficient to take the >> metrics. What will happen in that case? >> >> On Wednesday, February 19, 2020 at 10:32:43 PM UTC+5:30, Julius Volz >> wrote: >>> >>> While an explicit memory limit is not configurable, there are a number >>> of knobs in Prometheus that one can configure that limit resource usage >>> along certain dimensions, for example >>> https://www.robustperception.io/limiting-promql-resource-usage. >>> >>> There's also a setting that prevents a maximum number of samples >>> ingested per scrape. >>> >>> On Wed, Feb 19, 2020 at 5:34 PM Julien Pivotto >>> wrote: >>> >>>> On 19 Feb 08:24, adi garg wrote: >>>> > So what will happen if prometheus crosses the RAM limit, will it die? >>>> Or is >>>> > it gonna affect the other processes running on the system? >>>> >>>> >>>> It is the operating system that will chose. Prometheus will probably be >>>> terminated by the operating system. >>>> >>>> > >>>> > On Wednesday, February 19, 2020 at 9:41:36 PM UTC+5:30, Julien >>>> Pivotto >>>> > wrote: >>>> > > >>>> > > On 19 Feb 08:08, adi garg wrote: >>>> > > > Hello experts, >>>> > > > >>>> > > > Is there any way to give memory specifications by ourselves in >>>> > > prometheus? >>>> > > >>>> > > Hello, >>>> > > >>>> > > No, this is not possible. Prometheus will use the memory it needs. >>>> > > >>>> > > Regards, >>>> > > >>>> > > > >>>> > > > -- >>>> > > > You received this message because you are subscribed to the >>>> Google >>>> > > Groups "Prometheus Developers" group. >>>> > > > To unsubscribe from this group and stop receiving emails from it, >>>> send >>>> > > an email to prometheus-developers+unsubscr...@googlegroups.com >>>> > > . >>>> > > > To view this discussion on the web visit >>>> > > >>>> https://groups.google.com/d/msgid/prometheus-developers/0fb6ec18-c2a8-437f-9d2b-5cc2b9f5b330%40googlegroups.com. >>>> >>>> >>>> > > >>>> > > >>>> > > >>>> > > -- >>>> > > (o-Julien Pivotto >>>> > > //\Open-Source Consultant >>>> > > V_/_ Inuits - https://www.inuits.eu >>>> > > >>>> > >>>> > -- >>>> > You received this message because you are subscribed to the Google >>>> Groups "Prometheus Developers" group. >>>> > To unsubscribe from this group and stop receiving emails from it, >>>> send an email to prometheus-developers+unsubscr...@googlegroups.com. >>>> > To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/prometheus-developers/df7bdc80-b95f-4f02-88d1-664d3cf3c651%40googlegroups.com >>>> . >>>> >>>> >>>> -- >>>> (o-Julien Pivotto >>>> //\Open-Source Consultant >>>> V_/_ Inuits - https://www.inuits.eu >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Prometheus Developers" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to prometheus-developers+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/prometheus-developers/20200219163423.GA6819%40oxygen >>>> . >>>> >>> > -- > Sent from my Android device with K-9 Mail. Please excuse my brevity. > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/0b15e598-42ef-4d21-b080-4448a955d463%40googlegroups.com.
Re: [prometheus-developers] Is there any way to give memory specifications by ourselves in prometheus?
Thanks Julius and Julien. Awesome answers. This is related to RAM, but what will happen if the secondary storage is not sufficient to take the metrics. What will happen in that case? On Wednesday, February 19, 2020 at 10:32:43 PM UTC+5:30, Julius Volz wrote: > > While an explicit memory limit is not configurable, there are a number of > knobs in Prometheus that one can configure that limit resource usage along > certain dimensions, for example > https://www.robustperception.io/limiting-promql-resource-usage. > > There's also a setting that prevents a maximum number of samples ingested > per scrape. > > On Wed, Feb 19, 2020 at 5:34 PM Julien Pivotto > wrote: > >> On 19 Feb 08:24, adi garg wrote: >> > So what will happen if prometheus crosses the RAM limit, will it die? >> Or is >> > it gonna affect the other processes running on the system? >> >> >> It is the operating system that will chose. Prometheus will probably be >> terminated by the operating system. >> >> > >> > On Wednesday, February 19, 2020 at 9:41:36 PM UTC+5:30, Julien Pivotto >> > wrote: >> > > >> > > On 19 Feb 08:08, adi garg wrote: >> > > > Hello experts, >> > > > >> > > > Is there any way to give memory specifications by ourselves in >> > > prometheus? >> > > >> > > Hello, >> > > >> > > No, this is not possible. Prometheus will use the memory it needs. >> > > >> > > Regards, >> > > >> > > > >> > > > -- >> > > > You received this message because you are subscribed to the Google >> > > Groups "Prometheus Developers" group. >> > > > To unsubscribe from this group and stop receiving emails from it, >> send >> > > an email to prometheus-developers+unsubscr...@googlegroups.com >> >> > > . >> > > > To view this discussion on the web visit >> > > >> https://groups.google.com/d/msgid/prometheus-developers/0fb6ec18-c2a8-437f-9d2b-5cc2b9f5b330%40googlegroups.com. >> >> >> > > >> > > >> > > >> > > -- >> > > (o-Julien Pivotto >> > > //\Open-Source Consultant >> > > V_/_ Inuits - https://www.inuits.eu >> > > >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups "Prometheus Developers" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> an email to prometheus-developers+unsubscr...@googlegroups.com >> . >> > To view this discussion on the web visit >> https://groups.google.com/d/msgid/prometheus-developers/df7bdc80-b95f-4f02-88d1-664d3cf3c651%40googlegroups.com >> . >> >> >> -- >> (o-Julien Pivotto >> //\Open-Source Consultant >> V_/_ Inuits - https://www.inuits.eu >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Prometheus Developers" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to prometheus-developers+unsubscr...@googlegroups.com >> . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/prometheus-developers/20200219163423.GA6819%40oxygen >> . >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/92f1ffed-e5a6-4d5e-91fa-318363caa710%40googlegroups.com.
Re: [prometheus-developers] Is there any way to give memory specifications by ourselves in prometheus?
So what will happen if prometheus crosses the RAM limit, will it die? Or is it gonna affect the other processes running on the system? On Wednesday, February 19, 2020 at 9:41:36 PM UTC+5:30, Julien Pivotto wrote: > > On 19 Feb 08:08, adi garg wrote: > > Hello experts, > > > > Is there any way to give memory specifications by ourselves in > prometheus? > > Hello, > > No, this is not possible. Prometheus will use the memory it needs. > > Regards, > > > > > -- > > You received this message because you are subscribed to the Google > Groups "Prometheus Developers" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to prometheus-developers+unsubscr...@googlegroups.com > . > > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-developers/0fb6ec18-c2a8-437f-9d2b-5cc2b9f5b330%40googlegroups.com. > > > > > -- > (o-Julien Pivotto > //\Open-Source Consultant > V_/_ Inuits - https://www.inuits.eu > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/df7bdc80-b95f-4f02-88d1-664d3cf3c651%40googlegroups.com.
[prometheus-developers] Is there any way to give memory specifications by ourselves in prometheus?
Hello experts, Is there any way to give memory specifications by ourselves in prometheus? -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/0fb6ec18-c2a8-437f-9d2b-5cc2b9f5b330%40googlegroups.com.
