Re: [influxdb] Internal server error, timeout and unusable server after large imports

2016-10-12 Thread Sean Beckett
Tonya, when you write the data in ms but don't specify the precision, the database interprets those millisecond timestamps as nanoseconds, and all the data is written to a single shard covering Jan 1, 1970. > insert msns value=42 147633619 > select * from msns name: msns -- time value

Re: [influxdb] Internal server error, timeout and unusable server after large imports

2016-10-12 Thread Sean Beckett
That's the entire source of the issue. The system is creating 1 week shards from 1838 to now. That's a bit over 9000 shard groups, each of which only has a few hundred points. The shard files are incredibly sparse, and the overhead for each one is fixed. Use shards durations of 10 years or more. T

Re: [influxdb] Internal server error, timeout and unusable server after large imports

2016-10-12 Thread Tanya Unterberger
Hi Sean, I can reproduce all the CPU issues, slowness, etc. if I try to import the data that I have in milliseconds, specifying precision as milliseconds. If I insert the same data without specifying any precision and query without specifying any precision, the database is lightingly fast. The sa

Re: [influxdb] Continuous queries with latency?

2016-10-12 Thread Michael C
Brilliant, thank you! I should have been clever enough to have figured that out. Silly me! Thank you! Mike On Wednesday, October 12, 2016 at 12:23:58 PM UTC-7, Sean Beckett wrote: > > You want the FOR clause, which will cause the CQs to recalculate prior > intervals and pick up any newly

Re: [influxdb] Kapacitor record hung issue.

2016-10-12 Thread Sean Beckett
Perhaps Kapacitor isn't receiving any data from InfluxDB. What is the output of `show subscriptions` from InfluxDB and `kapacitor stats ingress` from Kapacitor? What is the output of `kapacitor show task_name` for your task? On Wed, Oct 12, 2016 at 5:08 PM, Nikhil Agrawal wrote: > Hi, > > Few b

Re: [influxdb] Internal server error, timeout and unusable server after large imports

2016-10-12 Thread Tanya Unterberger
Hi Sean, The data is from 1838 to 2016, daily (sparse at times). We need to retain it, therefore the default policy. Thanks, Tanya On 13 October 2016 at 06:26, Sean Beckett wrote: > Tanya, what range of time does your data cover? What are the retention > policies on the database? > > On Tue, O

[influxdb] Kapacitor record hung issue.

2016-10-12 Thread Nikhil Agrawal
Hi, Few background. I have installed InfluxDb and Grafana and my Monitoring Project is working fine. Now I am trying to setup alert for all influxDb measurements, so I have installed Kapacitor but getting no response when I enter record command. kapacitor record stream -task cpu_alert -duration

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread Sean Beckett
Does SELECT sum("value") as Sumin FROM "data" where metric = 'In_bits' GROUP BY time(15m) return the values you expect? Can you share actual CLI or curl output? This seems like a syntax issue. On Wed, Oct 12, 2016 at 3:00 PM, wrote: > On Wednesday, October 12, 2016 at 4:52:49 PM UTC-4, Sean B

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread tracyann . monteiro
On Wednesday, October 12, 2016 at 4:52:49 PM UTC-4, Sean Beckett wrote: > CQs only operate on recent data (by timestamp, not write time). Are you > continually inserting new values into "data"? > > > On Wed, Oct 12, 2016 at 1:56 PM, wrote: > On Wednesday, October 12, 2016 at 3:41:20 PM UTC-4,

Re: [influxdb] Downsampling collectd in place?

2016-10-12 Thread Sean Beckett
There is no way to downsample in place. The first challenge is that it requires deleting many individual raw data points after a month, rather than dropping entire files from disk, as retention policies do. Individual deletes are expensive in InfluxDB. They create a tombstone record which must be p

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread Sean Beckett
CQs only operate on recent data (by timestamp, not write time). Are you continually inserting new values into "data"? On Wed, Oct 12, 2016 at 1:56 PM, wrote: > On Wednesday, October 12, 2016 at 3:41:20 PM UTC-4, Sean Beckett wrote: > > To clarify, SELECT * FROM data.copy expands out to "fetch al

[influxdb] Downsampling collectd in place?

2016-10-12 Thread alexandre
Hi, I'm trying to figure out if it's possible to have a continuous query that would keep collectd's 10 seconds granularity, for up to a month, but then drop to an hourly mean, for up to a year then delete it. Setting the retention policy for a year is quite simple... But is it possible to down

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread tracyann . monteiro
On Wednesday, October 12, 2016 at 3:41:20 PM UTC-4, Sean Beckett wrote: > To clarify, SELECT * FROM data.copy expands out to "fetch all fields from the > retention policy named 'data', and the measurement named 'copy'." InfluxDB > supports [.[.]] in the FROM clause, > so if there's a period, it

Re: [influxdb] InfluxEnterprise hinted_handoff

2016-10-12 Thread Sean Beckett
That configures how often the system checks for data that exceeds the "max-age" property. On Tue, Oct 11, 2016 at 3:56 PM, kthommandra via InfluxData < influxdb@googlegroups.com> wrote: > What does the purge_interval configuration mean in [hinted_handoff] > section ? > > -- > Remember to include

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread Sean Beckett
To clarify, SELECT * FROM data.copy expands out to "fetch all fields from the retention policy named 'data', and the measurement named 'copy'." InfluxDB supports [.[.]] in the FROM clause, so if there's a period, it is separating the DB or RP from the measurement. Using double-quotes forces the qu

Re: [influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread Sean Beckett
> After creating this, how do I see the results saved in new measurement data.copy? SELECT * FROM "data.copy" On Wed, Oct 12, 2016 at 8:20 AM, wrote: > I have a measurement that has the following fields in InfluxDB. The > measurement name is data. > > Measurement name: data > Time

Re: [influxdb] Internal server error, timeout and unusable server after large imports

2016-10-12 Thread Sean Beckett
Tanya, what range of time does your data cover? What are the retention policies on the database? On Tue, Oct 11, 2016 at 11:14 PM, Tanya Unterberger < tanya.unterber...@gmail.com> wrote: > Hi Sean, > > 1. Initially I killed the process > 2. At some point I restarted influxdb service > 3. Error lo

Re: [influxdb] There was an error writing history file: open : The system cannot find the file specified.

2016-10-12 Thread Sean Beckett
Please open an issue on the Docs repro for the installation update, thanks! On Wed, Oct 12, 2016 at 10:17 AM, wrote: > Got it to work. The command line don't work for me. I tried on 2 > different PCs. However, works in GUI way by

Re: [influxdb] Continuous queries with latency?

2016-10-12 Thread Sean Beckett
You want the FOR clause, which will cause the CQs to recalculate prior intervals and pick up any newly written points in those intervals. https://docs.influxdata.com/influxdb/v1.0/query_language/continuous_queries/#advanced-syntax. E.g. CREATE CONTINUOUS QUERY foo ON db RESAMPLE EVERY 20s *FOR 2m

[influxdb] Continuous queries with latency?

2016-10-12 Thread Michael C
I was wondering if someone out there could offer some advice on setting up a CQ for my system. It would appear CQs might not be powerful enough to accomplish what i'm after, but im still new-ish to influx so maybe im wrong? I have a system where multiple nodes out in the world transmit packets

Re: [influxdb] Cannot find measurement after using INTO clause

2016-10-12 Thread Sean Beckett
This sounds like a syntax issue. Please give the actual queries you are running as well as any output. On Tue, Oct 11, 2016 at 3:08 PM, wrote: > I want to record my select statement by saving it into another > measurement. My query is as listed below: > > select sum(value) as Sum into new_measur

[influxdb] Re: Kapacitor and external InfluxDB.

2016-10-12 Thread nathaniel
What is the output of `kapacitor show task_name` for your task? On Wednesday, October 12, 2016 at 9:49:44 AM UTC-6, codep...@gmail.com wrote: > > And kapacitor list recordings produces: > ID TypeStatusSize Date > > f6dc1d97-6bb

Re: [influxdb] There was an error writing history file: open : The system cannot find the file specified.

2016-10-12 Thread everyonelovesdance
Got it to work. The command line don't work for me. I tried on 2 different PCs. However, works in GUI way by go to System Properties - > Environment Variables - > Add an User Variables for my profile, name = HOME value = E:\influxdb-1.0.1_windows_amd64\influxdb-1.0.1-1 (or whatever your pa

[influxdb] Re: Kapacitor and external InfluxDB.

2016-10-12 Thread codeprojtwo
And kapacitor list recordings produces: ID TypeStatusSize Date f6dc1d97-6bba-4beb-9ba5-29e52c10cd4bstream finished 23 B 12 Oct 16 18:48 MSK c442a78a-9267-448e-a21a-5073895b2f42stream finished 23 B 12 Oc

Re: [influxdb] There was an error writing history file: open : The system cannot find the file specified.

2016-10-12 Thread everyonelovesdance
I did it on 2 different computers. Go to DOS prompt, run that command, start up again, same error, restart computer, same error. If I ran into this, does Sean from Influxdb can repro that? > show databases name: databases --- name _internal There was an error writing history fil

[influxdb] Re: Kapacitor and external InfluxDB.

2016-10-12 Thread codeprojtwo
Hmm - now it no longer freezes, but doesn't record anything either. Current script is: stream // Select just the cpu measurement from our example database. |from() .database('cp') .measurement('user_cp') |alert() // Whenever we get an alert write it to a file

[influxdb] Reg usage of telegraf for Docker Stats within Container

2016-10-12 Thread pckeyan
Hi, I am using Telegraf in my current production environment to read the jolokia for JVM Stats and saves it in Influxdb. In the same way I would like to use the same telegraf plugin to post the Docker Stats to InfluxDb. We are using docker to deploy our APIs. Telegraf is installed within the Do

[influxdb] Not able to view new measurement after creating continuous query

2016-10-12 Thread tracyann . monteiro
I have a measurement that has the following fields in InfluxDB. The measurement name is data. Measurement name: data Time Device InterfaceMetric Value 2016-10-11T19:00:00Zdevice1_nameint_nameIn_bits10 2016-10-11T19:00:00Zde

[influxdb] Re: Kapacitor and external InfluxDB.

2016-10-12 Thread codeprojtwo
вторник, 11 октября 2016 г., 21:07:28 UTC+3 пользователь nath...@influxdb.com написал: > Kapacitor isn't receiving any data from InfluxDB. What is the output of > > > show subscriptions > > > and  > > > kapacitor stats ingress > > > > > On Tuesday, October 11, 2016 at 11:29:26 AM UTC-6,

Re: [influxdb] Time-weighted mean?

2016-10-12 Thread deandob
On Friday, September 30, 2016 at 1:14:21 PM UTC+10, Sean Beckett wrote: > That's not easy with InfluxDB, but you could build a UDF in Kapacitor to > handle that. > > > On Thu, Sep 29, 2016 at 8:50 PM, wrote: > Hi, > > > > Is there anyway in InfluxDB to calculate a time-weighted mean of meas

Re: [influxdb] There was an error writing history file: open : The system cannot find the file specified.

2016-10-12 Thread deandob
On Wednesday, October 12, 2016 at 7:13:02 AM UTC+10, everyonel...@gmail.com wrote: > What I did was download the latest zip, unzip to some local drive. Started > up by double click on the influxd.exe with no modify to the influxdb.conf > file. You should be able to reproduce this. Thanks. Hi