[weewx-user] Re: Questions about file import / wee_import csv

2020-07-22 Thread gjr80
Hmm, not sure how that one slipped by the QC department. The ability to specify 
the field delimiter for csv imports was introduced in v4.0.0. Unfortunately the 
(commonly used) comma has a special meaning for the config file parser so it 
needs to be included in quotes, somehow it seems I neglected to put that in the 
example csv import config file.

Thanks for finding this and apologies for the trouble.

Gary

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-user+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-user/fbe8a0bb-e6bc-418e-bf5a-40a865f10792o%40googlegroups.com.


[weewx-user] Re: Questions about file import / wee_import csv

2020-07-22 Thread schulz....@gmail.com
got it. had to change the config...

from  delimiter = ,  to  delimiter = ','  

schulz@gmail.com schrieb am Mittwoch, 22. Juli 2020 um 11:02:52 UTC+2:

> weewxd --version && lsb_release -a && uname -a
> 4.1.1
> No LSB modules are available.
> Distributor ID: Raspbian
> Description:Raspbian GNU/Linux 10 (buster)
> Release:10
> Codename:   buster
> Linux pi2 5.4.51-v7+ #1325 SMP Mon Jul 13 13:41:25 BST 2020 armv7l 
> GNU/Linux
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-user+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-user/46d619ca-64f5-4a7c-a004-c5e41a85944cn%40googlegroups.com.


[weewx-user] Re: Questions about file import / wee_import csv

2020-07-22 Thread David Schulz
weewxd --version && lsb_release -a && uname -a
4.1.1
No LSB modules are available.
Distributor ID: Raspbian
Description:Raspbian GNU/Linux 10 (buster)
Release:10
Codename:   buster
Linux pi2 5.4.51-v7+ #1325 SMP Mon Jul 13 13:41:25 BST 2020 armv7l GNU/Linux

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-user+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-user/482b0cec-1b07-46d9-aa93-828b27d7ea42o%40googlegroups.com.


[weewx-user] Re: Questions about file import / wee_import csv

2020-07-22 Thread David Schulz
weewxd --version && lsb_release -a && uname -a

4.1.1
No LSB modules are available.
Distributor ID: Raspbian
Description:Raspbian GNU/Linux 10 (buster)
Release:10
Codename:   buster
Linux pi2.fu110.de 5.4.51-v7+ #1325 SMP Mon Jul 13 13:41:25 BST 2020 armv7l 
GNU/Linux


Am Mittwoch, 22. Juli 2020 10:58:58 UTC+2 schrieb David Schulz:
>
> Hello,
>
> i have a question about file import via csv.
>
> My config looks like this:
>
> cat import_csv.conf
>
> # EXAMPLE CONFIGURATION FILE FOR IMPORTING FROM CSV FILES
> #
> # Copyright (c) 2009-2019 Tom Keffer  and Gary Roderick.
> # See the file LICENSE.txt for your rights.
>
>
> ##
>
> # Specify the source. Available options are:
> #   CSV - import obs from a single CSV format file
> #   WU - import obs from a Weather Underground PWS history
> #   Cumulus - import obs from a one or more Cumulus monthly log files
> #   WD - import obs from a one or more WD monthly log files
> # Format is:
> #   source = (CSV | WU | Cumulus)
> source = CSV
>
>
> ##
>
> [CSV]
> # Parameters used when importing from a CSV file
>
> # Path and name of our CSV source file. Format is:
> #   file = full path and filename
> file = /daten/dl/99/2019.csv
>
> # The character used to separate fields. Format is:
> #   delimiter = 
> # Default is , (comma).
> delimiter = ,
>
> # If there is no mapped interval field how will the interval field be
> # determined for the imported records. Available options are:
> #   derive - Derive the interval field from the timestamp of successive
> #records. This setting is best used when the imported 
> records
> #are equally spaced in time and there are no missing 
> records.
> #   conf   - Use the interval setting from weewx.conf. This setting is
> #best used if the records to be imported have been 
> produced by
> #WeeWX using the same archive interval as set in 
> weewx.conf on
> #this machine.
> #   x  - Use a fixed interval of x minutes for every record. This
> #setting is best used if the records to be imported are
> #equally based in time but there are some missing records.
> #
> # Note: If there is a mapped interval field then this setting will be
> #   ignored.
> # Format is:
> #   interval = (derive | conf | x)
> interval = derive
>
> # Should the [StdQC] max/min limits in weewx.conf be applied to the
> # imported data. This may be useful if the source has extreme values 
> that
> # are clearly incorrect for some observations. Available options are:
> #   True  - weewx.conf [StdQC] max/min limits are applied.
> #   False - weewx.conf [StdQC] max/min limits are not applied.
> # Format is:
> #   qc = (True | False)
> qc = True
>
> # Should any missing derived observations be calculated from the 
> imported
> # data if possible. Available options are:
> #   True  - Any missing derived observations are calculated.
> #   False - Any missing derived observations are not calculated.
> # Format is:
> #   calc_missing = (True | False)
> calc_missing = True
>
> # Specify how imported data fields that contain invalid data (eg a 
> numeric
> # field containing non-numeric data) are handled. Available options 
> are:
> #   True  - The invalid data is ignored, the WeeWX target field is set 
> to
> #   None and the import continues.
> #   False - The import is halted.
> # Format is:
> #   ignore_invalid_data = (True | False)
> # Default is True.
> ignore_invalid_data = True
>
> # Imported records are written to archive in transactions of tranche
> # records at a time. Increase for faster throughput, decrease to reduce
> # memory requirements. Format is:
> #   tranche = x
> # where x is an integer
> tranche = 250
>
> # Specify whether a UV sensor was used to produce any UV observations.
> # Available options are:
> #   True  - UV sensor was used and UV data will be imported.
> #   False - UV sensor was not used and any UV data will not be 
> imported.
> #   UV fields will be set to None/NULL.
> # For a CSV import UV_sensor should be set to False if a UV sensor was
> # NOT present when the import data was created. Otherwise it may be 
> set to
> # True or omitted. Format is:
> #   UV_sensor = (True | False)
> UV_sensor = false
>
> # Specify whether a solar radiation sensor was used to produce any 
> solar
> # radiation observations. Available options are:
> #   True  - Solar radiation sensor was used and solar radiation data 
> will
> #   be imported.
> #   False - Solar radiation sensor was not used and any sol