I switched from copy to move and removed the incremental and resume functions, seems to be working as normal now. If you have any ideas let me know. I'll try starting the copy function on a fresh directory and see if the problem ramps up again over time.
On Tuesday, 7 May 2019 11:02:47 UTC+10, Adrian Sampson wrote: > > Wow, that’s weird! I don’t have any obvious ideas, and the right way to > sort this out would be to do some proper profiling. Do you have any ideas > about how we might reproduce the problem? Or would you be willing to break > out a Python profiler and take a look? > https://docs.python.org/3.7/library/profile.html > > Adrian > > > > On May 6, 2019, at 8:09 PM, Enrico <[email protected] <javascript:>> > wrote: > > > > Hey, I've been running beets on an hourly cron for about 6 months, > everything used to be fine however I've noticed my imports becoming slower > and slower, typically when more than one album is imported the process time > is increased by an order of magnitude. Beets always gets through it with no > probs, however I'd prefer if it could keep up. I currently have an import > of about 25 albums which has been going for 36 hours. > > > > My musiclibrary.blb is 655mb, log is less than 15kb, and state is 48kb > (skips about 500 folders). An example of one of my config files is below, > nothing too remarkable. > > > > Any ideas? > > > > # Beets configuration > -------------------------------------------------------- > > > > directory: /music > > library: /config/musiclibrary.blb > > > > import: > > # copy settings > > move: no > > copy: yes > > incremental: yes > > resume: yes > > # ===================== > > write: yes > > delete: no > > autotag: yes > > timid: no > > log: /config/beet.log > > > > quiet: yes # enable with command line option > > quiet_fallback: asis > > none_rec_action: asis > > default_action: apply > > duplicate_action: remove > > > > singletons: no > > languages: [en] > > detail: no > > flat: no > > > > # General > -------------------------------------------------------------------- > > > > threaded: yes > > timeout: 5.0 > > verbose: no > > > > # use the release-date of the original (first) release of an album? > > original_date: no > > > > # on multi-disk releases, assign track numbers for the whole album. > > # If "per disk", make sure tracknames do not collide ("paths" setting). > > per_disc_numbering: yes > > > > # files matching these patterns are deleted from source after import > > #clutter: ["Thumbs.DB", ".DS_Store", "*.m3u", ".pls", "*.jpg", "*.m3u", > "*.log", "*.cue"] > > > > # files/directories matching one of these patterns are ignored during > import > > ignore: [".*", "*~", "System Volume Information"] > > > > # Paths > ---------------------------------------------------------------------- > > > > # Paths and filenames for music files > > # relative to music directory > > paths: > > #default: $albumartist/$album%aunique{}/%if{$multidisc,Disc > $disc/}$track - $title > > #singleton: Non-Album/%if{$multidisc,Disc $disc/$artist - $title > > #comp: Compilations/$album%aunique{}/%if{$multidisc,Disc > $disc/$track - $title > > #albumtype_soundtrack: > Soundtracks/$album%aunique{}/%if{$multidisc,Disc $disc/$track $title > > > > comp: '_Compilations/$album%aunique{}/%if{$multidisc,Disc > $disc/}$track $title' > > singleton: '%bucket{$albumartist > }/$artist/%if{$album,$album,(Single)}/%if{$multidisc,Disc $disc/}$title' > > # force soundtrack to default format; > > albumtype:soundtrack: '%bucket{$albumartist }/$albumartist/$album > %aunique{}/%if{$multidisc,Disc $disc/}$track $title' > > default: '%bucket{$albumartist }/$albumartist/$album > %aunique{}/%if{$multidisc,Disc $disc/}$track $title' > > > > item_fields: > > multidisc: 1 if disctotal > 1 else 0 > > > > # replace special characters in generated filenames > > replace: > > '[\\/]': _ > > '^\.': _ > > '[\x00-\x1f]': _ > > '[<>:"\?\*\|]': _ > > '\.$': _ > > '\s+$': '' > > > > path_sep_replace: _ > > > > # filename for the album art > > art_filename: cover # results in "coverart.jpg" > > > > max_filename_length: 0 # unlimited > > > > > > # User Interface > ------------------------------------------------------------- > > > > color: yes > > list_format_item: %upper{$artist} - $album - $track. $title > > list_format_album: %upper{$albumartist} - $album > > time_format: '%Y-%m-%d %H:%M:%S' > > terminal_encoding: utf8 > > > > ui: > > terminal_width: 80 > > length_diff_thresh: 10.0 > > > > > > # Auto Tagger > ---------------------------------------------------------------- > > > > match: > > strong_rec_thresh: 0.17 # match 90% or better for auto import > > medium_rec_thresh: 0.25 > > rec_gap_thresh: 0.25 > > max_rec: > > missing_tracks: medium > > unmatched_tracks: medium > > distance_weights: > > source: 2.0 > > artist: 3.0 > > album: 3.0 > > media: 1.0 > > mediums: 1.0 > > year: 1.0 > > country: 0.5 > > label: 0.5 > > catalognum: 0.5 > > albumdisambig: 0.5 > > album_id: 5.0 > > tracks: 2.0 > > missing_tracks: 0.9 > > unmatched_tracks: 0.6 > > track_title: 3.0 > > track_artist: 2.0 > > track_index: 1.0 > > track_length: 2.0 > > track_id: 5.0 > > preferred: > > countries: [] > > media: [] > > original_year: no > > ignored: [] > > track_length_grace: 10 > > track_length_max: 30 > > > > > > # Plugins > -------------------------------------------------------------------- > > > > plugins: [ > > #fetchart, > > lastgenre, > > #chroma, > > scrub, > > discogs, > > #beatport, > > duplicates, > > #web, > > #extrafiles, > > #lyrics, > > #echonest_tempo, > > acousticbrainz, > > embedart, > > inline, > > bucket > > #mbsync, > > #mpdupdate, > > #mpdstats, > > #missing, > > #fromfilename > > ] > > > > #pluginpath: /config/plugins/beatport.py > > > > > > # Plugins Config > ------------------------------------------------------------- > > > > lastgenre: > > # whitelist: ~/.config/beets/genres.txt > > #canoncical: ~/.config/beets/genres-tree.yaml > > #fallback: '' > > auto: yes > > source: album > > > > embedart: > > auto: yes > > maxwidth: 800 > > > > replaygain: > > auto: yes > > overwrite: yes > > albumgain: yes > > > > duplicates: > > checksum: no # expensive > > tiebreak: { items: [bitrate] } > > > > bucket: > > bucket_alpha: > > - _ > > - _Compilations > > - A > > - B > > - C > > - D > > - E > > - F > > - G > > - H > > - I > > - J > > - K > > - L > > - M > > - N > > - O > > - P > > - Q > > - R > > - S > > - T > > - U > > - V > > - W > > - X > > - Y > > - Z > > bucket_alpha_regex: > > _: ^[^A-Za-z] > > _Compilations: (\W|^)Various\sArtists(\W|$) > > bucket_year: [] > > extrapolate: no > > > > > > > > > > -- > > You received this message because you are subscribed to the Google > Groups "beets" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to [email protected] <javascript:>. > > For more options, visit https://groups.google.com/d/optout. > > -- You received this message because you are subscribed to the Google Groups "beets" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/beets-users/7e099c81-8ca5-46b6-83b4-021c326fcba6%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
