Re: [darktable-user] Storage solutions

[Bernhard]

Patrick Shanahan schrieb am 26.07.21 um 21:25:

* Willy Williams  [07-26-21 15:03]:

I've been using a free utility called FreeFileSync
(https://freefilesync.org/) to keep my image files with their sidecar files
(as well as other user files) synced between my Windows machines.  It seems
to do the job well, and keeps the folder structure synced, as well.

Willy Williams

**


BUT, it does not properly record your images to your library.db.


it DOES - just sync the darktable profile AND the image folder.
Use this in my Linux also for years now.

--

regards
Bernhard

https://www.bilddateien.de


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Patrick Shanahan]

* Willy Williams  [07-26-21 15:03]:
> I've been using a free utility called FreeFileSync
> (https://freefilesync.org/) to keep my image files with their sidecar files
> (as well as other user files) synced between my Windows machines.  It seems
> to do the job well, and keeps the folder structure synced, as well.
> 
> Willy Williams
> 
> **
> 
> On 7/26/2021 at 14:20, Matt Maguire wrote:
> > For the travelling laptop scenario, there's also a feature in darktable
> > called "local copies" that can be useful:
> > https://darktable-org.github.io/dtdocs/overview/sidecar-files/local-copies/ 
> > 
> > 
> > On Tue, 27 Jul 2021 at 01:46, David Vincent-Jones  > > wrote:
> > 
> > So, if I backup computer 'B' to an external drive .. then my main
> > computer 'A' can correctly be fully updated.
> > 
> > This is great for those who travel with a secondary system.
> > 
> > David
> > 
> > On 2021-07-25 8:37 p.m., August Schwerdfeger wrote:
> > > There is a script in Darktable's Lua repository,  "Transfer 
> > > Hierarchy,"
> > > designed for the specific task of moving images between disks. It will
> > > automatically transfer images from one directory tree to another while
> > > preserving the existing directory hierarchy.
> > > 
> > > --
> > > August Schwerdfeger
> > > aug...@schwerdfeger.name  
> > > 
> > > On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov  
> > >   wrote:
> > > 
> > > > > Is there a way to remap the image to new path? If not, how do you
> > > > > handle this kind of scenario? File is still available, but at a 
> > > > > new
> > > > > path. Main storage does get full and because it's a laptop, I can 
> > > > > not
> > > > > connect another disk easily.
> > > > > 
> > > > After you move the images to another location - right click on the 
> > > > film
> > > > row or folder, select search and locate your images - the program 
> > > > will
> > > > do the rest.
> > > > 
> > > > Also - if you work out of a shared disk (even an USB connected to a
> > > > router) DT does good work with the caching. It does fetch the raw 
> > > > file
> > > > but after that works out from the cache quite a bit (just an idea).
> > > > 
> > > > Regards,
> > > > 
> > > > B
> > > > 
> > > > 
> > > > 
> > > > 
> > > > darktable user mailing list
> > > > to unsubscribe send a mail to
> > > > darktable-user+unsubscr...@lists.darktable.org  
> > > > 
> > > > 
> > > > 
> > > 
> > > 
> > > darktable user mailing list
> > > to unsubscribe send a mail 
> > > todarktable-user+unsubscr...@lists.darktable.org  
> > > 
> > 
> > 
> > 
> > darktable user mailing list to unsubscribe send a mail to
> > darktable-user+unsubscr...@lists.darktable.org
> > 
> > 
> > 
> > 
> > darktable user mailing list to unsubscribe send a mail to
> > darktable-user+unsubscr...@lists.darktable.org
> 
> 
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org


BUT, it does not properly record your images to your library.db.

-- 
(paka)Patrick Shanahan   Plainfield, Indiana, USA  @ptilopteri
http://en.opensuse.orgopenSUSE Community Memberfacebook/ptilopteri
Photos: http://wahoo.no-ip.org/piwigo   paka @ IRCnet freenode

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Patrick Shanahan]

* Pascal Obry  [07-26-21 14:43]:
> Hello,
> 
> 1. Never move pictures after first import and moving it on safe storage.
> 
> 2. When you really really need to move them use DT corresponding feature
> from lighttable.
> 
> 3. When you go away with your laptop use the local copies feature.
> 
> That should cover all workflows.


I do different, but...

I move the images to my travel laptop, do culling and minor edits using:
  darktable --library :memory
which writes my edits to the accompanying xmp files,

then when I have access, *import* the photos to my mail library which also
records the edits.

  
-- 
(paka)Patrick Shanahan   Plainfield, Indiana, USA  @ptilopteri
http://en.opensuse.orgopenSUSE Community Memberfacebook/ptilopteri
Photos: http://wahoo.no-ip.org/piwigo   paka @ IRCnet freenode

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Willy Williams]

I've been using a free utility called FreeFileSync 
(https://freefilesync.org/) to keep my image files with their sidecar 
files (as well as other user files) synced between my Windows machines.  
It seems to do the job well, and keeps the folder structure synced, as 
well.


Willy Williams

**

On 7/26/2021 at 14:20, Matt Maguire wrote:
For the travelling laptop scenario, there's also a feature in 
darktable called "local copies" that can be useful:
https://darktable-org.github.io/dtdocs/overview/sidecar-files/local-copies/ 



On Tue, 27 Jul 2021 at 01:46, David Vincent-Jones > wrote:


So, if I backup computer 'B' to an external drive .. then my main
computer 'A' can correctly be fully updated.

This is great for those who travel with a secondary system.

David

On 2021-07-25 8:37 p.m., August Schwerdfeger wrote:

There is a script in Darktable's Lua repository,  "Transfer Hierarchy,"
designed for the specific task of moving images between disks. It will
automatically transfer images from one directory tree to another while
preserving the existing directory hierarchy.

--
August Schwerdfeger
aug...@schwerdfeger.name  

On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov  
  wrote:


Is there a way to remap the image to new path? If not, how do you
handle this kind of scenario? File is still available, but at a new
path. Main storage does get full and because it's a laptop, I can not
connect another disk easily.


After you move the images to another location - right click on the film
row or folder, select search and locate your images - the program will
do the rest.

Also - if you work out of a shared disk (even an USB connected to a
router) DT does good work with the caching. It does fetch the raw file
but after that works out from the cache quite a bit (just an idea).

Regards,

B



darktable user mailing list
to unsubscribe send a mail to
darktable-user+unsubscr...@lists.darktable.org  





darktable user mailing list
to unsubscribe send a mail todarktable-user+unsubscr...@lists.darktable.org  




darktable user mailing list to unsubscribe send a mail to
darktable-user+unsubscr...@lists.darktable.org



 
darktable user mailing list to unsubscribe send a mail to 
darktable-user+unsubscr...@lists.darktable.org



darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Pascal Obry]

Hello,

1. Never move pictures after first import and moving it on safe storage.

2. When you really really need to move them use DT corresponding feature
from lighttable.

3. When you go away with your laptop use the local copies feature.

That should cover all workflows.

Regards.


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Matt Maguire]

For the travelling laptop scenario, there's also a feature in darktable
called "local copies" that can be useful:
https://darktable-org.github.io/dtdocs/overview/sidecar-files/local-copies/

On Tue, 27 Jul 2021 at 01:46, David Vincent-Jones 
wrote:

> So, if I backup computer 'B' to an external drive .. then my main computer
> 'A' can correctly be fully updated.
>
> This is great for those who travel with a secondary system.
>
> David
> On 2021-07-25 8:37 p.m., August Schwerdfeger wrote:
>
> There is a script in Darktable's Lua repository,  "Transfer Hierarchy,"
> designed for the specific task of moving images between disks. It will
> automatically transfer images from one directory tree to another while
> preserving the existing directory hierarchy.
>
> --
> August schwerdfegeraug...@schwerdfeger.name
>
> On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov  
>  wrote:
>
>
> Is there a way to remap the image to new path? If not, how do you
> handle this kind of scenario? File is still available, but at a new
> path. Main storage does get full and because it's a laptop, I can not
> connect another disk easily.
>
>
> After you move the images to another location - right click on the film
> row or folder, select search and locate your images - the program will
> do the rest.
>
> Also - if you work out of a shared disk (even an USB connected to a
> router) DT does good work with the caching. It does fetch the raw file
> but after that works out from the cache quite a bit (just an idea).
>
> Regards,
>
> B
>
>
> 
> darktable user mailing list
> to unsubscribe send a mail todarktable-user+unsubscr...@lists.darktable.org
>
>  
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org
>
>
> 
> darktable user mailing list to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org
>


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Niranjan Rao]

Thank you. This helps a lot.

Regards,

Niranjan
On 7/25/21 8:37 PM, August Schwerdfeger wrote:
There is a script in Darktable's Lua repository, "Transfer Hierarchy," 
designed for the specific task of moving images between disks. It will 
automatically transfer images from one directory tree to another while 
preserving the existing directory hierarchy.


--
August Schwerdfeger
aug...@schwerdfeger.name 

On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov > wrote:



> Is there a way to remap the image to new path? If not, how do you
> handle this kind of scenario? File is still available, but at a new
> path. Main storage does get full and because it's a laptop, I
can not
> connect another disk easily.
>
After you move the images to another location - right click on the
film
row or folder, select search and locate your images - the program
will
do the rest.

Also - if you work out of a shared disk (even an USB connected to a
router) DT does good work with the caching. It does fetch the raw
file
but after that works out from the cache quite a bit (just an idea).

Regards,

B


darktable user mailing list
to unsubscribe send a mail to
darktable-user+unsubscr...@lists.darktable.org



 
darktable user mailing list to unsubscribe send a mail to 
darktable-user+unsubscr...@lists.darktable.org





darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[David Vincent-Jones]

So, if I backup computer 'B' to an external drive .. then my main 
computer 'A' can correctly be fully updated.


This is great for those who travel with a secondary system.

David

On 2021-07-25 8:37 p.m., August Schwerdfeger wrote:

There is a script in Darktable's Lua repository,  "Transfer Hierarchy,"
designed for the specific task of moving images between disks. It will
automatically transfer images from one directory tree to another while
preserving the existing directory hierarchy.

--
August Schwerdfeger
aug...@schwerdfeger.name

On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov  wrote:


Is there a way to remap the image to new path? If not, how do you
handle this kind of scenario? File is still available, but at a new
path. Main storage does get full and because it's a laptop, I can not
connect another disk easily.


After you move the images to another location - right click on the film
row or folder, select search and locate your images - the program will
do the rest.

Also - if you work out of a shared disk (even an USB connected to a
router) DT does good work with the caching. It does fetch the raw file
but after that works out from the cache quite a bit (just an idea).

Regards,

B



darktable user mailing list
to unsubscribe send a mail to
darktable-user+unsubscr...@lists.darktable.org




darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org



darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[August Schwerdfeger]

There is a script in Darktable's Lua repository,  "Transfer Hierarchy,"
designed for the specific task of moving images between disks. It will
automatically transfer images from one directory tree to another while
preserving the existing directory hierarchy.

--
August Schwerdfeger
aug...@schwerdfeger.name

On Sun, Jul 25, 2021 at 1:29 AM I. Ivanov  wrote:

>
> > Is there a way to remap the image to new path? If not, how do you
> > handle this kind of scenario? File is still available, but at a new
> > path. Main storage does get full and because it's a laptop, I can not
> > connect another disk easily.
> >
> After you move the images to another location - right click on the film
> row or folder, select search and locate your images - the program will
> do the rest.
>
> Also - if you work out of a shared disk (even an USB connected to a
> router) DT does good work with the caching. It does fetch the raw file
> but after that works out from the cache quite a bit (just an idea).
>
> Regards,
>
> B
>
>
> 
> darktable user mailing list
> to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org
>
>


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[I. Ivanov]

Is there a way to remap the image to new path? If not, how do you 
handle this kind of scenario? File is still available, but at a new 
path. Main storage does get full and because it's a laptop, I can not 
connect another disk easily.


After you move the images to another location - right click on the film 
row or folder, select search and locate your images - the program will 
do the rest.


Also - if you work out of a shared disk (even an USB connected to a 
router) DT does good work with the caching. It does fetch the raw file 
but after that works out from the cache quite a bit (just an idea).


Regards,

B


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Storage solutions

[Michael Staats]

On 25/07/2021 06:48, Niranjan Rao wrote:
> Greetings,
>
>
> Not a directly darktable question so to say, but relates to it and I'm
> sure many on this list have experienced similar issues.
>
>
> As photo collection grows, so does disk usage to the point it becomes a
> critical issue. I have another storage disk connected to different PC
> where I keep moving the files as needed. However when the file is moved,
> images are naturally broken.
>
>
> Is there a way to remap the image to new path? If not, how do you handle
> this kind of scenario? File is still available, but at a new path. Main
> storage does get full and because it's a laptop, I can not connect
> another disk easily.
>
>
> If it matters, all machines are Ubuntu based.

Ok, first of all: There is a "move" feature in dt's lighttable. If you
use this, I'd expect that it will update the library etc. all right.

But then, for the hackers here, I have some script to do that... But
it's messing around with the internal dt library, so the behaviour has
to be considered as undefined, and certainly not stable with regards to
future versions.
My script relies on my folder structure, so you probably cannot use it
directly. It will also move the files for you, if you have already done
it, it will also not help, so I'm not going to share it (and no one can
blame me for screwing their library).

So here's the outline what you can try:

1. Connect to the library.db wiht a SQLite client of you choice (I'm
using a perl script with the DBI module and the SQLite "driver".

2. Find the id of the folder where your files live with "select id from
film_rolls where folder = '/your/old/path'"

3. Update the DB with "update film_rolls set folder = '/your/new/path'
where id = ".

(of course, if you are sure about your source path, you can combine 2
and 3 with "update film_rolls set folder = '/your/new/path' where id =
(select id from film_rolls where folder = '/your/old/path'), or even
simply "update film_rolls set folder = '/your/new/path' where folder =
'/your/old/path'", but the last version could potentially update more
than one row... I'm not sure if it ever could happen, but I'd be careful
here -- on the other hand, maybe you want this to happen...)

4. If you also want to fix your history of folders, you can update your
darktablerc with sth. like using this perl-replace
s!/your/old/path!/your/new/path!g;

Step 4 is "nice to have", if you ignore it, your history in dt will not
find show the new paths, but that's not an issue, just open the new path
from "import".

Of course, needless to say, make backups of library.db and darktablerc
before even trying. As I said, this may or may not work for you, you
might render your library useless. You have been warned.

Best regards,
Michael

--
Michael Staats
michael.sta...@gmx.de

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org