Scheduled Maintenance: We are aware of an issue with Google, AOL, and Yahoo services as email providers which are blocking new registrations. We are trying to fix the issue and we have several internal and external support tickets in process to resolve the issue. Please see: viewtopic.php?t=158230

 

 

 

[Software] Deja Dup Backups.

If none of the specific sub-forums seem right for your thread, ask here.
Post Reply
Message
Author
LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

[Software] Deja Dup Backups.

#1 Post by LTL »

Hello,
I have an unknown error when using Deja Dup Backups. Please see the attached snapshots to see if you can help. Thank you very much.
Best regards,
Attachments
Deja_Dup_Backups.png

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#2 Post by Aki »

Hello,

It seems that you are posting on the Deja Dup support forum [1]. Have you asked elsewhere ?

---
[1] https://discourse.gnome.org/t/deja-dup- ... iled/14666
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#3 Post by LTL »

Aki wrote: 2023-03-31 18:23 Hello,

It seems that you are posting on the Deja Dup support forum [1]. Have you asked elsewhere ?

---
[1] https://discourse.gnome.org/t/deja-dup- ... iled/14666
Yes, I did. However, I did not receive a solution for this problem from their support forum.

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#4 Post by Aki »

Hello,
LTL wrote: 2023-04-01 02:04
Aki wrote: 2023-03-31 18:23 Hello,

It seems that you are posting on the Deja Dup support forum [1]. Have you asked elsewhere ?

---
[1] https://discourse.gnome.org/t/deja-dup- ... iled/14666
Yes, I did. However, I did not receive a solution for this problem from their support forum.
More info is needed:

1) what's your Debian version ? You can check with:

Code: Select all

cat /etc/debian_version
2) What are the installed version of duplicity and deja-dup (duplicity is the backend program internally used by Deja Dup) ? You can check with:

Code: Select all

apt show duplicity deja-dup | tee log.txt
The file log.txt will contain the full output of the previous command (please send it entirely).

3) What is your repository configuration ? You can check it with the following command (root password will be asked):

Code: Select all

apt-cache policy
4) Can you provide the full error log (compressed in zip format) as an attachment to the next post ?

5) Is your issue among those listed on the debian package bug page of duplicity [1] or deja-dup [2] ?

---
[1] https://bugs.debian.org/cgi-bin/pkgreport.cgi?pkg=duplicity;dist=unstable
[2] https://bugs.debian.org/cgi-bin/pkgreport.cgi?pkg=deja-dup;dist=unstable
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#5 Post by LTL »

Code: Select all

loc@debian:~$ cat /etc/debian_version
11.6
loc@debian:~$ apt show duplicity deja-dup | tee log.txt

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Package: duplicity
Version: 0.8.17-1+b1
Priority: optional
Section: utils
Source: duplicity (0.8.17-1)
Maintainer: Alexander Zangerl <az@debian.org>
Installed-Size: 1,803 kB
Depends: libc6 (>= 2.4), librsync2 (>= 1.0.0), python3 (<< 3.10), python3 (>= 3.9~), python3-fasteners, python3-future, python3:any (>= 3.7~), python3-lockfile, gnupg | gnupg1
Recommends: rsync, python3-paramiko, python3-pexpect, python3-urllib3, python3-oauthlib
Suggests: python3-boto, ncftp, lftp, tahoe-lafs, python3-swiftclient, python3-pip, par2
Homepage: http://duplicity.nongnu.org/
Tag: admin::backup, implemented-in::python, interface::commandline,
 role::program, scope::utility, security::cryptography,
 works-with-format::tar, works-with::archive
Download-Size: 341 kB
APT-Manual-Installed: no
APT-Sources: http://deb.debian.org/debian bullseye/main amd64 Packages
Description: encrypted bandwidth-efficient backup
 Duplicity backs directories by producing encrypted tar-format volumes
 and uploading them to a remote or local file server. Because duplicity
 uses librsync, the incremental archives are space efficient and only
 record the parts of files that have changed since the last backup.
 Because duplicity uses GnuPG to encrypt and/or sign these archives, they
 will be safe from spying and/or modification by the server.

Package: deja-dup
Version: 42.7-1
Priority: optional
Section: utils
Maintainer: Debian GNOME Maintainers <pkg-gnome-maintainers@lists.alioth.debian.org>
Installed-Size: 4,311 kB
Depends: duplicity (>= 0.7.14), dconf-gsettings-backend | gsettings-backend, libatk1.0-0 (>= 1.12.4), libc6 (>= 2.4), libgdk-pixbuf-2.0-0 (>= 2.22.0), libglib2.0-0 (>= 2.64), libgpg-error0 (>= 1.14), libgtk-3-0 (>= 3.22), libhandy-1-0 (>= 0.82.0), libjson-glib-1.0-0 (>= 1.5.2), libpackagekit-glib2-18 (>= 1.1.0), libsecret-1-0 (>= 0.18.6), libsoup2.4-1 (>= 2.48)
Recommends: gvfs-backends, packagekit, policykit-1
Homepage: https://launchpad.net/deja-dup
Tag: admin::backup, implemented-in::c, interface::graphical, interface::x11,
 role::program, scope::application, suite::gnome, uitoolkit::gtk,
 x11::application
Download-Size: 609 kB
APT-Manual-Installed: no
APT-Sources: http://deb.debian.org/debian bullseye/main amd64 Packages
Description: Backup utility
 Déjà Dup is a simple backup tool. It hides the complexity of backing up the
 Right Way (encrypted, off-site, and regular) and uses duplicity as the
 backend.
 .
 Features:
  * Support for local, remote, or cloud backup locations such as Nextcloud
  * Securely encrypts and compresses your data
  * Incrementally backs up, letting you restore from any particular backup
  * Schedules regular backups
  * Integrates well into your GNOME desktop

loc@debian:~$ apt-cache policy
Package files:
 100 /var/lib/dpkg/status
     release a=now
 500 http://deb.debian.org/debian bullseye-updates/main amd64 Packages
     release v=11-updates,o=Debian,a=stable-updates,n=bullseye-updates,l=Debian,c=main,b=amd64
     origin deb.debian.org
 500 http://security.debian.org/debian-security bullseye-security/main amd64 Packages
     release v=11,o=Debian,a=stable-security,n=bullseye-security,l=Debian-Security,c=main,b=amd64
     origin security.debian.org
 100 http://deb.debian.org/debian bullseye-backports/non-free amd64 Packages
     release o=Debian Backports,a=bullseye-backports,n=bullseye-backports,l=Debian Backports,c=non-free,b=amd64
     origin deb.debian.org
 100 http://deb.debian.org/debian bullseye-backports/contrib amd64 Packages
     release o=Debian Backports,a=bullseye-backports,n=bullseye-backports,l=Debian Backports,c=contrib,b=amd64
     origin deb.debian.org
 100 http://deb.debian.org/debian bullseye-backports/main amd64 Packages
     release o=Debian Backports,a=bullseye-backports,n=bullseye-backports,l=Debian Backports,c=main,b=amd64
     origin deb.debian.org
 500 http://deb.debian.org/debian bullseye/non-free amd64 Packages
     release v=11.6,o=Debian,a=stable,n=bullseye,l=Debian,c=non-free,b=amd64
     origin deb.debian.org
 500 http://deb.debian.org/debian bullseye/contrib amd64 Packages
     release v=11.6,o=Debian,a=stable,n=bullseye,l=Debian,c=contrib,b=amd64
     origin deb.debian.org
 500 http://deb.debian.org/debian bullseye/main amd64 Packages
     release v=11.6,o=Debian,a=stable,n=bullseye,l=Debian,c=main,b=amd64
     origin deb.debian.org
Pinned packages:
loc@debian:~$ 

5. Not at all for both.
6. Attached is a session_error_report when I ran the Deja Dup Backups.
Attachments
.xsession-errors.tar.gz
(38.83 KiB) Downloaded 5 times

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#6 Post by Aki »

Hello,

The .xsession-errors log does not contain any trace of deja-dup or duplicity messages/errors.

According to the image attached to your first post, deja-dup (probably) returned a log shown in the text scrollable window. This log could contain information about the error(s).

Furthermore, according to [1] and [2], the program deja-dup can be started from command line; in this case, you could start it in a terminal with the following commands:

Code: Select all

script deja-dup.log
DEJA_DUP_DEBUG=1 deja-dup --backup
exit
If you run the backup from command line and trigger the error, all the output eventually sent by deja-dup to the virtual terminal will be collected in the file named deja-dup.log .

Therefore, you could analyse the log to spot some clues about the cause of the issue. To read the log, you could use the following command (to get rid of terminal escape sequences):

Code: Select all

less -r deja-dup.log
You could also share it in the forum as post attachment after compressing it (e.g. in zip format). Please, in this case verify that sensitive information is obscured (if any).

Hope that help.

---
[1] https://manpages.debian.org/bullseye/de ... .1.en.html
[2] https://askubuntu.com/questions/337156/ ... debug-mode
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#7 Post by LTL »

Thanks. The deja-dup.log file was a very big file. I have tried to read it in a terminal window, but I was unable to find a clue. I compressed the file by using gzip, it now has the name deja-dup.log.gz. I will attach this file here as you had suggested.

P.S: The deja-dup.log.gz has 1.1MB, so it is a lot more than the 512KiB acceptable filesize. Is it possible to send an email with attachment directly to you?

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#8 Post by Aki »

You can use a public free file sharing service (e.g. https://filebin.net/).
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#9 Post by LTL »

Thanks. However, the public file sharing is full now. I am using DropBox instead. Here, the link to my file:
https://www.dropbox.com/s/4gberqy2cq3hn ... og.gz?dl=0

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#10 Post by Aki »

Hello,

From the log, it seems that duplicity (the backend program of deja-dup) releases more then one time the same lockfile before terminating (with the "unknown error", presumably):

Code: Select all

$ grep -ne "Acquiring\|Removing\|Releasing" deja-dup.log 
112:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
884:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
890:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1001:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
664116:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
664119:DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-a19zriqz-tempdir/mkstemp-bicvni7o-1
664122:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
664233:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1327114:DUPLICITY: . Removing still remembered temporary file /home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/duplicity-4kdasu64-tempdir/mktemp-t56vz4zw-1
1327117:DUPLICITY: . Removing still remembered temporary file /home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/duplicity-uacs26l8-tempdir/mktemp-d6do1x_n-1
1327170:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1327173:DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-ztbe34zo-tempdir/mkstemp-tspxi00g-1
1327176:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1327287:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1328090:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1328096:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1328207:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1329134:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1329137:DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-pfilkt6w-tempdir/mkstemp-l76zpph2-1
1329140:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1329143:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1329254:DUPLICITY: . Acquiring lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1331075:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1331078:DUPLICITY: . Removing still remembered temporary file /tmp/duplicity-n0ag0ly6-tempdir/mkstemp-krzk6g8u-1
1331081:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
1331084:DUPLICITY: . Releasing lockfile b'/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile'
When deja-dup and duplicity are not running, you could verify the existence of lockfiles in /home/loc/.cache/deja-dup/ ; you can use the command:

Code: Select all

find /home/loc/.cache/deja-dup/ -name lockfile 
It would also be useful to check whether the disk space used for /tmp and backup partition is enough to complete the operations.

Lastly, the log reports the following errors:

Code: Select all

$ grep -nie "Error " deja-dup.log 
1776:DUPLICITY: . Error accessing possibly locked file /.cache
1782:DUPLICITY: . Error accessing possibly locked file /.cache
663188:DUPLICITY: . Error accessing possibly locked file /lost+found
663194:DUPLICITY: . Error accessing possibly locked file /lost+found
663497:DUPLICITY: . Error accessing possibly locked file /root
663503:DUPLICITY: . Error accessing possibly locked file /root
665026:DUPLICITY: . Error accessing possibly locked file /.cache
665032:DUPLICITY: . Error accessing possibly locked file /.cache
1326208:DUPLICITY: . Error accessing possibly locked file /lost+found
1326214:DUPLICITY: . Error accessing possibly locked file /lost+found
1326517:DUPLICITY: . Error accessing possibly locked file /root
1326523:DUPLICITY: . Error accessing possibly locked file /root
These are probably directory that you need to exclude from backup because normal user cannot access to it.

A last question: does the error occur every time you run deja-dup or does it occur only sometime ?

Hope that helps.
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#11 Post by LTL »

Thank you very much for your helps again. By your suggestion, I tried to find a lockfile when deja-dup was not running:

Code: Select all

loc@debian:~$ find /home/loc/.cache/deja-dup/ -name lockfile
/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile
loc@debian:~$ 
For the last question, it does happen every time when deja-dup is running.

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#12 Post by Aki »

LTL wrote: 2023-04-04 17:22 Thank you very much for your helps again. By your suggestion, I tried to find a lockfile when deja-dup was not running:

Code: Select all

loc@debian:~$ find /home/loc/.cache/deja-dup/ -name lockfile
/home/loc/.cache/deja-dup/716f0a47c04ad383007082ea510da5f1/lockfile
loc@debian:~$ 
For the last question, it does happen every time when deja-dup is running.
You need probably to delete (or move in another directory outside the deja-dup cache, just in case) this lockfile and try again to start the backup. The lock file is the file named “lockfile” only.
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#13 Post by LTL »

Thanks. However, the problem was the same. So, to make sure it was gone after deleting it, I rechecked it before I ran the deja-dup again. Therefore, the lockfile was being created during deja-dup running.
Attachments
lockfile_gone after del.png

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#14 Post by Aki »

Hello,

Searching in the source code of deja-dup, in the files used for translation of the program's error message "Failed with an unknown error" is reported (eg. [1]):
[..]
#. But first, try to restart without a cache, since that seems to quite
#. frequently fix odd metadata errors with duplicity. If we hit an error
#. a second time, we'll show the unknown error message.
#: deja-dup/AssistantOperation.vala:690
#: libdeja/tools/duplicity/DuplicityJob.vala:707
The cache in the quoted text is the directory ~/.cache/deja-dup/

Hope that helps.

---
[1] https://codesearch.debian.net/show?file ... o&line=779
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

LTL
Posts: 41
Joined: 2018-06-06 01:03
Location: Sacramento, California

Re: [Software] Deja Dup Backups.

#15 Post by LTL »

Thank you very much for your times and efforts, but I switched to Back_In_Time now. It works great. It also provides the run in root app separately, so you can use it in case authorized permission accesses are required. Attached is a snapshot to introduce the app.
Attachments
Back_In_Time.png

Aki
Global Moderator
Global Moderator
Posts: 2823
Joined: 2014-07-20 18:12
Location: Europe
Has thanked: 69 times
Been thanked: 385 times

Re: [Software] Deja Dup Backups.

#16 Post by Aki »

Happy Debian !
⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄⠀

Post Reply