-
- Posts: 13
- Joined: Sat Dec 19, 2020 3:59 pm
Mirror backup not deleting deleted files in destination
Backup4All 9.2b413
Backup Type = Mirror, with zip + AES 256 compression (full details attached)
This is what I did to show my issue:
1. Create non-empty E:\BACK ME UP.txt, run a backup - I see this in the log:
[2021-10-03 13:58:01] Y:\B4A\E Drive Mirror Backup\1\F49035 [E:\BACK ME UP.txt] OK
2. Check the mirror destination, I see Y:\B4A\E Drive Mirror Backup\1\F49035.zip
3. Delete E:\BACK ME UP.txt, create non-empty E:\foobar.txt. In the log, I see these messages
[2021-10-03 14:11:26] Remove excluded or deleted files from backup
[2021-10-03 14:11:26] Deleting file Y:\B4A\E Drive Mirror Backup\E\BACK ME UP.txt.zip
[2021-10-03 14:11:33] Y:\B4A\E Drive Mirror Backup\1\F49036 [E:\foobar.txt] OK
4. Looking in the mirror destination, I see both files still existing:
Y:\B4A\E Drive Mirror Backup\1\F49035.zip
Y:\B4A\E Drive Mirror Backup\1\F49036.zip
Basically, the delete says it is deleting. I can no longer see E:\BACK ME UP.txt in Restore meaning it was removed from the catalog, but it still exists in the destination storage. This is a simple example but I have a few 10GB of wasted space in the destination that is used by orphans. Is there any way to clean them up without doing a full backup again (~18TB)?
Backup Type = Mirror, with zip + AES 256 compression (full details attached)
This is what I did to show my issue:
1. Create non-empty E:\BACK ME UP.txt, run a backup - I see this in the log:
[2021-10-03 13:58:01] Y:\B4A\E Drive Mirror Backup\1\F49035 [E:\BACK ME UP.txt] OK
2. Check the mirror destination, I see Y:\B4A\E Drive Mirror Backup\1\F49035.zip
3. Delete E:\BACK ME UP.txt, create non-empty E:\foobar.txt. In the log, I see these messages
[2021-10-03 14:11:26] Remove excluded or deleted files from backup
[2021-10-03 14:11:26] Deleting file Y:\B4A\E Drive Mirror Backup\E\BACK ME UP.txt.zip
[2021-10-03 14:11:33] Y:\B4A\E Drive Mirror Backup\1\F49036 [E:\foobar.txt] OK
4. Looking in the mirror destination, I see both files still existing:
Y:\B4A\E Drive Mirror Backup\1\F49035.zip
Y:\B4A\E Drive Mirror Backup\1\F49036.zip
Basically, the delete says it is deleting. I can no longer see E:\BACK ME UP.txt in Restore meaning it was removed from the catalog, but it still exists in the destination storage. This is a simple example but I have a few 10GB of wasted space in the destination that is used by orphans. Is there any way to clean them up without doing a full backup again (~18TB)?
- Attachments
-
- adv.png (58.63 KiB) Viewed 10437 times
-
- comp.png (34.37 KiB) Viewed 10437 times
-
- type.png (33.58 KiB) Viewed 10437 times
-
- Posts: 1849
- Joined: Wed Dec 16, 2009 12:46 pm
Re: Mirror backup not deleting deleted files in destination
Hi,
1. Did you receive any warning in log?
2. What drive type is Y: ?
1. Did you receive any warning in log?
2. What drive type is Y: ?
Do you know you can monitor your backups remotely with Backup4all Monitor? You can read more here: https://www.backup4all.com/backup4all-monitor.html
-
- Posts: 13
- Joined: Sat Dec 19, 2020 3:59 pm
Re: Mirror backup not deleting deleted files in destination
1. No warnings or errors other than what I posted
2. Y:\ is a DrivePool of 2 NTFS drives.
2. Y:\ is a DrivePool of 2 NTFS drives.
-
- Posts: 13
- Joined: Sat Dec 19, 2020 3:59 pm
Re: Mirror backup not deleting deleted files in destination
It should be noted the log is saying that it is trying to delete the wrong filename.
Backing up file log:
[2021-10-03 13:58:01] Y:\B4A\E Drive Mirror Backup\1\F49035 [E:\BACK ME UP.txt] OK
Deleting file log:
[2021-10-03 14:11:26] Deleting file Y:\B4A\E Drive Mirror Backup\E\BACK ME UP.txt.zip
It looks like it is attempting to delete:
<destination drive>:\<destination folder>\<original filename>.zip
INSTEAD OF:
<destination drive>:\<destination folder>\<obfuscated filename>.zip
Backing up file log:
[2021-10-03 13:58:01] Y:\B4A\E Drive Mirror Backup\1\F49035 [E:\BACK ME UP.txt] OK
Deleting file log:
[2021-10-03 14:11:26] Deleting file Y:\B4A\E Drive Mirror Backup\E\BACK ME UP.txt.zip
It looks like it is attempting to delete:
<destination drive>:\<destination folder>\<original filename>.zip
INSTEAD OF:
<destination drive>:\<destination folder>\<obfuscated filename>.zip
-
- Posts: 1849
- Joined: Wed Dec 16, 2009 12:46 pm
Re: Mirror backup not deleting deleted files in destination
Hi,
The path is correct. You cannot use E: in path, so there will be only "E"
Please download the latest version of Backup4all 9.3.420 and try again to run the backup.
If you still have the problem, please go to Backup Properties->Type and uncheck the "Copy files using Windows native API" option.
The path is correct. You cannot use E: in path, so there will be only "E"
Please download the latest version of Backup4all 9.3.420 and try again to run the backup.
If you still have the problem, please go to Backup Properties->Type and uncheck the "Copy files using Windows native API" option.
Do you know you can monitor your backups remotely with Backup4all Monitor? You can read more here: https://www.backup4all.com/backup4all-monitor.html
-
- Posts: 13
- Joined: Sat Dec 19, 2020 3:59 pm
Re: Mirror backup not deleting deleted files in destination
9.3b420 installed. Looks like it works now.
1. Created test file E:\B4A-9-3-420-TEST.txt.txt
2. Ran backup. Backup log (highlights):
[2021-10-12 22:28:14] Backup4all 9.3.420
[2021-10-12 22:28:14] Checking backup destination (Local hard drive)
[2021-10-12 22:28:14] Opening file "C:\Users\xxx\AppData\Roaming\Softland\Backup4all 9\Catalogs\E Drive Mirror Encrypted Backup.bkc"
[2021-10-12 22:28:16] Checking if the drives of the sources exist
[2021-10-12 22:28:16] Opening file ":memory:"
[2021-10-12 22:28:16] Creating the list of files to backup
[2021-10-12 22:28:55] Found file E:\B4A-9-3-420-TEST.txt.txt
[2021-10-12 22:28:55] Preparing shadow copy
[2021-10-12 22:29:15] Could not create Volume Shadow Copy. Locked files will not be copied.
[2021-10-12 22:29:15] Added file E:\B4A-9-3-420-TEST.txt.txt
[2021-10-12 22:29:16] Remove excluded or deleted files from backup
No files or folders were excluded or deleted
[2021-10-12 22:29:23] Starting test on "E Drive Mirror Encrypted Backup" for backup number 95, the last backup number at 2021-10-12 22:29:23
[2021-10-12 22:29:23] 95 Mirror 2021-10-12 22:28:14 1 12 bytes
[2021-10-12 22:29:23] Y:\B4A\E Drive Mirror Backup\1\F49061 [E:\B4A-9-3-420-TEST.txt.txt] OK
Test finished in 0 second(s) at 2021-10-12 22:29:23, 1 file(s) and 0 folder(s) tested, 0 error(s) and 0 warning(s) found
Total number of files added to backup: 1
Total number of folders added to backup: 0
Total size of files added to backup: 12 bytes
Number of files excluded: 0
Number of folders excluded: 0
Next scheduled backup: 2021-10-13 23:55:00
Backup completed in 1:09 minute(s) at 2021-10-12 22:29:23 with 0 error(s), 0 warning(s)
3. DELETED test file E:\B4A-9-3-420-TEST.txt.txt, updated another file to force a backup
4. Ran backup. Backup log (highlights):
[2021-10-12 22:35:00] Backup4all 9.3.420
[2021-10-12 22:35:00] Checking backup destination (Local hard drive)
[2021-10-12 22:35:00] Opening file "C:\Users\xxx\AppData\Roaming\Softland\Backup4all 9\Catalogs\E Drive Mirror Encrypted Backup.bkc"
[2021-10-12 22:35:01] Checking if the drives of the sources exist
[2021-10-12 22:35:02] Opening file ":memory:"
[2021-10-12 22:35:02] Creating the list of files to backup
[2021-10-12 22:35:40] Found file E:\foobarx.txt
[2021-10-12 22:35:40] Preparing shadow copy
[2021-10-12 22:36:01] Could not create Volume Shadow Copy. Locked files will not be copied.
[2021-10-12 22:36:01] Added file E:\foobarx.txt
[2021-10-12 22:36:01] Remove excluded or deleted files from backup
[2021-10-12 22:36:01] Deleting file Y:\B4A\E Drive Mirror Backup\1\F49036.zip
[2021-10-12 22:36:01] Deleting file Y:\B4A\E Drive Mirror Backup\1\F49061.zip
[2021-10-12 22:36:08] Starting test on "E Drive Mirror Encrypted Backup" for backup number 96, the last backup number at 2021-10-12 22:36:08
[2021-10-12 22:36:08] 96 Mirror 2021-10-12 22:35:00 1 4 bytes
[2021-10-12 22:36:08] Y:\B4A\E Drive Mirror Backup\1\F49062 [E:\foobarx.txt] OK
Test finished in 0 second(s) at 2021-10-12 22:36:08, 1 file(s) and 0 folder(s) tested, 0 error(s) and 0 warning(s) found
Total number of files added to backup: 1
Total number of folders added to backup: 0
Total size of files added to backup: 4 bytes
Number of files excluded: 0
Number of folders excluded: 0
Next scheduled backup: 2021-10-13 23:55:00
Backup completed in 1:08 minute(s) at 2021-10-12 22:36:08 with 0 error(s), 0 warning(s)
The zip file was deleted on the destination drive.
The log now also makes more sense since it shows the app is deleting the expected obfuscated filename (the zip) that exists in the destination. The previous log showed it was trying to delete the unobfuscated filename which never existed in the destination.
Thanks.
1. Created test file E:\B4A-9-3-420-TEST.txt.txt
2. Ran backup. Backup log (highlights):
[2021-10-12 22:28:14] Backup4all 9.3.420
[2021-10-12 22:28:14] Checking backup destination (Local hard drive)
[2021-10-12 22:28:14] Opening file "C:\Users\xxx\AppData\Roaming\Softland\Backup4all 9\Catalogs\E Drive Mirror Encrypted Backup.bkc"
[2021-10-12 22:28:16] Checking if the drives of the sources exist
[2021-10-12 22:28:16] Opening file ":memory:"
[2021-10-12 22:28:16] Creating the list of files to backup
[2021-10-12 22:28:55] Found file E:\B4A-9-3-420-TEST.txt.txt
[2021-10-12 22:28:55] Preparing shadow copy
[2021-10-12 22:29:15] Could not create Volume Shadow Copy. Locked files will not be copied.
[2021-10-12 22:29:15] Added file E:\B4A-9-3-420-TEST.txt.txt
[2021-10-12 22:29:16] Remove excluded or deleted files from backup
No files or folders were excluded or deleted
[2021-10-12 22:29:23] Starting test on "E Drive Mirror Encrypted Backup" for backup number 95, the last backup number at 2021-10-12 22:29:23
[2021-10-12 22:29:23] 95 Mirror 2021-10-12 22:28:14 1 12 bytes
[2021-10-12 22:29:23] Y:\B4A\E Drive Mirror Backup\1\F49061 [E:\B4A-9-3-420-TEST.txt.txt] OK
Test finished in 0 second(s) at 2021-10-12 22:29:23, 1 file(s) and 0 folder(s) tested, 0 error(s) and 0 warning(s) found
Total number of files added to backup: 1
Total number of folders added to backup: 0
Total size of files added to backup: 12 bytes
Number of files excluded: 0
Number of folders excluded: 0
Next scheduled backup: 2021-10-13 23:55:00
Backup completed in 1:09 minute(s) at 2021-10-12 22:29:23 with 0 error(s), 0 warning(s)
3. DELETED test file E:\B4A-9-3-420-TEST.txt.txt, updated another file to force a backup
4. Ran backup. Backup log (highlights):
[2021-10-12 22:35:00] Backup4all 9.3.420
[2021-10-12 22:35:00] Checking backup destination (Local hard drive)
[2021-10-12 22:35:00] Opening file "C:\Users\xxx\AppData\Roaming\Softland\Backup4all 9\Catalogs\E Drive Mirror Encrypted Backup.bkc"
[2021-10-12 22:35:01] Checking if the drives of the sources exist
[2021-10-12 22:35:02] Opening file ":memory:"
[2021-10-12 22:35:02] Creating the list of files to backup
[2021-10-12 22:35:40] Found file E:\foobarx.txt
[2021-10-12 22:35:40] Preparing shadow copy
[2021-10-12 22:36:01] Could not create Volume Shadow Copy. Locked files will not be copied.
[2021-10-12 22:36:01] Added file E:\foobarx.txt
[2021-10-12 22:36:01] Remove excluded or deleted files from backup
[2021-10-12 22:36:01] Deleting file Y:\B4A\E Drive Mirror Backup\1\F49036.zip
[2021-10-12 22:36:01] Deleting file Y:\B4A\E Drive Mirror Backup\1\F49061.zip
[2021-10-12 22:36:08] Starting test on "E Drive Mirror Encrypted Backup" for backup number 96, the last backup number at 2021-10-12 22:36:08
[2021-10-12 22:36:08] 96 Mirror 2021-10-12 22:35:00 1 4 bytes
[2021-10-12 22:36:08] Y:\B4A\E Drive Mirror Backup\1\F49062 [E:\foobarx.txt] OK
Test finished in 0 second(s) at 2021-10-12 22:36:08, 1 file(s) and 0 folder(s) tested, 0 error(s) and 0 warning(s) found
Total number of files added to backup: 1
Total number of folders added to backup: 0
Total size of files added to backup: 4 bytes
Number of files excluded: 0
Number of folders excluded: 0
Next scheduled backup: 2021-10-13 23:55:00
Backup completed in 1:08 minute(s) at 2021-10-12 22:36:08 with 0 error(s), 0 warning(s)
The zip file was deleted on the destination drive.
The log now also makes more sense since it shows the app is deleting the expected obfuscated filename (the zip) that exists in the destination. The previous log showed it was trying to delete the unobfuscated filename which never existed in the destination.
Thanks.