View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0000514 | bareos-core | director | public | 2015-09-09 11:02 | 2019-12-18 15:25 |
Reporter | zverg | Assigned To | arogge | ||
Priority | normal | Severity | minor | Reproducibility | always |
Status | closed | Resolution | no change required | ||
Platform | Linux | OS | Debian | OS Version | 7 |
Summary | 0000514: Big inc and diff backups with windows dedup | ||||
Description | Hi. If the files are located on the volume with dedupliŃate (Windows Server 2012R2), the incremental and differential backups copy all the files again. The parameter accurate does not help. | ||||
Additional Information | JobId Level Files Bytes Status Finished Name ====================================================================== 65 Full 1,474 10.40 G OK 09-Sep-15 12:11 host_job 66 Incr 123 2.400 G OK 09-Sep-15 12:33 host_job 67 Diff 792 10.40 G OK 09-Sep-15 12:55 host_job 70 Incr 792 10.40 G OK 09-Sep-15 13:45 host_job | ||||
Tags | No tags attached. | ||||
upd. Not always all the files are copied, but there is always the files that have not changed since the last backup |
|
Source directory is not changed Terminated Jobs: JobId Level Files Bytes Status Finished Name ====================================================================== 65 Full 1,474 10.40 G OK 09-Sep-15 12:11 host_job 66 Incr 123 2.400 G OK 09-Sep-15 12:33 host_job 67 Diff 792 10.40 G OK 09-Sep-15 12:55 host_job 70 Incr 792 10.40 G OK 09-Sep-15 13:45 host_job 72 Incr 105 2.457 G OK 09-Sep-15 15:54 host_job 73 Incr 85 1.145 G OK 09-Sep-15 16:23 host_job 74 Incr 64 1.297 G OK 09-Sep-15 17:00 host_job |
|
Hi Take a look at thread 460 (https://bugs.bareos.org/view.php?id=460). Is it the same problem? |
|
i dont know :) How can I see a detailed log with chcksumm? |
|
Start bareos with a debug level of 200; "/etc/rc.d/rc.bareos start -d200 | tee 2>&1 /tmp/bareos.log". (I don't know the path to the start script on Debian.) |
|
root@backup:~# cat /etc/bareos/clients.d/host.conf Schedule { Name = "host" Run = Level=Full 1st fri at 23:02 Run = Level=Differential 2nd-5th fri at 23:01 Run = Level=Incremental mon-thu at 23:00 } Client { Name = host-fd Address = 10.0.0.250 FDPort = 9102 Catalog = MyCatalog Password = "password" File Retention = 280 days Job Retention = 365 days AutoPrune = yes Maximum Concurrent Jobs = 100 } Storage { Name = host-sd Address = 10.0.0.106 SDPort = 9103 Password = "password" Device = HostStorage Media Type = File Maximum Concurrent Jobs = 100 } FileSet { Name = host_fileset Enable VSS = YES Include { Options { } Options { signature = MD5 Compression=GZIP } File = "E:/Shares/GDrive/Distr/iso" } } Job { Name = host_job Type = Backup Accurate = yes Client = host-fd FileSet = host_fileset Storage = bareos-sd Pool = Default Full Backup Pool = Full-test-Pool Differential Backup Pool = Diff-test-Pool Incremental Backup Pool = Inc-test-Pool Messages = Standart Schedule = "host" Maximum Concurrent Jobs = 100 SpoolData = yes } Job { Name = "HostRestore" Type = Restore Client = host-fd FileSet = host_fileset Storage = bareos-sd Where = "E:/Restore" Messages = Standard Pool = Default } |
|
signature=SHA1 when inc backup: *list files jobid=106 Using Catalog "MyCatalog" E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso * ost-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> lstat=A A IH/ A A A BAAAAA X8AAA A A DJGRrK DJGRrO DJ79EW A A M delta_seq=0 chksum= host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> lstat=A A IH/ A A A BAAAAA D3QAAA A A DJGRrK DJGRrO DJGRrK A A M delta_seq=0 chksum= host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> lstat=A A IH/ A A A BAAAAA N4AAA A A DJGRrK DJGRrO DJGRrK A A M delta_seq=0 chksum= host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso> lstat=A A IH/ A A A BAAAAA pV6AA A A DJGRrK DJGRrO DJGRrL A A M delta_seq=0 chksum= host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/> lstat=A A EH/ A A A A A A A DJGRrK DJGRrO DJGRrO A A M delta_seq=0 chksum= host-fd (100): filed/dir_cmd.c:476-106 <dird: backup FileIndex=0 host-fd (100): filed/dir_cmd.c:487-106 Executing backup command. host-fd (100): filed/dir_cmd.c:1715-106 JobFiles=0 host-fd (100): filed/dir_cmd.c:1745-106 begin backup ff=4c4028 host-fd (110): filed/dir_cmd.c:1754-106 filed>dird: 2000 OK backup host-fd (110): filed/dir_cmd.c:1760-106 >stored: append open session host-fd (110): filed/dir_cmd.c:1766-106 <stored: 3000 OK open ticket = 10 host-fd (110): filed/dir_cmd.c:1771-106 Got Ticket=10 host-fd (110): filed/dir_cmd.c:1781-106 >stored: append data 10 host-fd (110): filed/dir_cmd.c:2375-106 3000 OK data host-fd (110): filed/dir_cmd.c:1790-106 <stored: 3000 OK data host-fd (200): vss_generic.c:677-106 \\?\Volume{8add9262-61bf-4ae3-b29b-6a83b78a25ab}\ added to snapshotset (Drive E:\) host-fd (100): filed/dir_cmd.c:476-0 <dird: statushost-fd (100): filed/dir_cmd.c:476-0 host-fd (100): filed/dir_cmd.c:487-0 <dird: statusExecuting status command. host-fd (100): filed/dir_cmd.c:487-0 Executing status command. host-fd (100): filed/dir_cmd.c:476-0 <dird: statushost-fd (100): filed/dir_cmd.c:487-0 Executing status command. host-fd (200): lib/runscript.c:149-106 runscript: running all RUNSCRIPT object (ClientAfterVSS) JobStatus=B host-fd (110): filed/dir_cmd.c:1871-106 begin blast ff=4c4028 host-fd (50): findlib/find.c:161-106 Verify=<V> Accurate=<Cmcs> BaseJob=<Jspug5> flags=<4997632> host-fd (50): findlib/find.c:161-106 Verify=<V> Accurate=<Cmcs> BaseJob=<Jspug5> flags=<4997632> host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/> ok host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> ok host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> ok host-fd (99): filed/accurate.c:237-106 E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso st_ctime differs host-fd (130): filed/backup.c:532-106 FT_REG saving: E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso host-fd (130): filed/backup.c:633-106 filed: sending E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso to stored host-fd (150): lib/crypto_openssl.c:529-106 crypto_digest_new jcr=4fad88 host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso host-fd (150): filed/backup.c:759-106 type=3 do_read=1 host-fd (100): findlib/bfile.c:763-106 bopen: fname E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso, flags 32768, mode 0, rdev 1073741824 host-fd (50): findlib/bfile.c:604-106 === NO plugin host-fd (100): findlib/bfile.c:717-106 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy220\Shares\GDrive\Distr\iso\CentOS-7.0-1406-x86_64-DVD.iso ...... host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> ok host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso> ok host-fd (99): filed/accurate.c:237-106 E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso st_ctime differs host-fd (130): filed/backup.c:532-106 FT_REG saving: E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso host-fd (130): filed/backup.c:633-106 filed: sending E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso to stored host-fd (150): lib/crypto_openssl.c:529-106 crypto_digest_new jcr=4fad88 host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso host-fd (150): filed/backup.c:759-106 type=3 do_read=1 host-fd (100): findlib/bfile.c:763-106 bopen: fname E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso, flags 32768, mode 0, rdev 1073741824 host-fd (50): findlib/bfile.c:604-106 === NO plugin host-fd (100): findlib/bfile.c:717-106 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy220\Shares\GDrive\Distr\iso\Elastix-2.5.0-Stable-i386-bin-21oct2014.iso |
|
apparently deduplication constantly changing st_ctime | |
next run host-fd (99): filed/accurate.c:237-107 E:/Shares/GDrive/Distr/iso/ st_ctime differs host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> ok host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> ok host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> ok host-fd (99): filed/accurate.c:237-107 E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso st_ctime differs host-fd (130): filed/backup.c:532-107 FT_REG saving: E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso host-fd (130): filed/backup.c:633-107 filed: sending E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso to stored host-fd (150): lib/crypto_openssl.c:529-107 crypto_digest_new jcr=4dc5b8 host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso host-fd (150): filed/backup.c:759-107 type=3 do_read=1 host-fd (100): findlib/bfile.c:763-107 bopen: fname E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso, flags 32768, mode 0, rdev 1073741824 host-fd (50): findlib/bfile.c:604-107 === NO plugin host-fd (100): findlib/bfile.c:717-107 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy221\Shares\GDrive\Distr\iso\debian-7.8.0-amd64-netinst.iso |
|
Need more any data? | |
anybody here? | |
Which Bareos version are you using? Have you tried it with 15.2 release candidate? | |
The default settings will probably never handle a case where ctime/mtime change but not the file. You will have to configure the accurate flags in your fileset accordingly. |
|
Date Modified | Username | Field | Change |
---|---|---|---|
2015-09-09 11:02 | zverg | New Issue | |
2015-09-09 13:57 | zverg | Note Added: 0001823 | |
2015-09-09 15:09 | zverg | Note Added: 0001824 | |
2015-09-11 14:08 | qwerty | Note Added: 0001831 | |
2015-09-14 17:06 | zverg | Note Added: 0001832 | |
2015-09-14 19:37 | qwerty | Note Added: 0001834 | |
2015-09-21 15:16 | zverg | Note Added: 0001843 | |
2015-09-21 17:42 | zverg | Note Added: 0001845 | |
2015-09-21 17:52 | zverg | Note Added: 0001846 | |
2015-09-21 17:55 | zverg | Note Added: 0001847 | |
2015-09-21 17:57 | zverg | Note Edited: 0001845 | |
2015-09-26 23:30 | zverg | Note Added: 0001852 | |
2015-11-06 07:33 | zverg | Note Added: 0001920 | |
2015-11-06 17:27 | maik | Note Added: 0001939 | |
2015-11-06 17:27 | maik | Status | new => feedback |
2019-01-16 11:24 | arogge | Note Added: 0003184 | |
2019-01-16 11:24 | arogge | Status | feedback => resolved |
2019-01-16 11:24 | arogge | Resolution | open => no change required |
2019-01-16 11:24 | arogge | Assigned To | => arogge |
2019-12-18 15:25 | arogge | Status | resolved => closed |