View Issue Details

IDProjectCategoryView StatusLast Update
0000514bareos-coredirectorpublic2019-12-18 15:25
Reporterzverg Assigned Toarogge  
PrioritynormalSeverityminorReproducibilityalways
Status closedResolutionno change required 
PlatformLinuxOSDebianOS Version7
Summary0000514: Big inc and diff backups with windows dedup
DescriptionHi.
If the files are located on the volume with dedupliсate (Windows Server 2012R2), the incremental and differential backups copy all the files again. The parameter accurate does not help.
Additional Information JobId Level Files Bytes Status Finished Name
======================================================================
    65 Full 1,474 10.40 G OK 09-Sep-15 12:11 host_job
    66 Incr 123 2.400 G OK 09-Sep-15 12:33 host_job
    67 Diff 792 10.40 G OK 09-Sep-15 12:55 host_job
    70 Incr 792 10.40 G OK 09-Sep-15 13:45 host_job
TagsNo tags attached.

Activities

zverg

zverg

2015-09-09 13:57

reporter   ~0001823

upd.
 Not always all the files are copied, but there is always the files that have not changed since the last backup
zverg

zverg

2015-09-09 15:09

reporter   ~0001824

Source directory is not changed

Terminated Jobs:
 JobId Level Files Bytes Status Finished Name
======================================================================
    65 Full 1,474 10.40 G OK 09-Sep-15 12:11 host_job
    66 Incr 123 2.400 G OK 09-Sep-15 12:33 host_job
    67 Diff 792 10.40 G OK 09-Sep-15 12:55 host_job
    70 Incr 792 10.40 G OK 09-Sep-15 13:45 host_job
    72 Incr 105 2.457 G OK 09-Sep-15 15:54 host_job
    73 Incr 85 1.145 G OK 09-Sep-15 16:23 host_job
    74 Incr 64 1.297 G OK 09-Sep-15 17:00 host_job
qwerty

qwerty

2015-09-11 14:08

reporter   ~0001831

Hi

Take a look at thread 460 (https://bugs.bareos.org/view.php?id=460).
Is it the same problem?
zverg

zverg

2015-09-14 17:06

reporter   ~0001832

i dont know :)
How can I see a detailed log with chcksumm?
qwerty

qwerty

2015-09-14 19:37

reporter   ~0001834

Start bareos with a debug level of 200; "/etc/rc.d/rc.bareos start -d200 | tee 2>&1 /tmp/bareos.log".
(I don't know the path to the start script on Debian.)
zverg

zverg

2015-09-21 15:16

reporter   ~0001843

root@backup:~# cat /etc/bareos/clients.d/host.conf
Schedule {
        Name = "host"
        Run = Level=Full 1st fri at 23:02
        Run = Level=Differential 2nd-5th fri at 23:01
        Run = Level=Incremental mon-thu at 23:00
}

Client {
        Name = host-fd
        Address = 10.0.0.250
        FDPort = 9102
        Catalog = MyCatalog
        Password = "password"
        File Retention = 280 days
        Job Retention = 365 days
        AutoPrune = yes
        Maximum Concurrent Jobs = 100
}

Storage {
        Name = host-sd
        Address = 10.0.0.106
        SDPort = 9103
        Password = "password"
        Device = HostStorage
        Media Type = File
        Maximum Concurrent Jobs = 100
}

FileSet {
        Name = host_fileset
        Enable VSS = YES
        Include {
                Options {

               }
                Options {
                        signature = MD5
                        Compression=GZIP
                }
                File = "E:/Shares/GDrive/Distr/iso"
        }
}

Job {
        Name = host_job
        Type = Backup
        Accurate = yes
        Client = host-fd
        FileSet = host_fileset
        Storage = bareos-sd
        Pool = Default
        Full Backup Pool = Full-test-Pool
        Differential Backup Pool = Diff-test-Pool
        Incremental Backup Pool = Inc-test-Pool
        Messages = Standart
        Schedule = "host"
        Maximum Concurrent Jobs = 100
        SpoolData = yes
}


Job {
        Name = "HostRestore"
        Type = Restore
        Client = host-fd
        FileSet = host_fileset
        Storage = bareos-sd
        Where = "E:/Restore"
        Messages = Standard
        Pool = Default
}
zverg

zverg

2015-09-21 17:42

reporter   ~0001845

Last edited: 2015-09-21 17:57

signature=SHA1

when inc backup:
*list files jobid=106
Using Catalog "MyCatalog"
 E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso
 E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso
*


ost-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> lstat=A A IH/ A A A BAAAAA X8AAA A A DJGRrK DJGRrO DJ79EW A A M delta_seq=0 chksum=
host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> lstat=A A IH/ A A A BAAAAA D3QAAA A A DJGRrK DJGRrO DJGRrK A A M delta_seq=0 chksum=
host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> lstat=A A IH/ A A A BAAAAA N4AAA A A DJGRrK DJGRrO DJGRrK A A M delta_seq=0 chksum=
host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso> lstat=A A IH/ A A A BAAAAA pV6AA A A DJGRrK DJGRrO DJGRrL A A M delta_seq=0 chksum=
host-fd (100): filed/accurate_htable.c:98-106 add fname=<E:/Shares/GDrive/Distr/iso/> lstat=A A EH/ A A A A A A A DJGRrK DJGRrO DJGRrO A A M delta_seq=0 chksum=

host-fd (100): filed/dir_cmd.c:476-106 <dird: backup FileIndex=0
host-fd (100): filed/dir_cmd.c:487-106 Executing backup command.
host-fd (100): filed/dir_cmd.c:1715-106 JobFiles=0
host-fd (100): filed/dir_cmd.c:1745-106 begin backup ff=4c4028
host-fd (110): filed/dir_cmd.c:1754-106 filed>dird: 2000 OK backup
host-fd (110): filed/dir_cmd.c:1760-106 >stored: append open session
host-fd (110): filed/dir_cmd.c:1766-106 <stored: 3000 OK open ticket = 10
host-fd (110): filed/dir_cmd.c:1771-106 Got Ticket=10
host-fd (110): filed/dir_cmd.c:1781-106 >stored: append data 10
host-fd (110): filed/dir_cmd.c:2375-106 3000 OK data
host-fd (110): filed/dir_cmd.c:1790-106 <stored: 3000 OK data
host-fd (200): vss_generic.c:677-106 \\?\Volume{8add9262-61bf-4ae3-b29b-6a83b78a25ab}\ added to snapshotset (Drive E:\)
host-fd (100): filed/dir_cmd.c:476-0 <dird: statushost-fd (100): filed/dir_cmd.c:476-0 host-fd (100): filed/dir_cmd.c:487-0 <dird: statusExecuting status command.
host-fd (100): filed/dir_cmd.c:487-0 Executing status command.
host-fd (100): filed/dir_cmd.c:476-0 <dird: statushost-fd (100): filed/dir_cmd.c:487-0 Executing status command.
host-fd (200): lib/runscript.c:149-106 runscript: running all RUNSCRIPT object (ClientAfterVSS) JobStatus=B
host-fd (110): filed/dir_cmd.c:1871-106 begin blast ff=4c4028
host-fd (50): findlib/find.c:161-106 Verify=<V> Accurate=<Cmcs> BaseJob=<Jspug5> flags=<4997632>
host-fd (50): findlib/find.c:161-106 Verify=<V> Accurate=<Cmcs> BaseJob=<Jspug5> flags=<4997632>
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso
host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/> ok
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso
host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> ok
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso
host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> ok
host-fd (99): filed/accurate.c:237-106 E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso st_ctime differs
host-fd (130): filed/backup.c:532-106 FT_REG saving: E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso
host-fd (130): filed/backup.c:633-106 filed: sending E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso to stored
host-fd (150): lib/crypto_openssl.c:529-106 crypto_digest_new jcr=4fad88
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso
host-fd (150): filed/backup.c:759-106 type=3 do_read=1
host-fd (100): findlib/bfile.c:763-106 bopen: fname E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso, flags 32768, mode 0, rdev 1073741824
host-fd (50): findlib/bfile.c:604-106 === NO plugin
host-fd (100): findlib/bfile.c:717-106 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy220\Shares\GDrive\Distr\iso\CentOS-7.0-1406-x86_64-DVD.iso
......
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso
host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> ok
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso
host-fd (100): filed/accurate.c:56-106 lookup <E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso> ok
host-fd (99): filed/accurate.c:237-106 E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso st_ctime differs
host-fd (130): filed/backup.c:532-106 FT_REG saving: E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso
host-fd (130): filed/backup.c:633-106 filed: sending E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso to stored
host-fd (150): lib/crypto_openssl.c:529-106 crypto_digest_new jcr=4fad88
host-fd (200): filed/backup.c:1512-106 No strip for E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso
host-fd (150): filed/backup.c:759-106 type=3 do_read=1
host-fd (100): findlib/bfile.c:763-106 bopen: fname E:/Shares/GDrive/Distr/iso/Elastix-2.5.0-Stable-i386-bin-21oct2014.iso, flags 32768, mode 0, rdev 1073741824
host-fd (50): findlib/bfile.c:604-106 === NO plugin
host-fd (100): findlib/bfile.c:717-106 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy220\Shares\GDrive\Distr\iso\Elastix-2.5.0-Stable-i386-bin-21oct2014.iso

zverg

zverg

2015-09-21 17:52

reporter   ~0001846

apparently deduplication constantly changing st_ctime
zverg

zverg

2015-09-21 17:55

reporter   ~0001847

next run

host-fd (99): filed/accurate.c:237-107 E:/Shares/GDrive/Distr/iso/ st_ctime differs
host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso
host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/CentOS-6.6-x86_64-minimal.iso> ok
host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso
host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/CentOS-7.0-1406-x86_64-DVD.iso> ok
host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso
host-fd (100): filed/accurate.c:56-107 lookup <E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso> ok
host-fd (99): filed/accurate.c:237-107 E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso st_ctime differs
host-fd (130): filed/backup.c:532-107 FT_REG saving: E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso
host-fd (130): filed/backup.c:633-107 filed: sending E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso to stored
host-fd (150): lib/crypto_openssl.c:529-107 crypto_digest_new jcr=4dc5b8
host-fd (200): filed/backup.c:1512-107 No strip for E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso
host-fd (150): filed/backup.c:759-107 type=3 do_read=1
host-fd (100): findlib/bfile.c:763-107 bopen: fname E:/Shares/GDrive/Distr/iso/debian-7.8.0-amd64-netinst.iso, flags 32768, mode 0, rdev 1073741824
host-fd (50): findlib/bfile.c:604-107 === NO plugin
host-fd (100): findlib/bfile.c:717-107 Read CreateFileW=\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy221\Shares\GDrive\Distr\iso\debian-7.8.0-amd64-netinst.iso
zverg

zverg

2015-09-26 23:30

reporter   ~0001852

Need more any data?
zverg

zverg

2015-11-06 07:33

reporter   ~0001920

anybody here?
maik

maik

2015-11-06 17:27

administrator   ~0001939

Which Bareos version are you using? Have you tried it with 15.2 release candidate?
arogge

arogge

2019-01-16 11:24

manager   ~0003184

The default settings will probably never handle a case where ctime/mtime change but not the file.
You will have to configure the accurate flags in your fileset accordingly.

Issue History

Date Modified Username Field Change
2015-09-09 11:02 zverg New Issue
2015-09-09 13:57 zverg Note Added: 0001823
2015-09-09 15:09 zverg Note Added: 0001824
2015-09-11 14:08 qwerty Note Added: 0001831
2015-09-14 17:06 zverg Note Added: 0001832
2015-09-14 19:37 qwerty Note Added: 0001834
2015-09-21 15:16 zverg Note Added: 0001843
2015-09-21 17:42 zverg Note Added: 0001845
2015-09-21 17:52 zverg Note Added: 0001846
2015-09-21 17:55 zverg Note Added: 0001847
2015-09-21 17:57 zverg Note Edited: 0001845
2015-09-26 23:30 zverg Note Added: 0001852
2015-11-06 07:33 zverg Note Added: 0001920
2015-11-06 17:27 maik Note Added: 0001939
2015-11-06 17:27 maik Status new => feedback
2019-01-16 11:24 arogge Note Added: 0003184
2019-01-16 11:24 arogge Status feedback => resolved
2019-01-16 11:24 arogge Resolution open => no change required
2019-01-16 11:24 arogge Assigned To => arogge
2019-12-18 15:25 arogge Status resolved => closed