View Issue Details

IDProjectCategoryView StatusLast Update
0001453bareos-coredirectorpublic2024-01-15 14:11
Reporterinazo Assigned Tobruno-at-bareos  
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionunable to reproduce 
PlatformLinuxOSDebianOS Version10
Product Version20.0.6 
Summary0001453: Rate issue when prune and truncate volume
DescriptionHi,

Every day of month i run task with a pool which are limited to 31 volumes, each volume is used one time and maximum retention is 30 days. Each days since i have the 31 volumes in my pools the rate decrease to 14150 Kb/s to 141 Kb/s... So my backup which take initialy 5 minutes to run, take now 30 minutes... I thin it's when the job truncate / recycle / prune the volume.

First day of month i run an other pool in full mode. And it's not affected by the rate decrease beacuse for the moment the job don't have to recycle/prune/truncate volume.

Other information i use S3 storage.
Tags"libdroplet", droplet

Activities

inazo

inazo

2022-05-02 15:56

reporter  

bareos-dir.conf (893 bytes)   
Director {                            # define myself
  Name = bareos-dir
  QueryFile = "/usr/lib/bareos/scripts/query.sql"
  Maximum Concurrent Jobs = 10
  Messages = Daemon
  Auditing = yes

  # Enable the Heartbeat if you experience connection losses
  # (eg. because of your router or firewall configuration).
  # Additionally the Heartbeat can be enabled in bareos-sd and bareos-fd.
  #
  Heartbeat Interval = 1 min

  # remove comment in next line to load dynamic backends from specified directory
  # Backend Directory = /usr/lib/bareos/backends

  # remove comment from "Plugin Directory" to load plugins from specified directory.
  # if "Plugin Names" is defined, only the specified plugins will be loaded,
  # otherwise all director plugins (*-dir.so) from the "Plugin Directory".
  #
  # Plugin Directory = "/usr/lib/bareos/plugins"
  # Plugin Names = ""
}

bareos-dir.conf (893 bytes)   
client.conf (79 bytes)   
Client {
  Name = myHost
  Address = 333.444.555.666
  Auto Prune = yes
}
client.conf (79 bytes)   
fileset.conf (333 bytes)   
FileSet {
  Name = "WebDir"
  Description = "Fileset for backup all file in a /var/www, /etc and the cron in /var/spool/crontabs"
  Include {
    Options {
      Signature = MD5 # calculate md5 checksum per file
      Compression = GZIP
    }
    File = "/var/www"
    File = "/etc/"
    File = "/var/spool/cron/"
  }
}
fileset.conf (333 bytes)   
job.conf (435 bytes)   
Job {
  Name = myHost-job
  Client = myHost
  JobDefs = myHost-defs

  Run Script {
        Command = "bash /home/debian/scripts/bareos/bareos_after.sh"
        Runs When = After
        Runs On Failure = no
        Runs On Client = yes
  }
  Run Script {
        Command = "bash /home/debian/scripts/bareos/bareos_before.sh"
        Runs When = Before
        Runs On Failure = no
        Runs On Client = yes
  }
}
job.conf (435 bytes)   
jobdefs.conf (655 bytes)   
JobDefs {
  Name = "myHost-defs"
  Type = Backup
  Level = Incremental
  Client = bareos-fd
  FileSet = "WebDir"                     # selftest fileset                            (#13)
  Schedule = "myHost-BasicCycle"
  Storage = S3_Object 
  Messages = Standard
  Pool = Incremental
  Priority = 10
  Write Bootstrap = "/var/lib/bareos/%c.bsr"
  Full Backup Pool = myHost-Full                  # write Full Backups into "Full" Pool         (#05)
  Differential Backup Pool = Differential  # write Diff Backups into "Differential" Pool (#08)
  Incremental Backup Pool = Incremental    # write Incr Backups into "Incremental" Pool  (#11)
}
jobdefs.conf (655 bytes)   
pool.conf (2,697 bytes)   
Pool {
  Name = myHost-Full
  Pool Type = Backup
  Recycle = yes                       # Bareos can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Auto Prune = yes                     # Prune expired volumes
  Action On Purge = Truncate
  Volume Retention = 30 days         # How long should the Full Backups be kept? (#06)
  Maximum Volume Bytes = 50G          # Limit Volume size to something reasonable
  Maximum Volumes = 31               # Limit number of Volumes in Pool
  Label Format = "myHost-Full-"              # Volumes will be labeled "Full-<volume-id>"
  Maximum Volume Jobs = 1
  Use Volume Once = yes
  Recycle Oldest Volume = yes
}

Pool {
  Name = myHost-FullMonth
  Pool Type = Backup
  Recycle = yes                       # Bareos can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Auto Prune = yes                     # Prune expired volumes
  Action On Purge = Truncate
  Volume Retention = 365 days         # How long should the Full Backups be kept? (#06)
  Maximum Volume Bytes = 50G          # Limit Volume size to something reasonable
  Maximum Volumes = 13              # Limit number of Volumes in Pool
  Label Format = "myHost-FullMonth-"              # Volumes will be labeled "Full-<volume-id>"
  Use Volume Once = yes
  Recycle Oldest Volume = yes
}

Pool {
  Name = myHost-Incremental
  Pool Type = Backup
  Recycle = yes                       # Bareos can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Auto Prune = yes                     # Prune expired volumes
  Action On Purge = Truncate
  Volume Retention = 15 days         # How long should the Full Backups be kept? (#06)
  Maximum Volume Bytes = 50G          # Limit Volume size to something reasonable
  Maximum Volumes = 16              # Limit number of Volumes in Pool
  Label Format = "myHost-Incremental-"
  Use Volume Once = yes
  Recycle Oldest Volume = yes
}

Pool {
  Name = myHost-Differential
  Pool Type = Backup
  Recycle = yes                       # Bareos can automatically recycle Volumes
  AutoPrune = yes                     # Prune expired volumes
  Auto Prune = yes                     # Prune expired volumes
  Action On Purge = Truncate
  Volume Retention = 15 days         # How long should the Full Backups be kept? (#06)
  Maximum Volume Bytes = 50G          # Limit Volume size to something reasonable
  Maximum Volumes = 16              # Limit number of Volumes in Pool
  Label Format = "myHost-Differential-"
  Use Volume Once = yes
  Recycle Oldest Volume = yes
}


pool.conf (2,697 bytes)   
schedule.conf (167 bytes)   
Schedule {
  Name = "myHost-BasicCycle"
  Run = Full Pool=myHost-Full daily at 00:00                   # (#04)
  Run = Full Pool=myHost-FullMonth on 1 at 00:00
}
schedule.conf (167 bytes)   
bruno-at-bareos

bruno-at-bareos

2023-12-12 17:24

manager   ~0005616

missing the most important configuration file of storage (dir), device + profile (anonymized)
bruno-at-bareos

bruno-at-bareos

2024-01-15 14:11

manager   ~0005684

can't be analysed nor fixed without configuration

Issue History

Date Modified Username Field Change
2022-05-02 15:56 inazo New Issue
2022-05-02 15:56 inazo File Added: bareos-dir.conf
2022-05-02 15:56 inazo File Added: client.conf
2022-05-02 15:56 inazo File Added: fileset.conf
2022-05-02 15:56 inazo File Added: job.conf
2022-05-02 15:56 inazo File Added: jobdefs.conf
2022-05-02 15:56 inazo File Added: pool.conf
2022-05-02 15:56 inazo File Added: schedule.conf
2023-12-12 17:23 bruno-at-bareos Tag Attached: droplet
2023-12-12 17:23 bruno-at-bareos Tag Attached: "libdroplet"
2023-12-12 17:24 bruno-at-bareos Note Added: 0005616
2023-12-12 17:24 bruno-at-bareos Assigned To => bruno-at-bareos
2023-12-12 17:24 bruno-at-bareos Status new => feedback
2024-01-15 14:11 bruno-at-bareos Status feedback => closed
2024-01-15 14:11 bruno-at-bareos Resolution open => unable to reproduce
2024-01-15 14:11 bruno-at-bareos Note Added: 0005684