View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0000894bareos-corestorage daemonpublic2018-01-26 11:392023-07-14 15:17
Reportersberthelot Assigned Tobruno-at-bareos  
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionfixed 
PlatformLinux Ubuntu 16.04 LTSOSLinuxOS Version4.13
Product Version17.2.4 
Summary0000894: Restore error with Auto Deflate = in
DescriptionWe are evaluating a FileStorage on btrfs to use offline deduplication.
To achieve a good deduplication ratio we are storing backup volumes uncompressed and use btrfs to dedup/compress them (so they always appear uncompressed to bareos)

For best efficiency, reading the documentation, we get the compressed stream from client (minimizing bandwidth), use Auto Inflate to store it uncompressed on the filesystem. When restoring we want to Auto Deflate the stream to send it compressed to the clients.

Thus we started using :
SD/Device section
{
...
Auto Deflate = in
Auto Deflate Algorithm = GZIP
Auto Deflate Level = 6
Auto Inflate = out
...
}

It's fully OK for backups but when we try restoring we get "Error: Director's comm line to SD dropped." unless we use Auto Deflate = both which seems rather strange conceptually (the documentation states a compressed stream won't be re-compressed so it should be a NOOP compared to Auto Deflate = in in our case...)
Steps To ReproduceDo a backup with a SD Device containing (be sure to load autoxflate-sd plugin) :
Auto Deflate = in
Auto Deflate Algorithm = GZIP
Auto Deflate Level = 6
Auto Inflate = out


Try to restore this backup :
"Error: Director's comm line to SD dropped."


Change to "Auto Deflate = both" (no need to backup again), restore works.
Additional Information///Auto Deflate = in
26-janv. 11:16 b-dir JobId 12: Start Restore Job RestoreFiles.2018-01-26_11.16.22_10
26-janv. 11:16 b-dir JobId 12: Using Device "VDrive0" to read.
26-janv. 11:16 b-sd JobId 12: Ready to read from volume "client-0001" on device "VDrive0" (/var/backup/bareos/vchanger).
26-janv. 11:16 b-sd JobId 12: autoxflate-sd: VChanger OUT:[SD->inflate=yes->deflate=no->DEV] IN:[DEV->inflate=no->deflate=yes->SD]
26-janv. 11:16 b-sd JobId 12: Forward spacing Volume "client-0001" to file:block 0:238.
26-janv. 11:16 b-dir JobId 12: Error: Director's comm line to SD dropped.
26-janv. 11:16 b-dir JobId 12: Error: Bareos b-dir 17.2.4 (21Sep17):
  Build OS: x86_64-pc-linux-gnu ubuntu Ubuntu 16.04 LTS
  JobId: 12
  Job: RestoreFiles.2018-01-26_11.16.22_10
  Restore Client: client-fd
  Start time: 26-janv.-2018 11:16:24
  End time: 26-janv.-2018 11:16:25
  Elapsed time: 1 sec
  Files Expected: 394
  Files Restored: 1
  Bytes Restored: 0
  Rate: 0.0 KB/s
  FD Errors: 1
  FD termination status: OK
  SD termination status: Error
  Termination: *** Restore Error ***




///Auto Deflate = both (nothing else changed)
26-janv. 11:18 b-dir JobId 13: Start Restore Job RestoreFiles.2018-01-26_11.18.21_13
26-janv. 11:18 b-dir JobId 13: Using Device "VDrive0" to read.
26-janv. 11:18 b-sd JobId 13: Ready to read from volume "client-0001" on device "VDrive0" (/var/backup/bareos/vchanger).
26-janv. 11:18 b-sd JobId 13: autoxflate-sd: Compressor on device VChanger is GZIP
26-janv. 11:18 b-sd JobId 13: autoxflate-sd: VChanger OUT:[SD->inflate=yes->deflate=yes->DEV] IN:[DEV->inflate=no->deflate=yes->SD]
26-janv. 11:18 b-sd JobId 13: Forward spacing Volume "client-0001" to file:block 0:238.
26-janv. 11:19 b-sd JobId 13: autoxflate-sd: deflate ratio: 32.51%
26-janv. 11:19 b-dir JobId 13: Bareos b-dir 17.2.4 (21Sep17):
  Build OS: x86_64-pc-linux-gnu ubuntu Ubuntu 16.04 LTS
  JobId: 13
  Job: RestoreFiles.2018-01-26_11.18.21_13
  Restore Client: client-fd
  Start time: 26-janv.-2018 11:18:23
  End time: 26-janv.-2018 11:19:22
  Elapsed time: 59 secs
  Files Expected: 394
  Files Restored: 394
  Bytes Restored: 302,183,531
  Rate: 5121.8 KB/s
  FD Errors: 0
  FD termination status: OK
  SD termination status: OK
  Termination: Restore OK
TagsNo tags attached.

Activities

bruno-at-bareos

bruno-at-bareos

2023-07-14 15:17

manager   ~0005182

This is normally fixed in Bareos version > 22.1.0

Issue History

Date Modified Username Field Change
2018-01-26 11:39 sberthelot New Issue
2023-07-04 15:52 bruno-at-bareos Assigned To => bruno-at-bareos
2023-07-04 15:52 bruno-at-bareos Status new => assigned
2023-07-14 15:17 bruno-at-bareos Status assigned => closed
2023-07-14 15:17 bruno-at-bareos Resolution open => fixed
2023-07-14 15:17 bruno-at-bareos Note Added: 0005182