View Issue Details

IDProjectCategoryView StatusLast Update
0001037bareos-corestorage daemonpublic2019-12-18 15:40
Reporterr7 Assigned Toarogge  
PrioritynormalSeveritycrashReproducibilityalways
Status closedResolutionunable to reproduce 
PlatformWindowsOSWindowsOS Version7
Product Version18.2.4-rc2 
Summary0001037: Windows bareos-fd is crashing during backup
DescriptionAfter successful full backup incremental job always fail. Backup scheme is Always Incremental.
To begin please take a look here https://groups.google.com/forum/?fromgroups=#!topic/bareos-users/fbu6iz-Ugbc

Attached are traces, reports, memory dumps and dir logs for one such Windows 7 host with failing FD
- helium-WER.7z.* - contents of C:\ProgramData\Microsoft\Windows\WER\ReportQueue
- helium-traces.7z.* - crashing FD job traces (setdebug client=lab-helium level=200 trace=1)
- helium-dir.log - job logs from director
Steps To ReproduceNo specific steps. FD is just crashing during backup.
Additional InformationDirector: 18.2.4rc2
Storage: 18.2.4rc2
FD: Both 17.2.4 & 18.2.4rc2 are failing, no matter which Windows version 7 or 10
Tagsalways incremental, crash, fd

Activities

r7

r7

2019-01-24 18:26

reporter  

helium-dir.log (75,985 bytes)   
Connecting to Director localhost:9101
 Encryption: ECDHE-PSK-CHACHA20-POLY1305
1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
You are connected using the default console

Enter a period to cancel a command.
list jobs client=lab-helium
Using Catalog "MyCatalog"
+-------+------------+------------+---------------------+------+-------+----------+----------------+-----------+
| jobid | name       | client     | starttime           | type | level | jobfiles | jobbytes       | jobstatus |
+-------+------------+------------+---------------------+------+-------+----------+----------------+-----------+
| 1,669 | lab-helium | lab-helium | 2019-01-16 13:00:08 | B    | F     |  330,067 | 89,469,216,196 | W         |
| 1,703 | lab-helium | lab-helium | 2019-01-17 18:41:07 | B    | I     |        0 |              0 | f         |
| 1,719 | lab-helium | lab-helium | 2019-01-18 13:01:06 | B    | I     |        0 |              0 | f         |
| 1,726 | lab-helium | lab-helium | 2019-01-18 14:22:39 | B    | I     |        0 |              0 | f         |
| 1,731 | lab-helium | lab-helium | 2019-01-19 13:01:06 | B    | I     |        0 |              0 | f         |
| 1,737 | lab-helium | lab-helium | 2019-01-19 22:00:28 | B    | I     |        0 |              0 | f         |
| 1,738 | lab-helium | lab-helium | 2019-01-19 23:33:37 | B    | I     |        0 |              0 | f         |
| 1,739 | lab-helium | lab-helium | 2019-01-20 00:30:12 | B    | I     |        0 |              0 | f         |
| 1,740 | lab-helium | lab-helium | 2019-01-20 00:50:55 | B    | I     |        0 |              0 | f         |
| 1,741 | lab-helium | lab-helium | 2019-01-20 14:21:29 | B    | I     |        0 |              0 | f         |
| 1,744 | lab-helium | lab-helium | 2019-01-21 13:01:02 | B    | I     |        0 |              0 | f         |
| 1,751 | lab-helium | lab-helium | 2019-01-22 13:01:02 | B    | I     |        0 |              0 | f         |
| 1,758 | lab-helium | lab-helium | 2019-01-23 13:01:01 | B    | I     |        0 |              0 | f         |
| 1,765 | lab-helium | lab-helium | 2019-01-24 13:01:01 | B    | I     |        0 |              0 | f         |
+-------+------------+------------+---------------------+------+-------+----------+----------------+-----------+
You have messages.
Connecting to Director localhost:9101
 Encryption: ECDHE-PSK-CHACHA20-POLY1305
1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
You are connected using the default console

Enter a period to cancel a command.
list joblog jobid=1669
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
 2019-01-16 13:00:00 bareos-dir JobId 1669: No prior Full backup Job record found.
 2019-01-16 13:00:00 bareos-dir JobId 1669: No prior or suitable Full backup found in catalog. Doing FULL backup.
 2019-01-16 13:00:01 bareos-dir JobId 1669: Start Backup JobId 1669, Job=lab-helium.2019-01-16_13.00.00_12
 2019-01-16 13:00:01 bareos-dir JobId 1669: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-16 13:00:01 bareos-dir JobId 1669: Created new Volume "lab-helium.2019-01-16-13-00.aic_1669" in catalog.
 2019-01-16 13:00:01 bareos-dir JobId 1669: Using Device "disk-fs32-r6s2" to write.
 2019-01-16 13:00:01 bareos-dir JobId 1669: Probing... (result will be saved until config reload)
 2019-01-16 13:00:07 bareos-dir JobId 1669: Error: lib/crypto_openssl.cc:1565 TLS shutdown failure.: ERR=error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
 2019-01-16 13:00:07 bareos-dir JobId 1669: Fatal error: TLS negotiation failed.
 2019-01-16 13:00:07 bareos-dir JobId 1669: Connected Client: lab-helium at lab-helium.lan:9102, encryption: None
 2019-01-16 13:00:07 bareos-dir JobId 1669:    Handshake: Cleartext 
 2019-01-16 13:00:07 bareos-dir JobId 1669:  Encryption: None
 2019-01-16 13:00:13 lab-helium JobId 1669: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-16 13:00:13 lab-helium JobId 1669: Warning: XATTR support requested in fileset but not available on this platform. Disabling ...
 2019-01-16 13:00:08 fs32-sd JobId 1669: Labeled new Volume "lab-helium.2019-01-16-13-00.aic_1669" on device "disk-fs32-r6s2" (/_bareos).
 2019-01-16 13:00:08 fs32-sd JobId 1669: Wrote label to prelabeled Volume "lab-helium.2019-01-16-13-00.aic_1669" on device "disk-fs32-r6s2" (/_bareos)
 2019-01-16 13:00:08 bareos-dir JobId 1669: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-16-13-00.aic_1669" as Used.
 2019-01-16 13:00:32 lab-helium JobId 1669: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-16 13:00:32 lab-helium JobId 1669: VolumeMountpoints are not processed as onefs = yes.
 2019-01-16 13:00:33 lab-helium JobId 1669: VolumeMountpoints are not processed as onefs = yes.
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "Task Scheduler Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "VSS Metadata Store Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "Performance Counters Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "System Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "MSSearch Service Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "ASR Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "BITS Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "Shadow Copy Optimization Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "WMI Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "COM+ REGDB Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:52 lab-helium JobId 1669: VSS Writer (BackupComplete): "Registry Writer", State: 0x1 (VSS_WS_STABLE)
 2019-01-16 15:43:49 fs32-sd JobId 1669: Releasing device "disk-fs32-r6s2" (/_bareos).
 2019-01-16 15:43:50 fs32-sd JobId 1669: Elapsed time=02:43:42, Transfer rate=9.116 M Bytes/second
 2019-01-16 15:43:50 fs32-sd JobId 1669: Sending spooled attrs to the Director. Despooling 124,828,450 bytes ...
 2019-01-16 15:43:52 bareos-dir JobId 1669: Insert of attributes batch table with 330066 entries start
 2019-01-16 15:44:02 bareos-dir JobId 1669: Insert of attributes batch table done
 2019-01-16 15:44:02 bareos-dir JobId 1669: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1669
  Job:                    lab-helium.2019-01-16_13.00.00_12
  Backup Level:           Full (upgraded from Incremental)
  Client:                 "lab-helium" 17.2.4 (21Sep17) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aic" (From Job FullPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         16-Jan-2019 13:00:00
  Start time:             16-Jan-2019 13:00:08
  End time:               16-Jan-2019 15:44:02
  Elapsed time:           2 hours 43 mins 54 secs
  Priority:               12
  FD Files Written:       330,067
  SD Files Written:       330,067
  FD Bytes Written:       89,469,216,196 (89.46 GB)
  SD Bytes Written:       89,542,986,590 (89.54 GB)
  Rate:                   9097.9 KB/s
  Software Compression:   41.5 % (lz4hc)
  VSS:                    yes
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-16-13-00.aic_1669
  Volume Session Id:      6
  Volume Session Time:    1547554000
  Last Volume Bytes:      89,631,309,802 (89.63 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  OK
  SD termination status:  OK
  Termination:            Backup OK -- with warnings

You have messages.
list joblog jobid=1703
 2019-01-17 18:41:00 bareos-dir JobId 1703: Start Backup JobId 1703, Job=lab-helium.2019-01-17_18.41.00_06
 2019-01-17 18:41:00 bareos-dir JobId 1703: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-17 18:41:01 bareos-dir JobId 1703: Created new Volume "lab-helium.2019-01-17-18-41.aii_1703" in catalog.
 2019-01-17 18:41:01 bareos-dir JobId 1703: Using Device "disk-fs32-r6s2" to write.
 2019-01-17 18:41:01 bareos-dir JobId 1703: Probing... (result will be saved until config reload)
 2019-01-17 18:41:06 bareos-dir JobId 1703: Error: lib/crypto_openssl.cc:1565 TLS shutdown failure.: ERR=error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
 2019-01-17 18:41:06 bareos-dir JobId 1703: Fatal error: TLS negotiation failed.
 2019-01-17 18:41:06 bareos-dir JobId 1703: Connected Client: lab-helium at lab-helium.lan:9102, encryption: None
 2019-01-17 18:41:06 bareos-dir JobId 1703:    Handshake: Cleartext 
 2019-01-17 18:41:06 bareos-dir JobId 1703:  Encryption: None
 2019-01-17 18:41:07 bareos-dir JobId 1703: Sending Accurate information.
 2019-01-17 18:41:12 fs32-sd JobId 1703: Labeled new Volume "lab-helium.2019-01-17-18-41.aii_1703" on device "disk-fs32-r6s2" (/_bareos).
 2019-01-17 18:41:12 fs32-sd JobId 1703: Wrote label to prelabeled Volume "lab-helium.2019-01-17-18-41.aii_1703" on device "disk-fs32-r6s2" (/_bareos)
 2019-01-17 18:41:12 bareos-dir JobId 1703: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-17-18-41.aii_1703" as Used.
 2019-01-17 18:41:06 lab-helium JobId 1703: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-17 18:41:13 lab-helium JobId 1703: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-17 18:41:13 lab-helium JobId 1703: VolumeMountpoints are not processed as onefs = yes.
 2019-01-17 18:41:13 lab-helium JobId 1703: VolumeMountpoints are not processed as onefs = yes.
 2019-01-17 20:12:14 bareos-dir JobId 1703: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-17 20:12:14 fs32-sd JobId 1703: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-17 20:12:14 fs32-sd JobId 1703: Releasing device "disk-fs32-r6s2" (/_bareos).
 2019-01-17 20:12:14 bareos-dir JobId 1703: Fatal error: No Job status returned from FD.
 2019-01-17 20:12:14 bareos-dir JobId 1703: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1703
  Job:                    lab-helium.2019-01-17_18.41.00_06
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 17.2.4 (21Sep17) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         17-Jan-2019 18:41:00
  Start time:             17-Jan-2019 18:41:07
  End time:               17-Jan-2019 20:12:14
  Elapsed time:           1 hour 31 mins 7 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-17-18-41.aii_1703
  Volume Session Id:      2
  Volume Session Time:    1547739520
  Last Volume Bytes:      4,995,357,624 (4.995 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-17 20:12:14 bareos-dir JobId 1703: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1703 aii"
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: Connecting to Director localhost:9101
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: You are connected using the default console
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: 
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: Enter a period to cancel a command.
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1703"
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: Using Catalog "MyCatalog"
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: No results to list.
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: You have messages.
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-17-18-41.aii_1703'"
 2019-01-17 20:12:14 bareos-dir JobId 1703: AfterJob: No results to list.
 2019-01-17 20:12:15 bareos-dir JobId 1703: AfterJob: removed '/_bareos/lab-helium.2019-01-17-18-41.aii_1703'
list joblog jobid=1719
 2019-01-18 13:01:00 bareos-dir JobId 1719: Start Backup JobId 1719, Job=lab-helium.2019-01-18_13.01.00_36
 2019-01-18 13:01:00 bareos-dir JobId 1719: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-18 13:01:01 bareos-dir JobId 1719: Created new Volume "lab-helium.2019-01-18-13-01.aii_1719" in catalog.
 2019-01-18 13:01:01 bareos-dir JobId 1719: Using Device "disk-fs32-r6s2" to write.
 2019-01-18 13:01:01 bareos-dir JobId 1719: Probing... (result will be saved until config reload)
 2019-01-18 13:01:06 bareos-dir JobId 1719: Error: lib/crypto_openssl.cc:1565 TLS shutdown failure.: ERR=error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
 2019-01-18 13:01:06 bareos-dir JobId 1719: Fatal error: TLS negotiation failed.
 2019-01-18 13:01:06 bareos-dir JobId 1719: Connected Client: lab-helium at lab-helium.lan:9102, encryption: None
 2019-01-18 13:01:06 bareos-dir JobId 1719:    Handshake: Cleartext 
 2019-01-18 13:01:06 bareos-dir JobId 1719:  Encryption: None
 2019-01-18 13:01:07 bareos-dir JobId 1719: Sending Accurate information.
 2019-01-18 13:01:15 fs32-sd JobId 1719: Labeled new Volume "lab-helium.2019-01-18-13-01.aii_1719" on device "disk-fs32-r6s2" (/_bareos).
 2019-01-18 13:01:15 fs32-sd JobId 1719: Wrote label to prelabeled Volume "lab-helium.2019-01-18-13-01.aii_1719" on device "disk-fs32-r6s2" (/_bareos)
 2019-01-18 13:01:15 bareos-dir JobId 1719: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-18-13-01.aii_1719" as Used.
 2019-01-18 13:01:07 lab-helium JobId 1719: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-18 13:01:24 lab-helium JobId 1719: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-18 13:01:24 lab-helium JobId 1719: VolumeMountpoints are not processed as onefs = yes.
 2019-01-18 13:01:24 lab-helium JobId 1719: VolumeMountpoints are not processed as onefs = yes.
 2019-01-18 13:14:20 bareos-dir JobId 1719: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-18 13:14:20 fs32-sd JobId 1719: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-18 13:14:20 fs32-sd JobId 1719: Releasing device "disk-fs32-r6s2" (/_bareos).
 2019-01-18 13:14:20 bareos-dir JobId 1719: Fatal error: No Job status returned from FD.
 2019-01-18 13:14:20 bareos-dir JobId 1719: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1719
  Job:                    lab-helium.2019-01-18_13.01.00_36
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 17.2.4 (21Sep17) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         18-Jan-2019 13:01:00
  Start time:             18-Jan-2019 13:01:06
  End time:               18-Jan-2019 13:14:20
  Elapsed time:           13 mins 14 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-18-13-01.aii_1719
  Volume Session Id:      3
  Volume Session Time:    1547759606
  Last Volume Bytes:      2,872,332,335 (2.872 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-18 13:14:20 bareos-dir JobId 1719: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1719 aii"
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: Connecting to Director localhost:9101
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: You are connected using the default console
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: 
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: Enter a period to cancel a command.
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1719"
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: Using Catalog "MyCatalog"
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: No results to list.
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: You have messages.
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-18-13-01.aii_1719'"
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: No results to list.
 2019-01-18 13:14:20 bareos-dir JobId 1719: AfterJob: removed '/_bareos/lab-helium.2019-01-18-13-01.aii_1719'
list joblog jobid=1726
 2019-01-18 14:22:38 bareos-dir JobId 1726: Start Backup JobId 1726, Job=lab-helium.2019-01-18_14.22.36_52
 2019-01-18 14:22:38 bareos-dir JobId 1726: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-18 14:22:38 bareos-dir JobId 1726: Created new Volume "lab-helium.2019-01-18-14-22.aii_1726" in catalog.
 2019-01-18 14:22:38 bareos-dir JobId 1726: Using Device "disk-fs32-r6s1" to write.
 2019-01-18 14:22:38 bareos-dir JobId 1726: Connected Client: lab-helium at lab-helium.lan:9102, encryption: None
 2019-01-18 14:22:38 bareos-dir JobId 1726:  Handshake: Cleartext 
 2019-01-18 14:22:38 bareos-dir JobId 1726:  Encryption: None
 2019-01-18 14:22:39 bareos-dir JobId 1726: Sending Accurate information.
 2019-01-18 14:22:47 fs32-sd JobId 1726: Labeled new Volume "lab-helium.2019-01-18-14-22.aii_1726" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-18 14:22:47 fs32-sd JobId 1726: Wrote label to prelabeled Volume "lab-helium.2019-01-18-14-22.aii_1726" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-18 14:22:47 bareos-dir JobId 1726: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-18-14-22.aii_1726" as Used.
 2019-01-18 14:22:40 lab-helium JobId 1726: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-18 14:22:50 lab-helium JobId 1726: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-18 14:22:50 lab-helium JobId 1726: VolumeMountpoints are not processed as onefs = yes.
 2019-01-18 14:22:50 lab-helium JobId 1726: VolumeMountpoints are not processed as onefs = yes.
 2019-01-18 16:34:11 bareos-dir JobId 1726: Fatal error: Network error with FD during Backup: ERR=Connection timed out
 2019-01-18 16:34:11 fs32-sd JobId 1726: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Interrupted system call
 2019-01-18 16:34:11 fs32-sd JobId 1726: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-18 16:34:11 bareos-dir JobId 1726: Fatal error: No Job status returned from FD.
 2019-01-18 16:34:11 bareos-dir JobId 1726: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1726
  Job:                    lab-helium.2019-01-18_14.22.36_52
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 17.2.4 (21Sep17) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         18-Jan-2019 14:22:36
  Start time:             18-Jan-2019 14:22:39
  End time:               18-Jan-2019 16:34:11
  Elapsed time:           2 hours 11 mins 32 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-18-14-22.aii_1726
  Volume Session Id:      10
  Volume Session Time:    1547759606
  Last Volume Bytes:      999,936,195 (999.9 MB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-18 16:34:11 bareos-dir JobId 1726: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1726 aii"
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: Connecting to Director localhost:9101
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: You are connected using the default console
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: 
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: Enter a period to cancel a command.
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1726"
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: Using Catalog "MyCatalog"
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: No results to list.
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: You have messages.
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-18-14-22.aii_1726'"
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: No results to list.
 2019-01-18 16:34:11 bareos-dir JobId 1726: AfterJob: removed '/_bareos/lab-helium.2019-01-18-14-22.aii_1726'
list joblog jobid=1731
 2019-01-19 13:01:00 bareos-dir JobId 1731: Start Backup JobId 1731, Job=lab-helium.2019-01-19_13.01.00_12
 2019-01-19 13:01:00 bareos-dir JobId 1731: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-19 13:01:01 bareos-dir JobId 1731: Created new Volume "lab-helium.2019-01-19-13-01.aii_1731" in catalog.
 2019-01-19 13:01:01 bareos-dir JobId 1731: Using Device "disk-fs32-r6s2" to write.
 2019-01-19 13:01:01 bareos-dir JobId 1731: Probing... (result will be saved until config reload)
 2019-01-19 13:01:06 bareos-dir JobId 1731: Error: lib/crypto_openssl.cc:1565 TLS shutdown failure.: ERR=error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
 2019-01-19 13:01:06 bareos-dir JobId 1731: Fatal error: TLS negotiation failed.
 2019-01-19 13:01:06 bareos-dir JobId 1731: Connected Client: lab-helium at lab-helium.lan:9102, encryption: None
 2019-01-19 13:01:06 bareos-dir JobId 1731:    Handshake: Cleartext 
 2019-01-19 13:01:06 bareos-dir JobId 1731:  Encryption: None
 2019-01-19 13:01:07 bareos-dir JobId 1731: Sending Accurate information.
 2019-01-19 13:01:15 fs32-sd JobId 1731: Labeled new Volume "lab-helium.2019-01-19-13-01.aii_1731" on device "disk-fs32-r6s2" (/_bareos).
 2019-01-19 13:01:15 fs32-sd JobId 1731: Wrote label to prelabeled Volume "lab-helium.2019-01-19-13-01.aii_1731" on device "disk-fs32-r6s2" (/_bareos)
 2019-01-19 13:01:15 bareos-dir JobId 1731: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-19-13-01.aii_1731" as Used.
 2019-01-19 13:01:07 lab-helium JobId 1731: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-19 13:01:23 lab-helium JobId 1731: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-19 13:01:23 lab-helium JobId 1731: VolumeMountpoints are not processed as onefs = yes.
 2019-01-19 13:01:23 lab-helium JobId 1731: VolumeMountpoints are not processed as onefs = yes.
 2019-01-19 14:25:27 bareos-dir JobId 1731: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-19 14:25:27 fs32-sd JobId 1731: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-19 14:25:27 fs32-sd JobId 1731: Releasing device "disk-fs32-r6s2" (/_bareos).
 2019-01-19 14:25:28 bareos-dir JobId 1731: Fatal error: No Job status returned from FD.
 2019-01-19 14:25:28 bareos-dir JobId 1731: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1731
  Job:                    lab-helium.2019-01-19_13.01.00_12
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 17.2.4 (21Sep17) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         19-Jan-2019 13:01:00
  Start time:             19-Jan-2019 13:01:06
  End time:               19-Jan-2019 14:25:28
  Elapsed time:           1 hour 24 mins 22 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-19-13-01.aii_1731
  Volume Session Id:      14
  Volume Session Time:    1547759606
  Last Volume Bytes:      1,999,872,129 (1.999 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-19 14:25:28 bareos-dir JobId 1731: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1731 aii"
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: Connecting to Director localhost:9101
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: You are connected using the default console
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: 
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: Enter a period to cancel a command.
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1731"
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: Using Catalog "MyCatalog"
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: No results to list.
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: You have messages.
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-19-13-01.aii_1731'"
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: No results to list.
 2019-01-19 14:25:28 bareos-dir JobId 1731: AfterJob: removed '/_bareos/lab-helium.2019-01-19-13-01.aii_1731'
list joblog jobid=1737
 2019-01-19 21:59:26 bareos-dir JobId 1737: Start Backup JobId 1737, Job=lab-helium.2019-01-19_21.59.24_04
 2019-01-19 21:59:26 bareos-dir JobId 1737: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-19 21:59:26 bareos-dir JobId 1737: Created new Volume "lab-helium.2019-01-19-21-59.aii_1737" in catalog.
 2019-01-19 21:59:26 bareos-dir JobId 1737: Using Device "disk-fs32-r6s1" to write.
 2019-01-19 21:59:26 bareos-dir JobId 1737: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-19 21:59:26 bareos-dir JobId 1737:  Handshake: Immediate TLS  2019-01-19 21:59:26 bareos-dir JobId 1737:  Encryption: PSK-AES256-CBC-SHA
 2019-01-19 22:00:29 bareos-dir JobId 1737: Sending Accurate information.
 2019-01-19 22:00:38 fs32-sd JobId 1737: Labeled new Volume "lab-helium.2019-01-19-21-59.aii_1737" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-19 22:00:38 fs32-sd JobId 1737: Wrote label to prelabeled Volume "lab-helium.2019-01-19-21-59.aii_1737" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-19 22:00:38 bareos-dir JobId 1737: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-19-21-59.aii_1737" as Used.
 2019-01-19 21:59:28 lab-helium JobId 1737: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-19 22:00:30 lab-helium JobId 1737: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-19 22:00:47 lab-helium JobId 1737: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-19 22:00:47 lab-helium JobId 1737: VolumeMountpoints are not processed as onefs = yes.
 2019-01-19 22:00:47 lab-helium JobId 1737: VolumeMountpoints are not processed as onefs = yes.
 2019-01-19 23:26:18 bareos-dir JobId 1737: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-19 23:26:18 fs32-sd JobId 1737: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-19 23:26:18 fs32-sd JobId 1737: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-19 23:26:19 bareos-dir JobId 1737: Fatal error: No Job status returned from FD.
 2019-01-19 23:26:19 bareos-dir JobId 1737: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1737
  Job:                    lab-helium.2019-01-19_21.59.24_04
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         19-Jan-2019 21:59:24
  Start time:             19-Jan-2019 22:00:28
  End time:               19-Jan-2019 23:26:19
  Elapsed time:           1 hour 25 mins 51 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-19-21-59.aii_1737
  Volume Session Id:      1
  Volume Session Time:    1547924334
  Last Volume Bytes:      1,999,872,132 (1.999 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-19 23:26:19 bareos-dir JobId 1737: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1737 aii"
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: Connecting to Director localhost:9101
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: You are connected using the default console
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: 
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: Enter a period to cancel a command.
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1737"
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: Using Catalog "MyCatalog"
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: No results to list.
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: You have messages.
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-19-21-59.aii_1737'"
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: No results to list.
 2019-01-19 23:26:19 bareos-dir JobId 1737: AfterJob: removed '/_bareos/lab-helium.2019-01-19-21-59.aii_1737'
list joblog jobid=1738
 2019-01-19 23:32:34 bareos-dir JobId 1738: Start Backup JobId 1738, Job=lab-helium.2019-01-19_23.32.31_08
 2019-01-19 23:32:34 bareos-dir JobId 1738: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-19 23:32:34 bareos-dir JobId 1738: Created new Volume "lab-helium.2019-01-19-23-32.aii_1738" in catalog.
 2019-01-19 23:32:34 bareos-dir JobId 1738: Using Device "disk-fs32-r6s1" to write.
 2019-01-19 23:32:34 bareos-dir JobId 1738: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-19 23:32:34 bareos-dir JobId 1738:  Handshake: Immediate TLS  2019-01-19 23:32:34 bareos-dir JobId 1738:  Encryption: PSK-AES256-CBC-SHA
 2019-01-19 23:33:37 bareos-dir JobId 1738: Sending Accurate information.
 2019-01-19 23:33:44 fs32-sd JobId 1738: Labeled new Volume "lab-helium.2019-01-19-23-32.aii_1738" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-19 23:33:44 fs32-sd JobId 1738: Wrote label to prelabeled Volume "lab-helium.2019-01-19-23-32.aii_1738" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-19 23:33:44 bareos-dir JobId 1738: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-19-23-32.aii_1738" as Used.
 2019-01-19 23:32:36 lab-helium JobId 1738: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-19 23:33:39 lab-helium JobId 1738: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-19 23:33:55 lab-helium JobId 1738: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-19 23:33:56 lab-helium JobId 1738: VolumeMountpoints are not processed as onefs = yes.
 2019-01-19 23:33:56 lab-helium JobId 1738: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 00:01:41 bareos-dir JobId 1738: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-20 00:01:41 fs32-sd JobId 1738: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-20 00:01:41 fs32-sd JobId 1738: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 00:01:42 bareos-dir JobId 1738: Fatal error: No Job status returned from FD.
 2019-01-20 00:01:42 bareos-dir JobId 1738: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1738
  Job:                    lab-helium.2019-01-19_23.32.31_08
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         19-Jan-2019 23:32:31
  Start time:             19-Jan-2019 23:33:37
  End time:               20-Jan-2019 00:01:42
  Elapsed time:           28 mins 5 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-19-23-32.aii_1738
  Volume Session Id:      2
  Volume Session Time:    1547924334
  Last Volume Bytes:      3,020,000,274 (3.020 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-20 00:01:42 bareos-dir JobId 1738: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1738 aii"
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: Connecting to Director localhost:9101
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: You are connected using the default console
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: 
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: Enter a period to cancel a command.
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1738"
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: Using Catalog "MyCatalog"
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: No results to list.
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: You have messages.
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-19-23-32.aii_1738'"
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: No results to list.
 2019-01-20 00:01:42 bareos-dir JobId 1738: AfterJob: removed '/_bareos/lab-helium.2019-01-19-23-32.aii_1738'
list joblog jobid=1739
 2019-01-20 00:30:12 bareos-dir JobId 1739: Start Backup JobId 1739, Job=lab-helium.2019-01-20_00.30.09_04
 2019-01-20 00:30:12 bareos-dir JobId 1739: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 00:30:12 bareos-dir JobId 1739: Created new Volume "lab-helium.2019-01-20-00-30.aii_1739" in catalog.
 2019-01-20 00:30:12 bareos-dir JobId 1739: Using Device "disk-fs32-r6s1" to write.
 2019-01-20 00:30:12 bareos-dir JobId 1739: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:30:12 bareos-dir JobId 1739:  Handshake: Immediate TLS  2019-01-20 00:30:12 bareos-dir JobId 1739:  Encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:30:12 bareos-dir JobId 1739: Sending Accurate information.
 2019-01-20 00:30:21 fs32-sd JobId 1739: Labeled new Volume "lab-helium.2019-01-20-00-30.aii_1739" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 00:30:21 fs32-sd JobId 1739: Wrote label to prelabeled Volume "lab-helium.2019-01-20-00-30.aii_1739" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-20 00:30:21 bareos-dir JobId 1739: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-20-00-30.aii_1739" as Used.
 2019-01-20 00:30:14 lab-helium JobId 1739: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-20 00:30:14 lab-helium JobId 1739: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:30:36 lab-helium JobId 1739: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-20 00:30:36 lab-helium JobId 1739: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 00:30:37 lab-helium JobId 1739: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 00:44:43 bareos-dir JobId 1739: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-20 00:44:43 fs32-sd JobId 1739: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-20 00:44:43 fs32-sd JobId 1739: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 00:44:43 bareos-dir JobId 1739: Fatal error: No Job status returned from FD.
 2019-01-20 00:44:43 bareos-dir JobId 1739: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1739
  Job:                    lab-helium.2019-01-20_00.30.09_04
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         20-Jan-2019 00:30:09
  Start time:             20-Jan-2019 00:30:12
  End time:               20-Jan-2019 00:44:43
  Elapsed time:           14 mins 31 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-20-00-30.aii_1739
  Volume Session Id:      1
  Volume Session Time:    1547933369
  Last Volume Bytes:      3,007,226,988 (3.007 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-20 00:44:43 bareos-dir JobId 1739: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1739 aii"
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: Connecting to Director localhost:9101
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: You are connected using the default console
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: 
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: Enter a period to cancel a command.
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1739"
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: Using Catalog "MyCatalog"
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: No results to list.
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: You have messages.
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-20-00-30.aii_1739'"
 2019-01-20 00:44:43 bareos-dir JobId 1739: AfterJob: No results to list.
 2019-01-20 00:44:44 bareos-dir JobId 1739: AfterJob: removed '/_bareos/lab-helium.2019-01-20-00-30.aii_1739'
list joblog jobid=1740
 2019-01-20 00:50:55 bareos-dir JobId 1740: Start Backup JobId 1740, Job=lab-helium.2019-01-20_00.50.52_04
 2019-01-20 00:50:55 bareos-dir JobId 1740: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 00:50:55 bareos-dir JobId 1740: Created new Volume "lab-helium.2019-01-20-00-50.aii_1740" in catalog.
 2019-01-20 00:50:55 bareos-dir JobId 1740: Using Device "disk-fs32-r6s1" to write.
 2019-01-20 00:50:55 bareos-dir JobId 1740: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:50:55 bareos-dir JobId 1740:  Handshake: Immediate TLS  2019-01-20 00:50:55 bareos-dir JobId 1740:  Encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:50:55 bareos-dir JobId 1740: Sending Accurate information.
 2019-01-20 00:51:03 fs32-sd JobId 1740: Labeled new Volume "lab-helium.2019-01-20-00-50.aii_1740" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 00:51:04 fs32-sd JobId 1740: Wrote label to prelabeled Volume "lab-helium.2019-01-20-00-50.aii_1740" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-20 00:51:04 bareos-dir JobId 1740: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-20-00-50.aii_1740" as Used.
 2019-01-20 00:50:57 lab-helium JobId 1740: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-20 00:50:57 lab-helium JobId 1740: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-20 00:51:07 lab-helium JobId 1740: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-20 00:51:07 lab-helium JobId 1740: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 00:51:07 lab-helium JobId 1740: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 01:06:37 bareos-dir JobId 1740: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-20 01:06:37 fs32-sd JobId 1740: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-20 01:06:37 fs32-sd JobId 1740: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 01:06:37 bareos-dir JobId 1740: Fatal error: No Job status returned from FD.
 2019-01-20 01:06:37 bareos-dir JobId 1740: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1740
  Job:                    lab-helium.2019-01-20_00.50.52_04
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         20-Jan-2019 00:50:52
  Start time:             20-Jan-2019 00:50:55
  End time:               20-Jan-2019 01:06:37
  Elapsed time:           15 mins 42 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-20-00-50.aii_1740
  Volume Session Id:      1
  Volume Session Time:    1547934635
  Last Volume Bytes:      3,042,773,092 (3.042 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-20 01:06:37 bareos-dir JobId 1740: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1740 aii"
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: Connecting to Director localhost:9101
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: You are connected using the default console
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: 
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: Enter a period to cancel a command.
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1740"
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: Using Catalog "MyCatalog"
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: No results to list.
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: You have messages.
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-20-00-50.aii_1740'"
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: No results to list.
 2019-01-20 01:06:37 bareos-dir JobId 1740: AfterJob: removed '/_bareos/lab-helium.2019-01-20-00-50.aii_1740'
list joblog jobid=1741
 2019-01-20 14:20:27 bareos-dir JobId 1741: Start Backup JobId 1741, Job=lab-helium.2019-01-20_14.20.25_08
 2019-01-20 14:20:27 bareos-dir JobId 1741: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 14:20:27 bareos-dir JobId 1741: Created new Volume "lab-helium.2019-01-20-14-20.aii_1741" in catalog.
 2019-01-20 14:20:27 bareos-dir JobId 1741: Using Device "disk-fs32-r6s1" to write.
 2019-01-20 14:20:27 bareos-dir JobId 1741: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-20 14:20:27 bareos-dir JobId 1741:  Handshake: Immediate TLS  2019-01-20 14:20:27 bareos-dir JobId 1741:  Encryption: PSK-AES256-CBC-SHA
 2019-01-20 14:21:30 bareos-dir JobId 1741: Sending Accurate information.
 2019-01-20 14:21:41 fs32-sd JobId 1741: Labeled new Volume "lab-helium.2019-01-20-14-20.aii_1741" on device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 14:21:41 fs32-sd JobId 1741: Wrote label to prelabeled Volume "lab-helium.2019-01-20-14-20.aii_1741" on device "disk-fs32-r6s1" (/_bareos)
 2019-01-20 14:21:41 bareos-dir JobId 1741: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-20-14-20.aii_1741" as Used.
 2019-01-20 14:20:29 lab-helium JobId 1741: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-20 14:21:30 lab-helium JobId 1741: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-20 14:21:43 lab-helium JobId 1741: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-20 14:21:43 lab-helium JobId 1741: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 14:21:43 lab-helium JobId 1741: VolumeMountpoints are not processed as onefs = yes.
 2019-01-20 14:36:28 bareos-dir JobId 1741: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-20 14:36:28 fs32-sd JobId 1741: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-20 14:36:28 fs32-sd JobId 1741: Releasing device "disk-fs32-r6s1" (/_bareos).
 2019-01-20 14:36:28 bareos-dir JobId 1741: Fatal error: No Job status returned from FD.
 2019-01-20 14:36:28 bareos-dir JobId 1741: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1741
  Job:                    lab-helium.2019-01-20_14.20.25_08
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         20-Jan-2019 14:20:25
  Start time:             20-Jan-2019 14:21:29
  End time:               20-Jan-2019 14:36:28
  Elapsed time:           14 mins 59 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-20-14-20.aii_1741
  Volume Session Id:      2
  Volume Session Time:    1547934635
  Last Volume Bytes:      3,041,547,303 (3.041 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-20 14:36:28 bareos-dir JobId 1741: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1741 aii"
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: Connecting to Director localhost:9101
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: You are connected using the default console
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: 
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: Enter a period to cancel a command.
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1741"
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: Using Catalog "MyCatalog"
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: No results to list.
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: You have messages.
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-20-14-20.aii_1741'"
 2019-01-20 14:36:28 bareos-dir JobId 1741: AfterJob: No results to list.
 2019-01-20 14:36:29 bareos-dir JobId 1741: AfterJob: removed '/_bareos/lab-helium.2019-01-20-14-20.aii_1741'
list joblog jobid=1744
 2019-01-21 13:01:00 bareos-dir JobId 1744: Start Backup JobId 1744, Job=lab-helium.2019-01-21_13.01.00_14
 2019-01-21 13:01:01 bareos-dir JobId 1744: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-21 13:01:01 bareos-dir JobId 1744: Created new Volume "lab-helium.2019-01-21-13-01.aii_1744" in catalog.
 2019-01-21 13:01:01 bareos-dir JobId 1744: Using Device "disk-fs32-r6s3" to write.
 2019-01-21 13:01:01 bareos-dir JobId 1744: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-21 13:01:01 bareos-dir JobId 1744:  Handshake: Immediate TLS  2019-01-21 13:01:01 bareos-dir JobId 1744:  Encryption: PSK-AES256-CBC-SHA
 2019-01-21 13:01:02 bareos-dir JobId 1744: Sending Accurate information.
 2019-01-21 13:01:13 fs32-sd JobId 1744: Labeled new Volume "lab-helium.2019-01-21-13-01.aii_1744" on device "disk-fs32-r6s3" (/_bareos).
 2019-01-21 13:01:13 fs32-sd JobId 1744: Wrote label to prelabeled Volume "lab-helium.2019-01-21-13-01.aii_1744" on device "disk-fs32-r6s3" (/_bareos)
 2019-01-21 13:01:13 bareos-dir JobId 1744: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-21-13-01.aii_1744" as Used.
 2019-01-21 13:01:02 lab-helium JobId 1744: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-21 13:01:03 lab-helium JobId 1744: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-21 13:01:15 lab-helium JobId 1744: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-21 13:01:16 lab-helium JobId 1744: VolumeMountpoints are not processed as onefs = yes.
 2019-01-21 13:01:16 lab-helium JobId 1744: VolumeMountpoints are not processed as onefs = yes.
 2019-01-21 14:33:08 bareos-dir JobId 1744: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-21 14:33:08 fs32-sd JobId 1744: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-21 14:33:08 fs32-sd JobId 1744: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-01-21 14:33:09 bareos-dir JobId 1744: Fatal error: No Job status returned from FD.
 2019-01-21 14:33:09 bareos-dir JobId 1744: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1744
  Job:                    lab-helium.2019-01-21_13.01.00_14
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         21-Jan-2019 13:01:00
  Start time:             21-Jan-2019 13:01:02
  End time:               21-Jan-2019 14:33:09
  Elapsed time:           1 hour 32 mins 7 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-21-13-01.aii_1744
  Volume Session Id:      5
  Volume Session Time:    1547934635
  Last Volume Bytes:      3,093,931,086 (3.093 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-21 14:33:09 bareos-dir JobId 1744: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1744 aii"
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: Connecting to Director localhost:9101
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: You are connected using the default console
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: 
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: Enter a period to cancel a command.
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1744"
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: Using Catalog "MyCatalog"
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: No results to list.
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: You have messages.
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-21-13-01.aii_1744'"
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: No results to list.
 2019-01-21 14:33:09 bareos-dir JobId 1744: AfterJob: removed '/_bareos/lab-helium.2019-01-21-13-01.aii_1744'
list joblog jobid=1751
 2019-01-22 13:01:00 bareos-dir JobId 1751: Start Backup JobId 1751, Job=lab-helium.2019-01-22_13.01.00_33
 2019-01-22 13:01:00 bareos-dir JobId 1751: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-22 13:01:01 bareos-dir JobId 1751: Created new Volume "lab-helium.2019-01-22-13-01.aii_1751" in catalog.
 2019-01-22 13:01:01 bareos-dir JobId 1751: Using Device "disk-fs32-r6s3" to write.
 2019-01-22 13:01:01 bareos-dir JobId 1751: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-22 13:01:01 bareos-dir JobId 1751:  Handshake: Immediate TLS  2019-01-22 13:01:01 bareos-dir JobId 1751:  Encryption: PSK-AES256-CBC-SHA
 2019-01-22 13:01:02 bareos-dir JobId 1751: Sending Accurate information.
 2019-01-22 13:01:14 fs32-sd JobId 1751: Labeled new Volume "lab-helium.2019-01-22-13-01.aii_1751" on device "disk-fs32-r6s3" (/_bareos).
 2019-01-22 13:01:14 fs32-sd JobId 1751: Wrote label to prelabeled Volume "lab-helium.2019-01-22-13-01.aii_1751" on device "disk-fs32-r6s3" (/_bareos)
 2019-01-22 13:01:14 bareos-dir JobId 1751: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-22-13-01.aii_1751" as Used.
 2019-01-22 13:01:05 lab-helium JobId 1751: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-22 13:01:05 lab-helium JobId 1751: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-22 13:01:25 lab-helium JobId 1751: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-22 13:01:25 lab-helium JobId 1751: VolumeMountpoints are not processed as onefs = yes.
 2019-01-22 13:01:25 lab-helium JobId 1751: VolumeMountpoints are not processed as onefs = yes.
 2019-01-22 14:32:17 bareos-dir JobId 1751: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-22 14:32:17 fs32-sd JobId 1751: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-22 14:32:17 fs32-sd JobId 1751: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-01-22 14:32:17 bareos-dir JobId 1751: Fatal error: No Job status returned from FD.
 2019-01-22 14:32:17 bareos-dir JobId 1751: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1751
  Job:                    lab-helium.2019-01-22_13.01.00_33
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         22-Jan-2019 13:01:00
  Start time:             22-Jan-2019 13:01:02
  End time:               22-Jan-2019 14:32:17
  Elapsed time:           1 hour 31 mins 15 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-22-13-01.aii_1751
  Volume Session Id:      11
  Volume Session Time:    1547934635
  Last Volume Bytes:      2,999,808,052 (2.999 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-22 14:32:17 bareos-dir JobId 1751: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1751 aii"
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: Connecting to Director localhost:9101
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: You are connected using the default console
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: 
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: Enter a period to cancel a command.
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1751"
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: Using Catalog "MyCatalog"
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: No results to list.
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: You have messages.
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-22-13-01.aii_1751'"
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: No results to list.
 2019-01-22 14:32:17 bareos-dir JobId 1751: AfterJob: removed '/_bareos/lab-helium.2019-01-22-13-01.aii_1751'
list joblog jobid=1758
 2019-01-23 13:01:00 bareos-dir JobId 1758: Start Backup JobId 1758, Job=lab-helium.2019-01-23_13.01.00_49
 2019-01-23 13:01:00 bareos-dir JobId 1758: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-23 13:01:01 bareos-dir JobId 1758: Created new Volume "lab-helium.2019-01-23-13-01.aii_1758" in catalog.
 2019-01-23 13:01:01 bareos-dir JobId 1758: Using Device "disk-fs32-r6s3" to write.
 2019-01-23 13:01:01 bareos-dir JobId 1758: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-23 13:01:01 bareos-dir JobId 1758:  Handshake: Immediate TLS  2019-01-23 13:01:01 bareos-dir JobId 1758:  Encryption: PSK-AES256-CBC-SHA
 2019-01-23 13:01:01 bareos-dir JobId 1758: Sending Accurate information.
 2019-01-23 13:01:12 fs32-sd JobId 1758: Labeled new Volume "lab-helium.2019-01-23-13-01.aii_1758" on device "disk-fs32-r6s3" (/_bareos).
 2019-01-23 13:01:12 fs32-sd JobId 1758: Wrote label to prelabeled Volume "lab-helium.2019-01-23-13-01.aii_1758" on device "disk-fs32-r6s3" (/_bareos)
 2019-01-23 13:01:12 bareos-dir JobId 1758: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-23-13-01.aii_1758" as Used.
 2019-01-23 13:01:03 lab-helium JobId 1758: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-23 13:01:03 lab-helium JobId 1758: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-23 13:01:23 lab-helium JobId 1758: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-23 13:01:23 lab-helium JobId 1758: VolumeMountpoints are not processed as onefs = yes.
 2019-01-23 13:01:23 lab-helium JobId 1758: VolumeMountpoints are not processed as onefs = yes.
 2019-01-23 14:21:01 bareos-dir JobId 1758: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-23 14:21:01 fs32-sd JobId 1758: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-23 14:21:01 fs32-sd JobId 1758: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-01-23 14:21:01 bareos-dir JobId 1758: Fatal error: No Job status returned from FD.
 2019-01-23 14:21:01 bareos-dir JobId 1758: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1758
  Job:                    lab-helium.2019-01-23_13.01.00_49
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         23-Jan-2019 13:01:00
  Start time:             23-Jan-2019 13:01:01
  End time:               23-Jan-2019 14:21:01
  Elapsed time:           1 hour 20 mins 
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-23-13-01.aii_1758
  Volume Session Id:      16
  Volume Session Time:    1547934635
  Last Volume Bytes:      2,999,808,082 (2.999 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-23 14:21:01 bareos-dir JobId 1758: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1758 aii"
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: Connecting to Director localhost:9101
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: You are connected using the default console
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: 
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: Enter a period to cancel a command.
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1758"
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: Using Catalog "MyCatalog"
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: No results to list.
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: You have messages.
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-23-13-01.aii_1758'"
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: No results to list.
 2019-01-23 14:21:01 bareos-dir JobId 1758: AfterJob: removed '/_bareos/lab-helium.2019-01-23-13-01.aii_1758'
list joblog jobid=1765
 2019-01-24 13:01:00 bareos-dir JobId 1765: Start Backup JobId 1765, Job=lab-helium.2019-01-24_13.01.00_08
 2019-01-24 13:01:00 bareos-dir JobId 1765: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-24 13:01:01 bareos-dir JobId 1765: Created new Volume "lab-helium.2019-01-24-13-01.aii_1765" in catalog.
 2019-01-24 13:01:01 bareos-dir JobId 1765: Using Device "disk-fs32-r6s3" to write.
 2019-01-24 13:01:01 bareos-dir JobId 1765: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-01-24 13:01:01 bareos-dir JobId 1765:  Handshake: Immediate TLS  2019-01-24 13:01:01 bareos-dir JobId 1765:  Encryption: PSK-AES256-CBC-SHA
 2019-01-24 13:01:01 bareos-dir JobId 1765: Sending Accurate information.
 2019-01-24 13:01:12 fs32-sd JobId 1765: Labeled new Volume "lab-helium.2019-01-24-13-01.aii_1765" on device "disk-fs32-r6s3" (/_bareos).
 2019-01-24 13:01:12 fs32-sd JobId 1765: Wrote label to prelabeled Volume "lab-helium.2019-01-24-13-01.aii_1765" on device "disk-fs32-r6s3" (/_bareos)
 2019-01-24 13:01:12 bareos-dir JobId 1765: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-01-24-13-01.aii_1765" as Used.
 2019-01-24 13:01:05 lab-helium JobId 1765: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-01-24 13:01:05 lab-helium JobId 1765: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-01-24 13:01:26 lab-helium JobId 1765: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-01-24 13:01:26 lab-helium JobId 1765: VolumeMountpoints are not processed as onefs = yes.
 2019-01-24 13:01:26 lab-helium JobId 1765: VolumeMountpoints are not processed as onefs = yes.
 2019-01-24 14:27:12 bareos-dir JobId 1765: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-01-24 14:27:12 fs32-sd JobId 1765: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-01-24 14:27:12 fs32-sd JobId 1765: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-01-24 14:27:12 bareos-dir JobId 1765: Fatal error: No Job status returned from FD.
 2019-01-24 14:27:12 bareos-dir JobId 1765: Error: Bareos bareos-dir 18.2.4rc2 (18Dec18):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.6 (stretch)
  JobId:                  1765
  Job:                    lab-helium.2019-01-24_13.01.00_08
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         24-Jan-2019 13:01:00
  Start time:             24-Jan-2019 13:01:01
  End time:               24-Jan-2019 14:27:12
  Elapsed time:           1 hour 26 mins 11 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-01-24-13-01.aii_1765
  Volume Session Id:      23
  Volume Session Time:    1547934635
  Last Volume Bytes:      3,390,557,217 (3.390 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Termination:            *** Backup Error ***

 2019-01-24 14:27:12 bareos-dir JobId 1765: shell command: run AfterJob "/etc/bareos/_scripts/del-volume-after-job-failed.sh 1765 aii"
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: Connecting to Director localhost:9101
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob:  Encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: 1000 OK: bareos-dir Version: 18.2.4rc2 (18 Dec 2018)
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: You are connected using the default console
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: 
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: Enter a period to cancel a command.
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: .sql query="DELETE FROM jobmedia where jobid=1765"
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: Automatically selected Catalog: MyCatalog
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: Using Catalog "MyCatalog"
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: No results to list.
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: You have messages.
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: .sql query="DELETE FROM media where volumename='lab-helium.2019-01-24-13-01.aii_1765'"
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: No results to list.
 2019-01-24 14:27:13 bareos-dir JobId 1765: AfterJob: removed '/_bareos/lab-helium.2019-01-24-13-01.aii_1765'
helium-dir.log (75,985 bytes)   
r7

r7

2019-01-24 18:29

reporter   ~0003207

It is almost impossible to upload files to mantis with your limits.

APPLICATION ERROR 0000500

File upload failed. This is likely because the filesize was larger than is currently allowed by this PHP installation.

Please use the "Back" button in your web browser to return to the previous page. There you can correct whatever problems were identified in this error or select another action. You can also click an option from the menu bar to go directly to a new section.
r7

r7

2019-01-24 18:37

reporter   ~0003208

It is really a quest to attach files. What`s the limits for attachments?

APPLICATION ERROR #2800

Invalid form security token. This could be caused by a session timeout, or accidentally submitting the form twice.

Please use the "Back" button in your web browser to return to the previous page. There you can correct whatever problems were identified in this error or select another action. You can also click an option from the menu bar to go directly to a new section.
r7

r7

2019-01-24 19:07

reporter   ~0003209

- helium-WER.7z.* - contents of C:\ProgramData\Microsoft\Windows\WER\ReportQueue. There are reports with memory dumps.

P.S.: I`ve been struggling with your mantis timeouts, it`s attach limits and php post limits for 3 hours to complete this report. I`ve repacked crash reports files 3 or 4 times to get through attachment limits.
helium-WER.7z.001 (1,966,080 bytes)
r7

r7

2019-01-24 19:07

reporter  

helium-WER.7z.002 (1,966,080 bytes)
r7

r7

2019-01-24 22:36

reporter  

helium-WER.7z.003 (1,966,080 bytes)
r7

r7

2019-01-24 22:36

reporter  

helium-WER.7z.004 (1,966,080 bytes)
helium-WER.7z.005 (1,966,080 bytes)
helium-WER.7z.006 (1,966,080 bytes)
r7

r7

2019-01-24 22:36

reporter  

helium-WER.7z.007 (1,966,080 bytes)
helium-WER.7z.008 (1,966,080 bytes)
helium-WER.7z.009 (487,341 bytes)
r7

r7

2019-01-24 22:53

reporter  

helium-traces.7z.001 (2,097,152 bytes)
helium-traces.7z.002 (2,097,152 bytes)
helium-traces.7z.003 (2,097,152 bytes)
r7

r7

2019-01-25 00:07

reporter  

helium-traces.7z.004 (2,097,152 bytes)
helium-traces.7z.005 (2,097,152 bytes)
helium-traces.7z.006 (700,997 bytes)
r7

r7

2019-01-25 13:41

reporter   ~0003210

Sorry category is incorrect. Please edit it to be "[All Projects] file daemon".
teka74

teka74

2019-02-05 01:49

reporter   ~0003246

now I have same problem, switched to always incremental backup after update to 18.2.5

The 1st backup changed automatically to full, and worked. Next evening the AI was scheduled normally, and nothing happens

bconsole output:
Connecting to Client server01-fd at server01:9102
 Handshake: Cleartext, Encryption: None

server01-fd Version: 17.2.4 (21 Sep 2017) VSS Linux Cross-compile Win64
Daemon started 07-Jan-19 07:55. Jobs: run=29 running=1.
Microsoft Windows Server 2008 R2 Small Business Server Service Pack 1 (build 7601), 64-bit
 Heap: heap=0 smbytes=57,056,510 max_bytes=57,056,704 bufs=208 max_bufs=369
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=1 bwlimit=0kB/s

Running Jobs:
server01-mon (director) connected at: 07-Jan-19 08:02
server01-mon (director) connected at: 17-Jan-19 15:05
JobId 616 Job server01-ai.2019-02-05_01.00.00_19 is running.
    Incremental System or Console Job started: 05-Feb-19 01:00
    Files=0 Bytes=0 Bytes/sec=0 Errors=0
    Bwlimit=0
    Files Examined=0
    SDReadSeqNo=3 fd=720
bareos-dir (director) connected at: 05-Feb-19 01:40
====

daemon is still running, but doing nothing. On my linux machine (the director), mysql is at 40% cpu since backup started, and the webui is lagging
teka74

teka74

2019-02-05 02:52

reporter   ~0003247

after more than 1 hour waiting, i got an email from the bareos director:

05-Feb 02:43 bareos-dir: ERROR in dird/authenticate_console.cc:393 Number of console connections exceeded MaximumConsoleConnections


i cancelled the backup job, now switching back to normal backup
r7

r7

2019-02-05 16:36

reporter  

joblog.1835.txt (6,060 bytes)   
Connecting to Director localhost:9101
 Encryption: ECDHE-PSK-CHACHA20-POLY1305
1000 OK: bareos-dir Version: 18.2.5 (30 January 2019)
bareos.org build binary
bareos.org binaries are UNSUPPORTED by bareos.com.
Get official binaries and vendor support on https://www.bareos.com
You are connected using the default console

Enter a period to cancel a command.
list joblog jobid=1835
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
 2019-02-05 13:01:00 bareos-dir JobId 1835: Start Backup JobId 1835, Job=lab-helium.2019-02-05_13.01.00_05
 2019-02-05 13:01:01 bareos-dir JobId 1835: Connected Storage daemon at fs32.lan:9103, encryption: ECDHE-PSK-CHACHA20-POLY1305
 2019-02-05 13:01:01 bareos-dir JobId 1835: Created new Volume "lab-helium.2019-02-05-13-01.aii_1835" in catalog.
 2019-02-05 13:01:01 bareos-dir JobId 1835: Using Device "disk-fs32-r6s3" to write.
 2019-02-05 13:01:01 bareos-dir JobId 1835: Probing client protocol... (result will be saved until config reload)
 2019-02-05 13:01:01 bareos-dir JobId 1835: Connected Client: lab-helium at lab-helium.lan:9102, encryption: PSK-AES256-CBC-SHA
 2019-02-05 13:01:01 bareos-dir JobId 1835:    Handshake: Immediate TLS  2019-02-05 13:01:01 bareos-dir JobId 1835:  Encryption: PSK-AES256-CBC-SHA
 2019-02-05 13:01:02 bareos-dir JobId 1835: Sending Accurate information.
 2019-02-05 13:01:12 fs32-sd JobId 1835: Labeled new Volume "lab-helium.2019-02-05-13-01.aii_1835" on device "disk-fs32-r6s3" (/_bareos).
 2019-02-05 13:01:12 fs32-sd JobId 1835: Wrote label to prelabeled Volume "lab-helium.2019-02-05-13-01.aii_1835" on device "disk-fs32-r6s3" (/_bareos)
 2019-02-05 13:01:12 bareos-dir JobId 1835: Max Volume jobs=1 exceeded. Marking Volume "lab-helium.2019-02-05-13-01.aii_1835" as Used.
 2019-02-05 13:01:05 lab-helium JobId 1835: Created 29 wildcard excludes from FilesNotToBackup Registry key
 2019-02-05 13:01:05 lab-helium JobId 1835: Connected Storage daemon at fs32.lan:9103, encryption: PSK-AES256-CBC-SHA
 2019-02-05 13:01:22 lab-helium JobId 1835: Generate VSS snapshots. Driver="Win64 VSS", Drive(s)="CF"
 2019-02-05 13:01:23 lab-helium JobId 1835: VolumeMountpoints are not processed as onefs = yes.
 2019-02-05 13:01:23 lab-helium JobId 1835: VolumeMountpoints are not processed as onefs = yes.
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "Task Scheduler Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "VSS Metadata Store Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "Performance Counters Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "System Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "MSSearch Service Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "ASR Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "BITS Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "WMI Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "Registry Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "Shadow Copy Optimization Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:22 lab-helium JobId 1835: VSS Writer (BackupComplete): "COM+ REGDB Writer", State: 0x1 (VSS_WS_STABLE)
 2019-02-05 14:29:23 lab-helium: ABORTING due to ERROR in lib/smartall.cc:229
Overrun buffer: len=41300 addr=34a00a8 allocated: filed/accurate_htable.cc:49 called from /home/abuild/rpmbuild/BUILD/bareos-18.2.4rc2/src/filed/accurate_htable.cc:193
 2019-02-05 14:29:23 bareos-dir JobId 1835: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-02-05 14:29:23 fs32-sd JobId 1835: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-02-05 14:29:23 fs32-sd JobId 1835: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-02-05 14:29:23 bareos-dir JobId 1835: Fatal error: No Job status returned from FD.
 2019-02-05 14:29:23 bareos-dir JobId 1835: Error: Bareos bareos-dir 18.2.5 (30Jan19):
  Build OS:               Linux-4.4.92-6.18-default debian Debian GNU/Linux 9.7 (stretch)
  JobId:                  1835
  Job:                    lab-helium.2019-02-05_13.01.00_05
  Backup Level:           Incremental, since=2019-01-16 13:00:08
  Client:                 "lab-helium" 18.2.4rc2 (18Dec18) Microsoft Windows 7 Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:                "win-all" 2018-07-27 16:59:34
  Pool:                   "aii" (From Job IncPool override)
  Catalog:                "MyCatalog" (From Client resource)
  Storage:                "disk-fs32-r6" (From Job resource)
  Scheduled time:         05-Feb-2019 13:01:00
  Start time:             05-Feb-2019 13:01:02
  End time:               05-Feb-2019 14:29:23
  Elapsed time:           1 hour 28 mins 21 secs
  Priority:               12
  FD Files Written:       0
  SD Files Written:       0
  FD Bytes Written:       0 (0 B)
  SD Bytes Written:       0 (0 B)
  Rate:                   0.0 KB/s
  Software Compression:   None
  VSS:                    no
  Encryption:             no
  Accurate:               yes
  Volume name(s):         lab-helium.2019-02-05-13-01.aii_1835
  Volume Session Id:      3
  Volume Session Time:    1549321963
  Last Volume Bytes:      3,330,367,609 (3.330 GB)
  Non-fatal FD errors:    1
  SD Errors:              0
  FD termination status:  Error
  SD termination status:  Running
  Bareos binary info:     bareos.org build: Get official binaries and vendor support on bareos.com
  Termination:            *** Backup Error ***
joblog.1835.txt (6,060 bytes)   
r7

r7

2019-02-05 16:36

reporter   ~0003250

After DIR & SD upgrade to 18.2.5 job error in DIR logs of job with crashing 18.2.4rc2 FD changed.

2019-02-05 14:29:23 lab-helium: ABORTING due to ERROR in lib/smartall.cc:229
Overrun buffer: len=41300 addr=34a00a8 allocated: filed/accurate_htable.cc:49 called from /home/abuild/rpmbuild/BUILD/bareos-18.2.4rc2/src/filed/accurate_htable.cc:193
 2019-02-05 14:29:23 bareos-dir JobId 1835: Fatal error: Network error with FD during Backup: ERR=Connection reset by peer
 2019-02-05 14:29:23 fs32-sd JobId 1835: Fatal error: stored/append.cc:173 Error reading data header from FD. ERR=Connection reset by peer
 2019-02-05 14:29:23 fs32-sd JobId 1835: Releasing device "disk-fs32-r6s3" (/_bareos).
 2019-02-05 14:29:23 bareos-dir JobId 1835: Fatal error: No Job status returned from FD.
 2019-02-05 14:29:23 bareos-dir JobId 1835: Error: Bareos bareos-dir 18.2.5 (30Jan19):

You can find full joblog attached.
arogge

arogge

2019-07-22 13:28

manager   ~0003520

Does this happen with 18.2.5 or 18.2.6?
Are you able to retry with the nightly build from https://download.bareos.org/bareos/experimental/nightly/?

Can you check whether the problem persists if you fix the TLS configuration problem (i.e. your client seems to be misconfigured, as TLS-PSK fails. Maybe the name mismatches)?
arogge

arogge

2019-12-18 15:40

manager   ~0003692

closing due to no response on feedback request

Issue History

Date Modified Username Field Change
2019-01-24 18:26 r7 New Issue
2019-01-24 18:26 r7 Tag Attached: always incremental
2019-01-24 18:26 r7 Tag Attached: crash
2019-01-24 18:26 r7 Tag Attached: fd
2019-01-24 18:26 r7 File Added: helium-dir.log
2019-01-24 18:29 r7 Note Added: 0003207
2019-01-24 18:37 r7 Note Added: 0003208
2019-01-24 19:07 r7 File Added: helium-WER.7z.001
2019-01-24 19:07 r7 Note Added: 0003209
2019-01-24 19:07 r7 File Added: helium-WER.7z.002
2019-01-24 22:36 r7 File Added: helium-WER.7z.003
2019-01-24 22:36 r7 File Added: helium-WER.7z.004
2019-01-24 22:36 r7 File Added: helium-WER.7z.005
2019-01-24 22:36 r7 File Added: helium-WER.7z.006
2019-01-24 22:36 r7 File Added: helium-WER.7z.007
2019-01-24 22:36 r7 File Added: helium-WER.7z.008
2019-01-24 22:36 r7 File Added: helium-WER.7z.009
2019-01-24 22:53 r7 File Added: helium-traces.7z.001
2019-01-24 22:53 r7 File Added: helium-traces.7z.002
2019-01-24 22:53 r7 File Added: helium-traces.7z.003
2019-01-25 00:07 r7 File Added: helium-traces.7z.004
2019-01-25 00:07 r7 File Added: helium-traces.7z.005
2019-01-25 00:07 r7 File Added: helium-traces.7z.006
2019-01-25 13:41 r7 Note Added: 0003210
2019-02-05 01:49 teka74 Note Added: 0003246
2019-02-05 02:52 teka74 Note Added: 0003247
2019-02-05 16:36 r7 File Added: joblog.1835.txt
2019-02-05 16:36 r7 Note Added: 0003250
2019-07-22 13:28 arogge Status new => feedback
2019-07-22 13:28 arogge Note Added: 0003520
2019-12-18 15:40 arogge Assigned To => arogge
2019-12-18 15:40 arogge Status feedback => resolved
2019-12-18 15:40 arogge Resolution open => unable to reproduce
2019-12-18 15:40 arogge Status resolved => closed
2019-12-18 15:40 arogge Note Added: 0003692