0000805: can't restore vmware-plugin assisted backups via webui - Bareos Bug Tracker

ID	Project	Category	View Status	Date Submitted	Last Update

0000805	bareos-core	webui	public	2017-04-03 10:14	2019-01-31 10:22

Reporter	ivveh	Assigned To	stephand
Priority	normal	Severity	major	Reproducibility	always
Status	closed	Resolution	fixed
Platform	4.4.0-66-generic x86_64	OS	Ubuntu	OS Version	16.04
Product Version	16.2.4

Summary	0000805: can't restore vmware-plugin assisted backups via webui
Description	Backups taken via bconsole works (full and incremental). Backups taken via webui works (full and incremental). Restores done via bconsole works, tried both the full backup or parts of the increments. Tried with python:localvmdk=yes as well. All OK! Restores done via webui fails with following message: 30-Mar 13:56 bareos-dir JobId 100: Start Restore Job RestoreVM.2017-03-30_13.46.38_42 30-Mar 13:56 bareos-dir JobId 100: Using Device "FileStorage" to read. 30-Mar 13:56 bareos-sd JobId 100: Ready to read from volume "Full-0001" on device "FileStorage" (/var/lib/bareos/storage). 30-Mar 13:56 bareos-sd JobId 100: Forward spacing Volume "Full-0001" to file:block 4:4022143629. 30-Mar 13:56 bareos-fd JobId 100: Fatal error: python-fd: Traceback (most recent call last): File "/usr/lib/bareos/plugins/BareosFdWrapper.py", line 66, in create_file return bareos_fd_plugin_object.create_file(context, restorepkt) File "/usr/lib/bareos/plugins/vmware_plugin/BareosFdPluginVMware.py", line 288, in create_file cbt_data = self.vadp.restore_objects_by_objectname[objectname]['data'] KeyError: ('/VMS/Datacenter/Backup/[datastore2] Backup/Backup.vmdk',) 30-Mar 13:56 bareos-sd JobId 100: Error: bsock_tcp.c:405 Write error sending 31003 bytes to client:127.0.0.1:9103: ERR=Connection reset by peer 30-Mar 13:56 bareos-sd JobId 100: Fatal error: read.c:154 Error sending to File daemon. ERR=Connection reset by peer 30-Mar 13:56 bareos-sd JobId 100: Error: bsock_tcp.c:434 Socket has errors=1 on call to client:127.0.0.1:9103 30-Mar 13:56 bareos-dir JobId 100: Error: Bareos bareos-dir 16.2.4 (01Jul16): Build OS: x86_64-pc-linux-gnu ubuntu Ubuntu 16.04 LTS JobId: 100 Job: RestoreVM.2017-03-30_13.46.38_42 Restore Client: bareos-fd Start time: 30-Mar-2017 13:56:02 End time: 30-Mar-2017 13:56:03 Elapsed time: 1 sec Files Expected: 2 Files Restored: 0 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: Error SD termination status: Fatal Error Termination: * Restore Error * Does not really matter even if I choose to UNCHECK "merge all client filesets" which would of course screw a vmware restore if there are other backups on this client. I have also tried all possible combination of settings in the ui, it always fails with this error.
Steps To Reproduce	1) Set up VMWare environment with a virtual guest. 2) Install vmware-plugin with deps described in Additonal Information. 3) Create filesets, schedules, jobdefs, etc. for a vmware guest as per Bareos manual. 4) Enable CBT on the guest as per Bareos manual. 5) Take backups of the guest. 6) Try to restore via webui
Additional Information	bareos-dir Version: 16.2.4 (01 July 2016) x86_64-pc-linux-gnu ubuntu Ubuntu 16.04 LTS xUbuntu_16.04 x86_64 bareos-vadp-dumper_16.2.4_amd64.deb bareos-vmware-plugin_16.2.4_amd64.deb bareos-vmware-vix-disklib5_5.5.4-2454786_amd64.deb I would also suggest adding possiblity to enter plugin variables in the webui restore mechanism.
Tags	No tags attached.

ivveh 2017-04-03 10:22 reporter ~0002620	Job { Name = "Backup-virtual-machine" JobDefs = "DefaultJob" FileSet = "Backup" } ... FileSet { Name = "Backup" Include { Options { Signature = md5 Compression = gzip9 } Plugin = "python:module_path=/usr/lib/bareos/plugins/vmware_plugin:module_name=bareos-fd-vmware:dc=Datacenter:folder=/:vmname=Backup:vcserver=x.x.x.x:vcuser=administrator@vsphere.local:vcpass=xxx" } } ... JobDefs { Name = "DefaultJob" Type = Backup Level = Incremental Client = bareos-fd FileSet = "SelfTest" # selftest fileset (0000013) Schedule = "Nightly" Storage = File Messages = Standard Pool = Incremental Priority = 10 Write Bootstrap = "/var/lib/bareos/%c.bsr" Full Backup Pool = Full # write Full Backups into "Full" Pool (0000005) Differential Backup Pool = Differential # write Diff Backups into "Differential" Pool (0000008) Incremental Backup Pool = Incremental # write Incr Backups into "Incremental" Pool (0000011) } ... Schedule { Name = "Nightly" Run = daily at 23:00 }

stephand 2017-04-03 16:32 developer ~0002622	I was able to reproduce this. Essentially, the problem is that restoreobjects are not processed when trying to restore a vmware-plugin job via webui. We'll have to investigate further if it could be best fixed in bareos core or in webui.

maik 2018-10-05 13:46 administrator ~0003130	The cause is probably that restore objects are not restored, if restore job is trigerred via WebUI. Same effect has been observed with the percona xtrabackup plugin: 2018-09-19 17:55:05 \| bareos-fd JobId 1896: Fatal error: python-fd: Restore with xbstream needs empty directoy: /tmp/bareos-restores//_percona/1896/ 2018-09-19 17:55:05 \| bareos-fd JobId 1896: Error: python-fd: No lsn information found in restore object for file /tmp/bareos-restores//_percona/xbstream.0000000004 from job 4 Potentially fixed by https://github.com/bareos/bareos/pull/119

pstorz 2018-11-15 09:26 administrator ~0003151	Fix committed to bareos master branch with changesetid 10353.

franku 2018-12-06 09:32 administrator ~0003155	Fix committed to bareos bareos-18.2 branch with changesetid 10629.

bareos: master b840892b 2018-11-15 10:18 pstorz Ported: N/A Details Diff	Cleanup PR 119: Fix failure to send RestoreObjects for Jobs. Fixes 0000805: can't restore vmware-plugin assisted backups via webui Also updated AUTHORS file		Affected Issues 0000805
	mod - AUTHORS		Diff File
	mod - core/src/dird/ua_restore.cc		Diff File
bareos: bareos-18.2 2171b21d 2018-11-15 10:18 pstorz Committer: franku Ported: N/A Details Diff	Cleanup PR 119: Fix failure to send RestoreObjects for Jobs. Fixes 0000805: can't restore vmware-plugin assisted backups via webui Also updated AUTHORS file		Affected Issues 0000805
	mod - AUTHORS		Diff File
	mod - core/src/dird/ua_restore.cc		Diff File

Date Modified	Username	Field	Change
2017-04-03 10:14	ivveh	New Issue
2017-04-03 10:22	ivveh	Note Added: 0002620
2017-04-03 16:25	stephand	Assigned To	=> stephand
2017-04-03 16:25	stephand	Status	new => assigned
2017-04-03 16:32	stephand	Note Added: 0002622
2017-04-03 16:32	stephand	Status	assigned => acknowledged
2018-10-05 13:46	maik	Note Added: 0003130
2018-11-15 09:26	pstorz	Changeset attached	=> bareos master b840892b
2018-11-15 09:26	pstorz	Note Added: 0003151
2018-11-15 09:26	pstorz	Status	acknowledged => resolved
2018-11-15 09:26	pstorz	Resolution	open => fixed
2018-12-06 09:32	franku	Changeset attached	=> bareos bareos-18.2 2171b21d
2018-12-06 09:32	franku	Note Added: 0003155
2019-01-31 10:09	arogge_adm	Relationship added	child of 0001040
2019-01-31 10:22	arogge_adm	Status	resolved => closed