View Issue Details

IDProjectCategoryView StatusLast Update
0001444bareos-corevmware pluginpublic2022-04-07 11:22
Reporterroy Assigned Tostephand  
PriorityurgentSeveritycrashReproducibilityalways
Status closedResolutionnot fixable 
PlatformLinuxOSCentOSOS Version7
Product Version19.2.12 
Summary0001444: Vmware backup fail! Fatal error: python-fd: check_dumper(): bareos_vadp_dumper returncode: -11 error output:
Description29-Mar 09:07 bareos-dir JobId 11747: Start Backup JobId 11747, Job=vm-freepbx-backup-job.2022-03-29_09.07.09_08
29-Mar 09:07 bareos-dir JobId 11747: Connected Storage daemon at bareos:9103, encryption: TLS_CHACHA20_POLY1305_SHA256
29-Mar 09:07 bareos-dir JobId 11747: Using Device "VmwareStorage" to write.
29-Mar 09:07 bareos-dir JobId 11747: Connected Client: vmware at localhost:9102, encryption: TLS_CHACHA20_POLY1305_SHA256
29-Mar 09:07 bareos-dir JobId 11747: Handshake: Immediate TLS
29-Mar 09:07 bareos-fd JobId 11747: Connected Storage daemon at bareos:9103, encryption: TLS_CHACHA20_POLY1305_SHA256
29-Mar 09:07 bareos-fd JobId 11747: Extended attribute support is enabled
29-Mar 09:07 bareos-fd JobId 11747: ACL support is enabled
29-Mar 09:07 bareos-sd JobId 11747: Volume "Full-vm-freepbx-1406" previously written, moving to end of data.
29-Mar 09:07 bareos-sd JobId 11747: Ready to append to end of Volume "Full-vm-freepbx-1406" size=15878734121
29-Mar 09:07 bareos-fd JobId 11747: python-fd: Starting backup of /VMS/ha-datacenter/freepbx/[datastore1] freepbx/freepbx.vmdk_cbt.json
29-Mar 09:07 bareos-fd JobId 11747: python-fd: Starting backup of /VMS/ha-datacenter/freepbx/[datastore1] freepbx/freepbx.vmdk
29-Mar 09:07 bareos-fd JobId 11747: Fatal error: python-fd: check_dumper(): bareos_vadp_dumper returncode: -11 error output:
Warning: HostAgent is not a VirtualCenter, cannot disable sVmotion. Error 20 at 2536.
Failed to Prepare For Access: The command is not supported on remote objects [20]
29-Mar 09:07 bareos-fd JobId 11747: Fatal error: python-fd: plugin_io[IO_CLOSE]: bareos_vadp_dumper returncode: -11 error output:
Warning: HostAgent is not a VirtualCenter, cannot disable sVmotion. Error 20 at 2536.
Failed to Prepare For Access: The command is not supported on remote objects [20]
Steps To ReproduceESXI 7 problem after network reset!
TagsNo tags attached.

Activities

bruno-at-bareos

bruno-at-bareos

2022-03-30 16:40

manager   ~0004558

Hello Roy, with so few information than "ESXI 7 problem after network reset!" it will be hard to help you even with vodoo magics tricks.

The experience has shown that often, people getting update or reset of ESX get a new certificate and if so you will have to update the Plugin-Option "vcthumbprint"


https://docs.bareos.org/TasksAndConcepts/Plugins.html
roy

roy

2022-03-31 06:16

reporter   ~0004560

Hello Bruno! Tnks! We don't use Plugin-Option "vcthumbprint", but you right certificate is new!
python:module_path=/usr/lib64/bareos/plugins/vmware_plugin:module_name=bareos-fd-vmware:dc=ha-datacenter:folder=/:vmname=webdev-stage:vcserver=dellr640.office.i-digit.ru:vcuser=xxx:vcpass=xxx"
roy

roy

2022-03-31 06:25

reporter   ~0004561

Stack trace of thread 57665:
                                                                  #0 0x00007fc6f80402f4 _ZN6VcbLib5Mount21HotAddCredentialsImpl9HasMountsEv (libdiskLibPlugin.so)
                                                                  0000001 0x00007fc6f803d808 _ZN6VcbLib5Mount15UnmountBaseImpl14GenericUnmountEPNS_10DataAccess8DetacherEcRKSsS6_PN5Vmomi5MoRefES9_ (libdiskLibPlugin.so)
                                                                  0000002 0x00007fc6f803dfa7 _ZN6VcbLib5Mount15AutoUnmountImpl7UnmountERKSsS3_ (libdiskLibPlugin.so)
                                                                  0000003 0x00007fc6f806139c _ZN6VcbLib9Transport7CleanupERKSsPK23VixDiskLibConnectParamsPjS6_PPc (libdiskLibPlugin.so)
                                                                  0000004 0x00007fc6f8070147 n/a (libdiskLibPlugin.so)
                                                                  0000005 0x00007fc6fab1009b VixDiskLib_Cleanup (libvixDiskLib.so.6)
                                                                  0000006 0x0000000000402ce6 main (bareos_vadp_dumper)
                                                                  0000007 0x00007fc6f99e87b3 __libc_start_main (libc.so.6)
                                                                  0000008 0x000000000040306e _start (bareos_vadp_dumper)

                                                                  Stack trace of thread 57668:
                                                                  #0 0x00007fc6fa8d565d __lll_lock_wait (libpthread.so.0)
                                                                  0000001 0x00007fc6fa8ce979 __pthread_mutex_lock (libpthread.so.0)
                                                                  0000002 0x00007fc6f711f552 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f70a2c84 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000005 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000006 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57666:
                                                                  #0 0x00007fc6fa8d565d __lll_lock_wait (libpthread.so.0)
                                                                  0000001 0x00007fc6fa8ce979 __pthread_mutex_lock (libpthread.so.0)
                                                                  0000002 0x00007fc6f711f552 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f70a2c84 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000005 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000006 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57667:
                                                                  #0 0x00007fc6fa8d565d __lll_lock_wait (libpthread.so.0)
                                                                  0000001 0x00007fc6fa8ce979 __pthread_mutex_lock (libpthread.so.0)
                                                                  0000002 0x00007fc6f711f552 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f70a2c84 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000005 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000006 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57672:
                                                                  #0 0x00007fc6fa8d22fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
                                                                  0000001 0x00007fc6f711eba2 n/a (libvmacore.so)
                                                                  0000002 0x00007fc6f70a6a37 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000005 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57673:
                                                                  #0 0x00007fc6fa8d22fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
                                                                  0000001 0x00007fc6f6fdf76d n/a (libvmacore.so)
                                                                  0000002 0x00007fc6f70f0c37 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f70eb15f n/a (libvmacore.so)
                                                                  0000004 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000005 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57669:
                                                                  #0 0x00007fc6fa8d22fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
                                                                  0000001 0x00007fc6f711f6de n/a (libvmacore.so)
                                                                  0000002 0x00007fc6f70a2c84 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000005 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57671:
                                                                  #0 0x00007fc6f9ac2257 epoll_wait (libc.so.6)
                                                                  0000001 0x00007fc6f70ab8dc n/a (libvmacore.so)
                                                                  0000002 0x00007fc6f6fdf5a0 n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f70a362e n/a (libvmacore.so)
                                                                  0000004 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000005 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000006 0x00007fc6f9ac1f23 __clone (libc.so.6)

                                                                  Stack trace of thread 57670:
                                                                  #0 0x00007fc6fa8d22fc pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
                                                                  0000001 0x00007fc6f6fdf76d n/a (libvmacore.so)
                                                                  0000002 0x00007fc6f70a362e n/a (libvmacore.so)
                                                                  0000003 0x00007fc6f717b487 n/a (libvmacore.so)
                                                                  0000004 0x00007fc6fa8cc14a start_thread (libpthread.so.0)
                                                                  0000005 0x00007fc6f9ac1f23 __clone (libc.so.6)
stephand

stephand

2022-03-31 11:54

developer   ~0004563

As can be seen already from the message

Warning: HostAgent is not a VirtualCenter, cannot disable sVmotion

this is probably not a bug in Bareos. The bareos_vadp_dumper is just reporting the error that it's getting from the API.

To get more verbose information from bareos_vadp_dumper, you could add the plugin option
vadp_dumper_verbose=yes
(see https://docs.bareos.org/TasksAndConcepts/Plugins.html#debugging-in-case-of-problems)

This will create /var/log/bareos/bareos_vadp_dumper.<JobId>-<vapd_dumper_pid>.log

But this rather looks like that host is not properly connected to vCenter.
roy

roy

2022-04-01 11:19

reporter   ~0004564

Hello Stephand! I have two standalone hosts and no vcenter! Bareos worked fine for over a year!
stephand

stephand

2022-04-05 14:40

developer   ~0004565

Hello Roy,

ok, I didn't know that this ever worked on ESXi standalone/free.
However, This is obviously not a Bareos bug.
roy

roy

2022-04-06 03:28

reporter   ~0004566

Thank you, Stephand! I think you right!

Issue History

Date Modified Username Field Change
2022-03-29 04:49 roy New Issue
2022-03-30 16:40 bruno-at-bareos Note Added: 0004558
2022-03-31 06:16 roy Note Added: 0004560
2022-03-31 06:25 roy Note Added: 0004561
2022-03-31 11:25 stephand Assigned To => stephand
2022-03-31 11:25 stephand Status new => assigned
2022-03-31 11:54 stephand Status assigned => feedback
2022-03-31 11:54 stephand Note Added: 0004563
2022-04-01 11:19 roy Note Added: 0004564
2022-04-01 11:19 roy Status feedback => assigned
2022-04-05 14:40 stephand Note Added: 0004565
2022-04-06 03:28 roy Note Added: 0004566
2022-04-07 11:22 stephand Status assigned => closed
2022-04-07 11:22 stephand Resolution open => not fixable