 |
restore.png (89,086 bytes) |
|
|
Please have a look at http://bugs.bareos.org/view.php?id=570 and see if that helps you out. |
|
|
Hi frank, Unfortunately, running bareos-dbcheck -f -c /etc/bareos/bareos-dir.conf does not fix my problem. Webui still shows no files in "Select files to be restored" |
|
|
Did you also tried the following? 1. Find a jobid of a *nix/win client last full backup where webui does not show any files in restore panel/tree to choose from. 2. In bconsole execute the following command, to update the cache. .bvfs_update jobid=<jobid> 3. In bconsole execute the following command with empty path argument. .bvfs_lsdirs jobid=<jobid> path= You should the see something like this: *.bvfs_lsdirs jobid=654 path= 198 0 0 0 A A A A A A A A A A A A A A . 197 0 0 0 A A A A A A A A A A A A A A / * If you only get a one-liner like following, your catalog is maybe corrupt. *.bvfs_lsdirs jobid=169964 path= 939173 0 0 0 A A A A A A A A A A A A A A . * |
|
|
Sure, yes *.bvfs_update jobid=28695 Using Catalog "MyCatalog" *.bvfs_lsdirs jobid=28695 path= Using Catalog "MyCatalog" 0 0 0 0 A A A A A A A A A A A A A A . > bareos-dbcheck -f -c /etc/bareos/bareos-dir.conf Hello, this is the database check/correct program. Modify database is on. Verbose is off. Please select the function you want to perform. --//--- Select function number: 16 Checking for Filenames with a trailing slash Found 0 bad Filename records. Checking for Paths without a trailing slash Found 0 bad Path records. Checking for duplicate Filename entries. Found 0 duplicate Filename records. Checking for duplicate Path entries. Found 1 duplicate Path records. Checking for orphaned JobMedia entries. Checking for orphaned File entries. This may take some time! Pruning orphaned Path entries isn't possible when using BVFS. Note. Index over the FilenameId column not found, that can greatly slow down dbcheck. Create temporary index? (yes/no): yes Create temporary index... This may take some time! Checking for orphaned Filename entries. This may take some time! Drop temporary index. Checking for orphaned FileSet entries. This takes some time! Found 0 orphaned FileSet records. Checking for orphaned Client entries. Found 12 orphaned Client records. Deleting 12 orphaned Client records. Checking for orphaned Job entries. Found 0 orphaned Job records. Checking for Admin Job entries. Found 0 Admin Job records. Checking for Restore Job entries. Found 0 Restore Job records. |
|
|
Please perform a ".bvfs_clear_cache yes" in bconsole if not already done and see if the problem still exists. |
|
|
Sorry, forgot about .bvfs_clear_cache yes Seems it works now (trembling hands) |
|
|
Great |
|
|
Sorry to ping you again , the problem is client has a 3 defined jobs, but webui shows fileset for the first job only, with "Merge all client filesets = yes" If "Merge all client filesets = no", webui shows nothing. |
|
|
Ok, I created the same scenario on a test machine and wasn't able to reproduce, merging filesets works as expected. Just to make things clear. Only jobs of a client which had run before the actual one selected are merged. You can try to figure out what's going on under the hood by using the bvfs api. ... Get dependent jobs from a given JobId Bvfs allows you to query the catalog against any combination of jobs. You can combine all Jobs and all FileSet for a Client in a single session. To get all JobId needed to restore a particular job, you can use the .bvfs_get_jobids command. .bvfs_get_jobids jobid=num [all] Example: *.bvfs_get_jobids jobid=10 1,2,5,10 *.bvfs_get_jobids jobid=10 all 1,2,3,5,10 In this example, a normal restore will need to use JobIds 1,2,5,10 to compute a complete restore of the system. With the all option, the Director will use all defined FileSet for this client. ... How to get files and directories of your jobid list is stated above in this comment section. Further information on bvfs api can be found here: http://doc.bareos.org/master/html/bareos-developer-guide.html#sec:bvfs |
|
|
Hi Frank, The problem is fileset has a dynamically generated file names via bat script. FileSet { Name = "LD4-DBM-TR2-01-DB" Include { Options { signature = MD5 } File = "\\|backup.bat" } } And bat script itself @echo off powershell -command %programdata%\bareos\tr2_backup2.ps1 -folder E:\BACKUPS\DATA where tr2_backup2.ps1 generates files names, that are created in the last 2 hours. param( [string]$folder = "e:\backups\data" ) Get-ChildItem -path $folder | where { $_.CreationTime -gt ((get-date).AddHours(-2)) } | % { $_.FullName } |
|
|
Have the same problem with restore via webui but it is still broken: root@bcp2m:~# bconsole Connecting to Director bcp2m:9101 1000 OK: bcp2m-dir Version: 15.2.2 (16 November 2015) Enter a period to cancel a command. *.bvfs_update jobid=5418 Using Catalog "MyCatalog" You have messages. *.bvfs_lsdirs jobid=5418 path= 97 0 0 0 A A A A A A A A A A A A A A . 74 0 0 0 A A A A A A A A A A A A A A / *.bvfs_clear_cache Can't find 'yes' argument *.bvfs_clear_cache yes OK root@bcp2m:~# bareos-dbcheck -f -c /etc/bareos/bareos-dir.conf Hello, this is the database check/correct program. Modify database is on. Verbose is off. Please select the function you want to perform. 1) Toggle modify database flag 2) Toggle verbose flag 3) Repair bad Filename records 4) Repair bad Path records 5) Eliminate duplicate Filename records 6) Eliminate duplicate Path records 7) Eliminate orphaned Jobmedia records 8) Eliminate orphaned File records 9) Eliminate orphaned Path records 10) Eliminate orphaned Filename records 11) Eliminate orphaned FileSet records 12) Eliminate orphaned Client records 13) Eliminate orphaned Job records 14) Eliminate all Admin records 15) Eliminate all Restore records 16) All (3-15) 17) Quit Select function number: 16 Checking for Filenames with a trailing slash Found 0 bad Filename records. Checking for Paths without a trailing slash Found 1 bad Path records. Reparing 1 bad Filename records. Checking for duplicate Filename entries. Found 0 duplicate Filename records. Checking for duplicate Path entries. Found 1 duplicate Path records. Checking for orphaned JobMedia entries. Checking for orphaned File entries. This may take some time! Note. Index over the PathId column not found, that can greatly slow down dbcheck. Create temporary index? (yes/no): yes Create temporary index... This may take some time! Checking for orphaned Path entries. This may take some time! Found 7 orphaned Path records. Deleting 7 orphaned Path records. Drop temporary index. Note. Index over the FilenameId column not found, that can greatly slow down dbcheck. Create temporary index? (yes/no): yes Create temporary index... This may take some time! Checking for orphaned Filename entries. This may take some time! Drop temporary index. Checking for orphaned FileSet entries. This takes some time! Found 0 orphaned FileSet records. Checking for orphaned Client entries. Found 1 orphaned Client records. Deleting 1 orphaned Client records. Checking for orphaned Job entries. Found 0 orphaned Job records. Checking for Admin Job entries. Found 0 Admin Job records. Checking for Restore Job entries. Found 0 Restore Job records. |
|
|
Olga, BTW, if you have a fileset with dynamically generated files on Bareos client's side, like "File = "\\|script", the DB file record will be empty and restored files will not be shown in webui menu. |
|
|
I have separate fileset for mysql backup: FileSet { Name = "mysql" Include { Options { compression=GZIP signature = MD5 } Plugin = "python:module_path=/usr/lib/bareos/plugins:module_name=bareos-fd-mysql:defaultsfile=/etc/mysql/.login.conf:dumpoptions=--single-transaction --triggers --routines --set-gtid-purged=OFF" } } |
|
|
select files by jobid in bareos mysql table, if 0 files found - the game is over. the files, shown in webui, should be defined in fileset on director's side, bug or feature perhaps. |
|
|
I have over that 3mln rows in File table and the game is not over :) I can perfectly restore via bconsole but no luck in webui. |
|
|
Try to catch sql statement from webui app and looking into it |
|
|
380 Connect bareos@XXX.XXX.XXX.XXX on bareos 380 Query SELECT VersionId FROM Version 380 Query SET wait_timeout=691200 380 Query SET interactive_timeout=691200 380 Query SELECT VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles FROM Job WHERE JobId=5568 380 Query SELECT MAX(FileSet.FileSetId) FROM FileSet JOIN Job USING (FileSetId) WHERE Job.ClientId=1 GROUP BY FileSet 380 Query CREATE TABLE btemp30 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level='F' AND JobStatus IN ('T','W') AND Type='B' AND StartTime<'2016-02-03 21:00:02' AND FileSet.FileSet=(SELECT FileSet FROM FileSet WHERE FileSetId = 1) ORDER BY Job.JobTDate DESC LIMIT 1 380 Query DROP TABLE btemp30 380 Quit temporary table (btemp30) is created and dropped but no events are found between. |
|
|
Is this still an issue? |
|
|
Olga, in case of automatic generation file list on windows client trougth File = "\\|backup.bat" you can try replace all "\" to "/". In my case problem be in that and with "/" i can restore trougth webui without problem. After change in fileset, do not forget do ".bvfs_clear_cache yes" in bconsole and run "/usr/sbin/bareos-dbcheck -f" in case of success, that problem is described in https://bugs.bareos.org/view.php?id=666 |
|
|
Sure, same issue for me with python plugin, reported by Olga. If Fileset contains python plugin, like Plugin = "python:module_path=/usr/lib/bareos/plugins:module_name=bareos-fd-mysql", bareos-webui does not show restored files in tree, only empty root directory. bconsole shows restored files correctly. |
- Anonymous
