View Issue Details

IDProjectCategoryView StatusLast Update
0001374bareos-core[All Projects] Generalpublic2021-07-23 11:40
Reporterloli10KAssigned To 
PrioritynormalSeverityminorReproducibilityalways
Status acknowledgedResolutionopen 
PlatformLinuxOSUbuntuOS Version20.04
Product Version20.0.2 
Fixed in Version 
Summary0001374: AlwaysIncremental Backup Scheme: Consolidate job does not honor "Always Incremental Job Retention" with empty Incrementals
DescriptionThis happened during the latest vacation period when no one was using the fileserver and incremental jobs were always "empty" (no filesystem changes): the number of incrementals kept growing but the consolidate job would always terminate with the following message "less than two jobs to consolidate found, doing nothing".

Starting bareos-dir manually with "-d 100" shows the consolidate job ignoring all jobs with "JobFiles == 0": this could lead to an endless chain of incremental jobs that cannot be consolidated. Is this behaviour intentional (skip empty jobs)?
Steps To Reproduce1. configure job with AlwaysIncremental backup scheme and a FileSet with mostly static files

--- BEGIN CONF ---
  Level = Incremental
  Always Incremental = Yes
  Always Incremental Job Retention = 7 days
  Always Incremental Keep Number = 7
  Accurate = yes
  Pool = AI-Incremental
  Full Backup Pool = AI-Consolidated
  FileSet = "RarelyChangingFiles"
--- END CONF ---

2. configure daily schedule running aforementioned job

3. wait "Always Incremental Job Retention + some" days

4. run consolidate job

5. consolidate job ignores all incrementals with JobFiles == 0 and doesn't consolidate anything
Tagsalways incremental, consolidate
bareos-master: impact
bareos-master: action
bareos-19.2: impact
bareos-19.2: action
bareos-18.2: impact
bareos-18.2: action
bareos-17.2: impact
bareos-17.2: action
bareos-16.2: impact
bareos-16.2: action
bareos-15.2: impact
bareos-15.2: action
bareos-14.2: impact
bareos-14.2: action
bareos-13.2: impact
bareos-13.2: action
bareos-12.4: impact
bareos-12.4: action

Activities

loli10K

loli10K

2021-07-23 10:06

reporter  

bareos-dir.txt (20,229 bytes)
bareos-dir (100): lib/bsock.cc:84-0 Construct BareosSocket
bareos-dir (100): lib/jcr.cc:195-0 Construct JobControlRecord
bareos-dir (100): dird/storage.cc:152-0 write_storage_list=File
bareos-dir (100): dird/storage.cc:162-0 write_storage=File where=Job resource
bareos-dir (100): dird/job.cc:1558-0 JobId=0 created Job=-Console-.2021-07-23_07.18.51_04
bareos-dir (50): lib/cram_md5.cc:105-0 send: auth cram-md5 <439915846.1627024731@R_DIRECTOR::bareos-dir> ssl=0
bareos-dir (50): lib/cram_md5.cc:134-0 Authenticate OK FbjTkabpe5Vzuf4+TdeLyg
bareos-dir (100): lib/cram_md5.cc:166-0 cram-get received: auth cram-md5 <1391000987.1627024731@php-bsock> ssl=0
bareos-dir (50): lib/cram_md5.cc:60-0 my_name: <R_DIRECTOR::bareos-dir> - challenge_name: <php-bsock>
bareos-dir (99): lib/cram_md5.cc:231-0 sending resp to challenge: t4gnTG02NWMSR4+Mo6R/fC
bareos-dir (10): dird/ua_audit.cc:142-0 : Console [admin] from [127.0.0.1] cmdline run job="Consolidate" yes
bareos-dir (100): dird/ua_db.cc:150-0 UA Open database
bareos-dir (100): cats/sql_pooling.cc:60-0 DbSqlGetNonPooledConnection allocating 1 new non pooled database connection to database bareos, backend type postgresql
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename dbi, partly_compare = true
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename mysql, partly_compare = false
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename postgresql, partly_compare = false
bareos-dir (100): cats/postgresql.cc:1027-0 DB REopen bareos
bareos-dir (100): dird/ua_run.cc:2129-0 Using pool AI-Incremental
bareos-dir (100): dird/ua_run.cc:2143-0 Using next pool AI-Consolidated
bareos-dir (100): lib/jcr.cc:195-0 Construct JobControlRecord
bareos-dir (100): dird/storage.cc:152-0 write_storage_list=File
bareos-dir (100): dird/storage.cc:162-0 write_storage=File where=Job resource
bareos-dir (50): dird/storage.cc:187-0 write_storage=FileIncremental where=Pool resource
bareos-dir (100): dird/ua_run.cc:517-0 JobId=0 using pool AI-Incremental priority=10
bareos-dir (100): dird/job.cc:1558-0 JobId=0 created Job=Consolidate.2021-07-23_07.18.51_05
bareos-dir (100): dird/job.cc:190-0 Open database
bareos-dir (100): cats/sql_pooling.cc:60-0 DbSqlGetNonPooledConnection allocating 1 new non pooled database connection to database bareos, backend type postgresql
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename dbi, partly_compare = true
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename mysql, partly_compare = false
bareos-dir (100): cats/cats_backends.cc:79-0 db_init_database: Trying to find mapping of given interfacename postgresql to mapping interfacename postgresql, partly_compare = false
bareos-dir (100): cats/postgresql.cc:1027-0 DB REopen bareos
bareos-dir (100): cats/sql_query.cc:131-0 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT ClientId,Uname FROM Client WHERE Name='bareos-fd'
bareos-dir (100): dird/job.cc:1405-0 Created Client bareos-fd record 1
bareos-dir (100): dird/job.cc:232-0 Created job record JobId=33 Name=Consolidate.2021-07-23_07.18.51_05 Type=O Level=F
bareos-dir (100): dird/ua_run.cc:523-0 JobId=33 NewJobId=33 using pool AI-Incremental priority=10
bareos-dir (50): dird/jobq.cc:904-0 Inc Job=Consolidate rncj=1
bareos-dir (100): lib/jcr.cc:278-0 FreeCommonJcr: 7fe26c000e50 
bareos-dir (100): lib/bsock.cc:136-0 Destruct BareosSocket
bareos-dir (100): lib/bsock.cc:84-0 Construct BareosSocket
bareos-dir (100): lib/jcr.cc:195-0 Construct JobControlRecord
bareos-dir (100): dird/storage.cc:152-0 write_storage_list=File
bareos-dir (100): dird/storage.cc:162-0 write_storage=File where=Job resource
bareos-dir (100): dird/job.cc:1558-0 JobId=0 created Job=-Console-.2021-07-23_07.18.53_06
bareos-dir (50): lib/cram_md5.cc:105-0 send: auth cram-md5 <54017212.1627024733@R_DIRECTOR::bareos-dir> ssl=0
bareos-dir (50): lib/cram_md5.cc:134-0 Authenticate OK 3wQbsPYvHaCjQ+o/pA5uDg
bareos-dir (100): lib/cram_md5.cc:166-0 cram-get received: auth cram-md5 <7225644114.1627024733@php-bsock> ssl=0
bareos-dir (50): lib/cram_md5.cc:60-0 my_name: <R_DIRECTOR::bareos-dir> - challenge_name: <php-bsock>
bareos-dir (99): lib/cram_md5.cc:231-0 sending resp to challenge: 38QJ69/CSi/AK4IZv+MHkB
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query UPDATE Job SET JobStatus='R',Level='F',StartTime='2021-07-23 07:18:53',ClientId=1,JobTDate=1627024733,PoolId=0,FileSetId=0 WHERE JobId=33
bareos-dir (100): lib/jcr.cc:278-0 FreeCommonJcr: 7fe26c000e50 
bareos-dir (100): lib/bsock.cc:136-0 Destruct BareosSocket
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query UPDATE Job SET JobStatus='R',Level='F',StartTime='2021-07-23 07:18:53',ClientId=1,JobTDate=1627024733,PoolId=0,FileSetId=0 WHERE JobId=33
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:53','bareos-dir JobId 33: Start Consolidate JobId 33, Job=Consolidate.2021-07-23_07.18.51_05
')
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:53','bareos-dir JobId 33: Looking at always incremental job BackupCatalog
')
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT FileSetId,CreateTime FROM FileSet WHERE FileSet='Catalog' AND MD5='Y9gUE3Mi1UIy95+cHC/mUC'
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT ClientId,Uname FROM Client WHERE Name='bareos-fd'
bareos-dir (100): dird/job.cc:1405-33 Created Client bareos-fd record 1
bareos-dir (100): cats/sql_query.cc:104-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) with query name create_temp_accurate_jobids (36)
bareos-dir (100): cats/sql_query.cc:109-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) query is now CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-23 07:18:54' AND FileSet.FileSetId = 1 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-23 07:18:54' AND FileSet.FileSetId = 1 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='D' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-23 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 1) ORDER BY Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='I' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-23 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 1) ORDER BY Job.JobTDate DESC 
bareos-dir (1): cats/sql_get.cc:1412-33 db_accurate_get_jobids=
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query DROP TABLE btemp333
bareos-dir (10): dird/consolidate.cc:160-33 unlimited jobids list:  .
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: BackupCatalog: considering jobs older than 16-Jul-2021 07:18:53 for consolidation.
')
bareos-dir (10): dird/consolidate.cc:176-33 BackupCatalog: considering jobs with ClientId 1 and FilesetId 1 older than 16-Jul-2021 07:18:53 for consolidation.
bareos-dir (100): cats/sql_query.cc:104-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) with query name create_temp_accurate_jobids (36)
bareos-dir (100): cats/sql_query.cc:109-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) query is now CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSetId = 1 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSetId = 1 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='D' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 1) ORDER BY Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='I' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 1) ORDER BY Job.JobTDate DESC 
bareos-dir (1): cats/sql_get.cc:1412-33 db_accurate_get_jobids=
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query DROP TABLE btemp333
bareos-dir (10): dird/consolidate.cc:184-33 consolidate candidates:  .
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: BackupCatalog: less than two jobs to consolidate found, doing nothing.
')
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: Looking at always incremental job backup-bareos-fd
')
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT FileSetId,CreateTime FROM FileSet WHERE FileSet='MyFileSet' AND MD5='GXlxp7/utAlwrD/8o60O5C'
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT ClientId,Uname FROM Client WHERE Name='bareos-fd'
bareos-dir (100): dird/job.cc:1405-33 Created Client bareos-fd record 1
bareos-dir (100): cats/sql_query.cc:104-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) with query name create_temp_accurate_jobids (36)
bareos-dir (100): cats/sql_query.cc:109-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) query is now CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-23 07:18:55' AND FileSet.FileSetId = 3 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-23 07:18:55' AND FileSet.FileSetId = 3 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='D' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-23 07:18:55' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 3) ORDER BY Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='I' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-23 07:18:55' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 3) ORDER BY Job.JobTDate DESC 
bareos-dir (1): cats/sql_get.cc:1412-33 db_accurate_get_jobids=10
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query DROP TABLE btemp333
bareos-dir (10): dird/consolidate.cc:160-33 unlimited jobids list:  10.
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: backup-bareos-fd: considering jobs older than 16-Jul-2021 07:18:53 for consolidation.
')
bareos-dir (10): dird/consolidate.cc:176-33 backup-bareos-fd: considering jobs with ClientId 1 and FilesetId 3 older than 16-Jul-2021 07:18:53 for consolidation.
bareos-dir (100): cats/sql_query.cc:104-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) with query name create_temp_accurate_jobids (36)
bareos-dir (100): cats/sql_query.cc:109-33 called: void BareosDb::FillQueryVaList(PoolMem&, BareosDbQueryEnum::SQL_QUERY, __va_list_tag*) query is now CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSetId = 3 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query CREATE TABLE btemp333 AS SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND Level = 'F' AND JobStatus IN ('T', 'W') AND Type = 'B' AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSetId = 3 ORDER BY Job.JobId DESC, Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='D' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 3) ORDER BY Job.JobTDate DESC LIMIT 1 
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO btemp333 (JobId, StartTime, EndTime, JobTDate, PurgedFiles) SELECT JobId, StartTime, EndTime, JobTDate, PurgedFiles FROM Job JOIN FileSet USING (FileSetId) WHERE ClientId = 1 AND JobFiles > 0 AND Level='I' AND JobStatus IN ('T','W') AND Type='B' AND StartTime > (SELECT EndTime FROM btemp333 ORDER BY EndTime DESC LIMIT 1) AND StartTime < '2021-07-16 07:18:54' AND FileSet.FileSet= (SELECT FileSet FROM FileSet WHERE FileSetId = 3) ORDER BY Job.JobTDate DESC 
bareos-dir (1): cats/sql_get.cc:1412-33 db_accurate_get_jobids=10
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query DROP TABLE btemp333
bareos-dir (10): dird/consolidate.cc:184-33 consolidate candidates:  10.
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: backup-bareos-fd: less than two jobs to consolidate found, doing nothing.
')
bareos-dir (100): dird/consolidate.cc:349-33 Enter backup_cleanup()
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query UPDATE Job SET JobStatus='T',Level='I',EndTime='2021-07-23 07:18:54',ClientId=1,JobBytes=0,ReadBytes=0,JobFiles=0,JobErrors=0,VolSessionId=0,VolSessionTime=0,PoolId=0,FileSetId=3,JobTDate=1627024734,RealEndTime='2021-07-23 07:18:54',PriorJobId=0,HasBase=0,PurgedFiles=0 WHERE JobId=33
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query SELECT VolSessionId,VolSessionTime,PoolId,StartTime,EndTime,JobFiles,JobBytes,JobTDate,Job,JobStatus,Type,Level,ClientId,Name,PriorJobId,RealEndTime,JobId,FileSetId,SchedTime,RealEndTime,ReadBytes,HasBase,PurgedFiles FROM Job WHERE JobId=33
bareos-dir (100): cats/sql_query.cc:131-33 called: bool BareosDb::SqlQuery(const char*, int) with query INSERT INTO Log (JobId, Time, LogText) VALUES (33,'2021-07-23 07:18:54','bareos-dir JobId 33: BAREOS 20.0.1 (02Mar21): 23-Jul-2021 07:18:54
  JobId:                  33
  Job:                    Consolidate.2021-07-23_07.18.51_05
  Scheduled time:         23-Jul-2021 07:18:51
  Start time:             23-Jul-2021 07:18:53
  End time:               23-Jul-2021 07:18:54
  Bareos binary info:     bareos.org build: Get official binaries and vendor support on bareos.com
  Job triggered by:       User
  Termination:            Consolidate OK

')
bareos-dir (100): dird/consolidate.cc:397-33 Leave ConsolidateCleanup()
bareos-dir (50): dird/job.cc:680-33 ======== End Job stat=T ==========
bareos-dir (50): dird/jobq.cc:920-0 Dec Job=Consolidate rncj=0
bareos-dir (100): lib/bsys.cc:83-0 safe_unlink unlinking: /var/lib/bareos/bareos-dir.Consolidate.2021-07-23_07.18.51_05.1811978720.mail
bareos-dir (100): lib/bsys.cc:627-0 write_last_jobs seek to 192
bareos-dir (100): lib/jcr.cc:278-0 FreeCommonJcr: 7fe26c0082c0 

bareos-dir.txt (20,229 bytes)
bareos-webui.png (84,846 bytes)
bareos-webui.png (84,846 bytes)
loli10K

loli10K

2021-07-23 10:08

reporter  

bareos-webui-jobs.png (117,908 bytes)
bareos-webui-jobs.png (117,908 bytes)
loli10K

loli10K

2021-07-23 10:09

reporter  

frank

frank

2021-07-23 10:52

manager   ~0004192

Last edited: 2021-07-23 11:40

View 4 revisions

This is currently intended behaviour, see: https://github.com/bareos/bareos/blob/a89617abc0f40425a1a9faa00c1825200be6777a/core/src/cats/sql_get.cc#L1346 .

This might be an issue we need to investigate.

Issue History

Date Modified Username Field Change
2021-07-23 10:06 loli10K New Issue
2021-07-23 10:06 loli10K Tag Attached: always incremental
2021-07-23 10:06 loli10K File Added: bareos-dir.txt
2021-07-23 10:06 loli10K File Added: bareos-webui.png
2021-07-23 10:06 loli10K Tag Attached: consolidate
2021-07-23 10:08 loli10K File Added: bareos-webui-jobs.png
2021-07-23 10:09 loli10K File Added: bareos-webui-consolidate.png
2021-07-23 10:52 frank Note Added: 0004192
2021-07-23 10:53 frank Assigned To => frank
2021-07-23 10:53 frank Status new => feedback
2021-07-23 11:35 frank Note Edited: 0004192 View Revisions
2021-07-23 11:36 frank Assigned To frank =>
2021-07-23 11:36 frank Status feedback => acknowledged
2021-07-23 11:38 frank Note Edited: 0004192 View Revisions
2021-07-23 11:40 frank Note Edited: 0004192 View Revisions