Changesets: bareos

Search Browse Back to Index

master e9bf7643

2023-11-21 09:19

bruno-at-bareos

Ported: N/A

Details Diff		 plugin: fd mariabackup add support for mariadb 11+

- cmake introduce consistent cmake variable MARIADB_BACKUP_BINARY
instead of MARIABACKUP_BINARY
- cmake replace all call of mysql cmd to their mariadb equivalent
Mariadb >11 start echoing deprecated warning.
+ mysql -> mariadb
+ mysqld -> mariadbd
+ mariabackup -> mariadb-backup
- split testrunner to setup,cleanup,default
- fileset replace hardcoded mysql by @MARIADB_CLIENT_BINARY@
- add function check_plugin_mariadb_version()
this is needed to pick the right stream filename depending of
the version. (xbstream or mbstream)
- refactor start_backup_job() function
- add function get_lsn_by_command()
- add function parse_innodb_status(res) which can be used by cmd
and mysqlclient
- re-add self.restorecommand init in parse_plugin_definition
so restore directory is new for each file
- reword xbstream to mbstream expect for the protocol name
- improve logging placement statements
- use black for formating
- fix my.cnf usage

mariadb package hard require python3-mysqlclient module on SUSE.
The code using this module is then used during testing; to be
able to connect to the right instance we need to provide a default
config file.

Signed-off-by: Bruno Friedmann <bruno.friedmann@bareos.com>
mod - core/cmake/BareosFindPrograms.cmake Diff File
mod - core/src/plugins/filed/python/mariabackup/bareos-fd-mariabackup.py Diff File
mod - systemtests/environment.in Diff File
mod - systemtests/tests/py3plug-fd-mariabackup/CMakeLists.txt Diff File
mod - systemtests/tests/py3plug-fd-mariabackup/etc/bareos/bareos-dir.d/fileset/MariabackupTest.conf.in Diff File
rm - systemtests/tests/py3plug-fd-mariabackup/testrunner Diff File
add - systemtests/tests/py3plug-fd-mariabackup/testrunner-default Diff File

master 3cf2ddc3

2023-11-21 08:42

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 py3plug-fd-basic: add cancel test that does not wait
add - systemtests/tests/py3plug-fd-basic/etc/bareos/bareos-dir.d/fileset/CancelNoWaitFileset.conf Diff File
add - systemtests/tests/py3plug-fd-basic/testrunner-cancel-check-no-wait Diff File

master f6e861eb

2023-11-21 08:32

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 cancel-check-test: add option to not wait for cancellation

This allows us to test what happens if the plugin finishes the backup
while the cancelation is still ongoing.
mod - systemtests/tests/py3plug-fd-basic/python-modules/cancel-check-module.py Diff File

master a49742a9

2023-11-21 07:51

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 jcr/fd: add cancel check before destruction

This prevents the situation where one thread is still trying to cancel
something while another is already destroying parts of the jcr.
mod - core/src/filed/dir_cmd.cc Diff File
mod - core/src/include/jcr.h Diff File
mod - core/src/lib/jcr.cc Diff File

master daef1187

2023-11-20 12:12

Bareos Bot


Committer: GitHub

Ported: N/A

Details Diff		 Merge pull request 0001599

postgresql plugin: read config parameters from cluster
mod - CHANGELOG.md Diff File
mod - core/src/plugins/filed/python/postgresql/bareos-fd-postgresql.py Diff File
mod - docs/manuals/source/TasksAndConcepts/Plugins/FileDaemonPlugins/PostgreSQLPlugin.rst.inc Diff File
mod - systemtests/tests/py3plug-fd-postgresql/database/setup_local_db.sh.in Diff File
mod - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTest.conf.in Diff File
add - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTestDebian.conf.in Diff File
mod - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTestNoRole.conf.in Diff File
mod - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTestRole.conf.in Diff File
mod - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTestTablespace.conf.in Diff File
add - systemtests/tests/py3plug-fd-postgresql/etc/bareos/bareos-dir.d/fileset/PluginTestWalSymlink.conf.in Diff File
add - systemtests/tests/py3plug-fd-postgresql/testrunner-debian Diff File
mod - systemtests/tests/py3plug-fd-postgresql/testrunner-roles Diff File
add - systemtests/tests/py3plug-fd-postgresql/testrunner-walsymlink Diff File

master 7e7d6d5e

2023-11-20 12:12

Bareos Bot

Ported: N/A

Details Diff		 Update CHANGELOG.md
mod - CHANGELOG.md Diff File

master 398c483e

2023-11-20 11:19

arogge

Ported: N/A

Details Diff		 cmake: set some baseline compile flags by default

Previously, if you built Bareos without setting any options yourself,
you would get an unoptimized build. With this patch, if you do not set
any C and C++ compiler flags and also did not select a CMake build-type,
we will automatically set the build-type to RelWithDebInfo (i.e.
some optimizations, but with full debugging symbols).
As we don't want to have assertions disabled in our builds, CMake will
now also filter out the flags -DNDEBUG and /DNDEBUG from all build-type
defaults.
mod - CMakeLists.txt Diff File
add - cmake/RemoveNDebugFlag.cmake Diff File

master af77067d

2023-11-20 10:19

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 py3plug-fd-basic: add test checking cancel crash

The new test tries to cancel the job while the job is inside the
plugin module. This is to check whether there are any crashes.
mod - core/src/plugins/filed/python/module/bareosfd.cc Diff File
add - systemtests/tests/py3plug-fd-basic/etc/bareos/bareos-dir.d/fileset/CancelFileset.conf.in Diff File
add - systemtests/tests/py3plug-fd-basic/etc/bareos/bareos-dir.d/job/cancel-check.conf Diff File
add - systemtests/tests/py3plug-fd-basic/python-modules/cancel-check-module.py Diff File
add - systemtests/tests/py3plug-fd-basic/testrunner-cancel-check Diff File

master c8e2719e

2023-11-20 10:19

bruno-at-bareos

Ported: N/A

Details Diff		 python black suggestion fix
mod - core/src/plugins/filed/python/postgresql/bareos-fd-postgresql.py Diff File

master 29617ce7

2023-11-20 08:19

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 python-fd: fix messing with python thread states

Each seperate thread needs its own python thread state to do things
inside of python.
mod - core/src/plugins/filed/python/plugin_private_context.h Diff File
mod - core/src/plugins/filed/python/python-fd.cc Diff File

master 1d0ee2af

2023-11-17 15:35

Bareos Bot


Committer: GitHub

Ported: N/A

Details Diff		 Merge pull request 0001588

rename gettext macro
mod - CHANGELOG.md Diff File
mod - cmake/BareosSetVariableDefaults.cmake Diff File
mod - core/CMakeLists.txt Diff File
mod - core/src/cats/postgresql.cc Diff File
mod - core/src/cats/postgresql_batch.cc Diff File
mod - core/src/cats/sql.cc Diff File
mod - core/src/cats/sql_create.cc Diff File
mod - core/src/cats/sql_delete.cc Diff File
mod - core/src/cats/sql_find.cc Diff File
mod - core/src/cats/sql_get.cc Diff File
mod - core/src/cats/sql_list.cc Diff File
mod - core/src/cats/sql_query.cc Diff File
mod - core/src/console/console.cc Diff File
mod - core/src/console/console_conf.cc Diff File
mod - core/src/dird/admin.cc Diff File
mod - core/src/dird/archive.cc Diff File
mod - core/src/dird/authenticate.cc Diff File
mod - core/src/dird/authenticate_console.cc Diff File
mod - core/src/dird/autoprune.cc Diff File
mod - core/src/dird/backup.cc Diff File
mod - core/src/dird/bsr.cc Diff File
mod - core/src/dird/catreq.cc Diff File
mod - core/src/dird/check_catalog.cc Diff File
mod - core/src/dird/consolidate.cc Diff File
mod - core/src/dird/dbcheck.cc Diff File
mod - core/src/dird/dbcheck_utils.cc Diff File
mod - core/src/dird/dir_plugins.cc Diff File
mod - core/src/dird/dird.cc Diff File
mod - core/src/dird/dird_conf.cc Diff File
mod - core/src/dird/expand.cc Diff File
mod - core/src/dird/fd_cmds.cc Diff File
mod - core/src/dird/fd_sendfileset.cc Diff File
mod - core/src/dird/getmsg.cc Diff File
mod - core/src/dird/inc_conf.cc Diff File
mod - core/src/dird/job.cc Diff File
mod - core/src/dird/job_trigger.cc Diff File
mod - core/src/dird/jobq.cc Diff File
mod - core/src/dird/migrate.cc Diff File
mod - core/src/dird/msgchan.cc Diff File
mod - core/src/dird/ndmp_dma_backup_NDMP_BAREOS.cc Diff File
mod - core/src/dird/ndmp_dma_backup_NDMP_NATIVE.cc Diff File
mod - core/src/dird/ndmp_dma_backup_common.cc Diff File
mod - core/src/dird/ndmp_dma_generic.cc Diff File
mod - core/src/dird/ndmp_dma_restore_NDMP_BAREOS.cc Diff File
mod - core/src/dird/ndmp_dma_restore_NDMP_NATIVE.cc Diff File
mod - core/src/dird/ndmp_dma_restore_common.cc Diff File
mod - core/src/dird/ndmp_dma_storage.cc Diff File
mod - core/src/dird/ndmp_fhdb_helpers.cc Diff File
mod - core/src/dird/ndmp_fhdb_lmdb.cc Diff File
mod - core/src/dird/ndmp_fhdb_mem.cc Diff File
mod - core/src/dird/ndmp_ndmmedia_db_helpers.cc Diff File
mod - core/src/dird/newvol.cc Diff File
mod - core/src/dird/next_vol.cc Diff File
mod - core/src/dird/quota.cc Diff File
mod - core/src/dird/recycle.cc Diff File
mod - core/src/dird/reload.cc Diff File
mod - core/src/dird/restore.cc Diff File
mod - core/src/dird/run_conf.cc Diff File
mod - core/src/dird/scheduler_private.cc Diff File
mod - core/src/dird/sd_cmds.cc Diff File
mod - core/src/dird/socket_server.cc Diff File
mod - core/src/dird/stats.cc Diff File
mod - core/src/dird/storage.cc Diff File
mod - core/src/dird/ua_audit.cc Diff File
mod - core/src/dird/ua_cmds.cc Diff File
mod - core/src/dird/ua_configure.cc Diff File
mod - core/src/dird/ua_db.cc Diff File
mod - core/src/dird/ua_dotcmds.cc Diff File
mod - core/src/dird/ua_impexp.cc Diff File
mod - core/src/dird/ua_input.cc Diff File
mod - core/src/dird/ua_input.h Diff File
mod - core/src/dird/ua_label.cc Diff File
mod - core/src/dird/ua_output.cc Diff File
mod - core/src/dird/ua_prune.cc Diff File
mod - core/src/dird/ua_purge.cc Diff File
mod - core/src/dird/ua_query.cc Diff File
mod - core/src/dird/ua_restore.cc Diff File
mod - core/src/dird/ua_run.cc Diff File
mod - core/src/dird/ua_select.cc Diff File
mod - core/src/dird/ua_server.cc Diff File
mod - core/src/dird/ua_status.cc Diff File
mod - core/src/dird/ua_tree.cc Diff File
mod - core/src/dird/ua_update.cc Diff File
mod - core/src/dird/vbackup.cc Diff File
mod - core/src/dird/verify.cc Diff File
mod - core/src/filed/accurate.cc Diff File
mod - core/src/filed/accurate_lmdb.cc Diff File
mod - core/src/filed/authenticate.cc Diff File
mod - core/src/filed/backup.cc Diff File
mod - core/src/filed/compression.cc Diff File
mod - core/src/filed/crypto.cc Diff File
mod - core/src/filed/dir_cmd.cc Diff File
mod - core/src/filed/fd_plugins.cc Diff File
mod - core/src/filed/filed.cc Diff File
mod - core/src/filed/filed_conf.cc Diff File
mod - core/src/filed/filed_utils.cc Diff File
mod - core/src/filed/fileset.cc Diff File
mod - core/src/filed/restore.cc Diff File
mod - core/src/filed/sd_cmds.cc Diff File
mod - core/src/filed/socket_server.cc Diff File

master 77850569

2023-11-17 15:35

Bareos Bot

Ported: N/A

Details Diff		 Update CHANGELOG.md
mod - CHANGELOG.md Diff File

master 61844478

2023-11-17 15:12

arogge

Ported: N/A

Details Diff		 xxhash: automatically choose best way to build

Previously, we blindly used xxh3.h to have xxhash inlined completely.
While this provides decent performance, we can do better.
Based on wheter using bundled xxhash and the target platform, we
automatically select which header to include to get either the
dynamically linked system-provided library, an optimized algorithm
based on the CPU's features selected at runtime or just the plain
variant of xxhash.

We also configure the bundled xxhash library to be built with -O3.
mod - core/src/lib/CMakeLists.txt Diff File
mod - core/src/lib/xxhash.cc Diff File
mod - third-party/CMakeLists.txt Diff File
mod - third-party/xxHash.cmake Diff File

master 4e0ecb36

2023-11-17 14:50

arogge

Ported: N/A

Details Diff		 third-party: make xxhash a STATIC library
mod - third-party/xxHash.cmake Diff File

master 7bf0448e

2023-11-17 14:49

arogge

Ported: N/A

Details Diff		 benchmarks: add digest benchmark
mod - core/src/benchmarks/CMakeLists.txt Diff File
add - core/src/benchmarks/digest.cc Diff File

master 0086d54f

2023-11-17 10:57

arogge

Ported: N/A

Details Diff		 filed: remove unused test-plugin
mod - cmake/BareosSetVariableDefaults.cmake Diff File
mod - core/CMakeLists.txt Diff File
mod - core/src/plugins/filed/CMakeLists.txt Diff File
rm - core/src/plugins/filed/test-plugin/test-plugin-fd.cc Diff File

master ae059294

2023-11-16 20:19

Bruno Friedmann @Bareos


Committer: bruno-at-bareos

Ported: N/A

Details Diff		 Apply suggestions from code review

Co-authored-by: Philipp Storz <philipp.storz@bareos.com>
mod - core/src/plugins/filed/python/postgresql/bareos-fd-postgresql.py Diff File
mod - docs/manuals/source/TasksAndConcepts/Plugins/FileDaemonPlugins/PostgreSQLPlugin.rst.inc Diff File

master 59997793

2023-11-16 13:56

Sebastian Sura

Ported: N/A

Details Diff		 vadp-dumper: add support for VDL_QueryAllocatedBlocks()

This function returns -- up to a certain amount of precision -- a list
of intervals of all sectors containing useful (i.e. allocated) data.

For full backups its recommended to backup only the allocated blocks;
for other kinds of backups (incremental/differential) it is only
necessary to backup those sectors that are both changed & allocated.

Since we currently cannot take advantage of information regarding
unallocated, changed blocks, we just ignore them. In the future these
could be used for faster restores & consolidation.

The algorithm used for finding out the intersection is trivial as both
lists are sorted (and the intervals themselves are disjoint in each
set). As such it is enough to just go through both arrays linearly at
the same time, sending the pairwise intersection if any, and finally
advancing the pointer to the "smaller" interval.
mod - core/src/vmware/vadp_dumper/bareos_vadp_dumper.cc Diff File

master a146465b

2023-11-16 13:48

bruno-at-bareos

Ported: N/A

Details Diff		 docs: PostgreSQL plugin improvements

- remove no more used parameters
- add roles requirements sql examples
- add socket explanation for db_host
- add warning after restore: clean older wals and trigger new full
- fix typos

Signed-off-by: Bruno Friedmann <bruno.friedmann@bareos.com>
mod - docs/manuals/source/TasksAndConcepts/Plugins/FileDaemonPlugins/PostgreSQLPlugin.rst.inc Diff File

master 80e009ec

2023-11-16 09:40

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 backup: fix giving bad compression output

This also fixes the unescaped % inside a format string
mod - core/src/dird/backup.cc Diff File
mod - core/src/dird/inc_conf.cc Diff File
mod - core/src/dird/inc_conf.h Diff File

master 7fe5b75f

2023-11-16 08:58

pstorz


Committer: Bareos Bot

Ported: N/A

Details Diff		 backup.cc: warn if compression inflates full >1%
mod - core/src/dird/backup.cc Diff File

master 491a22cb

2023-11-15 15:02

Sebastian Sura


Committer: Bareos Bot

Ported: N/A

Details Diff		 btraceback: disable generating core by default
mod - core/scripts/btraceback.in Diff File

master ea0d3eb9

2023-11-15 09:40

bruno-at-bareos

Ported: N/A

Details Diff		 add manually added config rst.inc files for ktls

Signed-off-by: Bruno Friedmann <bruno.friedmann@bareos.com>
add - docs/manuals/source/manually_added_config_directive_descriptions/console-client-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-client-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-console-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-console-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-director-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-director-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-monitor-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-monitor-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-storage-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/console-storage-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-client-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-client-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-console-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-console-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-director-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-director-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-storage-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/dir-storage-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-client-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-client-MaximumWorkersPerJob.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-client-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-director-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-director-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-filedaemon-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-filedaemon-MaximumWorkersPerJob.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/fd-filedaemon-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/sd-director-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/sd-director-TlsCipherSuites.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/sd-storage-EnableKtls.rst.inc Diff File
add - docs/manuals/source/manually_added_config_directive_descriptions/sd-storage-TlsCipherSuites.rst.inc Diff File

master e832f2fb

2023-11-14 14:47

pstorz


Committer: Bareos Bot

Ported: N/A

Details Diff		 backup.cc: issue warning if compression is negative
mod - core/src/dird/backup.cc Diff File

master 9084398a

2023-11-14 14:38

pstorz


Committer: Bareos Bot

Ported: N/A

Details Diff		 backup: display negative compression rate

We now also display a negative compression rate in the job log, before
it was changed to "None".
This is an important information as it suggests the administrator to
disable compression.
mod - core/src/dird/backup.cc Diff File
 First  Prev  1 2 3 ... 51 52 53 54 55 56 57 ... 60 ... 120 ... 180 ... 240 ... 300 ... 360 ... 420 ... 480 ... 540 ... 600 ... 641 642 643  Next  Last