Changesets: bareos

Search Browse Back to Index

bareos-16.2 fbebd276

2017-09-29 17:28

stephand

Ported: N/A

Details Diff		 Improve .bvfs_lsdirs performance

In a previous fix, the the SQL query used by .bvfs_lsdirs was changed to
not show empty dirs from accurate jobs. This introduced performance
problems when .bvfs_lsdirs was used with larger amounts (hundreds) of
folders. This commit changes the SQL query to perform better when using
MySQL. Note that it is also necesary to create the following index when
using MySQL:
CREATE INDEX PathId_JobId_FileNameId_FileIndex ON File(PathId,JobId,FilenameId,FileIndex);
When using PostgreSQL create the following partial index:
CREATE INDEX file_jpfnidpart_idx ON File(PathId,JobId,FilenameId) WHERE FileIndex = 0;

Previously, the SQL Scripts for creating the tables added a single-key index
for JobId on the File table. Such an index is not necesary if another multi-key
index exists with JobId as the first key. As the number of indexes has a
performance impact on INSERT and UPATE, it is a good idea to drop the single-key
JobId index when adding the above index.

Fixes 0000837: performance issues with .bvfs_lsdirs while having a large number of directories		 Affected Issues
0000837
mod - src/cats/bvfs.c Diff File
mod - src/cats/ddl/creates/mysql.sql Diff File
mod - src/cats/ddl/creates/postgresql.sql Diff File

bareos-16.2 6cccbd46

2017-09-29 11:06

pstorz

Ported: N/A

Details Diff		 Attribute batch inserting: create job log entries.

We now create job log entries when the batch attribute table
gets inserted into the database.

We write a log entry when it starts and a job entry when its done.
mod - src/cats/sql_create.c Diff File

bareos-17.2 f95fb67b

2017-09-24 10:29

Andreas Unterkircher


Committer: joergs

Ported: N/A

Details Diff		 dbcheck.c, update for dver 2171, remove eliminate_duplicate_filenames(), update all queries referencing the old Filename table
mod - src/dird/dbcheck.c Diff File

bareos-17.2 219eb494

2017-09-22 16:48

pstorz

Ported: N/A

Details Diff		 Windows: restore attributes on directories

For unknown reason, directories were skipped when applying
windows attributes. We now apply attributes also to directories.

We need the additional access right GENERIC_READ even when
only opening directories WRITE_ONLY, as otherwise access is
denied when applying the compressed attribute.

Fixes 0000629: windows: Attributes for directories not restored		 Affected Issues
0000629
mod - src/findlib/bfile.c Diff File
mod - src/win32/compat/compat.c Diff File

bareos-16.2 7afb66df

2017-09-22 16:48

pstorz


Committer: stephand

Ported: N/A

Details Diff		 Windows: restore attributes on directories

For unknown reason, directories were skipped when applying
windows attributes. We now apply attributes also to directories.

We need the additional access right GENERIC_READ even when
only opening directories WRITE_ONLY, as otherwise access is
denied when applying the compressed attribute.

Fixes 0000629: windows: Attributes for directories not restored		 Affected Issues
0000629
mod - src/findlib/bfile.c Diff File
mod - src/win32/compat/compat.c Diff File

bareos-17.2 328d2aad

2017-09-21 23:07

joergs

Ported: N/A

Details Diff		 bareos-config get_database_version_by_release: fix
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 2831a4a8

2017-09-20 21:41

joergs

Ported: N/A

Details Diff		 Merge branch 'bareos-16.2'
mod - debian/control Diff File
mod - debian/control.in Diff File
mod - platforms/packaging/bareos.dsc Diff File
mod - platforms/packaging/bareos.spec Diff File

bareos-17.2 654b5759

2017-09-20 15:54

joergs

Ported: N/A

Details Diff		 Disabled use of SQL query 0065_bvfs_clear_cache_0

as MySQL does only support single SQL statements in a query.
Instead, implement this functionality in bvfs.c again.
mod - src/cats/bvfs.c Diff File
mod - src/cats/dml/0065_bvfs_clear_cache_0 Diff File
mod - src/cats/dml/README Diff File
mod - src/cats/mysql.c Diff File
mod - src/dird/ua_dotcmds.c Diff File

bareos-17.2 7321efb4

2017-09-20 13:03

joergs

Ported: N/A

Details Diff		 compile against openssl >= 1.1 if available

Before, workarounds to compile against openssl-1.0-compat libraries has
been added.
As Bareos has been adapted to work against newer openssl versions,
these workarounds are no longer required and hereby removed again.
mod - debian/control Diff File
mod - debian/control.in Diff File
mod - platforms/packaging/bareos.dsc Diff File
mod - platforms/packaging/bareos.spec Diff File

bareos-17.2 f4929da7

2017-09-20 02:03

stephand


Committer: joergs

Ported: N/A

Details Diff		 Fix .bvfs_lsdirs: Empty result for root node, performance enhanced

The underlying SQL query returned an empty result set for the root node,
when using .bvfs_lsdirs with the empty path argument, eg.
.bvfs_lsdirs jobid=23,45,48 path=
The SQL query was changed to fix this. It also performs better,
especially on MySQL/MariaDB, where it requires the following index:
CREATE INDEX PathId_JobId_FileIndex ON File (PathId, JobId, FileIndex);

The changed query also performs better on PostgreSQL. The following
partial index should be used on PostgreSQL:
CREATE INDEX file_jidpart_idx ON File(JobId) WHERE FileIndex = 0 AND Name = '';

For new installations these indexes will be created automatically, also
when upgrading from 16.x using the update_bareos_tables script.
mod - src/cats/ddl/creates/mysql.sql Diff File
mod - src/cats/ddl/updates/mysql.2004_2170.sql Diff File
mod - src/cats/dml/0064_bvfs_lsdirs_7 Diff File
mod - src/cats/mysql_queries.inc Diff File
mod - src/cats/postgresql_queries.inc Diff File
mod - src/cats/sqlite_queries.inc Diff File

bareos-17.2 4551c048

2017-09-18 16:19

joergs

Ported: N/A

Details Diff		 Merge branch 'bareos-16.2'
mod - debian/control.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 07d2a860

2017-09-18 15:53

joergs

Ported: N/A

Details Diff		 configure
mod - configure Diff File

bareos-17.2 3ea179f4

2017-09-18 14:54

frank

Ported: N/A

Details Diff		 Filter Framework and list command adjustments

This commit adjusts some parts of the filter-framework and the the (l)list
command in various contexts to have a solid base for a proper paging for
applications like webui using the JSON API. Also this commit introduces
a new counter variable, so we know how many rows have been filtered from our
original SQL result due to ACL settings.

- Adds count, limit and offset as additional and optional command arguments to
the (l)list command on our volume context.

- Adds count, limit and offset as additional and optional command arguments to
the (l)list command on our joblog context.

- In API 2 mode filtered, limit and offset are now attached as an key-value
pair object to the result object as a child, for additional information.

- A new query include file is introduced to count volumes/media

Example usage:
--------------

list volumes all count

list volumes pool=Incremental limit=10 offset=0

Example output:
---------------

{
"jsonrpc": "2.0",
"id": null,
"result": {
"volumes": [
{
"mediaid": "2",
"volumename": "Incremental-0002",
"volstatus": "Append",
"enabled": "1",
"volbytes": "182336976",
"volfiles": "0",
"volretention": "604800",
"recycle": "1",
"slot": "0",
"inchanger": "0",
"mediatype": "File",
"lastwritten": "2017-09-08 21:00:01",
"storage": "File"
},
{
"mediaid": "45",
"volumename": "Incremental-0045",
"volstatus": "Append",
"enabled": "1",
"volbytes": "222479",
"volfiles": "0",
"volretention": "604800",
"recycle": "1",
"slot": "0",
"inchanger": "0",
"mediatype": "File",
"lastwritten": "2017-09-15 21:00:04",
"storage": "File"
}
]
"meta": {
"range": {
"limit": 10,
"filtered": 0,
"offset": 0
}
}
}
}
mod - src/cats/bdb_query_enum_class.h Diff File
mod - src/cats/bdb_query_names.inc Diff File
mod - src/cats/cats.h Diff File
add - src/cats/dml/0067_list_volumes_count_0 Diff File
add - src/cats/dml/0068_list_volumes_by_name_count_1 Diff File
add - src/cats/dml/0069_list_volumes_by_poolid_count_1 Diff File
add - src/cats/dml/0070_list_joblog_2 Diff File
add - src/cats/dml/0071_list_joblog_count_1 Diff File
mod - src/cats/mysql_queries.inc Diff File
mod - src/cats/postgresql_queries.inc Diff File
mod - src/cats/sql_list.c Diff File
mod - src/cats/sqlite_queries.inc Diff File
mod - src/dird/ua_cmds.c Diff File
mod - src/dird/ua_output.c Diff File
mod - src/dird/ua_select.c Diff File
mod - src/lib/output_formatter.c Diff File
mod - src/lib/output_formatter.h Diff File

bareos-17.2 697a4d05

2017-09-15 19:32

joergs

Ported: N/A

Details Diff		 Debian: bareos-config requires gawk

Make sure, it is installed.
mod - debian/control.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 3c8f2572

2017-09-15 01:32

joergs

Ported: N/A

Details Diff		 build fix (install-includes): remove reference to already removed file

The file waitq.h has been removed from the source, because it has not
been used. However, the Makefile still tried to install it.

Fixes 0000853: waitq.h blocks make install		 Affected Issues
0000853
mod - src/lib/Makefile.in Diff File

bareos-17.2 67736264

2017-09-13 23:31

joergs

Ported: N/A

Details Diff		 Adapt handling of configtemplatedir

This affects
bareos-config deploy_config
used by Debian/Ubuntu and MacOS X packages.

Debian has used configtemplatedir before, however using a different
approach.

Now you can specify two things using configure:

* configure --with-confdir=CONFIG_PATH
* where the Bareos programs will look for there configuration

* configure --with-configtemplatedir=INSTALL_PATH
* where "make install" will copy the configuration files (which can
also be templates)
* when not specified, it is set to confdir.

Calling

bareos-config deploy_config "INSTALL_PATH" "CONFIG_PATH" "COMPONENT"

eg.
bareos-config deploy_config "/usr/lib/bareos/defaultconfigs/" "/etc/bareos/" "bareos-fd"

will copy the configuration of COMPONENT from "INSTALL_PATH" to "CONFIG_PATH".
No files will be overwritten in "CONFIG_PATH", however, if new files
are added to e.g. /usr/lib/bareos/defaultconfigs/bareos-fd/*/*, these will
also copied to /etc/bareos/bareos-fd.d/ (same behavior as introduced
with bareos-16.2).
mod - autoconf/configure.in Diff File
mod - debian/bareos-bconsole.install.in Diff File
mod - debian/bareos-director.dirs Diff File
mod - debian/bareos-director.install.in Diff File
mod - debian/bareos-director.postinst.in Diff File
mod - debian/bareos-filedaemon-ceph-plugin.install.in Diff File
mod - debian/bareos-filedaemon-glusterfs-plugin.install.in Diff File
mod - debian/bareos-filedaemon-ldap-python-plugin.install.in Diff File
rm - debian/bareos-filedaemon.dirs Diff File
mod - debian/bareos-filedaemon.install.in Diff File
mod - debian/bareos-filedaemon.postinst.in Diff File
mod - debian/bareos-storage-ceph.install.in Diff File
mod - debian/bareos-storage-fifo.install.in Diff File
mod - debian/bareos-storage-glusterfs.install.in Diff File
mod - debian/bareos-storage-tape.install.in Diff File
mod - debian/bareos-storage.dirs Diff File
mod - debian/bareos-storage.install.in Diff File
mod - debian/bareos-storage.postinst.in Diff File
rm - debian/bareos-traymonitor.dirs Diff File
mod - debian/bareos-traymonitor.install.in Diff File
mod - debian/bareos-traymonitor.postinst.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File
rm - scripts/defaultconfig Diff File
mod - src/console/Makefile.in Diff File
mod - src/dird/Makefile.in Diff File
mod - src/filed/Makefile.in Diff File
mod - src/plugins/filed/Makefile.in Diff File
mod - src/qt-tray-monitor/tray-monitor.pro.in Diff File
mod - src/stored/Makefile.in Diff File
mod - src/stored/backends/Makefile.in Diff File

bareos-17.2 7382cc73

2017-09-11 11:14

joergs

Ported: N/A

Details Diff		 add descriptions to the SQL pooling directives
mod - src/dird/dird_conf.c Diff File

bareos-17.2 ed92e918

2017-09-11 11:14

joergs

Ported: N/A

Details Diff		 RPM: allow read access for all on /etc/bareos/

Originally, this has been restricted to prevent that Bareos Daemon passwords could be
read. However, this is not required as the relevant files and
subdirectories do contain restricted permissions theirselfs.
Also other distributions (Debian) did not have this restriction.
Removed this restriction to get access to
/etc/bareos/bareos-regress.conf for all users.
mod - platforms/packaging/bareos.spec Diff File

bareos-17.2 684ffa4b

2017-09-05 19:21

joergs

Ported: N/A

Details Diff		 bareos-config: fixes default value of DB_NAME
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 24fdf269

2017-09-03 21:20

joergs

Ported: N/A

Details Diff		 add MacOS standalone Makefile

The default Makefile for MacOS X has been different from the other
platforms, as it has been intended to be called directly.
We keep this as Makefile-standalone(.in), in case somebody like to use
it.
add - platforms/osx/Makefile-standalone.in Diff File

bareos-17.2 ce3189f2

2017-09-03 21:16

joergs

Ported: N/A

Details Diff		 typo
mod - manpages/bareos-fd.8 Diff File

bareos-17.2 9eea8c56

2017-09-02 17:33

joergs

Ported: N/A

Details Diff		 MacOS X: make bareos-client package working again

* cleanup the build process
* building is now done via a mac specific configure script:

platforms/osx/configure.sh
make -C platforms/osx/ pkg

* adapted pre- and postinstall scripts to current (>= MacOS 10.4) format
* reuse "bareos-config deploy_config" to deploy configuration files
* package configuration files are now stored at
/usr/local/lib/bareos/defaultconfigs/
and deployed to
/usr/local/etc/bareos/
if they do not already exists.
This prevents that they get overwritten on package updates.

Fixes 0000480: file daemon does not start due to missing /var/run/bareos/working		 Affected Issues
0000480
mod - autoconf/Make.common.in Diff File
mod - autoconf/configure.in Diff File
rm - platforms/darwin/Makefile.in Diff File
mod - platforms/osx/Makefile.in Diff File
mod - platforms/osx/README Diff File
add - platforms/osx/configure.sh Diff File
mod - platforms/osx/files/org.bareos.bareos-fd.plist.in Diff File
mod - platforms/osx/resources/ReadMe.html.in Diff File
rm - platforms/osx/resources/postflight.in Diff File
add - platforms/osx/resources/postinstall.in Diff File
add - platforms/osx/resources/preinstall.in Diff File
rm - platforms/osx/resources/preupgrade.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File
mod - src/console/Makefile.in Diff File
mod - src/dird/Makefile.in Diff File
mod - src/filed/Makefile.in Diff File
mod - src/stored/Makefile.in Diff File

bareos-17.2 a6872e72

2017-09-02 17:29

joergs

Ported: N/A

Details Diff		 fix compile settings for client-only

when enable-client-only is set,
set build_dird and build_stored to no.
mod - autoconf/configure.in Diff File

master 158c2892

2017-08-29 17:46

joergs

Ported: N/A

Details Diff		 Build: Bump version number
mod - configure Diff File
mod - src/include/version.h Diff File

master f310a4cf

2017-08-29 17:44

joergs

Ported: N/A

Details Diff		 NDMP_NATIVE: cleanup

Assign database schema version 2171 to Bareos >= 17.2.3.
Director Storage resource:
* Renamed the ChangerDevice directive to NdmpChangerDevice (for clarification)
* Removed the TapeDevice directive. Use Device instead.
Remove some unused code.
mod - src/cats/ddl/versions.map.in Diff File
mod - src/cats/postgresql.c Diff File
mod - src/cats/protos.h Diff File
mod - src/dird/dird_conf.c Diff File
mod - src/dird/dird_conf.h Diff File
mod - src/dird/ndmp_dma_backup_NDMP_BAREOS.c Diff File
mod - src/dird/ndmp_dma_backup_NDMP_NATIVE.c Diff File
mod - src/dird/ndmp_dma_backup_common.c Diff File
mod - src/dird/ndmp_dma_generic.c Diff File
mod - src/dird/ndmp_dma_restore_NDMP_BAREOS.c Diff File
mod - src/dird/ndmp_dma_restore_NDMP_NATIVE.c Diff File
mod - src/dird/ndmp_dma_restore_common.c Diff File
mod - src/dird/ndmp_dma_storage.c Diff File
mod - src/dird/ndmp_fhdb_common.c Diff File
mod - src/dird/ndmp_ndmmedia_db_helpers.c Diff File
mod - src/dird/protos.h Diff File
mod - src/dird/storage.c Diff File
 First  Prev  1 2 3 ... 60 ... 120 ... 180 ... 240 ... 300 ... 360 ... 420 ... 456 457 458 459 460 461 462 ... 480 ... 540 ... 600 ... 641 642 643  Next  Last