Changesets: bareos

Search Browse Back to Index

bareos-17.2 654b5759

2017-09-20 15:54

joergs

Ported: N/A

Details Diff		 Disabled use of SQL query 0065_bvfs_clear_cache_0

as MySQL does only support single SQL statements in a query.
Instead, implement this functionality in bvfs.c again.
mod - src/cats/bvfs.c Diff File
mod - src/cats/dml/0065_bvfs_clear_cache_0 Diff File
mod - src/cats/dml/README Diff File
mod - src/cats/mysql.c Diff File
mod - src/dird/ua_dotcmds.c Diff File

bareos-17.2 7321efb4

2017-09-20 13:03

joergs

Ported: N/A

Details Diff		 compile against openssl >= 1.1 if available

Before, workarounds to compile against openssl-1.0-compat libraries has
been added.
As Bareos has been adapted to work against newer openssl versions,
these workarounds are no longer required and hereby removed again.
mod - debian/control Diff File
mod - debian/control.in Diff File
mod - platforms/packaging/bareos.dsc Diff File
mod - platforms/packaging/bareos.spec Diff File

bareos-17.2 f4929da7

2017-09-20 02:03

stephand


Committer: joergs

Ported: N/A

Details Diff		 Fix .bvfs_lsdirs: Empty result for root node, performance enhanced

The underlying SQL query returned an empty result set for the root node,
when using .bvfs_lsdirs with the empty path argument, eg.
.bvfs_lsdirs jobid=23,45,48 path=
The SQL query was changed to fix this. It also performs better,
especially on MySQL/MariaDB, where it requires the following index:
CREATE INDEX PathId_JobId_FileIndex ON File (PathId, JobId, FileIndex);

The changed query also performs better on PostgreSQL. The following
partial index should be used on PostgreSQL:
CREATE INDEX file_jidpart_idx ON File(JobId) WHERE FileIndex = 0 AND Name = '';

For new installations these indexes will be created automatically, also
when upgrading from 16.x using the update_bareos_tables script.
mod - src/cats/ddl/creates/mysql.sql Diff File
mod - src/cats/ddl/updates/mysql.2004_2170.sql Diff File
mod - src/cats/dml/0064_bvfs_lsdirs_7 Diff File
mod - src/cats/mysql_queries.inc Diff File
mod - src/cats/postgresql_queries.inc Diff File
mod - src/cats/sqlite_queries.inc Diff File

bareos-17.2 4551c048

2017-09-18 16:19

joergs

Ported: N/A

Details Diff		 Merge branch 'bareos-16.2'
mod - debian/control.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 07d2a860

2017-09-18 15:53

joergs

Ported: N/A

Details Diff		 configure
mod - configure Diff File

bareos-17.2 3ea179f4

2017-09-18 14:54

frank

Ported: N/A

Details Diff		 Filter Framework and list command adjustments

This commit adjusts some parts of the filter-framework and the the (l)list
command in various contexts to have a solid base for a proper paging for
applications like webui using the JSON API. Also this commit introduces
a new counter variable, so we know how many rows have been filtered from our
original SQL result due to ACL settings.

- Adds count, limit and offset as additional and optional command arguments to
the (l)list command on our volume context.

- Adds count, limit and offset as additional and optional command arguments to
the (l)list command on our joblog context.

- In API 2 mode filtered, limit and offset are now attached as an key-value
pair object to the result object as a child, for additional information.

- A new query include file is introduced to count volumes/media

Example usage:
--------------

list volumes all count

list volumes pool=Incremental limit=10 offset=0

Example output:
---------------

{
"jsonrpc": "2.0",
"id": null,
"result": {
"volumes": [
{
"mediaid": "2",
"volumename": "Incremental-0002",
"volstatus": "Append",
"enabled": "1",
"volbytes": "182336976",
"volfiles": "0",
"volretention": "604800",
"recycle": "1",
"slot": "0",
"inchanger": "0",
"mediatype": "File",
"lastwritten": "2017-09-08 21:00:01",
"storage": "File"
},
{
"mediaid": "45",
"volumename": "Incremental-0045",
"volstatus": "Append",
"enabled": "1",
"volbytes": "222479",
"volfiles": "0",
"volretention": "604800",
"recycle": "1",
"slot": "0",
"inchanger": "0",
"mediatype": "File",
"lastwritten": "2017-09-15 21:00:04",
"storage": "File"
}
]
"meta": {
"range": {
"limit": 10,
"filtered": 0,
"offset": 0
}
}
}
}
mod - src/cats/bdb_query_enum_class.h Diff File
mod - src/cats/bdb_query_names.inc Diff File
mod - src/cats/cats.h Diff File
add - src/cats/dml/0067_list_volumes_count_0 Diff File
add - src/cats/dml/0068_list_volumes_by_name_count_1 Diff File
add - src/cats/dml/0069_list_volumes_by_poolid_count_1 Diff File
add - src/cats/dml/0070_list_joblog_2 Diff File
add - src/cats/dml/0071_list_joblog_count_1 Diff File
mod - src/cats/mysql_queries.inc Diff File
mod - src/cats/postgresql_queries.inc Diff File
mod - src/cats/sql_list.c Diff File
mod - src/cats/sqlite_queries.inc Diff File
mod - src/dird/ua_cmds.c Diff File
mod - src/dird/ua_output.c Diff File
mod - src/dird/ua_select.c Diff File
mod - src/lib/output_formatter.c Diff File
mod - src/lib/output_formatter.h Diff File

bareos-17.2 697a4d05

2017-09-15 19:32

joergs

Ported: N/A

Details Diff		 Debian: bareos-config requires gawk

Make sure, it is installed.
mod - debian/control.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 3c8f2572

2017-09-15 01:32

joergs

Ported: N/A

Details Diff		 build fix (install-includes): remove reference to already removed file

The file waitq.h has been removed from the source, because it has not
been used. However, the Makefile still tried to install it.

Fixes 0000853: waitq.h blocks make install		 Affected Issues
0000853
mod - src/lib/Makefile.in Diff File

bareos-17.2 67736264

2017-09-13 23:31

joergs

Ported: N/A

Details Diff		 Adapt handling of configtemplatedir

This affects
bareos-config deploy_config
used by Debian/Ubuntu and MacOS X packages.

Debian has used configtemplatedir before, however using a different
approach.

Now you can specify two things using configure:

* configure --with-confdir=CONFIG_PATH
* where the Bareos programs will look for there configuration

* configure --with-configtemplatedir=INSTALL_PATH
* where "make install" will copy the configuration files (which can
also be templates)
* when not specified, it is set to confdir.

Calling

bareos-config deploy_config "INSTALL_PATH" "CONFIG_PATH" "COMPONENT"

eg.
bareos-config deploy_config "/usr/lib/bareos/defaultconfigs/" "/etc/bareos/" "bareos-fd"

will copy the configuration of COMPONENT from "INSTALL_PATH" to "CONFIG_PATH".
No files will be overwritten in "CONFIG_PATH", however, if new files
are added to e.g. /usr/lib/bareos/defaultconfigs/bareos-fd/*/*, these will
also copied to /etc/bareos/bareos-fd.d/ (same behavior as introduced
with bareos-16.2).
mod - autoconf/configure.in Diff File
mod - debian/bareos-bconsole.install.in Diff File
mod - debian/bareos-director.dirs Diff File
mod - debian/bareos-director.install.in Diff File
mod - debian/bareos-director.postinst.in Diff File
mod - debian/bareos-filedaemon-ceph-plugin.install.in Diff File
mod - debian/bareos-filedaemon-glusterfs-plugin.install.in Diff File
mod - debian/bareos-filedaemon-ldap-python-plugin.install.in Diff File
rm - debian/bareos-filedaemon.dirs Diff File
mod - debian/bareos-filedaemon.install.in Diff File
mod - debian/bareos-filedaemon.postinst.in Diff File
mod - debian/bareos-storage-ceph.install.in Diff File
mod - debian/bareos-storage-fifo.install.in Diff File
mod - debian/bareos-storage-glusterfs.install.in Diff File
mod - debian/bareos-storage-tape.install.in Diff File
mod - debian/bareos-storage.dirs Diff File
mod - debian/bareos-storage.install.in Diff File
mod - debian/bareos-storage.postinst.in Diff File
rm - debian/bareos-traymonitor.dirs Diff File
mod - debian/bareos-traymonitor.install.in Diff File
mod - debian/bareos-traymonitor.postinst.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File
rm - scripts/defaultconfig Diff File
mod - src/console/Makefile.in Diff File
mod - src/dird/Makefile.in Diff File
mod - src/filed/Makefile.in Diff File
mod - src/plugins/filed/Makefile.in Diff File
mod - src/qt-tray-monitor/tray-monitor.pro.in Diff File
mod - src/stored/Makefile.in Diff File
mod - src/stored/backends/Makefile.in Diff File

bareos-17.2 7382cc73

2017-09-11 11:14

joergs

Ported: N/A

Details Diff		 add descriptions to the SQL pooling directives
mod - src/dird/dird_conf.c Diff File

bareos-17.2 ed92e918

2017-09-11 11:14

joergs

Ported: N/A

Details Diff		 RPM: allow read access for all on /etc/bareos/

Originally, this has been restricted to prevent that Bareos Daemon passwords could be
read. However, this is not required as the relevant files and
subdirectories do contain restricted permissions theirselfs.
Also other distributions (Debian) did not have this restriction.
Removed this restriction to get access to
/etc/bareos/bareos-regress.conf for all users.
mod - platforms/packaging/bareos.spec Diff File

bareos-17.2 684ffa4b

2017-09-05 19:21

joergs

Ported: N/A

Details Diff		 bareos-config: fixes default value of DB_NAME
mod - scripts/bareos-config-lib.sh.in Diff File

bareos-17.2 24fdf269

2017-09-03 21:20

joergs

Ported: N/A

Details Diff		 add MacOS standalone Makefile

The default Makefile for MacOS X has been different from the other
platforms, as it has been intended to be called directly.
We keep this as Makefile-standalone(.in), in case somebody like to use
it.
add - platforms/osx/Makefile-standalone.in Diff File

bareos-17.2 ce3189f2

2017-09-03 21:16

joergs

Ported: N/A

Details Diff		 typo
mod - manpages/bareos-fd.8 Diff File

bareos-17.2 9eea8c56

2017-09-02 17:33

joergs

Ported: N/A

Details Diff		 MacOS X: make bareos-client package working again

* cleanup the build process
* building is now done via a mac specific configure script:

platforms/osx/configure.sh
make -C platforms/osx/ pkg

* adapted pre- and postinstall scripts to current (>= MacOS 10.4) format
* reuse "bareos-config deploy_config" to deploy configuration files
* package configuration files are now stored at
/usr/local/lib/bareos/defaultconfigs/
and deployed to
/usr/local/etc/bareos/
if they do not already exists.
This prevents that they get overwritten on package updates.

Fixes 0000480: file daemon does not start due to missing /var/run/bareos/working		 Affected Issues
0000480
mod - autoconf/Make.common.in Diff File
mod - autoconf/configure.in Diff File
rm - platforms/darwin/Makefile.in Diff File
mod - platforms/osx/Makefile.in Diff File
mod - platforms/osx/README Diff File
add - platforms/osx/configure.sh Diff File
mod - platforms/osx/files/org.bareos.bareos-fd.plist.in Diff File
mod - platforms/osx/resources/ReadMe.html.in Diff File
rm - platforms/osx/resources/postflight.in Diff File
add - platforms/osx/resources/postinstall.in Diff File
add - platforms/osx/resources/preinstall.in Diff File
rm - platforms/osx/resources/preupgrade.in Diff File
mod - scripts/bareos-config-lib.sh.in Diff File
mod - src/console/Makefile.in Diff File
mod - src/dird/Makefile.in Diff File
mod - src/filed/Makefile.in Diff File
mod - src/stored/Makefile.in Diff File

bareos-17.2 a6872e72

2017-09-02 17:29

joergs

Ported: N/A

Details Diff		 fix compile settings for client-only

when enable-client-only is set,
set build_dird and build_stored to no.
mod - autoconf/configure.in Diff File

master 158c2892

2017-08-29 17:46

joergs

Ported: N/A

Details Diff		 Build: Bump version number
mod - configure Diff File
mod - src/include/version.h Diff File

master f310a4cf

2017-08-29 17:44

joergs

Ported: N/A

Details Diff		 NDMP_NATIVE: cleanup

Assign database schema version 2171 to Bareos >= 17.2.3.
Director Storage resource:
* Renamed the ChangerDevice directive to NdmpChangerDevice (for clarification)
* Removed the TapeDevice directive. Use Device instead.
Remove some unused code.
mod - src/cats/ddl/versions.map.in Diff File
mod - src/cats/postgresql.c Diff File
mod - src/cats/protos.h Diff File
mod - src/dird/dird_conf.c Diff File
mod - src/dird/dird_conf.h Diff File
mod - src/dird/ndmp_dma_backup_NDMP_BAREOS.c Diff File
mod - src/dird/ndmp_dma_backup_NDMP_NATIVE.c Diff File
mod - src/dird/ndmp_dma_backup_common.c Diff File
mod - src/dird/ndmp_dma_generic.c Diff File
mod - src/dird/ndmp_dma_restore_NDMP_BAREOS.c Diff File
mod - src/dird/ndmp_dma_restore_NDMP_NATIVE.c Diff File
mod - src/dird/ndmp_dma_restore_common.c Diff File
mod - src/dird/ndmp_dma_storage.c Diff File
mod - src/dird/ndmp_fhdb_common.c Diff File
mod - src/dird/ndmp_ndmmedia_db_helpers.c Diff File
mod - src/dird/protos.h Diff File
mod - src/dird/storage.c Diff File

bareos-17.2 751787aa

2017-08-24 18:24

frank


Committer: joergs

Ported: N/A

Details Diff		 Reset JobStatus to previous JobStatus in status SD and FD loops

We need to reset the JobStatus value to its previous after each storage or client status call,
otherwise if we receive an JS_Error for one storage or client, all the following status calls
will fail as well.

This could happen for example if a client or storage is offline but more status calls to other
clients and storages will follow in the loop.
mod - src/dird/ua_status.c Diff File

bareos-17.2 cb5d872e

2017-08-24 18:24

frank


Committer: stephand

Ported: N/A

Details Diff		 Reset JobStatus to previous JobStatus in status SD and FD loops

We need to reset the JobStatus value to its previous after each storage or client status call,
otherwise if we receive an JS_Error for one storage or client, all the following status calls
will fail as well.

This could happen for example if a client or storage is offline but more status calls to other
clients and storages will follow in the loop.

(cherry picked from commit 751787aa81c60b1003b3c75c1a0fc6d38eb967ee)
mod - src/dird/ua_status.c Diff File

bareos-16.2-droplet df757790

2017-08-24 18:24

frank


Committer: stephand

Ported: N/A

Details Diff		 Reset JobStatus to previous JobStatus in status SD and FD loops

We need to reset the JobStatus value to its previous after each storage or client status call,
otherwise if we receive an JS_Error for one storage or client, all the following status calls
will fail as well.

This could happen for example if a client or storage is offline but more status calls to other
clients and storages will follow in the loop.

(cherry picked from commit 751787aa81c60b1003b3c75c1a0fc6d38eb967ee)
mod - src/dird/ua_status.c Diff File

master 4947a833

2017-08-19 11:31

pstorz

Ported: N/A

Details Diff		 Merge branch 'bareos-16.2'
mod - src/lib/crypto_openssl.c Diff File

master 6d61cd27

2017-08-19 11:30

pstorz

Ported: N/A

Details Diff		 Fix warning: 'Digest::jcr' will be initialized after [-Wreorder]
mod - src/lib/crypto_openssl.c Diff File

master 7d517efc

2017-08-18 16:37

pstorz

Ported: N/A

Details Diff		 Merge branch 'bareos-16.2'
mod - AUTHORS Diff File
mod - src/dird/job.c Diff File
mod - src/lib/crypto_openssl.c Diff File
mod - src/lib/sha1.c Diff File
mod - src/lib/tls_openssl.c Diff File

master d31cd38e

2017-08-14 12:35

pstorz

Ported: N/A

Details Diff		 NDMP: add support for 2-way NDMP with DAR and DDAR

The current implementation of NDMP in Bareos has some limitations
because of the way it was implemented.

- The backup is always sent over the network from the Data Agent to the
Tape Agent (3-way NDMP)
- DAR(Direct Access Recovery) and DDAR (Directory DAR) are not supported,
single file restores are VERY slow as the whole backup stream needs to
be scanned during restore.

This commit adds support for 2-way NDMP backups inside of the Director.
During 2-way NDMP Backups, the Director is the only bareos daemon involved,
the Storage Daemon does not do anything in this setup.

To be able to do 2-way NDMP backups and to support DAR and DDAR, the
director
- controls the NDMP changer via NDMP Protocol.
- does the bookkeeping for the NDMP media.
- stores the full NDMP file information being sent during backups (FhInfo and FhNode)
in the catalog database.
- sends back the full NDMP file information during restore to enable DAR
and DDAR.

The advantage of the 2-way NDMP backups are:
- Much higher backup speed as the data goes directly from the disks to
the tape without going over the network.
- Much higher restore speed for single files/directories with DAR and
DDAR, as only the required blocks are read during restore instead of
restoring the whole backup stream and only restoring the required
data.

The following NDMP Protocol keywords are now available:

* NDMP : which is an alias for NDMP_BAREOS for backward compatibility
* NDMP_BAREOS: which is NDMP backups with paired storage and NDMP Tape
Agent inside of the Bareos Storage Daemon
* NDMP_NATIVE: this is doing NDMP backups with only the DMA inside of
the Bareos Director without any connection to the SD

These keywords reflect the two ways of NDMP that are now supported in
Bareos, which is either the special way of NDMP backups implemented in
Bareos before, or the "NATIVE" way to do NDMP backups.

To be able to store the FileHandle information for DAR and DDAR, the
File table how has two additional columns for FhInfo and FhNode.
The JobMedia table how has the additional column JobBytes which is used
to store NDMP media Information.

This column is planned to hold the JobBytes that are stored in the
corresponding JobMedia record.

The ndmp_dma_backup and ndmp_dma_restore files were split up for the two
different ways of NDMP backups that we have now.
mod - src/cats/cats.h Diff File
mod - src/cats/ddl/creates/mysql.sql Diff File
mod - src/cats/ddl/creates/postgresql.sql Diff File
mod - src/cats/ddl/creates/sqlite3.sql Diff File
mod - src/cats/ddl/updates/mysql.2004_2170.sql Diff File
add - src/cats/ddl/updates/mysql.2170_2171.sql Diff File
add - src/cats/ddl/updates/postgresql.2170_2171.sql Diff File
add - src/cats/ddl/updates/sqlite3.2170_2171.sql Diff File
mod - src/cats/dml/0034_select_recent_version_with_basejob Diff File
mod - src/cats/dml/0034_select_recent_version_with_basejob.postgresql Diff File
mod - src/cats/dml/0035_select_recent_version_with_basejob_and_delta Diff File
mod - src/cats/dml/0035_select_recent_version_with_basejob_and_delta.postgresql Diff File
mod - src/cats/dml/0036_select_recent_version Diff File
mod - src/cats/dml/0036_select_recent_version.postgresql Diff File
mod - src/cats/dml/0039_create_temp_new_basefile Diff File
mod - src/cats/dml/0039_create_temp_new_basefile.ingres Diff File
mod - src/cats/ingres.c Diff File
mod - src/cats/mysql.c Diff File
mod - src/cats/mysql_queries.inc Diff File
mod - src/cats/postgresql.c Diff File
mod - src/cats/postgresql_queries.inc Diff File
mod - src/cats/protos.h Diff File
mod - src/cats/sql_create.c Diff File
mod - src/cats/sql_get.c Diff File
mod - src/cats/sql_pooling.c Diff File
mod - src/cats/sqlite.c Diff File
mod - src/cats/sqlite_queries.inc Diff File
mod - src/dird/Makefile.in Diff File
mod - src/dird/backup.c Diff File
mod - src/dird/catreq.c Diff File
mod - src/dird/dird_conf.c Diff File
mod - src/dird/job.c Diff File
add - src/dird/ndmp_dma_backup_NDMP_NATIVE.c Diff File
add - src/dird/ndmp_dma_backup_common.c Diff File
mod - src/dird/ndmp_dma_generic.c Diff File
mod - src/dird/ndmp_dma_priv.h Diff File
add - src/dird/ndmp_dma_restore_NDMP_NATIVE.c Diff File
add - src/dird/ndmp_dma_restore_common.c Diff File
mod - src/dird/ndmp_dma_storage.c Diff File
mod - src/dird/ndmp_fhdb_common.c Diff File
mod - src/dird/ndmp_fhdb_helpers.c Diff File
mod - src/dird/ndmp_fhdb_lmdb.c Diff File
add - src/dird/ndmp_ndmmedia_db_helpers.c Diff File
mod - src/dird/protos.h Diff File
mod - src/dird/restore.c Diff File
mod - src/dird/storage.c Diff File
mod - src/dird/ua_restore.c Diff File
mod - src/dird/ua_tree.c Diff File
mod - src/include/jcr.h Diff File
mod - src/lib/tree.h Diff File
mod - src/ndmp/Makefile.in Diff File
mod - src/ndmp/ndma_comm_job.c Diff File
mod - src/ndmp/ndma_comm_session.c Diff File
mod - src/ndmp/ndma_control.c Diff File
mod - src/ndmp/ndma_cops_backreco.c Diff File
mod - src/ndmp/ndma_cops_robot.c Diff File
mod - src/ndmp/ndma_ctrl_media.c Diff File
mod - src/ndmp/ndma_ctrl_robot.c Diff File
mod - src/ndmp/ndma_data_fh.c Diff File
mod - src/ndmp/ndma_listmgmt.c Diff File
mod - src/ndmp/ndma_tape.c Diff File
mod - src/ndmp/ndmagents.h Diff File
mod - src/ndmp/ndmjob_args.c Diff File
mod - src/ndmp/ndmjob_main.c Diff File
mod - src/ndmp/ndmjob_simulator.c Diff File
mod - src/ndmp/ndml_chan.c Diff File
mod - src/ndmp/ndml_conn.c Diff File
mod - src/ndmp/ndmos.h Diff File
mod - src/ndmp/ndmp4_pp.c Diff File
mod - src/stored/bscan.c Diff File
mod - src/stored/bsr.c Diff File
mod - src/stored/dir_cmd.c Diff File
mod - src/stored/job.c Diff File
mod - src/win32/dird/Makefile Diff File
 First  Prev  1 2 3 ... 70 ... 140 ... 210 ... 280 ... 350 ... 420 ... 486 487 488 489 490 491 492 ... 560 ... 630 ... 671 672 673  Next  Last