Changesets: bareos

master 638de766

2015-11-04 15:23

joergs

Ported: N/A

Details Diff
bcommand: add .jobstatus command
mod - src/cats/sql_cmds.c Diff File
mod - src/cats/sql_cmds.h Diff File
mod - src/dird/ua_cmds.c Diff File
mod - src/dird/ua_dotcmds.c Diff File

bareos-15.2 f15adf67

2015-11-03 00:12

mvwieringen

Ported: N/A

Details Diff
NDMP: Switch ndmplib to 2015 data types.

- u_short ==> uint16_t
- u_long ==> uint32_t
- int ==> int32_t
- unsigned long long ==> uint64_t
- long long ==> int64_t
- unsigned long ==> uint32_t
- unsigned short ==> uint16_t

For GCC we now disable the following warning:

-Wunused-variable
-Wunused-but-set-variable
-Wformat
-Wenum-compare

For the Solaris Studio compiler we now disable the following warnings:

- E_ENUM_TYPE_MISMATCH_OP
- E_ENUM_TYPE_MISMATCH_ARG
- E_STATEMENT_NOT_REACHED

Those warnings are not too interesting for this code as
we are not going to fix those problems anyway.

The original problem we encountered was the following:

In solaris, the xdrrec_putlong function has the following check:

if ((*lp > INT32_MAX) || (*lp < INT32_MIN))
return (FALSE);

As the NDMP code assumes everywhere that long is 4 bytes, but on LP64 it
is 8 bytes, we get the problem that this check triggers and we get
always false back. The LP64 gets enabled when compiling your code for
64 bits on at least SPARC. We didn't see this phenomenon on 64 bits
compiled code on X86 with the Solaris Studio compiler on Illumos.

We fix this problem by using XDR_GETINT32 and XDR_PUTINT32 on LP64,
instead of XDR_GETLONG and XDR_PUTLONG which handles 4 bytes and so
works as desired.

Signed-off-by: Philipp Storz <philipp.storz@bareos.com>
mod - src/ndmp/ndma_comm_dispatch.c Diff File
mod - src/ndmp/ndma_cops_backreco.c Diff File
mod - src/ndmp/ndma_cops_query.c Diff File
mod - src/ndmp/ndma_ctrl_calls.c Diff File
mod - src/ndmp/ndma_ctrl_media.c Diff File
mod - src/ndmp/ndma_ctst_mover.c Diff File
mod - src/ndmp/ndma_ctst_subr.c Diff File
mod - src/ndmp/ndma_ctst_tape.c Diff File
mod - src/ndmp/ndma_data.c Diff File
mod - src/ndmp/ndma_data_fh.c Diff File
mod - src/ndmp/ndma_listmgmt.c Diff File
mod - src/ndmp/ndma_noti_calls.c Diff File
mod - src/ndmp/ndma_tape.c Diff File
mod - src/ndmp/ndma_tape_simulator.c Diff File
mod - src/ndmp/ndmagents.h Diff File
mod - src/ndmp/ndmjob_simulator.c Diff File
mod - src/ndmp/ndml_chan.c Diff File
mod - src/ndmp/ndml_fhdb.c Diff File
mod - src/ndmp/ndml_log.c Diff File
mod - src/ndmp/ndml_media.c Diff File
mod - src/ndmp/ndmlib.h Diff File
mod - src/ndmp/ndmos.h Diff File
mod - src/ndmp/ndmos_common.c Diff File
mod - src/ndmp/ndmp0.x Diff File
mod - src/ndmp/ndmp2.x Diff File
mod - src/ndmp/ndmp2_translate.c Diff File
mod - src/ndmp/ndmp2_xmt.c Diff File
mod - src/ndmp/ndmp3.x Diff File
mod - src/ndmp/ndmp3_translate.c Diff File
mod - src/ndmp/ndmp3_xmt.c Diff File
mod - src/ndmp/ndmp4.x Diff File
mod - src/ndmp/ndmp4_translate.c Diff File
mod - src/ndmp/ndmp4_xmt.c Diff File
mod - src/ndmp/ndmp9.x Diff File
mod - src/ndmp/ndmp9_xmt.c Diff File
mod - src/ndmp/ndmp_msg_buf.h Diff File
mod - src/ndmp/ndmp_translate.c Diff File
mod - src/ndmp/ndmp_translate.h Diff File
mod - src/ndmp/smc.h Diff File
mod - src/ndmp/smc_raw.h Diff File
mod - src/ndmp/wraplib.c Diff File
mod - src/ndmp/wraplib.h Diff File
mod - src/stored/ndmp_tape.c Diff File

bareos-14.2 f4ad97c2

2015-11-03 00:12

mvwieringen

Ported: N/A

Details Diff
NDMP: Switch ndmplib to 2015 data types.

- u_short ==> uint16_t
- u_long ==> uint32_t
- int ==> int32_t
- unsigned long long ==> uint64_t
- long long ==> int64_t
- unsigned long ==> uint32_t
- unsigned short ==> uint16_t

For GCC we now disable the following warning:

-Wunused-variable
-Wunused-but-set-variable
-Wformat
-Wenum-compare

For the Solaris Studio compiler we now disable the following warnings:

- E_ENUM_TYPE_MISMATCH_OP
- E_ENUM_TYPE_MISMATCH_ARG
- E_STATEMENT_NOT_REACHED

Those warnings are not too interesting for this code as
we are not going to fix those problems anyway.

The original problem we encountered was the following:

In solaris, the xdrrec_putlong function has the following check:

if ((*lp > INT32_MAX) || (*lp < INT32_MIN))
return (FALSE);

As the NDMP code assumes everywhere that long is 4 bytes, but on LP64 it
is 8 bytes, we get the problem that this check triggers and we get
always false back. The LP64 gets enabled when compiling your code for
64 bits on at least SPARC. We didn't see this phenomenon on 64 bits
compiled code on X86 with the Solaris Studio compiler on Illumos.

We fix this problem by using XDR_GETINT32 and XDR_PUTINT32 on LP64,
instead of XDR_GETLONG and XDR_PUTLONG which handles 4 bytes and so
works as desired.

Signed-off-by: Philipp Storz <philipp.storz@bareos.com>
mod - src/ndmp/ndma_comm_dispatch.c Diff File
mod - src/ndmp/ndma_cops_backreco.c Diff File
mod - src/ndmp/ndma_cops_query.c Diff File
mod - src/ndmp/ndma_ctrl_calls.c Diff File
mod - src/ndmp/ndma_ctrl_media.c Diff File
mod - src/ndmp/ndma_ctst_mover.c Diff File
mod - src/ndmp/ndma_ctst_subr.c Diff File
mod - src/ndmp/ndma_ctst_tape.c Diff File
mod - src/ndmp/ndma_data.c Diff File
mod - src/ndmp/ndma_data_fh.c Diff File
mod - src/ndmp/ndma_listmgmt.c Diff File
mod - src/ndmp/ndma_noti_calls.c Diff File
mod - src/ndmp/ndma_tape.c Diff File
mod - src/ndmp/ndma_tape_simulator.c Diff File
mod - src/ndmp/ndmagents.h Diff File
mod - src/ndmp/ndmjob_simulator.c Diff File
mod - src/ndmp/ndml_chan.c Diff File
mod - src/ndmp/ndml_fhdb.c Diff File
mod - src/ndmp/ndml_log.c Diff File
mod - src/ndmp/ndml_media.c Diff File
mod - src/ndmp/ndmlib.h Diff File
mod - src/ndmp/ndmos.h Diff File
mod - src/ndmp/ndmos_common.c Diff File
mod - src/ndmp/ndmp0.x Diff File
mod - src/ndmp/ndmp2.x Diff File
mod - src/ndmp/ndmp2_translate.c Diff File
mod - src/ndmp/ndmp2_xmt.c Diff File
mod - src/ndmp/ndmp3.x Diff File
mod - src/ndmp/ndmp3_translate.c Diff File
mod - src/ndmp/ndmp3_xmt.c Diff File
mod - src/ndmp/ndmp4.x Diff File
mod - src/ndmp/ndmp4_translate.c Diff File
mod - src/ndmp/ndmp4_xmt.c Diff File
mod - src/ndmp/ndmp9.x Diff File
mod - src/ndmp/ndmp9_xmt.c Diff File
mod - src/ndmp/ndmp_msg_buf.h Diff File
mod - src/ndmp/ndmp_translate.c Diff File
mod - src/ndmp/ndmp_translate.h Diff File
mod - src/ndmp/smc.h Diff File
mod - src/ndmp/smc_raw.h Diff File
mod - src/ndmp/wraplib.c Diff File
mod - src/ndmp/wraplib.h Diff File
mod - src/stored/ndmp_tape.c Diff File

bareos-15.2 7c7148ff

2015-11-02 23:08

joergs


Committer: mvwieringen

Ported: N/A

Details Diff
bcommand: support compact json representation

By default, compact = false.
Using ".api json compact=true" can reduce the json result string by 1/3,
so it is adviced to use this whenever human readablity is not required.
mod - src/dird/ua_dotcmds.c Diff File
mod - src/dird/ua_output.c Diff File
mod - src/lib/output_formatter.c Diff File
mod - src/lib/output_formatter.h Diff File

master 8b379a2e

2015-11-02 17:20

Frank Bergkemper

Ported: N/A

Details Diff
JS: jqplot inclusion

Includes jqplot library only where it's needed.

Signed-off-by: Frank Bergkemper <frank.bergkemper@dass-it.de>
mod - module/Application/view/layout/layout.phtml Diff File
mod - module/Dashboard/view/dashboard/dashboard/index.phtml Diff File

bareos-15.2 abeab96d

2015-11-02 13:41

joergs


Committer: mvwieringen

Ported: N/A

Details Diff
bcommand: verify that result is send correctly

if not, in api 0 or 1, don't do output at all,
in api mode 2, send a json error message.
mod - src/dird/protos.h Diff File
mod - src/dird/ua_output.c Diff File
mod - src/lib/output_formatter.c Diff File
mod - src/lib/output_formatter.h Diff File

bareos-15.2 42ac8a11

2015-11-02 12:06

joergs


Committer: mvwieringen

Ported: N/A

Details Diff
bcommand: .api: get rid of a warning message
mod - src/dird/ua_dotcmds.c Diff File

bareos-15.2 d3168ac1

2015-11-02 11:59

joergs


Committer: mvwieringen

Ported: N/A

Details Diff
bcommand: json: fix memory leak
mod - src/lib/output_formatter.c Diff File

bareos-15.2 9b78b96b

2015-10-30 22:41

mvwieringen

Ported: N/A

Details Diff
NDMP: Add out of order meta data handling.

This uses an additional hash table when we receive the FHDB dir
information in a somewhat random order from the NDMP DATA Agent.
The NetApp NDMP implementation is known to do this semi random ordering.

We pre-allocate the nodes in the same way they are normally created them
but store them temporary in the hash table as a pointer to the node and
the node id of its parent. This way we use the tree alloc optimal.

When we start processing the actual node information we first look if
there is any out of order metadata captured in the hash table. If so we
do a linear walk of the hash table and recursivly create the missing
parent nodes until we can connect things to the existing tree. For
creating the parent node we hash lookup the parent node in the hash and
try inserting it into the tree. When we consume the node for a parent
node we set the pointer to the node to NULL in the hash table entry.
This way the linear walk knows we already visited this node and can skip
it.
Affected Issues
0000330
mod - src/dird/ndmp_fhdb_mem.c Diff File

bareos-14.2 c57f83f3

2015-10-30 22:41

mvwieringen

Ported: N/A

Details Diff
NDMP: Add out of order meta data handling.

This uses an additional hash table when we receive the FHDB dir
information in a somewhat random order from the NDMP DATA Agent.
The NetApp NDMP implementation is known to do this semi random ordering.

We pre-allocate the nodes in the same way they are normally created them
but store them temporary in the hash table as a pointer to the node and
the node id of its parent. This way we use the tree alloc optimal.

When we start processing the actual node information we first look if
there is any out of order metadata captured in the hash table. If so we
do a linear walk of the hash table and recursivly create the missing
parent nodes until we can connect things to the existing tree. For
creating the parent node we hash lookup the parent node in the hash and
try inserting it into the tree. When we consume the node for a parent
node we set the pointer to the node to NULL in the hash table entry.
This way the linear walk knows we already visited this node and can skip
it.
mod - src/dird/ndmp_fhdb_mem.c Diff File

master 0b34c5b3

2015-10-30 20:56

Joerg Steffens

Ported: N/A

Details Diff
added pool structure
mod - bareos/fuse/node/__init__.py Diff File
add - bareos/fuse/node/pool.py Diff File
add - bareos/fuse/node/pools.py Diff File
mod - bareos/fuse/root.py Diff File

master ccc5b9aa

2015-10-30 18:06

Joerg Steffens

Ported: N/A

Details Diff
optimize caching
mod - bareos/fuse/node/base.py Diff File
mod - bareos/fuse/node/directory.py Diff File
mod - bareos/fuse/node/job.py Diff File
mod - bareos/fuse/node/jobsname.py Diff File
mod - bareos/fuse/node/volume.py Diff File

master 2862ab10

2015-10-30 18:05

Joerg Steffens

Ported: N/A

Details Diff
bugfix for empty joblog entries
mod - bareos/fuse/node/joblog.py Diff File

master 2c08394d

2015-10-30 18:04

mvwieringen

Ported: N/A

Details Diff
Merge branch 'bareos-15.2'
mod - src/dird/dird_conf.c Diff File
mod - src/dird/job.c Diff File
mod - src/dird/migrate.c Diff File
mod - src/filed/fd_plugins.c Diff File
mod - src/findlib/attribs.c Diff File
mod - src/lib/compression.c Diff File
mod - src/lib/util.c Diff File
mod - src/lmdb/mdb.c Diff File
mod - src/stored/reserve.c Diff File

master 3e139af0

2015-10-30 17:02

Joerg Steffens

Ported: N/A

Details Diff
added .bareosfs.status.txt

show a list of objects in the bareosfs cache
mod - bareos/fuse/node/__init__.py Diff File
add - bareos/fuse/node/status.py Diff File
mod - bareos/fuse/root.py Diff File

bareos-15.2 3ed7a1da

2015-10-30 15:38

Philipp Storz


Committer: Marco van Wieringen

Ported: N/A

Details Diff
Unify *None* usage
mod - src/dird/dird_conf.c Diff File
mod - src/filed/fd_plugins.c Diff File
mod - src/findlib/attribs.c Diff File
mod - src/lib/compression.c Diff File
mod - src/lib/util.c Diff File
mod - src/stored/reserve.c Diff File

master 41b2c64e

2015-10-30 13:26

Joerg Steffens

Ported: N/A

Details Diff
various improvements, fixing a bug with volumestatus names

* reducing log messages
* reducing traffic on joblist stat
mod - bareos/bsock/lowlevel.py Diff File
mod - bareos/fuse/bareosfuse.py Diff File
mod - bareos/fuse/node/base.py Diff File
mod - bareos/fuse/node/bvfscommon.py Diff File
mod - bareos/fuse/node/bvfsdir.py Diff File
mod - bareos/fuse/node/client.py Diff File
mod - bareos/fuse/node/directory.py Diff File
mod - bareos/fuse/node/job.py Diff File
mod - bareos/fuse/node/jobslist.py Diff File
mod - bareos/fuse/node/volumestatus.py Diff File

master 94ff711c

2015-10-30 11:45

Joerg Steffens

Ported: N/A

Details Diff
fix database table description
mod - manuals/en/developers/catalog.md Diff File

bareos-15.2 bd1b2414

2015-10-30 09:49

mvwieringen

Ported: N/A

Details Diff
Sync lmdb.
mod - src/lmdb/mdb.c Diff File

master d6834534

2015-10-29 17:15

Philipp Storz

Ported: N/A

Details Diff
Add check for secure erase command reporting
mod - configs/secure-erase-test/bareos-dir.conf.in Diff File
mod - configs/secure-erase-test/bareos-fd.conf.in Diff File
mod - configs/secure-erase-test/bareos-sd.conf.in Diff File
mod - tests/secure-erase-test Diff File

master e9ae6dd2

2015-10-29 16:14

mvwieringen

Ported: N/A

Details Diff
Merge branch 'bareos-15.2'
mod - src/dird/Makefile.in Diff File
mod - src/win32/dird/Makefile Diff File

bareos-15.2 f61b5cc8

2015-10-29 16:12

mvwieringen

Ported: N/A

Details Diff
Fix windows build.
mod - src/dird/Makefile.in Diff File
mod - src/win32/dird/Makefile Diff File

master c0f249dc

2015-10-29 15:20

mvwieringen

Ported: N/A

Details Diff
Merge branch 'bareos-15.2'
mod - AUTHORS Diff File
mod - src/dird/Makefile.in Diff File
rm - src/dird/ndmp_dma.c Diff File
add - src/dird/ndmp_dma_backup.c Diff File
add - src/dird/ndmp_dma_generic.c Diff File
add - src/dird/ndmp_dma_priv.h Diff File
add - src/dird/ndmp_dma_restore.c Diff File
add - src/dird/ndmp_dma_storage.c Diff File
add - src/dird/ndmp_fhdb_helpers.c Diff File
add - src/dird/ndmp_fhdb_lmdb.c Diff File
add - src/dird/ndmp_fhdb_mem.c Diff File
mod - src/dird/protos.h Diff File
mod - src/ndmp/ndma_cops_labels.c Diff File
mod - src/ndmp/ndma_image_stream.c Diff File
mod - src/ndmp/ndma_robot_simulator.c Diff File
mod - src/ndmp/ndma_tape_simulator.c Diff File
mod - src/ndmp/ndmagents.h Diff File
mod - src/ndmp/ndmjob.h Diff File
mod - src/ndmp/ndmjob_main.c Diff File
mod - src/ndmp/ndmjob_simulator.c Diff File
mod - src/ndmp/ndml_fhdb.c Diff File
mod - src/ndmp/ndmlib.h Diff File
mod - src/ndmp/ndmos.h Diff File
mod - src/ndmp/ndmos_common.c Diff File
mod - src/stored/ndmp_tape.c Diff File
mod - src/win32/plugins/filed/mssqlvdi-fd.c Diff File

bareos-15.2 8ebd8908

2015-10-28 18:24

Zilvinas Krapavickas


Committer: mvwieringen

Ported: N/A

Details Diff
Allow backup/restore of MSSQL database with spaces in name

Signed-off-by: Marco van Wieringen <marco.van.wieringen@bareos.com>
mod - AUTHORS Diff File
mod - src/win32/plugins/filed/mssqlvdi-fd.c Diff File

bareos-14.2 698c4f6d

2015-10-28 18:24

Zilvinas Krapavickas


Committer: mvwieringen

Ported: N/A

Details Diff
Allow backup/restore of MSSQL database with spaces in name

Signed-off-by: Marco van Wieringen <marco.van.wieringen@bareos.com>
mod - AUTHORS Diff File
mod - src/win32/plugins/filed/mssqlvdi-fd.c Diff File
 First  Prev  1 2 3 ... 70 ... 140 ... 210 ... 280 ... 350 ... 420 ... 490 ... 538 539 540 541 542 543 544 ... 560 ... 630 ... 671 672 673  Next  Last