View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0000033 | bareos-core | file daemon | public | 2013-01-10 10:50 | 2015-03-25 19:19 |
| Reporter | mvwieringen | Assigned To | |||
| Priority | normal | Severity | feature | Reproducibility | N/A |
| Status | closed | Resolution | fixed | ||
| Platform | OpenIndiana | OS | OpenIndiana | OS Version | b151a |
| Product Version | 13.1.0 | ||||
| Fixed in Version | 13.1.0 | ||||
| Summary | 0000033: Implementation of LZ4 and LZ4HC compression | ||||
| Description | Currently we support ZLIB based gzip compression and LZO2 compression. LZ4 and LZ4HC (High Compression) are like LZO2 but are much faster on decompression and are implemented as a single source file per compressor. | ||||
| Additional Information | As there are no libraries yet on the different platforms we will include the current source code in the BAREOS codebase (same as NDMP) and as we already support building native C shared libraries (also due to NDMP) we can easily support this extra compression without any external dependencies. | ||||
| Tags | No tags attached. | ||||
 |
First working prototype is ready using the liblzfast library which supports 3 compression protocols: - LZFAST - LZ4 - LZ4HC Next is a benchmark of the different compression methods on different file types and the compression rates vs cpu-time vs decompression speed etc. |
|
|
Fix committed to bareos master branch with changesetid 730. |
|
|
Fix committed to bareos2015 bareos-13.2 branch with changesetid 4286. |
|
|
Due to the reimport of the Github repository to bugs.bareos.org, the status of some tickets have been changed. These tickets will be closed again. Sorry for the noise. |
|
bareos: master 8ffc55fb 2013-05-04 21:11 Committer: Ported: N/A Details Diff |
Implementation of LZ4 and LZ4HC compression Currently we support ZLIB based gzip compression and LZO2 compression. LZ4 and LZ4HC (High Compression) are like LZO2 but are much faster on decompression and are implemented as a single source file per compressor. As we don't want to handle things like uncompressable data etc ourself we settled for a wrapper library which mimics the zlib API and supports the following compression algorithms: - FASTLZ - LZ4 - LZ4HC The library is available at https://github.com/exalead/fastlzlib and the few fixes needed to make it work with Bareos are currently in a pullrequest to the original project. For the period until the patches merge we have a clone under the bareos project on github. Fixes 0000033: Implementation of LZ4 and LZ4HC compression Signed-off-by: Marco van Wieringen <marco.van.wieringen@bareos.com> |
Affected Issues 0000033 |
|
| mod - src/stored/bextract.c | Diff File | ||
| mod - src/stored/Makefile.in | Diff File | ||
| mod - src/include/jcr.h | Diff File | ||
| mod - src/include/ch.h | Diff File | ||
| mod - src/findlib/match.c | Diff File | ||
| mod - src/filed/protos.h | Diff File | ||
| mod - src/filed/fileset.c | Diff File | ||
| mod - src/filed/compression.c | Diff File | ||
| mod - src/filed/backup.c | Diff File | ||
| mod - src/filed/Makefile.in | Diff File | ||
| mod - src/dird/inc_conf.c | Diff File | ||
| mod - autoconf/configure.in | Diff File | ||
|
bareos2015: bareos-13.2 3b76f022 2013-05-04 23:11 Committer: mvwieringen Ported: N/A Details Diff |
Implementation of LZ4 and LZ4HC compression Currently we support ZLIB based gzip compression and LZO2 compression. LZ4 and LZ4HC (High Compression) are like LZO2 but are much faster on decompression and are implemented as a single source file per compressor. As we don't want to handle things like uncompressable data etc ourself we settled for a wrapper library which mimics the zlib API and supports the following compression algorithms: - FASTLZ - LZ4 - LZ4HC The library is available at https://github.com/exalead/fastlzlib and the few fixes needed to make it work with Bareos are currently in a pullrequest to the original project. For the period until the patches merge we have a clone under the bareos project on github. Fixes 0000033: Implementation of LZ4 and LZ4HC compression Signed-off-by: Marco van Wieringen <marco.van.wieringen@bareos.com> |
Affected Issues 0000033 |
|
| mod - autoconf/configure.in | Diff File | ||
| mod - src/dird/inc_conf.c | Diff File | ||
| mod - src/filed/Makefile.in | Diff File | ||
| mod - src/filed/backup.c | Diff File | ||
| mod - src/filed/compression.c | Diff File | ||
| mod - src/filed/fileset.c | Diff File | ||
| mod - src/filed/protos.h | Diff File | ||
| mod - src/findlib/match.c | Diff File | ||
| mod - src/include/ch.h | Diff File | ||
| mod - src/include/jcr.h | Diff File | ||
| mod - src/stored/Makefile.in | Diff File | ||
| mod - src/stored/bextract.c | Diff File | ||
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2013-01-10 10:50 | mvwieringen | New Issue | |
| 2013-01-10 10:50 | mvwieringen | Status | new => assigned |
| 2013-01-10 10:50 | mvwieringen | Assigned To | => mvwieringen |
| 2013-02-13 19:08 | mvwieringen | Assigned To | mvwieringen => pstorz |
| 2013-02-26 19:34 | mvwieringen | Target Version | => 12.4.0 |
| 2013-02-26 19:34 | mvwieringen | Fixed in Version | => 12.4.0 |
| 2013-02-26 19:34 | mvwieringen | Assigned To | pstorz => |
| 2013-02-26 19:34 | mvwieringen | Status | assigned => new |
| 2013-03-04 09:57 | mvwieringen | Fixed in Version | 12.4.0 => 12.4.2 |
| 2013-03-04 09:57 | mvwieringen | Product Version | => 13.1.0 |
| 2013-03-04 09:57 | mvwieringen | Fixed in Version | => 13.1.0 |
| 2013-03-15 22:24 | mvwieringen | Assigned To | => pstorz |
| 2013-03-15 22:24 | mvwieringen | Status | new => assigned |
| 2013-03-17 16:33 | mvwieringen | Note Added: 0000277 | |
| 2013-03-18 17:26 | mvwieringen | Changeset attached | => bareos master 219e57d7 |
| 2013-03-18 17:26 | mvwieringen | Assigned To | pstorz => mvwieringen |
| 2013-03-18 17:26 | mvwieringen | Status | assigned => closed |
| 2013-03-18 17:26 | mvwieringen | Resolution | open => fixed |
| 2013-03-18 17:28 | mvwieringen | Assigned To | mvwieringen => |
| 2013-05-24 12:52 | pstorz | Assigned To | => pstorz |
| 2013-05-24 12:52 | pstorz | Status | closed => resolved |
| 2013-07-04 12:59 | pstorz | Status | resolved => closed |
| 2013-08-13 03:12 |
|
Changeset attached | => bareos master 8ffc55fb |
| 2013-08-13 03:12 |
|
Note Added: 0000603 | |
| 2013-08-13 03:12 |
|
Assigned To | pstorz => mvwieringen adm |
| 2013-08-13 03:12 |
|
Status | closed => resolved |
| 2013-08-13 09:18 |
|
Assigned To | mvwieringen adm => |
| 2013-08-13 09:18 |
|
Status | resolved => closed |
| 2015-03-25 16:51 | mvwieringen | Changeset attached | => bareos2015 bareos-13.2 3b76f022 |
| 2015-03-25 16:51 | mvwieringen | Note Added: 0001422 | |
| 2015-03-25 16:51 | mvwieringen | Status | closed => resolved |
| 2015-03-25 19:19 | joergs | Note Added: 0001579 | |
| 2015-03-25 19:19 | joergs | Status | resolved => closed |
