View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0001422bareos-coreGeneralpublic2022-01-20 11:582023-11-20 11:16
Reporterniklas.skog Assigned Toarogge  
PrioritynormalSeveritymajorReproducibilityalways
Status confirmedResolutionopen 
PlatformLinuxOSDebianOS Version11
Product Version21.0.0 
Summary0001422: Bareos Libcloud Plugin incompatibe
DescriptionGoal is: to do backups of S3-buckets using Bareos

Situation:

Installed the Bareos 21.0.0-4 and "bareos-filedaemon-libcloud-python-plugin" on Debian 11 from "https://download.bareos.org/bareos/release/21/Debian_11"

Installed the "python3-libcloud" package on which the Plugin "bareos-filedaemon-libcloud-python-plugin" depends.

Configured the plugin according https://docs.bareos.org/TasksAndConcepts/Plugins.html

Trying to start a job, that should backup the data from S3 and getting following error in bconsole output:
---
20-Jan 08:27 bareos-dir JobId 13: Connected Storage daemon at backup:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 bareos-dir JobId 13: Using Device "FileStorage" to write.
20-Jan 08:27 bareos-dir JobId 13: Connected Client: backup-fd at localhost:9102, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 bareos-dir JobId 13: Handshake: Immediate TLS
20-Jan 08:27 backup-fd JobId 13: Fatal error: python3-fd-mod: BareosFdPluginLibcloud [50986]: Need Python version < 3.8 for Bareos Libcloud (current version: 3.9.2)
20-Jan 08:27 backup-fd JobId 13: Connected Storage daemon at backup:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 backup-fd JobId 13: Fatal error: TwoWayAuthenticate failed, because job was canceled.
20-Jan 08:27 backup-fd JobId 13: Fatal error: Failed to authenticate Storage daemon.
20-Jan 08:27 bareos-dir JobId 13: Fatal error: Bad response to Storage command: wanted 2000 OK storage
, got 2902 Bad storage
[...]
---

and the job fails.

Thus, main message:

"Fatal error: python3-fd-mod: BareosFdPluginLibcloud [50986]: Need Python version < 3.8 for Bareos Libcloud (current version: 3.9.2)"

which is understandable, because Debian 11 brings python3.9.*:

---
root@backup:/etc/bareos/bareos-dir.d/fileset# apt-cache policy python3
python3:
  Installed: 3.9.2-3
  Candidate: 3.9.2-3
  Version table:
 *** 3.9.2-3 500
        500 http://cdn-aws.deb.debian.org/debian bullseye/main amd64 Packages
        100 /var/lib/dpkg/status
root@backup:/etc/bareos/bareos-dir.d/fileset#
---


Accordingly, the plugin is incompatible with the current Debian version.
Steps To Reproduce* install stock debian 11
* install & configure bareos 21, "python3-libcloud" and "bareos-filedaemon-libcloud-python-plugin"
* configure the plugin according https://docs.bareos.org/TasksAndConcepts/Plugins.html
* try to run a job that is backing up an S3-bucket
* this will fail
Tagslibcloud, plugin, s3

Activities

arogge

arogge

2022-01-27 11:49

manager   ~0004487

You cannot use Python 3.9 or newer with python libcloud plugin due to a limitation in Python 3.9.
We're looking into this, but it isn't that easy to work around that limitation.
troloff

troloff

2023-11-14 15:42

reporter   ~0005513

Is there any progress in this issue?

As far as I can see, the last Debian version which brings a suitable Python is now oldoldstable with Debian 12 being released mid 2023. Would be nice to have a Ceph backup again, or a workaround.
arogge

arogge

2023-11-16 09:47

manager   ~0005517

I understand that this is frustrating, but we would have to rewrite most of the plugin due to Python deciding we cannot use multi-process in a subinterpreter anymore.
The workaround right now is to use a Bareos FD on RHEL 8, one of its clones or CentOS Stream 8. These will stay supported until 2029.
troloff

troloff

2023-11-16 10:59

reporter   ~0005518

Would it be possible to fund the redesign? If so, maybe you could contact me to discuss the details.
arogge

arogge

2023-11-20 11:16

manager   ~0005519

We're going to do an estimate and then look for co-funding. It will probably take a few days, but sales will be happy to get in touch with you.

Issue History

Date Modified Username Field Change
2022-01-20 11:58 niklas.skog New Issue
2022-01-20 11:58 niklas.skog Tag Attached: libcloud
2022-01-20 11:58 niklas.skog Tag Attached: plugin
2022-01-20 11:58 niklas.skog Tag Attached: s3
2022-01-27 11:49 arogge Assigned To => arogge
2022-01-27 11:49 arogge Status new => confirmed
2022-01-27 11:49 arogge Note Added: 0004487
2023-11-14 15:42 troloff Note Added: 0005513
2023-11-16 09:47 arogge Note Added: 0005517
2023-11-16 10:59 troloff Note Added: 0005518
2023-11-20 11:16 arogge Note Added: 0005519