View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0001422bareos-coreGeneralpublic2022-01-20 11:582024-05-15 15:49
Reporterniklas.skog Assigned Toarogge  
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionsuspended 
PlatformLinuxOSDebianOS Version11
Product Version21.0.0 
Summary0001422: Bareos Libcloud Plugin incompatibe
DescriptionGoal is: to do backups of S3-buckets using Bareos

Situation:

Installed the Bareos 21.0.0-4 and "bareos-filedaemon-libcloud-python-plugin" on Debian 11 from "https://download.bareos.org/bareos/release/21/Debian_11"

Installed the "python3-libcloud" package on which the Plugin "bareos-filedaemon-libcloud-python-plugin" depends.

Configured the plugin according https://docs.bareos.org/TasksAndConcepts/Plugins.html

Trying to start a job, that should backup the data from S3 and getting following error in bconsole output:
---
20-Jan 08:27 bareos-dir JobId 13: Connected Storage daemon at backup:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 bareos-dir JobId 13: Using Device "FileStorage" to write.
20-Jan 08:27 bareos-dir JobId 13: Connected Client: backup-fd at localhost:9102, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 bareos-dir JobId 13: Handshake: Immediate TLS
20-Jan 08:27 backup-fd JobId 13: Fatal error: python3-fd-mod: BareosFdPluginLibcloud [50986]: Need Python version < 3.8 for Bareos Libcloud (current version: 3.9.2)
20-Jan 08:27 backup-fd JobId 13: Connected Storage daemon at backup:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3
20-Jan 08:27 backup-fd JobId 13: Fatal error: TwoWayAuthenticate failed, because job was canceled.
20-Jan 08:27 backup-fd JobId 13: Fatal error: Failed to authenticate Storage daemon.
20-Jan 08:27 bareos-dir JobId 13: Fatal error: Bad response to Storage command: wanted 2000 OK storage
, got 2902 Bad storage
[...]
---

and the job fails.

Thus, main message:

"Fatal error: python3-fd-mod: BareosFdPluginLibcloud [50986]: Need Python version < 3.8 for Bareos Libcloud (current version: 3.9.2)"

which is understandable, because Debian 11 brings python3.9.*:

---
root@backup:/etc/bareos/bareos-dir.d/fileset# apt-cache policy python3
python3:
  Installed: 3.9.2-3
  Candidate: 3.9.2-3
  Version table:
 *** 3.9.2-3 500
        500 http://cdn-aws.deb.debian.org/debian bullseye/main amd64 Packages
        100 /var/lib/dpkg/status
root@backup:/etc/bareos/bareos-dir.d/fileset#
---


Accordingly, the plugin is incompatible with the current Debian version.
Steps To Reproduce* install stock debian 11
* install & configure bareos 21, "python3-libcloud" and "bareos-filedaemon-libcloud-python-plugin"
* configure the plugin according https://docs.bareos.org/TasksAndConcepts/Plugins.html
* try to run a job that is backing up an S3-bucket
* this will fail
Tagslibcloud, plugin, s3

Activities

arogge

arogge

2022-01-27 11:49

manager   ~0004487

You cannot use Python 3.9 or newer with python libcloud plugin due to a limitation in Python 3.9.
We're looking into this, but it isn't that easy to work around that limitation.
troloff

troloff

2023-11-14 15:42

reporter   ~0005513

Is there any progress in this issue?

As far as I can see, the last Debian version which brings a suitable Python is now oldoldstable with Debian 12 being released mid 2023. Would be nice to have a Ceph backup again, or a workaround.
arogge

arogge

2023-11-16 09:47

manager   ~0005517

I understand that this is frustrating, but we would have to rewrite most of the plugin due to Python deciding we cannot use multi-process in a subinterpreter anymore.
The workaround right now is to use a Bareos FD on RHEL 8, one of its clones or CentOS Stream 8. These will stay supported until 2029.
troloff

troloff

2023-11-16 10:59

reporter   ~0005518

Would it be possible to fund the redesign? If so, maybe you could contact me to discuss the details.
arogge

arogge

2023-11-20 11:16

manager   ~0005519

We're going to do an estimate and then look for co-funding. It will probably take a few days, but sales will be happy to get in touch with you.
arogge

arogge

2024-05-15 15:49

manager   ~0005943

We cannot fix this, we can only reimplement it differently and as of now there are no plans to do so. Sorry.

Issue History

Date Modified Username Field Change
2022-01-20 11:58 niklas.skog New Issue
2022-01-20 11:58 niklas.skog Tag Attached: libcloud
2022-01-20 11:58 niklas.skog Tag Attached: plugin
2022-01-20 11:58 niklas.skog Tag Attached: s3
2022-01-27 11:49 arogge Assigned To => arogge
2022-01-27 11:49 arogge Status new => confirmed
2022-01-27 11:49 arogge Note Added: 0004487
2023-11-14 15:42 troloff Note Added: 0005513
2023-11-16 09:47 arogge Note Added: 0005517
2023-11-16 10:59 troloff Note Added: 0005518
2023-11-20 11:16 arogge Note Added: 0005519
2024-05-15 15:49 arogge Status confirmed => closed
2024-05-15 15:49 arogge Resolution open => suspended
2024-05-15 15:49 arogge Note Added: 0005943