The RedHat Production Grade OSG Guide1 has a LOT of useful info. I’d strongly encourage you to take some time to look through it to familiarize yourself with the moving pieces.
There’s a LOT going on in there.
Do This on each node!
Create the privilege tokens
Add the newly minted auth tokens to the cluster
Using the admin keyring, add the newly minted tokens to the cluster.
Adding RADOSgw to /etc/services makes various systemic tools aware of the most likely use is, and displays the service in question when viewing nework connection states.
Adjusting Thread Cache Memory
The RH Guidance2 is to adjust Ceph’s TCMalloc setting to tune how much memory is allocated for ceph’s thread cache..
in RHEL/CentOS this is adjusted in /etc/sysconfig/ceph. However, ProxMox is based on Debian / Ubuntu The “default” config dir there is /etc/default/ as such the file to inspect is /etc/default/ceph.
When I looked, it was already set to what I believe to be an acceptable level:
Increase Systemic Limits
The RH Guidance3 is to increase the file descriptor limits for the ceph user in /etc/security/limits.conf:
Adjust ceph config file
Insert the following blob into the [global] section of /etc/ceph/ceph.conf:references:
Things I considered adjusting, but didn’t
I thought about setting these in the config file, but left them at their defaults (most of which undefined)
Appending this to /etc/ceph/ceph.conf is required in order to have RADCOS work
Installation and Service Enablement
Wahoo! ya did it! now lets go ahead and install the necessary packages an start the services!