Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
19e501b
fixing sigchld
gcmalloc Aug 10, 2015
ff767d3
fix interval not being configured
lloucas-imvu Oct 21, 2015
e66e72c
fix typo
cfz May 31, 2016
eb9de79
add new client_io_rate metics for Jewel
cfz Jun 15, 2016
7cf5edb
fixes to subprocess call on ceph monitor plugin
Jun 15, 2016
386f08e
fix permissions on ceph pool plugin
Jun 15, 2016
cf0a97b
fix logic in ceph latency plugin
Jun 15, 2016
a3880e7
register read callback after conf callback
cfz Jun 28, 2016
c9896d7
removed hardcoded bench pool
patchkez Jul 29, 2016
999f4a7
several fixes
patchkez Jul 29, 2016
fa02e8f
Move osd subprocess launch into base class
KrissN Aug 31, 2016
ffbf3c2
Try to use Python API for Rados if available
KrissN Aug 31, 2016
51f7817
Merge remote-tracking branch 'upstream/master'
gcmalloc Sep 21, 2016
4189c9f
fixing typos
gcmalloc Sep 21, 2016
57804d1
take the testpool for latency analysis from the testpool
gcmalloc Sep 21, 2016
ca047e7
fixing wrong class name
gcmalloc Sep 21, 2016
24b568c
Merge pull request #1 from cfz/master
grinapo Oct 26, 2016
a549e47
Merge branch 'master' of git://github.com/patchkez/collectd-ceph into…
Oct 26, 2016
9c5c954
Merge branch 'patchkez-master'
Oct 26, 2016
e4daddf
Merge branch 'master' of git://github.com/gcmalloc/collectd-ceph into…
Oct 26, 2016
b433133
Merge branch 'gcmalloc-master'
Oct 26, 2016
1a066fb
Merge branch 'master' of git://github.com/KrissN/collectd-ceph into K…
Oct 26, 2016
6da83a3
Merge branch 'KrissN-master'
Oct 26, 2016
04e9ed0
Merge branch 'master' of git://github.com/lloucas-imvu/collectd-ceph …
Oct 26, 2016
f05dc70
Merge branch 'lloucas-imvu-master'
Oct 26, 2016
04e7ea2
Add client name to base.py (to be able to change the default 'client.…
Oct 26, 2016
621f771
Fix mind slip in ceph_pool_plugin.py (this is not shell but librados)
Oct 26, 2016
c17389e
Insert some disclaimer
grinapo Oct 26, 2016
da26381
update debian files and add ubuntu doc
Oct 26, 2016
01126f3
Merge branch 'catalyst-master'
Oct 26, 2016
21e3cf9
Merge branch 'master' of github.com:grinapo/collectd-ceph
Oct 26, 2016
068f13e
update changelog
grinapo Oct 27, 2016
019e6aa
Merge commit 'cf0a97b'
Nov 2, 2016
d2a2cfa
Fixing ceph_monitor_plugin: the beauty of multi-source multi-merging:…
Nov 2, 2016
1acb63c
Remove unnecessary 'shlex' lib from ceph_monitor_plugin
Nov 2, 2016
5d6a615
ceph_latency_plugin in ms, not sec
Nov 2, 2016
b1c19f5
Fix magniture calculation in ceph_latency_plugin
Nov 2, 2016
8178d96
fix rados bench ouput parsing
y4ns0l0 Nov 8, 2016
a872930
Merge pull request #8 from y4ns0l0/master
grinapo Nov 8, 2016
ce3d177
Improve grafana dashboard
y4ns0l0 Nov 9, 2016
5274a74
Merge pull request #9 from y4ns0l0/master
grinapo Nov 9, 2016
d7deebb
fix pools throughput rows
y4ns0l0 Nov 9, 2016
8294b07
change docker depot
y4ns0l0 Nov 9, 2016
6ac5158
fix pools throughput rows
y4ns0l0 Nov 9, 2016
56ecd1f
fix pools throughput rows
y4ns0l0 Nov 9, 2016
71bbaa3
fix pools throughput rows
y4ns0l0 Nov 9, 2016
f0527c3
Merge pull request #10 from y4ns0l0/master
grinapo Nov 9, 2016
5024baa
ceph_latency_plugin: suport yet another rados bench format. This is a
Nov 25, 2016
d47b876
Fix rados bench command parsing for previous ceph versions
y4ns0l0 Nov 30, 2016
ec6b6f2
Fix rados bench command parsing for previous ceph versions
y4ns0l0 Nov 30, 2016
d1efbac
Fix rados bench command parsing for previous ceph versions
y4ns0l0 Nov 30, 2016
51b23a6
Merge branch 'master' of https://github.com/y4ns0l0/collectd-ceph
y4ns0l0 Nov 30, 2016
d19e7af
Merge pull request #13 from y4ns0l0/master
grinapo Nov 30, 2016
fbe3ce6
Added lookup for a specific pool max avail bytes
Kallio Dec 2, 2016
3b353dc
Merge pull request #14 from Kallio/patch-1
grinapo Dec 3, 2016
c2bf3f7
Tickets and issues were going to old direction
Kallio Dec 13, 2016
bee54d6
Merge pull request #17 from Kallio/patch-2
grinapo Dec 20, 2016
60189f8
Document the format of my 'rados' output
Dec 20, 2016
68999ff
Merge branch 'master' of github.com:grinapo/collectd-ceph
Dec 20, 2016
8d39ec8
Update README with recent contributors
Dec 20, 2016
8f8b5f0
{
y4ns0l0 Dec 20, 2016
889534a
More effective drawing *_latency
y4ns0l0 Dec 20, 2016
d638a30
Merge pull request #18 from y4ns0l0/master
grinapo Dec 20, 2016
8d1e659
Add some usefull capacity pool info
y4ns0l0 Dec 21, 2016
a16c444
Add some usefull capacity pool info
y4ns0l0 Dec 22, 2016
370ca99
Add new dashborad
y4ns0l0 Dec 22, 2016
4e4edd5
Merge pull request #19 from y4ns0l0/master
grinapo Dec 22, 2016
c4fba6c
ceph_pg_plugin: recent ceph (luminous) uses different name for perfor…
grinapo Aug 16, 2017
1ff7b35
ceph_latency_plugin: raise timeout from 30s to 60s as cleanup may tak…
grinapo Aug 16, 2017
84ca651
Updated ceph_pg_plugin to handle new format from luminous (as well as…
grinapo Aug 15, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
53 changes: 45 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,15 @@
This is a fork of rochaporto's version, which seems to have been abandoned
around 2015, with plenty of bugs and pull requests lying around. I have tried
to incorporate most of the outstanding pulls and some of the interesting looking
but not overly conflicting forks.

If __you__ have a clean pull request I will eventually try to merge in. I don't
promise to fix issues but if anyone do I'll merge it.

I don't really want to maintain this but I don't want to let it lying bug-ridden,
I want to use it.


collectd-ceph
==================

Expand All @@ -7,13 +19,21 @@ A set of collectd plugins monitoring and publishing metrics for Ceph components.

## Screenshots

Sample Grafana dashboard displaying common metrics from the plugins.
Sample __Ceph Overview__ dashboard displaying common metrics from the plugins.

![image](public/ceph-overview.png)

![image](public/ceph-overview1.png)

![image](public/ceph-overview2.png)

Sample __Ceph Pool Capacity__ dashboard, if you are using pool quota this sample may be usefull.

![image](https://raw.github.com/rochaporto/collectd-ceph/master/public/ceph-overview.png)
![image](public/ceph-pool-capacity.png)

![image](https://raw.github.com/rochaporto/collectd-ceph/master/public/ceph-dash2.png)
[Check here](grafana/ceph-overview.json) for the __Ceph Overview__ dashboard definition.

[Check here](grafana/ceph-overview.json) for the dashboard definition.
[Check here](grafana/ceph-pool-capacity.json) for the __Ceph Pool Capacity__ dashboard definition.

## Plugins and Metrics

Expand All @@ -30,12 +50,22 @@ Find below a list of the available plugins and the metrics they publish.
* ceph-<cluster>.osd.gauge.in (number of osds 'in')
* ceph-<cluster>.osd.gauge.out (number of osds 'out')
* ceph_pool_plugin
* ceph-<cluster>.pool-<name>.gauge.size (per pool size)
* ceph-<cluster>.pool-<name>.gauge.min_size (per pool min_size)
* ceph-<cluster>.pool-<name>.gauge.pg_num (per pool pg_num)
* ceph-<cluster>.pool-<name>.gauge.pgp_num (per pool pg_placement_num)
* ceph-<cluster>.pool-<name>.gauge.quota_max_bytes (per pool quota_max_bytes)
* ceph-<cluster>.pool-<name>.gauge.quota_max_objects (per pool quota_max_objects)
* ceph-<cluster>.pool-<name>.gauge.max_avail (per pool max_available)
* ceph-<cluster>.pool-<name>.gauge.objects (per pool objects number)
* ceph-<cluster>.pool-<name>.gauge.objects (per pool objects number)
* ceph-<cluster>.pool-<name>.gauge.read_bytes_sec (per pool read bytes/sec)
* ceph-<cluster>.pool-<name>.gauge.write_bytes_sec (per pool write bytes/sec)
* ceph-<cluster>.pool-<name>.gauge.op_per_sec (per pool iops)
* ceph-<cluster>.pool-<name>.gauge.bytes_used (per pool bytes used)
* ceph-<cluster>.pool-<name>.gauge.kb_used (per pool KBytes used)
* ceph-<cluster>.pool-<name>.gauge.objects (per pool number of objects)
min_size
* ceph-<cluster>.cluster.gauge.total_avail (cluster space available)
* ceph-<cluster>.cluster.gauge.total_space (cluster total raw space)
* ceph-<cluster>.cluster.gauge.total_used (cluster raw space used)
Expand All @@ -55,7 +85,8 @@ Find below a list of the available plugins and the metrics they publish.

It assumes an existing installation of [collectd](http://collectd.org/documentation.shtml) - check docs for details.

If you want to publish to [graphite](http://graphite.readthedocs.org/), configure the [write_graphite](https://collectd.org/wiki/index.php/Plugin:Write_Graphite) collectd plugin.
If you want to publish to [graphite](http://graphite.readthedocs.org/), configure
the [write_graphite](https://collectd.org/wiki/index.php/Plugin:Write_Graphite) collectd plugin.

And you might want the awesome [grafana](http://grafana.org) too, which provides awesome displays.

Expand Down Expand Up @@ -108,7 +139,7 @@ It has plenty of docs on how to use it, but for our specific plugins:

### Docker

Check [this repo](https://github.com/bobrik/ceph-collectd-graphite) for a nice docker setup to run collectd-ceph (thanks to Ian Babrou).
Check [this repo](https://github.com/y4ns0l0/ceph-collectd-graphite) for a nice docker setup to run collectd-ceph (thanks to Ian Babrou).

## Limitations

Expand All @@ -124,11 +155,17 @@ GPLv2 (check LICENSE).

## Contributors

Ricardo Rocha <rocha.porto@gmail.com>
* Ricardo Rocha <rocha.porto@gmail.com> - original author
* [Peter Gervai (grinapo) - merge maintainer](https://github.com/grinapo)
* [Yann Matysiak (y4ns0l0)](https://github.com/y4ns0l0)
* [Pietari Hyvärinen (kallio)](https://github.com/kallio)
* [gcmalloc](https://github.com/gcmalloc)
* [cfz](https://github.com/cfz)
* [tynorth-cisco](https://github.com/tynorth-cisco)

## Support

Please log tickets and issues at the [github home](https://github.com/rochaporto/collectd-ceph/issues).
Please log tickets and issues at the [github home](https://github.com/grinapo/collectd-ceph/issues).

## Additional Notes

Expand Down
13 changes: 13 additions & 0 deletions debian/changelog
Original file line number Diff line number Diff line change
@@ -1,3 +1,16 @@
collectd-ceph (0.5.1-1) jessie; urgency=medium

* Fro the original non-active head and merge various
3rd party fixes.

-- Peter Gervai <grin@grin.hu> Thu, Oct 27 2016 08:57:58 +0200

collectd-ceph (0.5.0-1ubuntu1) precise; urgency=medium

* Merge pull request for Giant support

-- Xav Paice <xav@catalyst.net.nz> Tue, 09 Dec 2014 15:51:23 +1300

collectd-ceph (0.4.0-1ubuntu1) precise; urgency=low

* Added osd latency metrics and usage
Expand Down
11 changes: 6 additions & 5 deletions docs/ubuntu.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,18 +11,19 @@ pbuilder-dist precise create

and for every release (from master):
```
RELEASE=0.2.0
rm -rf /tmp/build-collectd
mkdir /tmp/build-collectd
cd /tmp/build-collectd
wget https://github.com/rochaporto/collectd-ceph/archive/master.zip
wget https://github.com/catalyst/collectd-ceph/archive/master.zip
unzip master.zip
tar zcvf collectd-ceph-0.2.0.tar.gz collectd-ceph-master/
bzr dh-make collectd-ceph 0.2.0 collectd-ceph-0.2.0.tar.gz
tar zcvf collectd-ceph-${RELEASE}.tar.gz collectd-ceph-master/
bzr dh-make collectd-ceph ${RELEASE} collectd-ceph-${RELEASE}.tar.gz
cd collectd-ceph
bzr builddeb -S
cd ../build-area
pbuilder-dist precise build collectd-ceph_0.2.0-1ubuntu1.dsc
dput ppa:rocha-porto/collectd ../collectd-ceph_0.2.0-1ubuntu1_source.changes
pbuilder-dist precise build collectd-ceph_${RELEASE}-1ubuntu1.dsc
dput ppa:rocha-porto/collectd ../collectd-ceph_${RELEASE}-1ubuntu1_source.changes
```

## Rebuilding a newer collectd version for precise
Expand Down
Loading