Project:LHS Graphs and Visualizations: Difference between revisions

From London Hackspace Wiki
No edit summary
m (→‎Metrics: Babbage deprecation)
 
(113 intermediate revisions by 10 users not shown)
Line 1: Line 1:
__NOTOC__ __NOEDITSECTION__
{{Project|members=[[User:Teabot|Elliot]]}}
{{Project|members=[[User:Teabot|Elliot]]}}
===Overview===
==Overview==
I'd like to supplement [http://hack.rs/cacti/graph_view.php?action=tree&tree_id=1 the Cacti graphs] that we have for LHS bandwidth and power with metrics that provide insight to the growth of our community and organisation over time.
I have supplemented [http://hack.rs/cacti/graph_view.php?action=tree&tree_id=1 the Cacti graphs] that we have for LHS bandwidth and power with [http://hack.rs/cacti/graph_view.php?action=tree&tree_id=5 metrics] that provide insight to the growth of our community and organisation over time.


To chart the metrics various bits of data are exposed in a Cacti friendly way.


Initially I'd like to chart the following:
==Metrics==
===Number of members===


* Number of members
We may have to wait 12 months before it becomes interesting.
* Mailing list activity
* Wiki activity
* Website visitors and/or page impressions


This data is stored in an Sqlite database on [[Turing]].  See the [https://github.com/londonhackspace/hackspace-foundation-sites/blob/master/etc/schema.sql Schema]. It can be queried like so:


Later I'd like to investigate:
  SELECT COUNT(id)
  FROM users
  WHERE subscribed = true;


* Space occupancy
Cacti runs on chomsky but the members database is on Turing. There is a PHP script on Turing to expose the member numbers and then a script on chomsky to pull this in with a HTTP request.


===Phase 1===
''Code:'' https://github.com/londonhackspace/monitoring
To chart the initial metrics various bits of data will need to be exposed in a Cacti friendly way. I need help in getting access to these data sources so that I can write the various data input methods.


=====Number of members=====
''URL:'' http://london.hackspace.org.uk/member_stats.php
* This data is presumably stored in a database and can be queried with a simple <tt>SELECT COUNT(ID) FROM ACCOUNTS</tt> or some such.
* It would be nice to import historic data into rrdtool for this one - perhaps by looking at the date of members first payments?  See the [https://github.com/londonhackspace/hackspace-foundation-sites/blob/master/etc/schema.sql Schema]


=====Mailing list activity=====  
===IRC statistics===
* There is no API for Google Groups. Instead we could set up a Google Groups member account for this purpose and then periodically check the inbox for activity?
''See project: [[Project:Ircensus|ircensus]]''


=====Wiki statistics=====
===Wiki statistics===
* I'm fairly certain we can get this using the MediaWiki API:
* We get this using the MediaWiki API:


   http://wiki.hackspace.org.uk/w/api.php?action=query&meta=siteinfo&siprop=statistics&format=xml
   http://wiki.hackspace.org.uk/w/api.php?action=query&meta=siteinfo&siprop=statistics&format=xml


Returns:
It returns:


   <?xml version="1.0"?>
   <?xml version="1.0"?>
Line 51: Line 49:
   </api>
   </api>


=====Website visitors and/or page impressions=====
* Do we have some kind of analytics tool we could use for this? Google Analytics has an API.


===Phase 2===
A Perl script generates the following output for cacti: '''<tt>pages:759 articles:215 views:229656 edits:7368 images:186 users:166 activeusers:22 admins:61 jobs:13</tt>'''


=====Space occupancy=====
''Code:'' https://github.com/londonhackspace/monitoring
* We could use a directional IR occupancy counter. I think that we already have something like this in the LHS stores.
 
===Mailing list activity===
 
* My thanks to JamesG for his assistance and '78.86.160.161' for the original idea. We poll and scrape the groups page for members and and message count.
 
  http://groups.google.com/group/london-hack-space
 
We have a script that outputs: '''<tt>members:693 messages:3123</tt>'''
 
''Code:'' https://github.com/londonhackspace/monitoring
 
===Space occupancy===
''See project: [[Project:Spacensus|spacensus]]''
 
[[Category:Projects]]
[[Category:Infrastructure]]
[[Category:Space_Infrastructure_Projects]]

Latest revision as of 11:52, 5 January 2016

LHS Graphs and Visualizations


Members Elliot
QR code

Overview

I have supplemented the Cacti graphs that we have for LHS bandwidth and power with metrics that provide insight to the growth of our community and organisation over time.

To chart the metrics various bits of data are exposed in a Cacti friendly way.

Metrics

Number of members

We may have to wait 12 months before it becomes interesting.

This data is stored in an Sqlite database on Turing. See the Schema. It can be queried like so: 

 SELECT COUNT(id)
 FROM users
 WHERE subscribed = true;

Cacti runs on chomsky but the members database is on Turing. There is a PHP script on Turing to expose the member numbers and then a script on chomsky to pull this in with a HTTP request.

Code: https://github.com/londonhackspace/monitoring

URL: http://london.hackspace.org.uk/member_stats.php

IRC statistics

See project: ircensus

Wiki statistics

  • We get this using the MediaWiki API:
 http://wiki.hackspace.org.uk/w/api.php?action=query&meta=siteinfo&siprop=statistics&format=xml

It returns: 

 <?xml version="1.0"?>
 <api>
   <query>
     <statistics
       pages="759"
       articles="215"
       views="229656"
       edits="7368"
       images="186"
       users="166"
       activeusers="22"
       admins="61"
       jobs="13"
     />
   </query>
 </api>


A Perl script generates the following output for cacti: pages:759 articles:215 views:229656 edits:7368 images:186 users:166 activeusers:22 admins:61 jobs:13

Code: https://github.com/londonhackspace/monitoring

Mailing list activity

  • My thanks to JamesG for his assistance and '78.86.160.161' for the original idea. We poll and scrape the groups page for members and and message count.
 http://groups.google.com/group/london-hack-space

We have a script that outputs: members:693 messages:3123

Code: https://github.com/londonhackspace/monitoring

Space occupancy

See project: spacensus

Retrieved from ‘https://wiki.london.hackspace.org.uk/w/index.php?title=Project:LHS_Graphs_and_Visualizations&oldid=48830’