== How to maintain the portal == The portal was written by PML (adbe then later knpa) to provide GRIMM data collected by ARSF to end users. It was also a goal to have a way of displaying the data (currently instigated as 3D plot) and a way of searching for data within given geo-ordinates (works but needs major improvements). It is currently live and address is:[[BR]] http://arsf-dan.nerc.ac.uk/grimm/ To edit it, you need to ssh onto our web server as rsgadmin: (password on wiki)[[BR]] ssh rsgadmin@www The grimm files are located here:[[BR]] ~rsgadmin/arsf-dan.nerc.ac.uk/html/grimm Errors from the site will be logged here:[[BR]] ~rsgadmin/arsf-dan.nerc.ac.uk/logs/ knpa's stuff:[[BR]] ~knpa/grimm/ Ben Barrett has been giving feedback about the portal and would like to be kept in the loop:[[BR]] benjamin.barratt@kcl.ac.uk === Structure/Files === '''index.html''' - initial page with links to csv data (and plotting), area/time search tool, and this wiki '''cgi-bin/query_grimm_db.cgi''' - python cgi script that queries the postgres database for a supplied area/time and returns result '''data_list.php''' - page that displays the list of csv files that we have available '''data_search.html''' - the page that houses the time/area search tool '''data/''' - contains CSV data files that are graphed and can be downloaded, one per flight day '''scatter.php''' - page that houses the graph and allows you to download the csv '''scripts/scatter.js''' - javascript that generates the graph '''scripts/cavasXpress.min.js''' - javascript library used by above '''templates/''' - css file for formatting the appearance of the html pages '''lib/''' - contains libraries used by other scripts '''images/''' - contains images such as the NERC banner === The database === The area/time selection tool uses information from a postgres database. This database holds the same information as the CSV files, which were read in with the following script: ~knpa/grimm/input_file.csv The database is currently on knpa's machine (knpa to remember to change before he goes). I wrote down what I needed to do to create the database and configure it. In case this is needed again (you may need the command to restart it if the server goes down for example), this information is here:[[BR]] [wiki:settingUpPostgresDB How to set up an configure a postgres database] === Other scripts === Phil's script to create the CSV files in real time: A script I wrote to extract "vertical profiles" from the data: === Things to be fixed/improved === - Improve speed of area/date search - Return area/date search results in a way that can be easily downloaded - add 2010 and 2013/14 values to web portal. - 2d graph needed - example format of time is wrong (: vs -) - move database from knpa PC to a server - option to save graphs (png?) - get rid of minor marklines on axes? - allow plots of different particle sizes on same graph - different colours? - get data list page to look ok in non-chrome browser - improve interactivity of graph (less lag)