Skip to content

Latest commit

 

History

History
362 lines (265 loc) · 12.8 KB

infrastructure.md

File metadata and controls

362 lines (265 loc) · 12.8 KB

How the GRASS GIS Webserver and related infrastructure works

written by M. Neteler Last changed: July 2020

Related Wiki documents:

GRASS GIS Source code repository

Maintainer: Markus Neteler, Martin Landa, OSGeo-SAC, http://wiki.osgeo.org/wiki/SAC

Important update April 2019: The source code is now managed on GitHub (rather than in SVN).

The GitHub repositories are:

Git usage:

Issues:

Trac related notes:

  • For easier linking in the Trac Wiki, some macro definitions are used for manual page refs (G7:modulename)
  • ZIP file download support in trac (was needed for g.extension) * on trac.osgeo.org:
/var/www/trac/grass/conf/trac.ini
[browser]
downloadable_paths = /grass-addons/grass7/*/*,/sandbox/*/*

Statistics:

GRASS Web server

Maintainer: M. Neteler

Summary: The system should run almost autonomously.

WinGRASS maintenance scripts

GRASS Mailing lists

Maintainer: Markus Neteler

Available lists:

  • at OSGeo.org (https://lists.osgeo.org/mailman/listinfo):

    • grass-abm Integration of GRASS with JAVA based agent based modeling (ABM)
    • grass-announce GRASS announcements
    • grass-commit Mailing list to distribute GRASS-CVS commits
    • grass-dev GRASS GIS Development mailing list
    • grass-es La lista de correo de GRASS GIS en español
    • grass-psc GRASS-PSC: GRASS Project Steering Committee
    • grass-stats GRASS and statistical software
    • grass-translations Translation of GRASS (i18N)
    • grass-user GRASS user list
    • grass-web GRASS website mailing list

  • OLD, UNUSED: at FBK-irst (http://grass.fbk.eu/mailman/admin/):

    • grass-commit-addons Mailing list to distribute GRASS Addons-SVN commits
    • grass-gui GRASSGUI mailing list
    • grass-qa GRASS Quality Assessment and monitoring list
    • grass-windows winGRASS * Using GRASS on MS-Windows systems mailing list

Notes:

  • grass-announce:
    • moderated by M. Neteler
    • has monthly password reminder disabled to avoid leakage into publicly archived lists
  • grass-commit is receiving posts from the GRASS SVN at osgeo.org. Not open for other postings, they will be trashed automatically
  • grass-web is an open list (posting without subscription possible) with (Google) spam filter
    • moderated by M. Neteler to avoid spam
  • OLD, UNUSED: grass-qa is receiving posts from the GRASS Quality Control System at Ecole Polytechnique de Montreal, Canada. Not open for other postings.

GRASS Wiki

Maintainer: Martin Landa, Markus Neteler

Summary: The system should run almost autonomous. An eye must be be kept on people trying to spam the site

Macros for manual pages (src, cmd, API, ...):

GRASS IRC

Channel: irc://irc.freenode.net/grass Web based client: See https://grasswiki.osgeo.org/wiki/IRC

  • channel owner: Alessandro Frigeri < afrigeri unipg.it > ("geoalf")
  • quasi guru level: Markus Neteler ("markusN")
  • further operators:
    • Jachym ("jachym")
    • Luca ("doktoreas")
    • Soeren ("huhabla")
    • Brad ("bdouglas")

GRASS Bugtracker

Current bugtracker (Jan 2020 - today):

Old bugtracker (Jan 2008 - Jan 2020):

Old tracsvn (OSGeo server) (Dec 2007 * Mai 2019)

/var/www/trac/env/grass/conf/trac.ini
  downloadable_paths = /grass-addons/grass7/*/*,/sandbox/*/*
  path = /var/www/grass/htdocs
  link = <https://grass.osgeo.org/>
  src = site/grasslogo_vector_small.png
  smtp_always_cc = [email protected]
  smtp_replyto = [email protected]
  url = <https://grass.osgeo.org>
  .dir = /var/www/svn/repos/grass
  base_url = <https://trac.osgeo.org/grass/>
  database = postgres://postgres@/trac_grass

Very old bugtracker (Jan 2007 * Dec 2008):

Very very old bugtracker (Dec 2000 * Dec 2006):

  • https://intevation.de/rt/webrt?q_queue=grass
  • webRT, sponsored by Intevation GmbH, Germany
  • spamassasin spamfilter locally, bogofilter at grass-dev list
  • reports are directly sent to GRASS Developers mailing list for notification
  • TODO: migrate to trac

GRASS Addons

Maintainer: Martin Landa and Markus Neteler

Details:

The redirect to the latest grass7x directory is defined on grass.osgeo.org: /etc/apache2/includes/grass.osgeo.org.inc

Procedure building of binaries (Windows):

Procedure of granting write access to Addons repo:

XML file for g.extension: https://grass.osgeo.org/addons/grass7/modules.xml

  • generated in grass-addons/utils/addons/grass-addons-publish.sh

GRASS Travis CI

Maintainer: Martin Landa

Travis CI control files: trunk/.travis/ linux.before_install.sh linux.install.sh linux.script.sh

Maintenance script:

The github update is run as a cronjob on server "geo102" (CTU, CZ).

GRASS CI: GitHub Actions

Started Apr. 2020

Maintainer: Vaclav Petras

  • https://github.com/OSGeo/grass/actions

  • Details: OSGeo#525

  • CI workflow with:

    • A build job which is not parallelized and is meant for clear & relatively fast check of compilation and building in general. (Duplicating what is running on Travis)
    • A test job which of course needs to build, but the main focus is to run tests, so the compilation is parallelized (depending on nproc) and thus potentially less readable. This runs the whole test suite. (You need to run it locally to see the actual error, but you can see which tests are failing.)

  • Static code analysis/Code quality check using Flake8 with separate checks for python/grass, gui/wxpython, scripts and temporal directories.

    • Configurations ignore different lists of Flake8 errors. The idea is to reduce that to minimum.
    • Code in testsuite directories is also ignored for now, but should not be in the future.

Helper files placed to .github/workflows

GRASS Coverity Scan

Maintainer: Markus Neteler

Transifex translation management

i18N gettext messages:

OLD: GRASS Quality Control

Maintainer: Prof. Giulio Antoniol

Further notification/functionality test systems:

  • posts into #grass IRC channel
  • posts into #osgeo-commits IRC channel

Previous hosting sponsors

Since 2010 the GRASS GIS project is hosted at the Oregon State University Open Source Lab (OSUOSL), Oregon, USA

Numerous institutions have sponsored the GRASS Project with Hardware/Bandwidth (list of master site hosting):

  • 1997-1999: Institut fuer Landschaftspflege und Naturschutz (ILN), Universitaet Hannover, Germany
  • 1999-2001: Institut fuer Physische Geographie und Landschaftsoekologie, Universitaet Hannover, Germany
  • 2001-2008: ITC-irst, Trento, Italy
  • 2009-2010: Telascience.org at San Diego Supercomputer Center, California, USA
  • 2010-today: Oregon State University | Open Source Lab, USA