Differences between revisions 61 and 89 (spanning 28 versions)
Revision 61 as of 2018-02-04 02:40:19
Size: 8248
Editor: roed
Comment:
Revision 89 as of 2022-04-23 00:18:54
Size: 7072
Editor: mkoeppe
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
Question mark means that the information is not confirmed, please edit if you know more. Question mark means that the information is not confirmed, please edit if you know more... and '''note the date of your update''' so that current and stale information can be distinguished.
Line 6: Line 6:
<<TableOfContents()>> [[PageOutline]]
Line 17: Line 17:
  * hosted at: [[Ohio State University|https://www.osu.edu/]]
  * technology used: ubuntu, nginx, uwsgi, postgesql, askbot
  * resources needed: database on a separate VM, 2GB RAM, 10GB disk
  * admin: niles, tmonteil, vdelecroix, slelievre, kcrisman, mhansen
  * hosted at: [[https://lipn.univ-paris13.fr/|LIPN (CS lab)]], University Paris North (Villetaneuse)
Line 22: Line 19:
  * local tech contact: David Alden   * url: https://ask.sagemath.org
  * admin: tmonteil
  * local sage dev: tmonteil
  * technology used: unprivileged LXC, debian, nginx, uwsgi, postgesql, askbot
  * issues : upgrade askbot to further versions is pretty painful (broken database migration scripts)
  * formerly hosted at: [[https://www.osu.edu/|Ohio State University]] (thanks !)
    * resources needed: database on a separate VM, 2GB RAM, 10GB disk
    * admin: niles, tmonteil
    * local tech contact: David Alden, Josh Carroll
    * technology used: ubuntu, nginx, uwsgi, postgesql, askbot
    * there are two machines : ask-sagemath and ask-sagemath-db
Line 26: Line 34:
  * hosted at: [[http://www.math.u-psud.fr/?lang=fr|Mathematics lab]], University Paris South (Orsay)
  * technology used: debian, rsync, rssh, rsnapshot
  * hosted at: [[https://www.math.u-psud.fr/?lang=fr|Mathematics lab]], Université Paris Sud (Orsay)
  * technology used: debian, rsync, cron
Line 32: Line 40:
  * currently keeping a daily backup of :
    * https://ask.sagemath.org
    * https://wiki.sagemath.org
Line 40: Line 52:
  * url: https://doc.sagemath.org https://planet.sagemath.org https://www.sagemath.org
Line 49: Line 62:
  * url: http://files.sagemath.org http://fileserver.sagemath.org http://old.files.sagemath.org
Line 52: Line 66:
  * hosted at: UW, going to move soon   * hosted at: google ?
Line 55: Line 69:
  * admin: people with root access: kclawson, ohanar, vbraun, mderickx, robertwb, wstein, tmonteil, dimpase   * admin: people with root access: kclawson, ohanar, vbraun, mderickx, robertwb, wstein, dimpase
Line 57: Line 71:
  * url: https://git.sagemath.org https://trac.sagemath.org
Line 59: Line 74:
  * url: http://github.com/sagemath   * url: https://github.com/sagemath
Line 61: Line 76:

== GitLab organization for SageMath ==

  * url: https://gitlab.com/sagemath
  * admin: embray, jrueth
Line 64: Line 84:
  * hosted at: ?UW?
  * technology used: ubuntu, nginx: see [[buildbot]] for more details
  * hosted at: University of Washington
  * technology used: ubuntu, nginx; using using the continuous integration framework of http://buildbot.net/
Line 69: Line 89:
  * url: http://build.sagemath.org
Line 72: Line 93:
  * hosted at: [[http://www-irma.u-strasbg.fr|IRMA]], Université de Strasbourg
  * technology used: ubuntu, nginx, uwsgi, flask, mongodb, see [[buildbot]] for more details
  * hosted at: [[https://irma.math.unistra.fr/|IRMA]], [[http://www.unistra.fr|Université de Strasbourg]]
  * technology used: ubuntu, nginx, uwsgi, flask, mongodb, see [[patchbot]] for more details
Line 81: Line 102:
  * url: https://patchbot.sagemath.org
Line 84: Line 106:
  * hosted at: UW   * hosted at: University of Washington
Line 92: Line 114:

== sageb0t ==
  * purpose: turn pull requests on !GitHub into trac tickets
  * contact: robertwb
  * url: http://rsync.sagemath.org
Line 101: Line 120:
    * [[http://www.uam.es|Universidad Autónoma de Madrid]] (Madrid, Spain)     * [[https://www.uam.es|Universidad Autónoma de Madrid]] (Madrid, Spain)
Line 110: Line 129:
  * available urls: http://aleph.sagemath.org, http://sagecell.sagemath.org   * available urls: http://aleph.sagemath.org, https://sagecell.sagemath.org

== wiki.sagemath.org ==
  * purpose: the wiki you are reading!
  * #33725: Migrate wiki.sagemath.org to trac.sagemath.org/wiki
  * hosted at: [[https://lipn.univ-paris13.fr/|LIPN (CS lab)]], University Paris North (Villetaneuse)
  * contact: sagemath-admins@googlegroups.com
  * url: https://wiki.sagemath.org
  * admin: tmonteil
  * local sage dev: tmonteil
  * technology used: unprivileged LXC, debian, nginx, certbot, uwsgi, moinmoin, jsmath, docutils
  * formerly hosted at: cloud.google.com
  * possible issue in migration: the database of user accounts is synced from trac when this latter is modified (incron)

== DockerHub organization ==
  * purpose: distribute SageMath Docker images
  * hosted at: https://hub.docker.com/u/sagemath/
  * admin: embray, jrueth
  * other: slelievre also has push access

= Defunct services =
Line 114: Line 153:
  * state: end of life, replaced by [[http://cloud.sagemath.com]]   * state: end of life; redirects to [[https://cocalc.com/|CoCalc]]
Line 117: Line 156:
== wiki.sagemath.org ==
  * purpose: the wiki you are reading!
  * hosted at: UW, going to move soon
  * technology used: ubuntu, apache, moinmoin
  * resources needed: ?CPU ?RAM ?DISK
  * admin: people with root access: kclawson, wstein, ohanar, mmarco, tmonteil, dimpase
  * contact: no real organisation yet, go to sage-devel
  * possible issue in migration: the database of user accounts is synced from trac when this latter is modified (incron)
== sageb0t ==
  * purpose: turn pull requests on !GitHub into trac tickets
  * contact: robertwb
Line 128: Line 162:
  * hosted at: cloud.google.com
  * resources needed: a dedicated VM with 2-4GB of RAM
  * admin: roed

== combinat.sagemath.org ==
  * purpose: ? (holds a copy of the mercurial patches of sage-combinat)
  * hosted at: UW ?
  * technology used: ?
  * resources needed: ?CPU ?RAM ?DISK
  * admin: people with root access: schilly?
  * contact: ?

= Planned services (wishlist) =

  * schilly: who wishes this and did define those purposes based on what discussion?
  * tmonteil: this is a ''wishlist'', not something collectively decided. Note however that almost nothing in the current framework was collectively discussed either.

== backup ==
  * purpose: backup between remote hosts, local backups can be destroyed
     * schilly: backup of what?
     * tmonteil: backup of the data of the services we maintain: ask, trac, git, wiki,... according to [https://groups.google.com/forum/#!msg/sage-devel/ed_ya-d-k_E/5csVA6wsCwAJ this] [http://comments.gmane.org/gmane.comp.mathematics.sage.devel/84894 post] there is currently no regular backup at all for those services (except ask, that benefits for a semi-automatic backup system), this is why i proposed to have a server dedicated to that, located in a different place than the other services.
     * we got a VM at [[https://www.math.u-psud.fr/|Orsay math department]] with 1TB of disk, we are currently setting it up, and use it for more and more services.

== stats ==
  * purpose: stop feeding google-analytics database
    * schilly: strong objection, we have a long time history stored there and it's far better than any other tools
    * tmonteil: i hope this long time history could be easily fetched in some open format, or does this mean that we locked ourselves there? (being locked would imply that this tool is among the worst)
    * tmonteil: better for who? for google and the NSA to which we currently provide all our visitors IPs? There is a serious privacy issue with such analytics saas tools.
  * public stats are here [[http://www.histats.com/viewstats/?SID=1579950&f=2]]
    * novoselt: horrific page - I thought such blinking adds are a thing of the past, had to close it before finding any data
    * tmonteil: note that free software alternative do exist

== lists ==
  * purpose: do not depend on googlegroups (see what happened with googleID on ask and sagenb)
     * schilly strong objection: what has this to do with google id?
     * tmonteil: googleID is an example of a service that was stopped by google, with strong consequences on our side (some people not able to connect anymore (e.g. on ask.sagemath.org), or not able to retrieve their work (e.g. on sagenb.org)). What will happen when google will decide that googlegroups will be shut down? Would we be able to discuss with them about this issue?
  * state: has been replaced by https://sagemath.zulipchat.com/

This page aims to keep information public about Sage's infrastructure. Question mark means that the information is not confirmed, please edit if you know more... and note the date of your update so that current and stale information can be distinguished.

Please mark which services still need to find a new home, with the system requirements and the deadline.

PageOutline

Current services

DNS

  • registrant: was
  • admin: was, schilly
  • tech contact: was, schilly

ask.sagemath.org

  • purpose: webserver where users can get support
  • hosted at: LIPN (CS lab), University Paris North (Villetaneuse)

  • contact: sage-askbot-admin@googlegroups.com

  • url: https://ask.sagemath.org

  • admin: tmonteil
  • local sage dev: tmonteil
  • technology used: unprivileged LXC, debian, nginx, uwsgi, postgesql, askbot
  • issues : upgrade askbot to further versions is pretty painful (broken database migration scripts)
  • formerly hosted at: Ohio State University (thanks !)

    • resources needed: database on a separate VM, 2GB RAM, 10GB disk
    • admin: niles, tmonteil
    • local tech contact: David Alden, Josh Carroll
    • technology used: ubuntu, nginx, uwsgi, postgesql, askbot
    • there are two machines : ask-sagemath and ask-sagemath-db

backup

  • purpose: keep the data of various services in a separate place
  • hosted at: Mathematics lab, Université Paris Sud (Orsay)

  • technology used: debian, rsync, cron
  • resources needed: 1TB disk
  • admin: tmonteil, slelievre
  • local sage dev: slelievre
  • local tech contact: Mathilde Rousseau
  • currently keeping a daily backup of :

doc.sagemath.org, planet.sagemath.org, www.sagemath.org

files.sagemath.org, fileserver.sagemath.org, old.files.sagemath.org

git.sagemath.org, trac.sagemath.org

  • purpose: development tools, they share the same host
  • hosted at: google ?
  • technology used: ubuntu, apache, git, trac
  • resources needed: ?CPU ?RAM ?DISK
  • admin: people with root access: kclawson, ohanar, vbraun, mderickx, robertwb, wstein, dimpase
  • contact: no real organisation yet, go to sage-devel
  • url: https://git.sagemath.org https://trac.sagemath.org

GitHub organization for SageMath

GitLab organization for SageMath

build.sagemath.org

  • purpose: distribute and gathers automatic binary building on volunteer's machines
  • hosted at: University of Washington
  • technology used: ubuntu, nginx; using using the continuous integration framework of http://buildbot.net/

  • resources needed: ?CPU ?RAM ?DISK
  • admin: ??
  • contact: ??
  • url: http://build.sagemath.org

patchbot.sagemath.org

rsync.sagemath.org

  • purpose: the seed for mirrors, see MirrorNetwork for more details

  • hosted at: University of Washington
  • technology used: rsync
  • resources needed:
    • CPU 1 core
    • RAM 2-3 GB (mostly for caching when calculating hashes)
    • DISK enough for all sage files (50+ GB)
  • admin: schilly
  • contact: schilly
  • url: http://rsync.sagemath.org

sagecell.sagemath.org

  • purpose: allow embedding sage computations within a webpage
  • hosted at:
  • technology used: production installation requires a dedicated server (either physical or virtual)
  • resources needed:
    • RAM: 32GB recommended for smooth operation, 16GB may become enough in the future
    • CPU: the more the better for handling spikes in load and allowing parallel interacts, but any will do if necessary
    • DISK: must have BTRFS at least for /var/lib/lxc, SSD is preferable, 100GB should be sufficient for the foreseeable future
  • admin: novoselt
  • contact: novoselt
  • available urls: http://aleph.sagemath.org, https://sagecell.sagemath.org

wiki.sagemath.org

  • purpose: the wiki you are reading!
  • #33725: Migrate wiki.sagemath.org to trac.sagemath.org/wiki
  • hosted at: LIPN (CS lab), University Paris North (Villetaneuse)

  • contact: sagemath-admins@googlegroups.com

  • url: https://wiki.sagemath.org

  • admin: tmonteil
  • local sage dev: tmonteil
  • technology used: unprivileged LXC, debian, nginx, certbot, uwsgi, moinmoin, jsmath, docutils
  • formerly hosted at: cloud.google.com
  • possible issue in migration: the database of user accounts is synced from trac when this latter is modified (incron)

DockerHub organization

Defunct services

sagenb.org

  • purpose: public notebook,
  • state: end of life; redirects to CoCalc

  • volunteers to provide worksheets back to the users: dimpase, tmonteil, vdelecroix

sageb0t

  • purpose: turn pull requests on GitHub into trac tickets

  • contact: robertwb

zulip.sagemath.org