Differences between revisions 57 and 151 (spanning 94 versions)
Revision 57 as of 2021-12-18 23:23:50
Size: 16877
Editor: mkoeppe
Comment: package upgrades
Revision 151 as of 2024-08-20 06:19:57
Size: 0
Editor: mkoeppe
Comment: migrated to https://github.com/sagemath/sage/releases/tag/9.5
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Sage 9.5 Release Tour =

current development cycle (2021)

<<TableOfContents>>


== Symbolics ==

=== Changes to symbolic expressions ===

 * `symbolic_expression` is now able to create vectors and matrices of symbolic expressions for more general inputs. [[https://trac.sagemath.org/ticket/16761|#16761]]

  For example, if the input is a list or tuple of lists/tuples/vectors:
   {{{
sage: M = symbolic_expression([[1, x, x^2], (x, x^2, x^3), vector([x^2, x^3, x^4])]); M
[ 1 x x^2]
[ x x^2 x^3]
[x^2 x^3 x^4]
sage: M.parent()
Full MatrixSpace of 3 by 3 dense matrices over Symbolic Ring
}}}


 * Symbolic expressions can no longer be called with positional arguments. [[https://trac.sagemath.org/ticket/14270|#14270]]

   This was deprecated since Sage 4.0, although a bug prevented the deprecation warning from being issued in Sage versions 8.4 to 9.3. [[https://trac.sagemath.org/ticket/32139|#32319]]

   Instead of `(x+1)(2)`, write either `(x+1)(x=2)`, or `(x+1).subs(x=2)`, or `((x+1).function(x))(2)`.

=== Interface to Mathics, a free implementation of the Wolfram language ===

Sage now has an optional package providing [[https://mathics.org/|Mathics]], a free (open-source) general-purpose computer algebra system featuring Mathematica-compatible syntax and functions, and an interface to it.[[https://trac.sagemath.org/ticket/31778|#31778]]


== Linear Algebra ==


== Manifolds ==


== Number theory ==

 * Logarithms modulo composite integers are now dramatically faster in some important cases (such as prime-power moduli). [[https://trac.sagemath.org/ticket/32375|#32375]]
 * Logarithms in binary finite fields now use index calculus instead of generic-group algorithms when appropriate (via PARI's [[https://pari.math.u-bordeaux.fr/dochtml/html/Arithmetic_functions.html#se:fflog|fflog()]]). [[https://trac.sagemath.org/ticket/32842|#32842]]
 * Binary quadratic forms' [[https://doc.sagemath.org/html/en/reference/quadratic_forms/sage/quadratic_forms/binary_qf.html#sage.quadratic_forms.binary_qf.BinaryQF.solve_integer|.solve_integer()]] method now uses PARI's [[https://pari.math.u-bordeaux.fr/dochtml/html-stable/Arithmetic_functions.html#se:qfbsolve|qfbsolve()]] instead of a brute-force search, which is often exponentially faster. [[https://trac.sagemath.org/ticket/32782|#32782]]

=== Elliptic curves and isogenies ===

 * The `.abelian_group()` method for elliptic curves over finite fields is now much faster (with an exponential speedup in some cases). [[https://trac.sagemath.org/ticket/32312|#32312]]
 * Mutability of elliptic-curve isogenies is now deprecated. [[https://trac.sagemath.org/ticket/32388|#32388]]
   (This affects the methods `.switch_sign()`, `.set_pre_isomorphism()`, and `.set_post_isomorphism()`.)

Bugfixes:

 * The `.multiplication_by_m_isogeny()` method used to be correct only up to isomorphism. [[https://trac.sagemath.org/ticket/32490|#32490]]
 * Computing isomorphisms between elliptic curves in characteristic 2 used to fail in some cases. [[https://trac.sagemath.org/ticket/32632|#32632]]

=== Modular and quasimodular forms ===

[[https://davidayotte.github.io/posts/2021/08/gsoc-final/|David Ayotte's project]] in the [[https://summerofcode.withgoogle.com/archive/2021/organizations/5180088957534208/|2021 Google Summer of Code]] has brought major new features and improvements to modular forms:

 * The class `ModularFormsRing` (now in `sage.modular.modform.ring`) now follows the `Parent`/`Element` structure. [[https://trac.sagemath.org/ticket/31559|#31559]].
 * Rings of quasimodular forms for a given congruence subgroups are now implemented. [[https://trac.sagemath.org/ticket/31512|#31512]]
 * One can now convert a modular form ring element and a quasimodular form ring element to a polynomial in the generator of the ring. [[https://trac.sagemath.org/ticket/32135|#32135]], [[https://trac.sagemath.org/ticket/32336|#32336]]
 * It is now possible to take derivatives of modular forms and quasimodular forms. [[https://trac.sagemath.org/ticket/32343|#32343]], [[https://trac.sagemath.org/ticket/32357|#32357]]

Also a conversion bug between spaces of modular forms was fixed. See [[https://trac.sagemath.org/ticket/31560|Meta-ticket #31560]] for an overview of tickets.

== Algebra ==

 * The Lie algebras e,,7,, and e,,8,, now have [[https://trac.sagemath.org/ticket/32082|implementations]] as matrix Lie algebras.

=== New lazy Laurent series backend ===

The lazy Laurent series has been nearly completely rewritten using a new backend coefficient stream with a cache has both sparse and dense formatted input. This has been designed to increase speed and be very flexible. This has also been extensively doctested to make sure the code is robust. This constituted Tejavsi Chebrolu's 2021 [[https://trac.sagemath.org/ticket/31651|GSoC project (metaticket)]]. This is meant to be the eventual replacement of the coefficient streams used in the species code (including for lazy power series), which is known to be buggy (see, e.g., [[https://trac.sagemath.org/ticket/15673|#15673]]). This also extends the functionality to include:

 * formal power series defined by functional equations;
 * [[https://trac.sagemath.org/ticket/32345|special functions]] such as `sin(f)`;
 * dense and sparse implementations;
 * more robust checks for equality.

=== Lazy Dirichlet series ===

As a demonstration of the flexibility for the coefficient stream framework for lazy Laurent series, we also implement [[https://trac.sagemath.org/ticket/32309|lazy Dirichlet series]]. We also give this a structure of a valuation ring by using the log of degree of the lowest nonzero coefficient.

== Deprecated and removed functionality ==

 * The package `sage.finance` is now deprecated. (The module `sage.finance.time_series` is now available as `sage.stats.time_series`.) [[https://trac.sagemath.org/ticket/32427|#32427]]

 * The module `sage.interfaces.primecount` is now deprecated. [[https://trac.sagemath.org/ticket/32412|#32412]]

 * The package `sage.media` is now deprecated. [[https://trac.sagemath.org/ticket/12673|#12673]]

 * The module `sage.stats.basic_stats` is now deprecated. [[https://trac.sagemath.org/ticket/29662|#29662]]

   In the deprecation messages, we point users to suitable [[https://numpy.org/doc/stable/reference/routines.statistics.html|numpy]], and [[https://docs.scipy.org/doc/scipy/reference/stats.html|scipy.stats]], and [[https://pandas.pydata.org/pandas-docs/stable/reference/series.html|pandas]] functions. (Python 3 also comes with a basic ​built-in `stats` module, but much of its functionality is unfortunately incompatible with !SageMath's number types, [[https://trac.sagemath.org/ticket/28234|#28234]].)

 * Many `is_...` functions are now deprecated.

   Use `isinstance` with the new abstract base classes instead (see below).

== Package upgrades ==

[[https://numpy.org/|NumPy]] has been upgraded from 1.20.3 to the 1.21 series, see the [[https://numpy.org/doc/stable/release.html|release notes]].

[[https://scipy.org/|SciPy]] has been upgraded from 1.6.3 to the 1.7 series, see the [[http://scipy.github.io/devdocs/release.1.7.0.html|release notes]].

[[https://networkx.org/|NetworkX]] has been upgraded from 2.5.1 to the 2.6 series, bringing various new features and improvements, see the [[https://networkx.org/documentation/stable/release/release_2.6.html|changelog]].

[[https://www.sympy.org/en/index.html|SymPy]] has been upgrade from 1.8 to 1.9, see the [[https://github.com/sympy/sympy/wiki/release-notes-for-1.9|release notes]].

[[https://polymake.org/doku.php|polymake]] has been upgraded from 4.4 to 4.5, see the [[https://polymake.org/doku.php/news/release_4_5|release notes]]. On macOS, Sage is now also able to use a polymake installation made via Homebrew.

IPython and Jupyter packages have been upgraded. In particular, `notebook` has been upgraded from 6.1.1 to the 6.4 series, see the [[https://jupyter-notebook.readthedocs.io/en/stable/changelog.html#changelog|changelog]].

For a list of all packages and their versions, see
 * https://repology.org/projects/?inrepo=sagemath_develop

== Configuration changes ==

=== Separate virtual environment for Python packages ===

In non-incremental builds from source, Sage now defaults to setting up the virtual environment for the Python packages in a directory separate from `SAGE_ROOT/local`. [[https://trac.sagemath.org/ticket/32442|#32442]]

At the end of a run of `./configure`, you will see messages like the following:
{{{
config.status: executing links commands
config.status: creating convenience symlink prefix -> local
config.status: creating convenience symlink venv -> local/var/lib/sage/venv-python3.9
}}}
The symbolic link `SAGE_ROOT/venv` points to the location of the virtual environment. It depends on the version of Python that is in use. The symbolic link is not needed for build or runtime; it is only provided for convenience.

The previous behavior can be restored by using `./configure --without-sage-venv`.

=== New default: configure --with-system-gcc=force ===

The Sage distribution no longer attempts to build its own `gcc` if no suitable C/C++ compilers can be found. Instead, `configure` will exit with an error in this situation. [[https://trac.sagemath.org/ticket/32060|#32060]]

The previous behavior can be restored by using `./configure --with-system-gcc=yes`; alternatively, you can use `./configure --with-system-gcc=no`.

=== Packages atlas and mpir removed ===

The package `atlas`, which could be used as an alternative to `openblas`, and the corresponding `configure` options have been removed. [[https://trac.sagemath.org/ticket/30350|#30350]]

The package `mpir`, which could be used as an alternative to `gmp`, and the corresponding `configure` options have been removed. [[https://trac.sagemath.org/ticket/32549|#32549]]


== Modularization and packaging changes ==

Sage 9.5 contains many changes that were made as part of the modularization project described in [[https://trac.sagemath.org/ticket/29705|#29705]].

=== New distribution package: sage-setup ===

The build system of the Sage library, `sage_setup`, is now provided by a separate [[https://pypi.org/project/sage-setup/|distribution package sage-setup]]. The source tree is the subdirectory [[https://github.com/sagemath/sage/tree/develop/pkgs/sage-setup|pkgs/sage-setup/]] of the Sage git repository. [[https://trac.sagemath.org/ticket/29847|#29847]]

=== Pynac merged into the Sage library ===

The core of the symbolic expressions subsystem of Sage, an adaptation of the [[https://www.ginac.de/|GiNaC]] library to Python known as [[http://pynac.org/|Pynac]], has been merged into the Sage library source code as [[https://github.com/sagemath/sage/tree/develop/src/sage/symbolic/ginac|src/sage/symbolic/ginac/]]; all future development of Pynac is intended to happen here. [[https://trac.sagemath.org/ticket/32386|#32386]], [[https://trac.sagemath.org/ticket/32387|#32387]]

  This removes an obstacle to Python packaging: Pynac was a shared library with a dependency on the Python C API but not an extension module, and it could not be installed using standard Python tools. Now the shared library is gone; all of Pynac (about 60kLOC of C++ code spread over 100 *.h and *.cpp files) is put in a single extension module `sage.symbolic.expression`. All other extension modules that used to link to libpynac (`sage.libs.pynac.pynac`, `sage.symbolic.function`, `sage.symbolic.series` etc.) have either been merged into `sage.symbolic.expression`, or the dependency has been resolved through refactoring.

  The integration of Pynac into the Sage source tree will also make it easier for Sage developers to make changes to symbolics.

=== Doctest annotation "# optional - FEATURE" for portions of the Sage library ===

In the Sage doctesting framework, a line of tests can be [[https://doc.sagemath.org/html/en/developer/doctesting.html#run-optional-doctests|conditionalized on the presence of a feature]], such as an installed optional package, using a comment of the form `# optional - FEATURE`.

In Sage 9.5, doctests can also be conditionalized on the presence of certain parts of the Sage library. [[https://trac.sagemath.org/ticket/32614|#32614]]

For example, doctests that depend on the Symbolic Ring can be marked `# optional - sage.symbolic`, and doctests that need number fields can be marked `# optional - sage.rings.number_field`.

Also various runtime tests for external programs have been rewritten as `Feature`s. [[https://trac.sagemath.org/ticket/27744|#27744]] [[https://trac.sagemath.org/ticket/32649|#32649]] [[https://trac.sagemath.org/ticket/32650|#32650]] [[https://trac.sagemath.org/ticket/32866|#32866]]


=== Module-level annotation "# sage.doctest: optional - FEATURE" ===

Moreover, Sage 9.5 extends this mechanism by allowing developers to mark all doctests in a Python file as conditional on a feature. [[https://trac.sagemath.org/ticket/30778|#30778]]

These module-level directives go to the top of the source file and take the form
{{{
# sage.doctest: optional - FEATURE
}}}


=== Abstract base classes for "isinstance" testing ===

The new module `sage.rings.abc` defines a number of abstract base classes that can be used for `isinstance` testing with parent classes instead of importing `is_...` functions from various implementation modules. [[https://trac.sagemath.org/ticket/32566|#32566]], [[https://trac.sagemath.org/ticket/32600|#32600]], [[https://trac.sagemath.org/ticket/32606|#32606]], [[https://trac.sagemath.org/ticket/32610|#32610]], [[https://trac.sagemath.org/ticket/32612|#32612]], [[https://trac.sagemath.org/ticket/32660|#32660]],
[[https://trac.sagemath.org/ticket/32665|#32665]], [[https://trac.sagemath.org/ticket/32719|#32719]], [[https://trac.sagemath.org/ticket/32742|#32742]], [[https://trac.sagemath.org/ticket/32750|#32750]]

In a similar way, `sage.geometry.abc` defines abstract base classes `Polyhedron`, `ConvexRationalPolyhedralCone`, etc. [[https://trac.sagemath.org/ticket/32637|#32637]]

Likewise, `sage.structure.element` now defines an abstract base class `Expression` that can be used for `isinstance` testing, instead of importing `is_Expression` or the implementation class `Expression` from `sage.symbolic.expression`. [[https://trac.sagemath.org/ticket/32638|#32638]], [[https://trac.sagemath.org/ticket/32730|#32730]]


See also Meta-ticket [[https://trac.sagemath.org/ticket/32414|#32414]].

== Availability of Sage 9.5 and installation help ==

The [[https://groups.google.com/g/sage-release/c/3Kc0y5g-VXs/m/ocUI0ysCAwAJ|first beta release]] in the 9.5 development series was tagged on 2021-08-31. The current development release is 9.5.beta8, tagged 2021-12-12.

As of 9.5.beta8, Sage does not yet support building on recent Linux distributions that use glibc >= 2.34 (fedora-35, ubuntu-impish etc.) [[https://trac.sagemath.org/ticket/32576|#32756]]

As of 9.5.beta8, support for system python is still limited to 3.7 to 3.9; work to support system python 3.10 is ongoing. [[https://trac.sagemath.org/ticket/30766|#30766]]

Sage 9.5 has dropped support for `debian-jessie` with the default compiler, GCC 4.9.x. This has allowed us to upgrade the package [[https://github.com/kimwalisch/primecount|primecount]] to the latest version, which requires support for C++ 11, and to make it a standard package. (Sage 9.5 still supports distributions with compilers from the GCC 4.8.x series, such as `ubuntu-trusty`.) [[https://trac.sagemath.org/ticket/25009|#25009]]

Building Sage 9.5 from source on Apple Silicon (M1) requires the use of [[https://brew.sh/|Homebrew]]. Be sure to follow the [[https://github.com/sagemath/sage/blob/develop/README.md|README]] and the instructions that the `./configure` command issues regarding the installation of system packages from Homebrew.

 * See [[https://groups.google.com/forum/#!forum/sage-devel|sage-devel]] for development discussions and [[https://groups.google.com/forum/#!forum/sage-release|sage-release]] for announcements of beta versions and release candidates.

== More details ==

 * [[https://trac.sagemath.org/query?status=needs_info&status=needs_review&status=needs_work&status=new&summary=~Meta&col=id&col=summary&col=status&col=type&col=priority&col=milestone&col=component&order=priority|Open Meta-Tickets]]

 * [[https://trac.sagemath.org/query?milestone=sage-9.5&groupdesc=1&group=status&max=1500&col=id&col=summary&col=author&col=reviewer&col=time&col=changetime&col=component&col=keywords&order=component|Trac tickets with milestone 9.5]]

 * [[https://github.com/sagemath/sage/compare/9.4...develop#files_bucket|Diff from 9.4]]