Skip to content

Commit

Permalink
Preliminary changelog update
Browse files Browse the repository at this point in the history
  • Loading branch information
ask committed Mar 19, 2014
1 parent 5ecc16f commit 7e5e92b
Show file tree
Hide file tree
Showing 3 changed files with 103 additions and 0 deletions.
41 changes: 41 additions & 0 deletions Changelog
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,47 @@ This document contains change notes for bugfix releases in the 3.1.x series
(Cipater), please see :ref:`whatsnew-3.1` for an overview of what's
new in Celery 3.1.

.. _version-3.1.10:

3.1.10
======
:release-date: 2014-XX-XX XX:XX X.X UTC
:release-by: XX

- **Requirements**:

- Now depends on :ref:`Kombu 3.0.13 <kombu:version-3.0.13>`.

- **Beat**: No longer attempts to upgrade a newly created database file
(Issue #1923).

- **Events**: The "Substantial drift" warning message is now logged once
per node name only (Issue #1802).

- **Worker**: Ability to use one log file per child process when using the
prefork pool.

This can be enabled by using the new ``%i`` and ``%I`` format specifiers
for the log file name. See :ref:`worker-files-process-index`.

- **Task**: A regression caused the ``queue`` argument to ``Task.retry`` to be
ignored (Issue #1892).

- **App**: Fixed error message for :meth:`[email protected]_from_envvar`.

Fix contributed by Dmitry Malinovsky.

- **Canvas**: Calling ``result.get()`` for a chain task will now complete
even if one of the tasks in the chain is ``ignore_result=True``
(Issue #1905).

- **Canvas**: Chords can now be combined when using the amqp result backend
(a chord where the callback is also a chord).

- **Commands**: :program:`celery inspect memdump` no longer crashes
if the :mod:`psutil` module is not installed (Issue #1914).


.. _version-3.1.9:

3.1.9
Expand Down
4 changes: 4 additions & 0 deletions docs/getting-started/brokers/redis.rst
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,8 @@ For a complete list of options supported by the Redis result backend, see
Caveats
=======

.. _redis-caveat-fanout-prefix:

- Broadcast messages will be seen by all virtual hosts by default.

You have to set a transport option to prefix the messages so that
Expand All @@ -80,6 +82,8 @@ Caveats
This setting will be the default in the future, so better to migrate
sooner rather than later.

.. _redis-caveat-fanout-patterns:

- Workers will receive all task related events by default.

To avoid this you must set the ``fanout_patterns`` fanout option so that
Expand Down
58 changes: 58 additions & 0 deletions docs/userguide/workers.rst
Original file line number Diff line number Diff line change
Expand Up @@ -134,6 +134,62 @@ The worker's main process overrides the following signals:
| :sig:`USR2` | Remote debug, see :mod:`celery.contrib.rdb`. |
+--------------+-------------------------------------------------+

.. _worker-files:

Variables in file paths
=======================

The file path arguments for :option:`--logfile`, :option:`--pidfile` and :option:`--statedb`
can contain variables that the worker will expand:

Node name replacements
----------------------

- ``%h``: Hostname including domain name.
- ``%n``: Hostname only.
- ``%d``: Domain name only.
- ``%i``: Prefork pool process index or 0 if MainProcess.
- ``%I``: Prefork pool process index with separator.

E.g. if the current hostname is ``george.example.com`` then
these will expand to:

- ``--logfile=%h.log`` -> :file:`george.example.com.log`
- ``--logfile=%n.log`` -> :file:`george.log`
- ``--logfile=%d`` -> :file:`example.com.log`

.. _worker-files-process-index:

Prefork pool process index
--------------------------

The prefork pool process index specifiers will expand into a different
filename depending on the process that will eventually need to open the file.

This can be used to specify one log file per child process.

Note that the numbers will stay within the process limit even if processes
exit or if autoscale/maxtasksperchild/time limits are used. I.e. the number
is the *process index* not the process count or pid.

* ``%i`` - Pool process index or 0 if MainProcess.

Where ``-n [email protected] -c2 -f %n-%i.log`` will result in
three log files:

- :file:`worker1-0.log` (main process)
- :file:`worker1-1.log` (pool process 1)
- :file:`worker1-2.log` (pool process 2)

* ``%I`` - Pool process index with separator.

Where ``-n [email protected] -c2 -f %n%I.log`` will result in
three log files:

- :file:`worker1.log` (main process)
- :file:`worker1-1.log`` (pool process 1)
- :file:`worker1-2.log`` (pool process 2)

.. _worker-concurrency:

Concurrency
Expand Down Expand Up @@ -334,6 +390,8 @@ name:
celery multi start 2 -l info --statedb=/var/run/celery/%n.state
See also :ref:`worker-files`

Note that remote control commands must be working for revokes to work.
Remote control commands are only supported by the RabbitMQ (amqp) and Redis
at this point.
Expand Down

0 comments on commit 7e5e92b

Please sign in to comment.