Fix Django worker recursion bug + defensive checks for pool_cls.__module__ by maycuatroi1 · Pull Request #10048 · celery/celery

maycuatroi1 · 2026-01-03T10:23:08Z

Description

This PR builds on top of #10045 by @bruunotrindade to add defensive checks for pool_cls.__module__ access in additional locations throughout the codebase.

Root Cause (from #10045)

DjangoWorkerFixup.__init__ was creating a WorkController instance via the worker or WorkController(app) pattern. This created a circular dependency where:

WorkController.__init__ triggers the worker_init signal
DjangoFixup.on_worker_init creates/accesses DjangoWorkerFixup
DjangoWorkerFixup.__init__ tries to create another WorkController
Infinite recursion ensues

Additionally, pool_cls can be a string (e.g., 'prefork', 'solo', 'gevent') instead of a class object, which causes AttributeError: 'str' object has no attribute '__module__' when trying to access pool_cls.__module__.

Changes in this PR

This PR includes all changes from #10045 plus:

celery/contrib/testing/worker.py: Added defensive check for pool_cls being a string in TestWorkController.__init__
celery/worker/components.py: Added defensive check for pool_cls being a string in Beat.create
New unit tests: Added tests to verify the defensive checks work correctly when pool_cls is a string

Pattern Applied

# Before (can raise AttributeError if pool_cls is a string)
if w.pool_cls.__module__.endswith(('gevent', 'eventlet')):

# After (handles both string and class pool_cls)
pool_module = w.pool_cls if isinstance(w.pool_cls, str) else w.pool_cls.__module__
if pool_module.endswith(('gevent', 'eventlet')):

Testing

All existing unit tests pass
Added 2 new tests for Beat.create with string pool_cls
Pre-commit hooks pass (flake8, mypy, isort, etc.)
Test coverage maintained

Related Issues

AttributeError: 'str' object has no attribute '__module__' in django.py fixups when using Flower #10042 - Original issue reporting RecursionError
Fix recursive WorkController instantiation in DjangoWorkerFixup + AttributeError when pool_cls is a string #10045 - Original PR by @bruunotrindade fixing the root cause
reliable prefork detection #10023 - Previous attempts to fix the issue

Acknowledgments

Thanks to @bruunotrindade for identifying and fixing the root cause in #10045. This PR extends that fix to cover additional edge cases.

- Remove worker parameter from DjangoWorkerFixup.__init__ - Set worker via on_worker_init callback instead - Add None check for worker.pool_cls to prevent AttributeError - Add regression test to prevent future recursion bugs Fixes recursive instantiation issue where DjangoWorkerFixup(app) would create WorkController(app), which in turn would create another DjangoWorkerFixup, leading to infinite recursion. The worker instance is now properly set via the on_worker_init signal callback, avoiding the circular dependency.

Extends the fix from celery#10045 by adding defensive checks for when pool_cls is a string instead of a class in two additional locations: - celery/contrib/testing/worker.py: TestWorkController.__init__ - celery/worker/components.py: Beat.create This prevents AttributeError: 'str' object has no attribute '__module__' when pool_cls is passed as a string (e.g., 'prefork', 'gevent', 'eventlet'). Also adds unit tests to verify the defensive checks work correctly.

for more information, see https://pre-commit.ci

auvipy

please check the unit test failures

codecov · 2026-01-03T14:05:21Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.47%. Comparing base (6a43c84) to head (34882eb).
⚠️ Report is 86 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #10048      +/-   ##
==========================================
+ Coverage   88.43%   88.47%   +0.04%     
==========================================
  Files         153      153              
  Lines       19373    19375       +2     
  Branches     2228     2228              
==========================================
+ Hits        17132    17142      +10     
+ Misses       1941     1934       -7     
+ Partials      300      299       -1

Flag	Coverage Δ
unittests	`88.44% <100.00%> (+0.04%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

auvipy · 2026-01-04T07:16:27Z

may be we can consider the remaining changes here as minor improvements

Copilot

Pull request overview

This PR extends #10045 to add defensive checks for accessing pool_cls.__module__ in two additional locations throughout the codebase, preventing AttributeError when pool_cls is a string instead of a class object.

Key Changes:

Added defensive checks in Beat.create and TestWorkController.__init__ to handle string pool_cls values
Added two unit tests for Beat.create to verify the fix works with string pool types
Applies the same pattern used in the Django fixup to prevent AttributeErrors

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
`celery/worker/components.py`	Added defensive check in `Beat.create` to handle string `pool_cls` before checking for green pools
`celery/contrib/testing/worker.py`	Added defensive check in `TestWorkController.__init__` to handle string `pool_cls` before checking for prefork pool
`t/unit/worker/test_components.py`	Added two unit tests verifying `Beat.create` raises `ImproperlyConfigured` when `pool_cls` is string 'gevent' or 'eventlet'

auvipy

is it possible to improve test coverage?

maycuatroi1 · 2026-01-05T15:03:16Z

@auvipy Added unit tests for TestWorkController with string pool_cls to improve test coverage. Please review.

auvipy · 2026-01-05T15:30:00Z

can you please check why the tests are failing with new changes?

Add tests to verify defensive handling of string pool_cls in TestWorkController.__init__, addressing reviewer feedback.

maycuatroi1 · 2026-01-05T17:58:27Z

@auvipy Fixed a test pollution issue discovered during local CI testing.

Root cause: The test_init_with_string_pool_cls_prefork test was calling tblib.pickling_support.install() (via TestWorkController.__init__), which modifies global pickling behavior and caused test_retry_with_unpickleable_exception to fail when running the full test suite.

Fix: Added patch.dict('sys.modules', {'tblib': None, 'tblib.pickling_support': None}) to prevent tblib from being imported during the test.

Note: Force pushed to amend the previous commit with this fix. Apologies for not creating a separate commit.

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

…ule__ (#10048) * Fix recursive WorkController instantiation in DjangoWorkerFixup - Remove worker parameter from DjangoWorkerFixup.__init__ - Set worker via on_worker_init callback instead - Add None check for worker.pool_cls to prevent AttributeError - Add regression test to prevent future recursion bugs Fixes recursive instantiation issue where DjangoWorkerFixup(app) would create WorkController(app), which in turn would create another DjangoWorkerFixup, leading to infinite recursion. The worker instance is now properly set via the on_worker_init signal callback, avoiding the circular dependency. * fix: improve prefork detection and add integration test * fix: Copilot recommendations * Add defensive checks for pool_cls.__module__ in additional locations Extends the fix from #10045 by adding defensive checks for when pool_cls is a string instead of a class in two additional locations: - celery/contrib/testing/worker.py: TestWorkController.__init__ - celery/worker/components.py: Beat.create This prevents AttributeError: 'str' object has no attribute '__module__' when pool_cls is passed as a string (e.g., 'prefork', 'gevent', 'eventlet'). Also adds unit tests to verify the defensive checks work correctly. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add unit tests for TestWorkController with string pool_cls Add tests to verify defensive handling of string pool_cls in TestWorkController.__init__, addressing reviewer feedback. --------- Co-authored-by: Asif Saif Uddin {"Auvi":"অভি"} <[email protected]>

This MR contains the following updates: | Package | Type | Update | Change | OpenSSF | |---|---|---|---|---| | [celery](https://docs.celeryq.dev/) ([source](https://github.com/celery/celery), [changelog](https://docs.celeryq.dev/en/stable/changelog.html)) | dependencies | patch | `5.6.2` → `5.6.3` | [![OpenSSF Scorecard](https://api.securityscorecards.dev/projects/github.com/celery/celery/badge)](https://securityscorecards.dev/viewer/?uri=github.com/celery/celery) | --- ### Release Notes <details> <summary>celery/celery (celery)</summary> ### [`v5.6.3`](https://github.com/celery/celery/releases/tag/v5.6.3) [Compare Source](celery/celery@v5.6.2...v5.6.3) #### What's Changed - Fix Django worker recursion bug + defensive checks for pool\_cls.**module** by [@maycuatroi1](https://github.com/maycuatroi1) in [#10048](celery/celery#10048) - Docs: Update user\_preload\_options example to use click. by [@jorsyk](https://github.com/jorsyk) in [#10056](celery/celery#10056) - Fix invalid configuration key "bootstrap\_servers" in Kafka demo by [@jorsyk](https://github.com/jorsyk) in [#10060](celery/celery#10060) - Fix broken images on PyPI page by [@Timour-Ilyas](https://github.com/Timour-Ilyas) in [#10066](celery/celery#10066) - Remove broken reference. by [@sueannioanis](https://github.com/sueannioanis) in [#10071](celery/celery#10071) - Removed --dist=loadscope from smoke tests by [@Nusnus](https://github.com/Nusnus) in [#10073](celery/celery#10073) - Docs: Clarify task\_retry signal args may be None by [@GangEunzzang](https://github.com/GangEunzzang) in [#10076](celery/celery#10076) - Update example for Django by [@sbc-khacnha](https://github.com/sbc-khacnha) in [#10081](celery/celery#10081) - Make tests compatible with pymongo >= 4.16 by [@cjwatson](https://github.com/cjwatson) in [#10074](celery/celery#10074) - fix: source install of cassandra-driver by [@Izzette](https://github.com/Izzette) in [#10105](celery/celery#10105) - fix: register task cross-reference role in Sphinx extension by [@veeceey](https://github.com/veeceey) in [#10100](celery/celery#10100) - fix: avoid cycle detection in native delayed delivery by [@Izzette](https://github.com/Izzette) in [#10095](celery/celery#10095) - fix(asynpool): avoid AttributeError when proc lacks \_sentinel\_poll by [@mriddle](https://github.com/mriddle) in [#10086](celery/celery#10086) - fix dusk\_astronomical horizon sign (+18 -> -18) by [@Mr-Neutr0n](https://github.com/Mr-Neutr0n) in [#10121](celery/celery#10121) - Fix/10106 onupdate col use lambda func by [@ChickenBenny](https://github.com/ChickenBenny) in [#10108](celery/celery#10108) - Fix warm shutdown RuntimeError with eventlet>=0.37.0 ([#10083](celery/celery#10083)) by [@ChickenBenny](https://github.com/ChickenBenny) in [#10123](celery/celery#10123) - Fix 10109 db backend connection health by [@ChickenBenny](https://github.com/ChickenBenny) in [#10124](celery/celery#10124) - Database Backend filter unsupport sql engine arguments with nullpool [#7355](celery/celery#7355) by [@ChickenBenny](https://github.com/ChickenBenny) in [#10134](celery/celery#10134) - fix(beat): correct argument order in Service.**reduce** by [@bysiber](https://github.com/bysiber) in [#10137](celery/celery#10137) - ci: declare explicit read-only token permissions in workflow jobs by [@Rohan5commit](https://github.com/Rohan5commit) in [#10139](celery/celery#10139) - chore: 'boto3to' to 'boto3 to' by [@cuiweixie](https://github.com/cuiweixie) in [#10133](celery/celery#10133) - Database Backend: Add missing index on date\_done (Fixes [#10097](celery/celery#10097)) by [@ChickenBenny](https://github.com/ChickenBenny) in [#10098](celery/celery#10098) - docs: fix typo in CONTRIBUTING.rst by [@Rohan5commit](https://github.com/Rohan5commit) in [#10141](celery/celery#10141) - Refer to Flower / Prometheus for monitoring by [@WilliamDEdwards](https://github.com/WilliamDEdwards) in [#10140](celery/celery#10140) - docs: remove duplicated words in broker and routing docs by [@Rohan5commit](https://github.com/Rohan5commit) in [#10146](celery/celery#10146) - docs: fix stale version reference and grammar in README by [@kelsonbrito50](https://github.com/kelsonbrito50) in [#10145](celery/celery#10145) - docs: fix wording in Celery 5.3 worker pool notes by [@Rohan5commit](https://github.com/Rohan5commit) in [#10149](celery/celery#10149) - docs: fix duplicated wording in 3.1 changelog entry by [@Rohan5commit](https://github.com/Rohan5commit) in [#10152](celery/celery#10152) - docs: fix changelog typo in context manager wording by [@Rohan5commit](https://github.com/Rohan5commit) in [#10144](celery/celery#10144) - Fix/10096 worker fails to reconnect after redis failover by [@ChickenBenny](https://github.com/ChickenBenny) in [#10151](celery/celery#10151) - Improve on\_after\_finalize signal documentation by [@Br1an67](https://github.com/Br1an67) in [#10155](celery/celery#10155) - Add non-commutative example to clarify partial arg ordering in canvas docs by [@Br1an67](https://github.com/Br1an67) in [#10157](celery/celery#10157) - Remove redundant test\_isa\_mapping test (fixes [#10077](celery/celery#10077)) by [@daniel7an](https://github.com/daniel7an) in [#10103](celery/celery#10103) - Upgrade pytest-celery to >=1.3.0 and adopt PYTEST\_CELERY\_PKG build arg by [@Nusnus](https://github.com/Nusnus) in [#10162](celery/celery#10162) - Remove deprecated args from redis get\_connection call by [@JaeHyuckSa](https://github.com/JaeHyuckSa) in [#10036](celery/celery#10036) - Fix [#6912](celery/celery#6912) rpc backend reconnection error by [@ChickenBenny](https://github.com/ChickenBenny) in [#10179](celery/celery#10179) - Fix NameError with TYPE\_CHECKING annotations on Python 3.14+ (PEP 649) by [@drichardson](https://github.com/drichardson) in [#10165](celery/celery#10165) - docs: Add elaboration on prefetch multiplier settings (worker\_prefetch\_multiplier) and worker\_eta\_task\_limit by [@tsangwailam](https://github.com/tsangwailam) in [#10181](celery/celery#10181) - Fix O(K²) message bloat in a chain of chords by [@Borzik](https://github.com/Borzik) in [#10171](celery/celery#10171) - Fix mock connection interfaces to prevent `TypeError` during exception handling by [@ChickenBenny](https://github.com/ChickenBenny) in [#10178](celery/celery#10178) - fix(trace): dispatch chain/callbacks on dedup fast-path for redelivered tasks by [@aurangzaib048](https://github.com/aurangzaib048) in [#10159](celery/celery#10159) - Extract `reconnect_on_error` to `BaseResultConsumer` by [@ChickenBenny](https://github.com/ChickenBenny) in [#10189](celery/celery#10189) - pep 649 by [@ericbuehl](https://github.com/ericbuehl) in [#10187](celery/celery#10187) - [Fix#9722](https://github.com/Fix/celery/issues/9722) friendly status errors for CLI by [@ChickenBenny](https://github.com/ChickenBenny) in [#10190](celery/celery#10190) - docs: clarify after\_return behavior for retried tasks by [@KianAnbarestani](https://github.com/KianAnbarestani) in [#10192](celery/celery#10192) - Add compression header to message protocol docs by [@Br1an67](https://github.com/Br1an67) in [#10156](celery/celery#10156) - docs: fix duplicated word in bootsteps comment by [@Rohan5commit](https://github.com/Rohan5commit) in [#10153](celery/celery#10153) - Remove outdated autoreloader section from extending docs by [@Br1an67](https://github.com/Br1an67) in [#10154](celery/celery#10154) - Fix: prioritize request ignore\_result over task definition by [@patri27826](https://github.com/patri27826) in [#10184](celery/celery#10184) - fix: clear the timer while catch the exception by [@ChickenBenny](https://github.com/ChickenBenny) in [#10218](celery/celery#10218) - Prepare for release: v5.6.3 by [@Nusnus](https://github.com/Nusnus) in [#10221](celery/celery#10221) #### New Contributors - [@maycuatroi1](https://github.com/maycuatroi1) made their first contribution in [#10048](celery/celery#10048) - [@jorsyk](https://github.com/jorsyk) made their first contribution in [#10056](celery/celery#10056) - [@Timour-Ilyas](https://github.com/Timour-Ilyas) made their first contribution in [#10066](celery/celery#10066) - [@sueannioanis](https://github.com/sueannioanis) made their first contribution in [#10071](celery/celery#10071) - [@GangEunzzang](https://github.com/GangEunzzang) made their first contribution in [#10076](celery/celery#10076) - [@sbc-khacnha](https://github.com/sbc-khacnha) made their first contribution in [#10081](celery/celery#10081) - [@veeceey](https://github.com/veeceey) made their first contribution in [#10100](celery/celery#10100) - [@mriddle](https://github.com/mriddle) made their first contribution in [#10086](celery/celery#10086) - [@Mr-Neutr0n](https://github.com/Mr-Neutr0n) made their first contribution in [#10121](celery/celery#10121) - [@ChickenBenny](https://github.com/ChickenBenny) made their first contribution in [#10108](celery/celery#10108) - [@bysiber](https://github.com/bysiber) made their first contribution in [#10137](celery/celery#10137) - [@Rohan5commit](https://github.com/Rohan5commit) made their first contribution in [#10139](celery/celery#10139) - [@cuiweixie](https://github.com/cuiweixie) made their first contribution in [#10133](celery/celery#10133) - [@kelsonbrito50](https://github.com/kelsonbrito50) made their first contribution in [#10145](celery/celery#10145) - [@Br1an67](https://github.com/Br1an67) made their first contribution in [#10155](celery/celery#10155) - [@daniel7an](https://github.com/daniel7an) made their first contribution in [#10103](celery/celery#10103) - [@drichardson](https://github.com/drichardson) made their first contribution in [#10165](celery/celery#10165) - [@tsangwailam](https://github.com/tsangwailam) made their first contribution in [#10181](celery/celery#10181) - [@Borzik](https://github.com/Borzik) made their first contribution in [#10171](celery/celery#10171) - [@aurangzaib048](https://github.com/aurangzaib048) made their first contribution in [#10159](celery/celery#10159) - [@ericbuehl](https://github.com/ericbuehl) made their first contribution in [#10187](celery/celery#10187) - [@KianAnbarestani](https://github.com/KianAnbarestani) made their first contribution in [#10192](celery/celery#10192) - [@patri27826](https://github.com/patri27826) made their first contribution in [#10184](celery/celery#10184) **Full Changelog**: <celery/celery@v5.6.2...v5.6.3> </details> --- - [ ] If you want to rebase/retry this MR, check this box --- This MR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).  See merge request swiss-armed-forces/cyber-command/cea/loom!419

bruunotrindade and others added 5 commits December 31, 2025 12:33

fix: improve prefork detection and add integration test

84c436e

fix: Copilot recommendations

d01ed94

[pre-commit.ci] auto fixes from pre-commit.com hooks

7176bdf

for more information, see https://pre-commit.ci

auvipy requested changes Jan 3, 2026

View reviewed changes

Merge branch 'main' into fix-django-worker-recursion-bug-v2

7b8a407

auvipy requested a review from Copilot January 4, 2026 07:19

Copilot started reviewing on behalf of auvipy January 4, 2026 07:20 View session

Copilot AI reviewed Jan 4, 2026

View reviewed changes

Comment thread celery/contrib/testing/worker.py

Nusnus added 2 commits January 4, 2026 14:18

Merge branch 'main' into fix-django-worker-recursion-bug-v2

20a1c56

Merge branch 'main' into fix-django-worker-recursion-bug-v2

237ecd7

auvipy added this to the 5.6.x milestone Jan 4, 2026

auvipy requested changes Jan 5, 2026

View reviewed changes

maycuatroi1 requested a review from auvipy January 5, 2026 15:04

Add unit tests for TestWorkController with string pool_cls

34882eb

Add tests to verify defensive handling of string pool_cls in TestWorkController.__init__, addressing reviewer feedback.

maycuatroi1 force-pushed the fix-django-worker-recursion-bug-v2 branch from a7d89b7 to 34882eb Compare January 5, 2026 17:48

auvipy requested a review from Copilot January 5, 2026 18:16

Copilot started reviewing on behalf of auvipy January 5, 2026 18:16 View session

Copilot AI reviewed Jan 5, 2026

View reviewed changes

auvipy approved these changes Jan 5, 2026

View reviewed changes

auvipy merged commit 8ea903b into celery:main Jan 5, 2026
377 checks passed

claude Bot mentioned this pull request Mar 26, 2026

Bump celery from 5.6.2 to 5.6.3 Open-Source-Legal/OpenContracts#1167

Merged

mitchh456 mentioned this pull request Mar 31, 2026

Celery 5.6.3 removes deprecated redis get_connection args — verify Scout instrumentation scoutapp/scout_apm_python#837

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix Django worker recursion bug + defensive checks for pool_cls.module#10048

Fix Django worker recursion bug + defensive checks for pool_cls.module#10048
auvipy merged 9 commits into
celery:mainfrom
maycuatroi1:fix-django-worker-recursion-bug-v2

maycuatroi1 commented Jan 3, 2026

Uh oh!

auvipy left a comment

Uh oh!

codecov Bot commented Jan 3, 2026 •

edited

Loading

Uh oh!

auvipy commented Jan 4, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

auvipy left a comment

Uh oh!

maycuatroi1 commented Jan 5, 2026

Uh oh!

auvipy commented Jan 5, 2026

Uh oh!

maycuatroi1 commented Jan 5, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Uh oh!

Conversation

maycuatroi1 commented Jan 3, 2026

Description

Root Cause (from #10045)

Changes in this PR

Pattern Applied

Testing

Related Issues

Acknowledgments

Uh oh!

auvipy left a comment

Choose a reason for hiding this comment

Uh oh!

codecov Bot commented Jan 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

auvipy commented Jan 4, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Key Changes:

Reviewed changes

Uh oh!

Uh oh!

auvipy left a comment

Choose a reason for hiding this comment

Uh oh!

maycuatroi1 commented Jan 5, 2026

Uh oh!

auvipy commented Jan 5, 2026

Uh oh!

maycuatroi1 commented Jan 5, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

codecov Bot commented Jan 3, 2026 •

edited

Loading