django-pylibmc-bug

Django CacheMiddleware has a multi-threading issue with pylibmc.

CacheMiddleware shares a thread-unsafe cache object with many threads. It works in most cache backends have Python implementations, but pylibmc is C with Python bindings.

How to reproduce

This is a simple Django project, with only django and pylibmc installed. Just start it ./manage.py runserver with a localhost memcached and run lots of concurrent requests: ab -n100 -c10 http://localhost:8000/

This will trigger some exceptions like:

Traceback (most recent call last):
  File "pylibmcbug/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "pylibmcbug/lib/python3.9/site-packages/django/core/handlers/base.py", line 181, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "pylibmcbug/lib/python3.9/site-packages/django/utils/decorators.py", line 122, in _wrapped_view
    result = middleware.process_request(request)
  File "pylibmcbug/lib/python3.9/site-packages/django/middleware/cache.py", line 145, in process_request
    cache_key = get_cache_key(request, self.key_prefix, 'GET', cache=self.cache)
  File "pylibmcbug/lib/python3.9/site-packages/django/utils/cache.py", line 362, in get_cache_key
    headerlist = cache.get(cache_key)
  File "pylibmcbug/lib/python3.9/site-packages/django/core/cache/backends/memcached.py", line 77, in get
    return self._cache.get(key, default)
pylibmc.ConnectionError: error 3 from memcached_get(:1:views.decorators.cache.cache_): (0x7f290400bd60) FAILURE, poll() returned a value that was not dealt with,  host: localhost:11211 -> libmemcached/io.cc:254

Django CacheMiddleware has a multi-threading issue with pylibmc

Related tags

Overview

django-pylibmc-bug

How to reproduce

Owner

Iuri de Silvio

A Django chatbot that is capable of doing math and searching Chinese poet online. Developed with django, channels, celery and redis.

Mobile Detect is a lightweight Python package for detecting mobile devices (including tablets).

xsendfile etc wrapper

🗂️ 🔍 Geospatial Data Management and Search API - Django Apps

Backend with Django .

This a Django TODO app project and practiced how to deploy and publish the project to Heroku

A task management system created using Django 4.0 and Python 3.8 for a hackathon.

Book search Django web project that uses requests python library and openlibrary API.

Code coverage measurement for Python

RedisTimeSeries python client

AUES Student Management System Developed for laboratory works №9 Purpose using Python (Django).

A simple Django middleware for Duo V4 2-factor authentication.

A simple app that provides django integration for RQ (Redis Queue)

Yet another Django audit log app, hopefully the simplest one.

Py-instant-search-redis - Source code example for how to build an instant search with redis in python

Customize the behavior of django.contrib.auth permissions.

Dockerizing Django with Postgres, Gunicorn, Nginx and Certbot. A fully Django starter project.

Bootstrap 3 integration with Django.

Packs a bunch of smaller CSS files together from 1 folder.

django social media app with real time features