id summary reporter owner description type status component version severity resolution keywords cc stage has_patch needs_docs needs_tests needs_better_patch easy ui_ux 4969 GZip middleware fails due to UnicodeDecodeError Johann Queuniet nobody "The GZip middleware crash after the compression, when it tries to fill the Content-Length header and calls len(str(request.content)). HttpResponse calls smart_str(), which fails since it expects UTF-8 content. {{{ 2007-07-25 18:32:48: (mod_fastcgi.c.2550) FastCGI-stderr: Traceback (most recent call last): File ""/usr/lib64/python2.5/site-packages/flup/server/fcgi_base.py"", line 558, in run protocolStatus, appStatus = self.server.handler(self) File ""/usr/lib64/python2.5/site-packages/flup/server/fcgi_base.py"", line 1112, in handler result = self.application(environ, start_response) File ""/usr/lib/python2.5/django/core/handlers/wsgi.py"", line 194, in __call__ File ""/usr/lib64/python2.5/site-packages/django/middleware/gzip.py"", line 28, in process_response response['Content-Length'] = str(len(response.content)) File ""/usr/lib64/python2.5/site-packages/django/http/__init__.py"", line 275, in _get_content content = smart_str(''.join(self._container), self._charset) File ""/usr/lib/python2.5/django/utils/encoding.py"", line 63, in smart_str File ""/usr/lib/python2.5/encodings/utf_8.py"", line 16, in decode return codecs.utf_8_decode(input, errors, True) UnicodeDecodeError: 'utf8' codec can't decode byte 0x8b in position 1: unexpected code byte }}} I don't really know where the fault lies here. Is it smart_str's if it chocks on gzip-encoded content ? Or should the HttpResponse object do something else when the Content-Encoding header is set ? The patch included assumes the latter." closed HTTP handling dev fixed unicode gzip middleware Design decision needed 1 0 0 1 0 0