Opened 15 years ago
Closed 11 years ago
#12027 closed Bug (fixed)
EmailField validation is incorrect, trailing dots fail
Reported by: | Klas H | Owned by: | shaz |
---|---|---|---|
Component: | Core (Other) | Version: | dev |
Severity: | Normal | Keywords: | email, regular expression, validation |
Cc: | joshcartme@…, timograham@… | Triage Stage: | Ready for checkin |
Has patch: | yes | Needs documentation: | no |
Needs tests: | no | Patch needs improvement: | no |
Easy pickings: | no | UI/UX: | no |
Description
When the email field related denial-of-service attack was patched the new code suddenly allowed email addresses to end with a '.' character. For example, according to the new regular expression 'test@test.com.'
is a valid email address (please note the trailing period character).
I attach a patch that fixes this.
Attachments (5)
Change History (18)
by , 15 years ago
Attachment: | email_re_patch.diff added |
---|
comment:1 by , 15 years ago
Cc: | removed |
---|---|
Resolution: | → invalid |
Status: | new → closed |
Ignore this ticket. Apparently the domain part of an URL can end with a '.' character, so I guess it's the same for mail addresses then.
comment:2 by , 13 years ago
Cc: | added |
---|---|
Easy pickings: | unset |
Resolution: | invalid |
Severity: | → Normal |
Status: | closed → reopened |
Summary: | EmailField validation is incorrect → EmailField validation is incorrect, trailing dots fail |
Type: | → Uncategorized |
UI/UX: | unset |
I'm not convinced this should be closed. Although DNS should correctly resolve a domain with a trailing dot according to the specification (documented at the beginning of page 7 here http://www.ietf.org/rfc/rfc1034.txt) sending emails to addresses that end with a dot fails at least in my case. For example I tried sending an email to and from a google apps address of mine using thunderbird. I was sent back a Delivery Status Notification (Failure).
When trying to use EmailMultiAlternatives with a email address of this form, me@…. as an example, msg.send() breaks with the following error:
SMTPRecipientsRefused: {'me@….': (501, '<tedlittle5@….>: domain missing or malformed')}
Here is a quote from RFC 5321 section 2.3.5 (http://tools.ietf.org/html/rfc5321#section-2.3.5):
"A domain name (or often just a "domain") consists of one or more components, separated by dots if more than one appears."
I think the important word is separated, it does not say terminated therefore an email address should not be terminated by a dot.
More discussion on that here: http://tech.groups.yahoo.com/group/postfix-users/message/244166.
At the very least I think this needs to be revisited and properly discussed. Emails with dots at the end do not send so why should they be validated by Django?
comment:3 by , 13 years ago
Triage Stage: | Unreviewed → Accepted |
---|---|
Type: | Uncategorized → Bug |
#16310 was a duplicate. Note that this behaviour was introduced in changeset [11605], which itself was to fix a security issue where the email and url validation regular expressions could be exploited in public form submissions to cause a DOS. Therefore this should be treated very cautiously.
I haven't done enough research to confirm whether this is a genuine bug or not. However, this behaviour (i.e. trailing dots) doesn't seem to be tested at all. So I'm accepting this ticket on the basis that at the very least it needs some tests.
comment:4 by , 13 years ago
Needs tests: | set |
---|
comment:5 by , 12 years ago
Status: | reopened → new |
---|
comment:6 by , 11 years ago
Triage Stage: | Accepted → Ready for checkin |
---|
by , 11 years ago
Attachment: | 12027_patch_test.diff added |
---|
comment:7 by , 11 years ago
Owner: | changed from | to
---|---|
Status: | new → assigned |
comment:8 by , 11 years ago
Cc: | added |
---|---|
Patch needs improvement: | set |
Triage Stage: | Ready for checkin → Accepted |
Please don't mark your own patch as RFC. It looks like this needs to be discussed as to whether we want to continue to allow email addresses that end with periods or not. If so, the test in the latest patch is a bit awkward (using both unittest.expectedFailure and assertFailsValidation).
comment:9 by , 11 years ago
We just had an SMTP exception from Exim because a user managed to enter his email address with a trailing dot. Probably he copied it from somewhere with a period at the end. This echoes what Josh C said, but I just want to confirm that Django's behaviour in this case caused us a real problem, so yeah, this is a genuine bug.
by , 11 years ago
Attachment: | 12027.diff added |
---|
comment:10 by , 11 years ago
Needs tests: | unset |
---|---|
Patch needs improvement: | unset |
Here's a simple patch that avoids messing with the regex. Perhaps it's good enough.
by , 11 years ago
Attachment: | 12027_regex.diff added |
---|
comment:12 by , 11 years ago
Triage Stage: | Accepted → Ready for checkin |
---|
comment:13 by , 11 years ago
Resolution: | → fixed |
---|---|
Status: | assigned → closed |
Patch of regular expression for email address validation