Opened 10 years ago

Closed 7 years ago

Last modified 7 years ago

#22654 closed Bug (fixed)

DecimalField and DECIMAL_SEPARATOR (in admin)

Reported by: matija@… Owned by: Raphael Michel
Component: Forms Version: 1.11
Severity: Normal Keywords:
Cc: Artem Skoretskiy Triage Stage: Accepted
Has patch: yes Needs documentation: no
Needs tests: no Patch needs improvement: no
Easy pickings: no UI/UX: no


DecimalField with following settings:

USE_I18N = True
USE_L10N = False
USE_TZ = False
DATE_FORMAT = 'd.m.Y.'
DATE_INPUT_FORMATS = ('%d.%m.%Y.', '%d.%m.%Y', '%Y-%m-%d')

Correctly shows Decimal field in admin, but raises validation error.

As most of our customers do not set their preferences to Croatian, and we need to show Croatian locale for all users. So with settings above, things sdhould work.

Tried in 1.6 and 1.7.

In order to reproduce, all you need is a single model with a DecimalField, registered in Admin. And the above settings. Input any non-integer value and press save_and_continue_editing. If you encounter no errors, press it again. Now it will show an error.

I added a new ticked because related ones were closed years ago.

Change History (20)

comment:1 by sabinemaennel, 10 years ago

Owner: changed from nobody to sabinemaennel
Status: newassigned

comment:2 by sabinemaennel, 10 years ago

I think this is clearly an error. I tested it with a decimal field. The settings DECIMAL_SEPARATOR = ',' is taken into account when the field is shown in the admin, but when validating the field only input with a . as delimiter is accepted. The field validation needs to be adapted to the delimiter given in the settings as well. I tested this with the new 1.7 Django.

comment:3 by sabinemaennel, 10 years ago

Component: UncategorizedForms
Owner: sabinemaennel removed
Status: assignednew
Triage Stage: UnreviewedSomeday/Maybe
Type: UncategorizedBug

This is actually an HTML5 Problem. The admin form for the input of a number uses the following HTML5 statement:
<input id="id_decimal_number" name="..." step="0.01" type="number" />.
step= in HTML5 can only be defined that way with a .as delimiter. Then the browser will show it on the screen according to local browser settings. Mine showed it as a dot, but I read on stackoverflow, that some other users see it with a comma.

I think HTML5 will develop further and this behaviour can be corrected via a Javascript-Library-Use in the meantime. I am not sure what to do with this bug. I would probably place it outside the influence of Django even though I can see that it is annoying. Django decided to use HTML5 for its forms and this is due to the actual state of HTML5. I feel Django is not responsible to correct HTML5 behaviour, but I would really like to know the opinion of some more experienced Django contributers on this. So I am handing the ticket back.

comment:4 by matija@…, 10 years ago

ACTUALLY this is DJANGO problem. Remove type="number". The ValidationError on Django side is the issue, not browser side.

comment:5 by Claude Paroz, 10 years ago

Could you please give us a little more information: what is displayed exactly in your widget (dot or comma), what value is actually posted to the request, what validation error message do you get ?

comment:6 by anonymous, 10 years ago

Sure. With settings above, everything works as excpected, comma is shown, but when I try to save, ValidationError is shown.
Error is, of course, in croatian, but it comes back to this:

invalid': _('Enter a number.'),

If L10N is set tu True, everything actually works. The problem is in this line. When self.localize is set to true, this works fine, but this should be run when localization is off, but DECIMAL_SEPARATOR is anything other than '.'. Would anything break if this "if" is simple removed?

if self.localize:

value = formats.sanitize_separators(value)

comment:7 by Claude Paroz, 10 years ago

So do you really get a comma in the widget value, even when L10N is off? Is that dot-to-comma conversion done by the browser itself (AFAIK Django is sending a dot in the HTML source)?

comment:8 by matija@…, 10 years ago

Ok, I got it.

This is definitely a design problem. Date/Datetime settings work regardless of L10N, and Decimal-related only when L10N is set. (sanitize_separators checks L10N first).

These two things are closely related and should follow the same logic.

IMHO the key question is should Dates AND Decimals (and other L10N-related stuff) follow DATE_FORMATS, DECIMAL_SEPARATOR and other L10N related setting when L10N is False. The answer should be Yes or No for all of them.

Yes, I do get a comma in the output. However, on re-saving, errors are shown. If I replace it with a dot, it works, and comma is shown in response.

Last edited 7 years ago by Anton Samarchyan (previous) (diff)

comment:9 by anonymous, 10 years ago

Sorry, no comma with the default widget. However, with TextInput, it is there.

This design problem still exists, at least docs should be updated indicating what works when. This definitely does not work as one may expect.

However, there SHOULD be a way to work with a fixed locale other than en-us ;)

comment:10 by Claude Paroz, 10 years ago

Triage Stage: Someday/MaybeAccepted

I think we should be as much as flexible as possible on the input side of things (potentially removing the is_localize/USE_L10N tests).
However, it's a bit tricky when you get ambiguous inputs like 24,637...

comment:11 by matija, 10 years ago

Well, it is clear that nothing should be done quickly. The whole thing seems a bit messy. I did test many different configs and mostly got unexpected results, either in Decimal or Date.

Id say this is 1.8 issue.

My deadline is approaching and I already spent too much time on this, right now I have a middleware forcing locale I want and L10N turned on and formats ... works fine.

Ill do an update when I find time to re-test from scratch (weekend perhaps).

comment:12 by Artem Skoretskiy, 7 years ago

I have the same issue.

It is very easy to reproduce:

# in

LANGUAGES = (('de', 'German'),)

# in

    (Decimal('0.25'), '0.25d'),
    (Decimal('0.50'), '0.5d'),
    (Decimal('0.75'), '0.75d'),
    (Decimal('1.00'), '1d'),

class Number(models.Model):
    num = models.DecimalField(max_digits=3, decimal_places=2, choices=CHOICES)

# in

class NumberAdmin(admin.ModelAdmin):

If you go to admin and try to save it would give you a validation error.

Reason is that it generates following HTML -- see comma in value:

<select name="num" id="id_num">
  <option value="0,25">0.25d</option>
  <option value="0,50">0.5d</option>
  <option value="0,75">0.75d</option>
  <option value="1,00" selected="">1d</option>

But when you provide choices -- it would be TypedChoiceField. Somehow it cannot handle comma in value and convert it correctly to decimal.

Interesting here if you drop choices. Then DecimalField would be used and everything would work -- you would use comma in the field.

BUT if you check HTML, it would use dots internally:

<input name="num" value="0.25" step="0.01" required="" id="id_num" type="number">

Also, POST request would send dot-separated value, not comma (though comma is shown in UI).

It seems if we force TypedChoiceField generate dot-separated HTML for Decimals despite of localization and i18n -- it would fix the issue.

Last edited 7 years ago by Artem Skoretskiy (previous) (diff)

comment:13 by Artem Skoretskiy, 7 years ago

Version: 1.61.11

It is still present in Django 1.11rc1

comment:14 by Artem Skoretskiy, 7 years ago

Cc: Artem Skoretskiy added

in reply to:  13 comment:15 by Sergey Lyapustin, 7 years ago

Replying to tonnzor:

It is still present in Django 1.11rc1

Also present in Django 1.11 release

comment:16 by Raphael Michel, 7 years ago

Owner: set to Raphael Michel
Status: newassigned

comment:18 by Florian Apolloner <apollo13@…>, 7 years ago

Resolution: fixed
Status: assignedclosed

In bde81414:

Fixed #22654 -- Broken decimal validation

comment:19 by Claude Paroz, 7 years ago

I think this change warrants a note in backwards incompatibilities:

For example, with following settings:


Before: "1.345" => 1.345
After: "1.345" => 1345

comment:20 by Tim Graham <timograham@…>, 7 years ago

In 504e778:

Refs #22654 -- Added additional tests and amended release note.

Note: See TracTickets for help on using tickets.
Back to Top