Opened 15 years ago
Closed 3 years ago
#13295 closed New feature (wontfix)
Add a Meta.sequence option to models
Reported by: | Max Shabalihin | Owned by: | nobody |
---|---|---|---|
Component: | Database layer (models, ORM) | Version: | 1.1 |
Severity: | Normal | Keywords: | sequence last_id postgresql |
Cc: | Matti Haavikko | Triage Stage: | Unreviewed |
Has patch: | no | Needs documentation: | no |
Needs tests: | no | Patch needs improvement: | no |
Easy pickings: | no | UI/UX: | no |
Description (last modified by )
Attachments (2)
Change History (14)
by , 15 years ago
Attachment: | postgresql_name_seq.diff added |
---|
by , 15 years ago
Attachment: | postgresql_name_seq.2.diff added |
---|
comment:1 by , 15 years ago
Keywords: | sequence added; sequnce removed |
---|---|
milestone: | 1.2 |
Needs documentation: | set |
Needs tests: | set |
comment:2 by , 15 years ago
Patch needs improvement: | set |
---|---|
Triage Stage: | Unreviewed → Accepted |
comment:3 by , 15 years ago
At least tickets #8901, #13179 and #1946 deal with the same problem. There are actually a lot more issues than just fixing last_insert_id to use the custom db_seq. Postgresql truncates sequence names to 63 characters, and we need to deal with table creation, sequence resetting and sql_flush. We still need to think how to deal with problems presented by users trying to use the same sequence for multiple tables. And we need to take care of automatically generated m2m tables and their sequences.
First problem is ticket #8901. If it happens so that the table_name + column_name + _seq is longer than 63 characters, then the sequence name will be truncated to 63 characters in a complex way by postgresql. Complex here means that it is not easy to create the right sequence name for all supported versions of postgresql. Django currently doesn't work at all for tables where the table_nam + column_name is longer than 63 characters.
There is a function pg_get_serial_sequence(tablename, column) (see ticket #13179), which returns the sequence name for given column. Unfortunately this only works for tables having serial columns, that is
id serial not null primary key
, not for tables having column of type
id integer primary key default nextval('some_custom_sequence_name')
This means that using pg_get_serial_sequence will result in backwards incompatible behaviour for custom schemas where the default nextval way of specifying the sequence is used, and it can't be used with custom sequence names. Issuing postgresql command
ALTER SEQUENCE tablename_colname_seq OWNED BY tablename.colname;
will fix the problem, but it is still a backwards incompatible change. It is impossible to have the sequence owned by multiple tables, so I don't think using pg_get_serial_sequence is a good solution.
The proposed solution:
Models get a new meta attribute, db_seq. In initialization we set up _meta.db_seq to always contain the right sequence name for the model, either the given db_seq or %s_%s_seq % (table_name, autofield_column_name). In model validation we check that the db_seq is shorter than 63 characters long, indifferent of if it is automatically generated or given as meta option. This should not be backwards incompatible, as currently if the sequence is longer than 63 characters django will not work.
In table generation, if db_seq is not automatically generated, we generate the pk column as "col_name integer not null primary key default next_val('db_seq')", else we will use the current behaviour of "col_name serial not null primary key". When using the next_val definition we need to generate the sequence before we generate the table. We need to also alter some other places (at least db/backends/postgresql/options.py functions sql_flush, last_insert_id, and sequence_reset_sql).
There is another problem: users will probably want to use the same sequence for multiple tables. In this case, we should create the sequence only once. But how to handle sequence_reset_sql? It should probably go through all the tables using the sequence and determine the maximum of all the ids in use. A simple solution for this would be to document that if you want to use the same sequence for multiple tables, Django currently can't manage the database schema for you. Note that the solution using pg_get_serial_sequence would break if the user tried to use the same sequence for multiple tables.
Still one more problem: what to do with autogenerated m2m tables. Here django currently uses table_name_id_seq as sequence name, but if I am not mistaken it is also possible for the sequence name to be longer than 63 characters here.
I think I can do the coding to get the proposed solution to work, but before starting the work it would be good to get a confirmation that the proposed solution has a chance to get accepted into 1.3.
comment:4 by , 14 years ago
Severity: | → Normal |
---|---|
Type: | → New feature |
comment:7 by , 14 years ago
Description: | modified (diff) |
---|---|
Summary: | alternate name sequence for postgresql in class meta db_seq → Add a Meta.sequence option to models |
Updated title, description.
comment:9 by , 8 years ago
I wonder if there is already a solution after so many years for this problem?
comment:10 by , 5 years ago
Cc: | added |
---|
comment:12 by , 3 years ago
Has patch: | unset |
---|---|
Needs documentation: | unset |
Needs tests: | unset |
Patch needs improvement: | unset |
Resolution: | → wontfix |
Status: | new → closed |
Triage Stage: | Accepted → Unreviewed |
Replying to Claude Paroz:
Should this be closed now that #30511 was merged?
There are still scenarios that could be covered by Meta.sequence
, e.g. common sequence for multiple tables. However, since we are using identity columns on PostgreSQL and Oracle it becomes much more complicated or even not feasible. I don't think there is a way to move it forward. Closing as "wontfix".
It's an edge case, but one that's probably worth supporting.
Regarding the patch --