Opened 11 years ago

Closed 7 years ago

Last modified 7 years ago

#20939 closed Cleanup/optimization (fixed)

Convert QuerySet to Query when filtering

Reported by: Anssi Kääriäinen Owned by: nobody
Component: Database layer (models, ORM) Version: dev
Severity: Normal Keywords:
Cc: Triage Stage: Accepted
Has patch: no Needs documentation: no
Needs tests: no Patch needs improvement: no
Easy pickings: no UI/UX: no

Description

The current ORM coding has very similar, yet not equivalent paths for using QuerySet and the internal Query when doing filter(something=queryset_or_query). It seems that converting a QuerySet to Query early on would lead to cleaner implementation. Proof of concept here: https://github.com/akaariai/django/tree/queryset_to_query_in_filter

There are two problems in the current implementation:

  • The way user-defined .values() and Django issued .values() in build_filter() is detected is ugly
  • There is no multidb protection (test_subquery in multiple_database.tests.QueryTestCase) fails).

I'll mark this as accepted directly in the sense of "worth doing if above problems can be addressed).

Change History (6)

comment:1 by Tim Graham, 7 years ago

I rebased and updated this to see if it's still worth doing and to learn something in the process. It's still incomplete and tests aren't passing: PR.

comment:2 by GitHub <noreply@…>, 7 years ago

Resolution: fixed
Status: newclosed

In 1bc249c:

Fixed #20939 -- Simplified query generation by converting QuerySet to Query.

Thanks Anssi Kääriäinen for the initial patch and Anssi, Simon Charette,
and Josh Smeaton for review.

comment:3 by Simon Charette <charette.s@…>, 7 years ago

In ec50937:

Refs #20939 -- Removed the Query._forced_pk hack.

comment:4 by Simon Charette <charette.s@…>, 7 years ago

In c9159a08:

Refs #20939 -- Removed the Query._prepare_as_filter_value() hack.

comment:5 by Simon Charette <charette.s@…>, 7 years ago

In e62ea0bb:

Refs #20939 -- Moved subquery ordering clearing optimization to the in lookup.

Queries could potentially be resolved in cases where ordering matter.

comment:6 by Tim Graham <timograham@…>, 7 years ago

In eb4724a0:

Reverted "Refs #20939 -- Moved subquery ordering clearing optimization to the in lookup."

This reverts commit e62ea0bb9cbb54c1eef848871fe3eab2bad268dc since it
broke multi-column in lookups and _meta.order_wrt on Oracle.

Note: See TracTickets for help on using tickets.
Back to Top