Opened 10 years ago
Last modified 10 years ago
#25095 closed Bug
Fields annotated for filtering which are not included in values are included in GROUP BY clause in SQL — at Initial Version
| Reported by: | mitchelljkotler | Owned by: | nobody |
|---|---|---|---|
| Component: | Database layer (models, ORM) | Version: | dev |
| Severity: | Normal | Keywords: | |
| Cc: | Triage Stage: | Ready for checkin | |
| Has patch: | yes | Needs documentation: | no |
| Needs tests: | no | Patch needs improvement: | no |
| Easy pickings: | no | UI/UX: | no |
Description
I am running a complex query, which annotates certain fields solely to filter on them. They are not included in a call to values. Another annotation is included, but it is incorrect due to the previous annotations being included in the GROUP BY clause.
Here is a not so simple example:
# We are filtering on the journey date, using the datediff function
# We annotate the reported tds fields, since we need two aliases of them for the different filterings applied
print EpTag.objects.filter(statuschanges__status=attached)\
.annotate(attach_date=F('statuschanges__reported_tds'))\
.filter(statuschanges__status=detached)\
.annotate(detach_date=F('statuschanges__reported_tds'))\
.annotate(journey_days=Func(F('detach_date'), F('attach_date'), function='DATEDIFF', output_field=IntegerField()))\
.filter(journey_days__lt=10)\
.annotate(name=F('object__producer__name'))\
.values('object__producer', 'name')\
.annotate(count=Count('pk', distinct=True))\
.order_by().query
SELECT `ep_object`.`cid`, `ep_entity`.`name` AS `name`, COUNT(DISTINCT `ep_tag`.`tid`) AS `count`
FROM `ep_tag`
INNER JOIN `ep_statuschange` ON ( `ep_tag`.`tid` = `ep_statuschange`.`tid` )
INNER JOIN `ep_statuschange` T4 ON ( `ep_tag`.`tid` = T4.`tid` )
LEFT OUTER JOIN `ep_object` ON ( `ep_tag`.`oid` = `ep_object`.`oid` )
LEFT OUTER JOIN `ep_entity` ON ( `ep_object`.`cid` = `ep_entity`.`eid` )
WHERE (`ep_statuschange`.`statusid` = 201 AND T4.`statusid` = 1000 AND DATEDIFF(T4.`reported_tds`, `ep_statuschange`.`reported_tds`) < 10)
# Group by still includes reported_tds and DATEDIFF fields, even though they were not selected. This breaks my count
GROUP BY `ep_object`.`cid`, `ep_statuschange`.`reported_tds`, T4.`reported_tds`, DATEDIFF(T4.`reported_tds`, `ep_statuschange`.`reported_tds`), `ep_entity`.`name` ORDER BY NULL
In django/db/models/sql/query.py, line 1751 - all annotations are included in the group by. I believe this should be using annotation_select instead of annotations.
Note:
See TracTickets
for help on using tickets.