Django

Code

root/django/branches/sqlalchemy/docs/db-api.txt

Revision 4455, 60.7 kB (checked in by rmunn, 2 years ago)

Merged revisions 4186 to 4454 from trunk.

Line 
1 ======================
2 Database API reference
3 ======================
4
5 Once you've created your `data models`_, Django automatically gives you a
6 database-abstraction API that lets you create, retrieve, update and delete
7 objects. This document explains that API.
8
9 .. _`data models`: http://www.djangoproject.com/documentation/model_api/
10
11 Throughout this reference, we'll refer to the following models, which comprise
12 a weblog application::
13
14     class Blog(models.Model):
15         name = models.CharField(maxlength=100)
16         tagline = models.TextField()
17
18         def __str__(self):
19             return self.name
20
21     class Author(models.Model):
22         name = models.CharField(maxlength=50)
23         email = models.URLField()
24
25         def __str__(self):
26             return self.name
27
28     class Entry(models.Model):
29         blog = models.ForeignKey(Blog)
30         headline = models.CharField(maxlength=255)
31         body_text = models.TextField()
32         pub_date = models.DateTimeField()
33         authors = models.ManyToManyField(Author)
34
35         def __str__(self):
36             return self.headline
37
38 Creating objects
39 ================
40
41 To represent database-table data in Python objects, Django uses an intuitive
42 system: A model class represents a database table, and an instance of that
43 class represents a particular record in the database table.
44
45 To create an object, instantiate it using keyword arguments to the model class,
46 then call ``save()`` to save it to the database.
47
48 You import the model class from wherever it lives on the Python path, as you
49 may expect. (We point this out here because previous Django versions required
50 funky model importing.)
51
52 Assuming models live in a file ``mysite/blog/models.py``, here's an example::
53
54     from mysite.blog.models import Blog
55     b = Blog(name='Beatles Blog', tagline='All the latest Beatles news.')
56     b.save()
57
58 This performs an ``INSERT`` SQL statement behind the scenes. Django doesn't hit
59 the database until you explicitly call ``save()``.
60
61 The ``save()`` method has no return value.
62
63 To create an object and save it all in one step see the `create`__ method.
64
65 __ `create(**kwargs)`_
66
67 Auto-incrementing primary keys
68 ------------------------------
69
70 If a model has an ``AutoField`` -- an auto-incrementing primary key -- then
71 that auto-incremented value will be calculated and saved as an attribute on
72 your object the first time you call ``save()``.
73
74 Example::
75
76     b2 = Blog(name='Cheddar Talk', tagline='Thoughts on cheese.')
77     b2.id     # Returns None, because b doesn't have an ID yet.
78     b2.save()
79     b2.id     # Returns the ID of your new object.
80
81 There's no way to tell what the value of an ID will be before you call
82 ``save()``, because that value is calculated by your database, not by Django.
83
84 (For convenience, each model has an ``AutoField`` named ``id`` by default
85 unless you explicitly specify ``primary_key=True`` on a field. See the
86 `AutoField documentation`_.)
87
88 .. _AutoField documentation: http://www.djangoproject.com/documentation/model_api/#autofield
89
90 Explicitly specifying auto-primary-key values
91 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
92
93 If a model has an ``AutoField`` but you want to define a new object's ID
94 explicitly when saving, just define it explicitly before saving, rather than
95 relying on the auto-assignment of the ID.
96
97 Example::
98
99     b3 = Blog(id=3, name='Cheddar Talk', tagline='Thoughts on cheese.')
100     b3.id     # Returns 3.
101     b3.save()
102     b3.id     # Returns 3.
103
104 If you assign auto-primary-key values manually, make sure not to use an
105 already-existing primary-key value! If you create a new object with an explicit
106 primary-key value that already exists in the database, Django will assume
107 you're changing the existing record rather than creating a new one.
108
109 Given the above ``'Cheddar Talk'`` blog example, this example would override
110 the previous record in the database::
111
112     b4 = Blog(id=3, name='Not Cheddar', tagline='Anything but cheese.')
113     b4.save()  # Overrides the previous blog with ID=3!
114
115 See _`How Django knows to UPDATE vs. INSERT`, below, for the reason this
116 happens.
117
118 Explicitly specifying auto-primary-key values is mostly useful for bulk-saving
119 objects, when you're confident you won't have primary-key collision.
120
121 Saving changes to objects
122 =========================
123
124 To save changes to an object that's already in the database, use ``save()``.
125
126 Given a ``Blog`` instance ``b5`` that has already been saved to the database,
127 this example changes its name and updates its record in the database::
128
129     b5.name = 'New name'
130     b5.save()
131
132 This performs an ``UPDATE`` SQL statement behind the scenes. Django doesn't hit
133 the database until you explicitly call ``save()``.
134
135 The ``save()`` method has no return value.
136
137 How Django knows to UPDATE vs. INSERT
138 -------------------------------------
139
140 You may have noticed Django database objects use the same ``save()`` method
141 for creating and changing objects. Django abstracts the need to use ``INSERT``
142 or ``UPDATE`` SQL statements. Specifically, when you call ``save()``, Django
143 follows this algorithm:
144
145     * If the object's primary key attribute is set to a value that evaluates to
146       ``True`` (i.e., a value other than ``None`` or the empty string), Django
147       executes a ``SELECT`` query to determine whether a record with the given
148       primary key already exists.
149     * If the record with the given primary key does already exist, Django
150       executes an ``UPDATE`` query.
151     * If the object's primary key attribute is *not* set, or if it's set but a
152       record doesn't exist, Django executes an ``INSERT``.
153
154 The one gotcha here is that you should be careful not to specify a primary-key
155 value explicitly when saving new objects, if you cannot guarantee the
156 primary-key value is unused. For more on this nuance, see
157 "Explicitly specifying auto-primary-key values" above.
158
159 Retrieving objects
160 ==================
161
162 To retrieve objects from your database, you construct a ``QuerySet`` via a
163 ``Manager`` on your model class.
164
165 A ``QuerySet`` represents a collection of objects from your database. It can
166 have zero, one or many *filters* -- criteria that narrow down the collection
167 based on given parameters. In SQL terms, a ``QuerySet`` equates to a ``SELECT``
168 statement, and a filter is a limiting clause such as ``WHERE`` or ``LIMIT``.
169
170 You get a ``QuerySet`` by using your model's ``Manager``. Each model has at
171 least one ``Manager``, and it's called ``objects`` by default. Access it
172 directly via the model class, like so::
173
174     Blog.objects  # <django.db.models.manager.Manager object at ...>
175     b = Blog(name='Foo', tagline='Bar')
176     b.objects     # AttributeError: "Manager isn't accessible via Blog instances."
177
178 (``Managers`` are accessible only via model classes, rather than from model
179 instances, to enforce a separation between "table-level" operations and
180 "record-level" operations.)
181
182 The ``Manager`` is the main source of ``QuerySets`` for a model. It acts as a
183 "root" ``QuerySet`` that describes all objects in the model's database table.
184 For example, ``Blog.objects`` is the initial ``QuerySet`` that contains all
185 ``Blog`` objects in the database.
186
187 Retrieving all objects
188 ----------------------
189
190 The simplest way to retrieve objects from a table is to get all of them.
191 To do this, use the ``all()`` method on a ``Manager``.
192
193 Example::
194
195     all_entries = Entry.objects.all()
196
197 The ``all()`` method returns a ``QuerySet`` of all the objects in the database.
198
199 (If ``Entry.objects`` is a ``QuerySet``, why can't we just do ``Entry.objects``?
200 That's because ``Entry.objects``, the root ``QuerySet``, is a special case
201 that cannot be evaluated. The ``all()`` method returns a ``QuerySet`` that
202 *can* be evaluated.)
203
204 Filtering objects
205 -----------------
206
207 The root ``QuerySet`` provided by the ``Manager`` describes all objects in the
208 database table. Usually, though, you'll need to select only a subset of the
209 complete set of objects.
210
211 To create such a subset, you refine the initial ``QuerySet``, adding filter
212 conditions. The two most common ways to refine a ``QuerySet`` are:
213
214 ``filter(**kwargs)``
215     Returns a new ``QuerySet`` containing objects that match the given lookup
216     parameters.
217
218 ``exclude(**kwargs)``
219     Returns a new ``QuerySet`` containing objects that do *not* match the given
220     lookup parameters.
221
222 The lookup parameters (``**kwargs`` in the above function definitions) should
223 be in the format described in `Field lookups`_ below.
224
225 For example, to get a ``QuerySet`` of blog entries from the year 2006, use
226 ``filter()`` like so::
227
228     Entry.objects.filter(pub_date__year=2006)
229
230 (Note we don't have to add an ``all()`` -- ``Entry.objects.all().filter(...)``.
231 That would still work, but you only need ``all()`` when you want all objects
232 from the root ``QuerySet``.)
233
234 Chaining filters
235 ~~~~~~~~~~~~~~~~
236
237 The result of refining a ``QuerySet`` is itself a ``QuerySet``, so it's
238 possible to chain refinements together. For example::
239
240     Entry.objects.filter(
241         headline__startswith='What').exclude(
242             pub_date__gte=datetime.now()).filter(
243                 pub_date__gte=datetime(2005, 1, 1))
244
245 ...takes the initial ``QuerySet`` of all entries in the database, adds a
246 filter, then an exclusion, then another filter. The final result is a
247 ``QuerySet`` containing all entries with a headline that starts with "What",
248 that were published between January 1, 2005, and the current day.
249
250 Filtered QuerySets are unique
251 -----------------------------
252
253 Each time you refine a ``QuerySet``, you get a brand-new ``QuerySet`` that is
254 in no way bound to the previous ``QuerySet``. Each refinement creates a
255 separate and distinct ``QuerySet`` that can be stored, used and reused.
256
257 Example::
258
259     q1 = Entry.objects.filter(headline__startswith="What")
260     q2 = q1.exclude(pub_date__gte=datetime.now())
261     q3 = q1.filter(pub_date__gte=datetime.now())
262
263 These three ``QuerySets`` are separate. The first is a base ``QuerySet``
264 containing all entries that contain a headline starting with "What". The second
265 is a subset of the first, with an additional criteria that excludes records
266 whose ``pub_date`` is greater than now. The third is a subset of the first,
267 with an additional criteria that selects only the records whose ``pub_date`` is
268 greater than now. The initial ``QuerySet`` (``q1``) is unaffected by the
269 refinement process.
270
271 QuerySets are lazy
272 ------------------
273
274 ``QuerySets`` are lazy -- the act of creating a ``QuerySet`` doesn't involve
275 any database activity. You can stack filters together all day long, and Django
276 won't actually run the query until the ``QuerySet`` is *evaluated*.
277
278 When QuerySets are evaluated
279 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
280
281 You can evaluate a ``QuerySet`` in the following ways:
282
283     * **Iteration.** A ``QuerySet`` is iterable, and it executes its database
284       query the first time you iterate over it. For example, this will print
285       the headline of all entries in the database::
286
287           for e in Entry.objects.all():
288               print e.headline
289
290     * **Slicing.** As explained in `Limiting QuerySets`_ below, a ``QuerySet``
291       can be sliced, using Python's array-slicing syntax. Usually slicing a
292       ``QuerySet`` returns another (unevaluated )``QuerySet``, but Django will
293       execute the database query if you use the "step" parameter of slice
294       syntax.
295
296     * **repr().** A ``QuerySet`` is evaluated when you call ``repr()`` on it.
297       This is for convenience in the Python interactive interpreter, so you can
298       immediately see your results when using the API interactively.
299
300     * **len().** A ``QuerySet`` is evaluated when you call ``len()`` on it.
301       This, as you might expect, returns the length of the result list.
302
303       Note: *Don't* use ``len()`` on ``QuerySet``\s if all you want to do is
304       determine the number of records in the set. It's much more efficient to
305       handle a count at the database level, using SQL's ``SELECT COUNT(*)``,
306       and Django provides a ``count()`` method for precisely this reason. See
307       ``count()`` below.
308
309     * **list().** Force evaluation of a ``QuerySet`` by calling ``list()`` on
310       it. For example::
311
312           entry_list = list(Entry.objects.all())
313
314       Be warned, though, that this could have a large memory overhead, because
315       Django will load each element of the list into memory. In contrast,
316       iterating over a ``QuerySet`` will take advantage of your database to
317       load data and instantiate objects only as you need them.
318
319 Limiting QuerySets
320 ------------------
321
322 Use Python's array-slicing syntax to limit your ``QuerySet`` to a certain
323 number of results. This is the equivalent of SQL's ``LIMIT`` and ``OFFSET``
324 clauses.
325
326 For example, this returns the first 5 objects (``LIMIT 5``)::
327
328     Entry.objects.all()[:5]
329
330 This returns the fifth through tenth objects (``OFFSET 5 LIMIT 5``)::
331
332     Entry.objects.all()[5:10]
333
334 Generally, slicing a ``QuerySet`` returns a new ``QuerySet`` -- it doesn't
335 evaluate the query. An exception is if you use the "step" parameter of Python
336 slice syntax. For example, this would actually execute the query in order to
337 return a list of every *second* object of the first 10::
338
339     Entry.objects.all()[:10:2]
340
341 To retrieve a *single* object rather than a list
342 (e.g. ``SELECT foo FROM bar LIMIT 1``), use a simple index instead of a
343 slice. For example, this returns the first ``Entry`` in the database, after
344 ordering entries alphabetically by headline::
345
346     Entry.objects.order_by('headline')[0]
347
348 This is roughly equivalent to::
349
350     Entry.objects.order_by('headline')[0:1].get()
351
352 Note, however, that the first of these will raise ``IndexError`` while the
353 second will raise ``DoesNotExist`` if no objects match the given criteria.
354
355 QuerySet methods that return new QuerySets
356 ------------------------------------------
357
358 Django provides a range of ``QuerySet`` refinement methods that modify either
359 the types of results returned by the ``QuerySet`` or the way its SQL query is
360 executed.
361
362 ``filter(**kwargs)``
363 ~~~~~~~~~~~~~~~~~~~~
364
365 Returns a new ``QuerySet`` containing objects that match the given lookup
366 parameters.
367
368 The lookup parameters (``**kwargs``) should be in the format described in
369 `Field lookups`_ below. Multiple parameters are joined via ``AND`` in the
370 underlying SQL statement.
371
372 ``exclude(**kwargs)``
373 ~~~~~~~~~~~~~~~~~~~~~
374
375 Returns a new ``QuerySet`` containing objects that do *not* match the given
376 lookup parameters.
377
378 The lookup parameters (``**kwargs``) should be in the format described in
379 `Field lookups`_ below. Multiple parameters are joined via ``AND`` in the
380 underlying SQL statement, and the whole thing is enclosed in a ``NOT()``.
381
382 This example excludes all entries whose ``pub_date`` is the current date/time
383 AND whose ``headline`` is "Hello"::
384
385     Entry.objects.exclude(pub_date__gt=datetime.date(2005, 1, 3), headline='Hello')
386
387 In SQL terms, that evaluates to::
388
389     SELECT ...
390     WHERE NOT (pub_date > '2005-1-3' AND headline = 'Hello')
391
392 This example excludes all entries whose ``pub_date`` is the current date/time
393 OR whose ``headline`` is "Hello"::
394
395     Entry.objects.exclude(pub_date__gt=datetime.date(2005, 1, 3)).exclude(headline='Hello')
396
397 In SQL terms, that evaluates to::
398
399     SELECT ...
400     WHERE NOT pub_date > '2005-1-3'
401     AND NOT headline = 'Hello'
402
403 Note the second example is more restrictive.
404
405 ``order_by(*fields)``
406 ~~~~~~~~~~~~~~~~~~~~~
407
408 By default, results returned by a ``QuerySet`` are ordered by the ordering
409 tuple given by the ``ordering`` option in the model's ``Meta``. You can
410 override this on a per-``QuerySet`` basis by using the ``order_by`` method.
411
412 Example::
413
414     Entry.objects.filter(pub_date__year=2005).order_by('-pub_date', 'headline')
415
416 The result above will be ordered by ``pub_date`` descending, then by
417 ``headline`` ascending. The negative sign in front of ``"-pub_date"`` indicates
418 *descending* order. Ascending order is implied. To order randomly, use ``"?"``,
419 like so::
420
421     Entry.objects.order_by('?')
422
423 To order by a field in a different table, add the other table's name and a dot,
424 like so::
425
426     Entry.objects.order_by('blogs_blog.name', 'headline')
427
428 There's no way to specify whether ordering should be case sensitive. With
429 respect to case-sensitivity, Django will order results however your database
430 backend normally orders them.
431
432 ``distinct()``
433 ~~~~~~~~~~~~~~
434
435 Returns a new ``QuerySet`` that uses ``SELECT DISTINCT`` in its SQL query. This
436 eliminates duplicate rows from the query results.
437
438 By default, a ``QuerySet`` will not eliminate duplicate rows. In practice, this
439 is rarely a problem, because simple queries such as ``Blog.objects.all()``
440 don't introduce the possibility of duplicate result rows.
441
442 However, if your query spans multiple tables, it's possible to get duplicate
443 results when a ``QuerySet`` is evaluated. That's when you'd use ``distinct()``.
444
445 ``values(*fields)``
446 ~~~~~~~~~~~~~~~~~~~
447
448 Returns a ``ValuesQuerySet`` -- a ``QuerySet`` that evaluates to a list of
449 dictionaries instead of model-instance objects.
450
451 Each of those dictionaries represents an object, with the keys corresponding to
452 the attribute names of model objects.
453
454 This example compares the dictionaries of ``values()`` with the normal model
455 objects::
456
457     # This list contains a Blog object.
458     >>> Blog.objects.filter(name__startswith='Beatles')
459     [Beatles Blog]
460
461     # This list contains a dictionary.
462     >>> Blog.objects.filter(name__startswith='Beatles').values()
463     [{'id': 1, 'name': 'Beatles Blog', 'tagline': 'All the latest Beatles news.'}]
464
465 ``values()`` takes optional positional arguments, ``*fields``, which specify
466 field names to which the ``SELECT`` should be limited. If you specify the
467 fields, each dictionary will contain only the field keys/values for the fields
468 you specify. If you don't specify the fields, each dictionary will contain a
469 key and value for every field in the database table.
470
471 Example::
472
473     >>> Blog.objects.values()
474     [{'id': 1, 'name': 'Beatles Blog', 'tagline': 'All the latest Beatles news.'}],
475     >>> Blog.objects.values('id', 'name')
476     [{'id': 1, 'name': 'Beatles Blog'}]
477
478 A ``ValuesQuerySet`` is useful when you know you're only going to need values
479 from a small number of the available fields and you won't need the
480 functionality of a model instance object. It's more efficient to select only
481 the fields you need to use.
482
483 Finally, note a ``ValuesQuerySet`` is a subclass of ``QuerySet``, so it has all
484 methods of ``QuerySet``. You can call ``filter()`` on it, or ``order_by()``, or
485 whatever. Yes, that means these two calls are identical::
486
487     Blog.objects.values().order_by('id')
488     Blog.objects.order_by('id').values()
489
490 The people who made Django prefer to put all the SQL-affecting methods first,
491 followed (optionally) by any output-affecting methods (such as ``values()``),
492 but it doesn't really matter. This is your chance to really flaunt your
493 individualism.
494
495 ``dates(field, kind, order='ASC')``
496 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
497
498 Returns a ``DateQuerySet`` -- a ``QuerySet`` that evaluates to a list of
499 ``datetime.datetime`` objects representing all available dates of a particular
500 kind within the contents of the ``QuerySet``.
501
502 ``field`` should be the name of a ``DateField`` or ``DateTimeField`` of your
503 model.
504
505 ``kind`` should be either ``"year"``, ``"month"`` or ``"day"``. Each
506 ``datetime.datetime`` object in the result list is "truncated" to the given
507 ``type``.
508
509     * ``"year"`` returns a list of all distinct year values for the field.
510     * ``"month"`` returns a list of all distinct year/month values for the field.
511     * ``"day"`` returns a list of all distinct year/month/day values for the field.
512
513 ``order``, which defaults to ``'ASC'``, should be either ``'ASC'`` or
514 ``'DESC'``. This specifies how to order the results.
515
516 Examples::
517
518     >>> Entry.objects.dates('pub_date', 'year')
519     [datetime.datetime(2005, 1, 1)]
520     >>> Entry.objects.dates('pub_date', 'month')
521     [datetime.datetime(2005, 2, 1), datetime.datetime(2005, 3, 1)]
522     >>> Entry.objects.dates('pub_date', 'day')
523     [datetime.datetime(2005, 2, 20), datetime.datetime(2005, 3, 20)]
524     >>> Entry.objects.dates('pub_date', 'day', order='DESC')
525     [datetime.datetime(2005, 3, 20), datetime.datetime(2005, 2, 20)]
526     >>> Entry.objects.filter(headline__contains='Lennon').dates('pub_date', 'day')
527     [datetime.datetime(2005, 3, 20)]
528    
529 ``none()``
530 ~~~~~~~~~~
531
532 **New in Django development version**
533
534 Returns an ``EmptyQuerySet`` -- a ``QuerySet`` that always evaluates to
535 an empty list. This can be used in cases where you know that you should
536 return an empty result set and your caller is expecting a ``QuerySet``
537 object (instead of returning an empty list, for example.)
538
539 Examples::
540    
541     >>> Entry.objects.none()
542     []
543
544 ``select_related()``
545 ~~~~~~~~~~~~~~~~~~~~
546
547 Returns a ``QuerySet`` that will automatically "follow" foreign-key
548 relationships, selecting that additional related-object data when it executes
549 its query. This is a performance booster which results in (sometimes much)
550 larger queries but means later use of foreign-key relationships won't require
551 database queries.
552
553 The following examples illustrate the difference between plain lookups and
554 ``select_related()`` lookups. Here's standard lookup::
555
556     # Hits the database.
557     e = Entry.objects.get(id=5)
558
559     # Hits the database again to get the related Blog object.
560     b = e.blog
561
562 And here's ``select_related`` lookup::
563
564     # Hits the database.
565     e = Entry.objects.select_related().get(id=5)
566
567     # Doesn't hit the database, because e.blog has been prepopulated
568     # in the previous query.
569     b = e.blog
570
571 ``select_related()`` follows foreign keys as far as possible. If you have the
572 following models::
573
574     class City(models.Model):
575         # ...
576
577     class Person(models.Model):
578         # ...
579         hometown = models.ForeignKey(City)
580
581     class Book(models.Model):
582         # ...
583         author = models.ForeignKey(Person)
584
585 ...then a call to ``Book.objects.select_related().get(id=4)`` will cache the
586 related ``Person`` *and* the related ``City``::
587
588     b = Book.objects.select_related().get(id=4)
589     p = b.author         # Doesn't hit the database.
590     c = p.hometown       # Doesn't hit the database.
591
592     sv = Book.objects.get(id=4) # No select_related() in this example.
593     p = b.author         # Hits the database.
594     c = p.hometown       # Hits the database.
595
596 Note that ``select_related()`` does not follow foreign keys that have
597 ``null=True``.
598
599 ``extra(select=None, where=None, params=None, tables=None)``
600 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
601
602 Sometimes, the Django query syntax by itself can't easily express a complex
603 ``WHERE`` clause. For these edge cases, Django provides the ``extra()``
604 ``QuerySet`` modifier -- a hook for injecting specific clauses into the SQL
605 generated by a ``QuerySet``.
606
607 By definition, these extra lookups may not be portable to different database
608 engines (because you're explicitly writing SQL code) and violate the DRY
609 principle, so you should avoid them if possible.
610
611 Specify one or more of ``params``, ``select``, ``where`` or ``tables``. None
612 of the arguments is required, but you should use at least one of them.
613
614 ``select``
615     The ``select`` argument lets you put extra fields in the ``SELECT`` clause.
616     It should be a dictionary mapping attribute names to SQL clauses to use to
617     calculate that attribute.
618
619     Example::
620
621         Entry.objects.extra(select={'is_recent': "pub_date > '2006-01-01'"})
622
623     As a result, each ``Entry`` object will have an extra attribute,
624     ``is_recent``, a boolean representing whether the entry's ``pub_date`` is
625     greater than Jan. 1, 2006.
626
627     Django inserts the given SQL snippet directly into the ``SELECT``
628     statement, so the resulting SQL of the above example would be::
629
630         SELECT blog_entry.*, (pub_date > '2006-01-01')
631         FROM blog_entry;
632
633
634     The next example is more advanced; it does a subquery to give each
635     resulting ``Blog`` object an ``entry_count`` attribute, an integer count
636     of associated ``Entry`` objects::
637
638         Blog.objects.extra(
639             select={
640                 'entry_count': 'SELECT COUNT(*) FROM blog_entry WHERE blog_entry.blog_id = blog_blog.id'
641             },
642         )
643
644     (In this particular case, we're exploiting the fact that the query will
645     already contain the ``blog_blog`` table in its ``FROM`` clause.)
646
647     The resulting SQL of the above example would be::
648
649         SELECT blog_blog.*, (SELECT COUNT(*) FROM blog_entry WHERE blog_entry.blog_id = blog_blog.id)
650         FROM blog_blog;
651
652     Note that the parenthesis required by most database engines around
653     subqueries are not required in Django's ``select`` clauses. Also note that
654     some database backends, such as some MySQL versions, don't support
655     subqueries.
656
657 ``where`` / ``tables``
658     You can define explicit SQL ``WHERE`` clauses -- perhaps to perform
659     non-explicit joins -- by using ``where``. You can manually add tables to
660     the SQL ``FROM`` clause by using ``tables``.
661
662     ``where`` and ``tables`` both take a list of strings. All ``where``
663     parameters are "AND"ed to any other search criteria.
664
665     Example::
666
667         Entry.objects.extra(where=['id IN (3, 4, 5, 20)'])
668
669     ...translates (roughly) into the following SQL::
670
671         SELECT * FROM blog_entry WHERE id IN (3, 4, 5, 20);
672
673 ``params``
674     The ``select`` and ``where`` parameters described above may use standard
675     Python database string placeholders -- ``'%s'`` to indicate parameters the
676     database engine should automatically quote. The ``params`` argument is a
677     list of any extra parameters to be substituted.
678
679     Example::
680
681         Entry.objects.extra(where=['headline=%s'], params=['Lennon'])
682
683     Always use ``params`` instead of embedding values directly into ``select``
684     or ``where`` because ``params`` will ensure values are quoted correctly
685     according to your particular backend. (For example, quotes will be escaped
686     correctly.)
687
688     Bad::
689
690         Entry.objects.extra(where=["headline='Lennon'"])
691
692     Good::
693
694         Entry.objects.extra(where=['headline=%s'], params=['Lennon'])
695
696 QuerySet methods that do not return QuerySets
697 ---------------------------------------------
698
699 The following ``QuerySet`` methods evaluate the ``QuerySet`` and return
700 something *other than* a ``QuerySet``.
701
702 These methods do not use a cache (see _`Caching and QuerySets` below). Rather,
703 they query the database each time they're called.
704
705 ``get(**kwargs)``
706 ~~~~~~~~~~~~~~~~~
707
708 Returns the object matching the given lookup parameters, which should be in
709 the format described in `Field lookups`_.
710
711 ``get()`` raises ``AssertionError`` if more than one object was found.
712
713 ``get()`` raises a ``DoesNotExist`` exception if an object wasn't found for the
714 given parameters. The ``DoesNotExist`` exception is an attribute of the model
715 class. Example::
716
717     Entry.objects.get(id='foo') # raises Entry.DoesNotExist
718
719 The ``DoesNotExist`` exception inherits from
720 ``django.core.exceptions.ObjectDoesNotExist``, so you can target multiple
721 ``DoesNotExist`` exceptions. Example::
722
723     from django.core.exceptions import ObjectDoesNotExist
724     try:
725         e = Entry.objects.get(id=3)
726         b = Blog.objects.get(id=1)
727     except ObjectDoesNotExist:
728         print "Either the entry or blog doesn't exist."
729
730 ``create(**kwargs)``
731 ~~~~~~~~~~~~~~~~~~~~
732
733 A convenience method for creating an object and saving it all in one step.  Thus::
734
735     p = Person.objects.create(first_name="Bruce", last_name="Springsteen")
736
737 and::
738
739     p = Person(first_name="Bruce", last_name="Springsteen")
740     p.save()
741
742 are equivalent.
743
744 ``get_or_create(**kwargs)``
745 ~~~~~~~~~~~~~~~~~~~~~~~~~~~
746
747 A convenience method for looking up an object with the given kwargs, creating
748 one if necessary.
749
750 Returns a tuple of ``(object, created)``, where ``object`` is the retrieved or
751 created object and ``created`` is a boolean specifying whether a new object was
752 created.
753
754 This is meant as a shortcut to boilerplatish code and is mostly useful for
755 data-import scripts. For example::
756
757     try:
758         obj = Person.objects.get(first_name='John', last_name='Lennon')
759     except Person.DoesNotExist:
760         obj = Person(first_name='John', last_name='Lennon', birthday=date(1940, 10, 9))
761         obj.save()
762
763 This pattern gets quite unwieldy as the number of fields in a model goes up.
764 The above example can be rewritten using ``get_or_create()`` like so::
765
766     obj, created = Person.objects.get_or_create(first_name='John', last_name='Lennon',
767                       defaults={'birthday': date(1940, 10, 9)})
768
769 Any keyword arguments passed to ``get_or_create()`` -- *except* an optional one
770 called ``defaults`` -- will be used in a ``get()`` call. If an object is found,
771 ``get_or_create()`` returns a tuple of that object and ``False``. If an object
772 is *not* found, ``get_or_create()`` will instantiate and save a new object,
773 returning a tuple of the new object and ``True``. The new object will be
774 created according to this algorithm::
775
776     defaults = kwargs.pop('defaults', {})
777     params = dict([(k, v) for k, v in kwargs.items() if '__' not in k])
778     params.update(defaults)
779     obj = self.model(**params)
780     obj.save()
781
782 In English, that means start with any non-``'defaults'`` keyword argument that
783 doesn't contain a double underscore (which would indicate a non-exact lookup).
784 Then add the contents of ``defaults``, overriding any keys if necessary, and
785 use the result as the keyword arguments to the model class.
786
787 If you have a field named ``defaults`` and want to use it as an exact lookup in
788 ``get_or_create()``, just use ``'defaults__exact'``, like so::
789
790     Foo.objects.get_or_create(defaults__exact='bar', defaults={'defaults': 'baz'})
791
792 Finally, a word on using ``get_or_create()`` in Django views. As mentioned
793 earlier, ``get_or_create()`` is mostly useful in scripts that need to parse
794 data and create new records if existing ones aren't available. But if you need
795 to use ``get_or_create()`` in a view, please make sure to use it only in
796 ``POST`` requests unless you have a good reason not to. ``GET`` requests
797 shouldn't have any effect on data; use ``POST`` whenever a request to a page
798 has a side effect on your data. For more, see `Safe methods`_ in the HTTP spec.
799
800 .. _Safe methods: http://www.w3.org/Protocols/rfc2616/rfc2616-sec9.html#sec9.1.1
801
802 ``count()``
803 ~~~~~~~~~~~
804
805 Returns an integer representing the number of objects in the database matching
806 the ``QuerySet``. ``count()`` never raises exceptions.
807
808 Example::
809
810     # Returns the total number of entries in the database.
811     Entry.objects.count()
812
813     # Returns the number of entries whose headline contains 'Lennon'
814     Entry.objects.filter(headline__contains='Lennon').count()
815
816 ``count()`` performs a ``SELECT COUNT(*)`` behind the scenes, so you should
817 always use ``count()`` rather than loading all of the record into Python
818 objects and calling ``len()`` on the result.
819
820 Depending on which database you're using (e.g. PostgreSQL vs. MySQL),
821 ``count()`` may return a long integer instead of a normal Python integer. This
822 is an underlying implementation quirk that shouldn't pose any real-world
823 problems.
824
825 ``in_bulk(id_list)``
826 ~~~~~~~~~~~~~~~~~~~~
827
828 Takes a list of primary-key values and returns a dictionary mapping each
829 primary-key value to an instance of the object with the given ID.
830
831 Example::
832
833     >>> Blog.objects.in_bulk([1])
834     {1: Beatles Blog}
835     >>> Blog.objects.in_bulk([1, 2])
836     {1: Beatles Blog, 2: Cheddar Talk}
837     >>> Blog.objects.in_bulk([])
838     {}
839
840 If you pass ``in_bulk()`` an empty list, you'll get an empty dictionary.
841
842 ``latest(field_name=None)``
843 ~~~~~~~~~~~~~~~~~~~~~~~~~~~
844
845 Returns the latest object in the table, by date, using the ``field_name``
846 provided as the date field.
847
848 This example returns the latest ``Entry`` in the table, according to the
849 ``pub_date`` field::
850
851     Entry.objects.latest('pub_date')
852
853 If your model's ``Meta`` specifies ``get_latest_by``, you can leave off the
854 ``field_name`` argument to ``latest()``. Django will use the field specified in
855 ``get_latest_by`` by default.
856
857 Like ``get()``, ``latest()`` raises ``DoesNotExist`` if an object doesn't
858 exist with the given parameters.
859
860 Note ``latest()`` exists purely for convenience and readability.
861
862 Field lookups
863 -------------
864
865 Field lookups are how you specify the meat of an SQL ``WHERE`` clause. They're
866 specified as keyword arguments to the ``QuerySet`` methods ``filter()``,
867 ``exclude()`` and ``get()``.
868
869 Basic lookups keyword arguments take the form ``field__lookuptype=value``.
870 (That's a double-underscore). For example::
871
872     Entry.objects.filter(pub_date__lte='2006-01-01')
873
874 translates (roughly) into the following SQL::
875
876     SELECT * FROM blog_entry WHERE pub_date <= '2006-01-01';
877
878 .. admonition:: How this is possible
879
880    Python has the ability to define functions that accept arbitrary name-value
881    arguments whose names and values are evaluated at runtime. For more
882    information, see `Keyword Arguments`_ in the official Python tutorial.
883
884    .. _`Keyword Arguments`: http://docs.python.org/tut/node6.html#SECTION006720000000000000000
885
886 If you pass an invalid keyword argument, a lookup function will raise
887 ``TypeError``.
888
889 The database API supports the following lookup types:
890
891 exact
892 ~~~~~
893
894 Exact match. If the value provided for comparison is ``None``, it will
895 be interpreted as an SQL ``NULL`` (See isnull_ for more details). 
896
897 Examples::
898
899     Entry.objects.get(id__exact=14)
900     Entry.objects.get(id__exact=None)
901
902 SQL equivalents::
903
904     SELECT ... WHERE id = 14;
905     SELECT ... WHERE id = NULL;
906
907 iexact
908 ~~~~~~
909
910 Case-insensitive exact match.
911
912 Example::
913
914     Blog.objects.get(name__iexact='beatles blog')
915
916 SQL equivalent::
917
918     SELECT ... WHERE name ILIKE 'beatles blog';
919
920 Note this will match ``'Beatles Blog'``, ``'beatles blog'``,
921 ``'BeAtLes BLoG'``, etc.
922
923 contains
924 ~~~~~~~~
925
926 Case-sensitive containment test.
927
928 Example::
929
930     Entry.objects.get(headline__contains='Lennon')
931
932 SQL equivalent::
933
934     SELECT ... WHERE headline LIKE '%Lennon%';
935
936 Note this will match the headline ``'Today Lennon honored'`` but not
937 ``'today lennon honored'``.
938
939 SQLite doesn't support case-sensitive ``LIKE`` statements; ``contains`` acts
940 like ``icontains`` for SQLite.
941
942 icontains
943 ~~~~~~~~~
944
945 Case-insensitive containment test.
946
947 Example::
948
949     Entry.objects.get(headline__icontains='Lennon')
950
951 SQL equivalent::
952
953     SELECT ... WHERE headline ILIKE '%Lennon%';
954
955 gt
956 ~~
957
958 Greater than.
959
960 Example::
961
962     Entry.objects.filter(id__gt=4)
963
964 SQL equivalent::
965
966     SELECT ... WHERE id > 4;
967
968 gte
969 ~~~
970
971 Greater than or equal to.
972
973 lt
974 ~~
975
976 Less than.
977
978 lte
979 ~~~
980
981 Less than or equal to.
982
983 in
984 ~~
985
986 In a given list.
987
988 Example::
989
990     Entry.objects.filter(id__in=[1, 3, 4])
991
992 SQL equivalent::
993
994     SELECT ... WHERE id IN (1, 3, 4);
995
996 startswith
997 ~~~~~~~~~~
998
999 Case-sensitive starts-with.
1000
1001 Example::
1002
1003     Entry.objects.filter(headline__startswith='Will')
1004
1005 SQL equivalent::
1006
1007     SELECT ... WHERE headline LIKE 'Will%';
1008
1009 SQLite doesn't support case-sensitive ``LIKE`` statements; ``startswith`` acts
1010 like ``istartswith`` for SQLite.
1011
1012 istartswith
1013 ~~~~~~~~~~~
1014
1015 Case-insensitive starts-with.
1016
1017 Example::
1018
1019     Entry.objects.filter(headline__istartswith='will')
1020
1021 SQL equivalent::
1022
1023     SELECT ... WHERE headline ILIKE 'Will%';
1024
1025 endswith
1026 ~~~~~~~~
1027
1028 Case-sensitive ends-with.
1029
1030 Example::
1031
1032     Entry.objects.filter(headline__endswith='cats')
1033
1034 SQL equivalent::
1035
1036     SELECT ... WHERE headline LIKE '%cats';
1037
1038 SQLite doesn't support case-sensitive ``LIKE`` statements; ``endswith`` acts
1039 like ``iendswith`` for SQLite.
1040
1041 iendswith
1042 ~~~~~~~~~
1043
1044 Case-insensitive ends-with.
1045
1046 Example::
1047
1048     Entry.objects.filter(headline__iendswith='will')
1049
1050 SQL equivalent::
1051
1052     SELECT ... WHERE headline ILIKE '%will'
1053
1054 range
1055 ~~~~~
1056
1057 Range test (inclusive).
1058
1059 Example::
1060
1061     start_date = datetime.date(2005, 1, 1)
1062     end_date = datetime.date(2005, 3, 31)
1063     Entry.objects.filter(pub_date__range=(start_date, end_date))
1064
1065 SQL equivalent::
1066
1067     SELECT ... WHERE pub_date BETWEEN '2005-01-01' and '2005-03-31';
1068
1069 You can use ``range`` anywhere you can use ``BETWEEN`` in SQL -- for dates,
1070 numbers and even characters.
1071
1072 year
1073 ~~~~
1074
1075 For date/datetime fields, exact year match. Takes a four-digit year.
1076
1077 Example::
1078
1079     Entry.objects.filter(pub_date__year=2005)
1080
1081 SQL equivalent::
1082
1083     SELECT ... WHERE EXTRACT('year' FROM pub_date) = '2005';
1084
1085 (The exact SQL syntax varies for each database engine.)
1086
1087 month
1088 ~~~~~
1089
1090 For date/datetime fields, exact month match. Takes an integer 1 (January)
1091 through 12 (December).
1092
1093 Example::
1094
1095     Entry.objects.filter(pub_date__month=12)
1096
1097 SQL equivalent::
1098
1099     SELECT ... WHERE EXTRACT('month' FROM pub_date) = '12';
1100
1101 (The exact SQL syntax varies for each database engine.)
1102
1103 day
1104 ~~~
1105
1106 For date/datetime fields, exact day match.
1107
1108 Example::
1109
1110     Entry.objects.filter(pub_date__day=3)
1111
1112 SQL equivalent::
1113
1114     SELECT ... WHERE EXTRACT('day' FROM pub_date) = '3';
1115
1116 (The exact SQL syntax varies for each database engine.)
1117
1118 Note this will match any record with a pub_date on the third day of the month,
1119 such as January 3, July 3, etc.
1120
1121 isnull
1122 ~~~~~~
1123
1124 Takes either ``True`` or ``False``, which correspond to SQL queries of
1125 ``IS NULL`` and ``IS NOT NULL``, respectively.
1126
1127 Example::
1128
1129     Entry.objects.filter(pub_date__isnull=True)
1130
1131 SQL equivalent::
1132
1133     SELECT ... WHERE pub_date IS NULL;
1134
1135 .. admonition:: ``__isnull=True`` vs ``__exact=None``
1136
1137     There is an important difference between ``__isnull=True`` and
1138     ``__exact=None``. ``__exact=None`` will *always* return an empty result
1139     set, because SQL requires that no value is equal to ``NULL``.
1140     ``__isnull`` determines if the field is currently holding the value
1141     of ``NULL`` without performing a comparison.
1142
1143 search
1144 ~~~~~~
1145
1146 A boolean full-text search, taking advantage of full-text indexing. This is
1147 like ``contains`` but is significantly faster due to full-text indexing.
1148
1149 Note this is only available in MySQL and requires direct manipulation of the
1150 database to add the full-text index.
1151
1152 Default lookups are exact
1153 -------------------------
1154
1155 If you don't provide a lookup type -- that is, if your keyword argument doesn't
1156 contain a double underscore -- the lookup type is assumed to be ``exact``.
1157
1158 For example, the following two statements are equivalent::
1159
1160     Blog.objects.get(id__exact=14) # Explicit form
1161     Blog.objects.get(id=14) # __exact is implied
1162
1163 This is for convenience, because ``exact`` lookups are the common case.
1164
1165 The pk lookup shortcut
1166 ----------------------
1167
1168 For convenience, Django provides a ``pk`` lookup type, which stands for
1169 "primary_key".
1170
1171 In the example ``Blog`` model, the primary key is the ``id`` field, so these
1172 three statements are equivalent::
1173
1174     Blog.objects.get(id__exact=14) # Explicit form
1175     Blog.objects.get(id=14) # __exact is implied
1176     Blog.objects.get(pk=14) # pk implies id__exact
1177
1178 The use of ``pk`` isn't limited to ``__exact`` queries -- any query term
1179 can be combined with ``pk`` to perform a query on the primary key of a model::
1180
1181     # Get blogs entries  with id 1, 4 and 7
1182     Blog.objects.filter(pk__in=[1,4,7])
1183     # Get all blog entries with id > 14
1184     Blog.objects.filter(pk__gt=14)
1185    
1186 ``pk`` lookups also work across joins. For example, these three statements are
1187 equivalent::
1188
1189     Entry.objects.filter(blog__id__exact=3) # Explicit form
1190     Entry.objects.filter(blog__id=3) # __exact is implied
1191     Entry.objects.filter(blog__pk=3) # __pk implies __id__exact
1192
1193 Lookups that span relationships
1194 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1195
1196 Django offers a powerful and intuitive way to "follow" relationships in
1197 lookups, taking care of the SQL ``JOIN``\s for you automatically, behind the
1198 scenes. To span a relationship, just use the field name of related fields
1199 across models, separated by double underscores, until you get to the field you
1200 want.
1201
1202 This example retrieves all ``Entry`` objects with a ``Blog`` whose ``name``
1203 is ``'Beatles Blog'``::
1204
1205     Entry.objects.filter(blog__name__exact='Beatles Blog')
1206
1207 This spanning can be as deep as you'd like.
1208
1209 It works backwards, too. To refer to a "reverse" relationship, just use the
1210 lowercase name of the model.
1211
1212 This example retrieves all ``Blog`` objects which have at least one ``Entry``
1213 whose ``headline`` contains ``'Lennon'``::
1214
1215     Blog.objects.filter(entry__headline__contains='Lennon')
1216
1217 Escaping parenthesis and underscores in LIKE statements
1218 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1219
1220 The field lookups that equate to ``LIKE`` SQL statements (``iexact``,
1221 ``contains``, ``icontains``, ``startswith``, ``istartswith``, ``endswith``
1222 and ``iendswith``) will automatically escape the two special characters used in
1223</