Ticket #17258: benchmark.txt

File benchmark.txt, 7.2 KB (added by Anssi Kääriäinen, 12 years ago)

djangobench results (see comment 17)

Line 
1Running all benchmarks
2Control: Django 1.4 pre-alpha (in git branch master)
3Experiment: Django 1.4 alpha-julien 0 (in git branch connections_threadlocal)
4
5Running 'form_clean' benchmark ...
6Min: 0.000084 -> 0.000085: 1.0114x slower
7Avg: 0.000089 -> 0.000089: 1.0049x faster
8Not significant
9Stddev: 0.00004 -> 0.00004: 1.0181x smaller (N = 400)
10
11Running 'form_create' benchmark ...
12Min: 0.000175 -> 0.000175: no change
13Avg: 0.000206 -> 0.000182: 1.1330x faster
14Not significant
15Stddev: 0.00038 -> 0.00004: 9.0656x smaller (N = 400)
16
17Running 'l10n_render' benchmark ...
18Min: 0.025791 -> 0.025472: 1.0125x faster
19Avg: 0.026388 -> 0.025997: 1.0150x faster
20Significant (t=2.672148)
21Stddev: 0.00211 -> 0.00203: 1.0423x smaller (N = 400)
22
23Running 'model_creation' benchmark ...
24Min: 0.000542 -> 0.000547: 1.0092x slower
25Avg: 0.000557 -> 0.000560: 1.0057x slower
26Not significant
27Stddev: 0.00009 -> 0.00008: 1.0397x smaller (N = 400)
28
29Running 'multi_value_dict' benchmark ...
30Min: 0.000143 -> 0.000145: 1.0150x slower
31Avg: 0.001389 -> 0.001401: 1.0087x slower
32Not significant
33Stddev: 0.00072 -> 0.00073: 1.0147x larger (N = 400)
34
35Running 'qs_filter_chaining' benchmark ...
36Min: 0.007770 -> 0.007741: 1.0037x faster
37Avg: 0.007847 -> 0.008375: 1.0673x slower
38Significant (t=-5.061584)
39Stddev: 0.00010 -> 0.00208: 21.0670x larger (N = 400)
40
41Running 'query_aggregate' benchmark ...
42Min: 0.000827 -> 0.000829: 1.0026x slower
43Avg: 0.000840 -> 0.000842: 1.0022x slower
44Not significant
45Stddev: 0.00002 -> 0.00002: 1.0861x smaller (N = 400)
46
47Running 'query_all' benchmark ...
48Min: 0.090574 -> 0.090021: 1.0061x faster
49Avg: 0.095761 -> 0.097979: 1.0232x slower
50Significant (t=-2.782593)
51Stddev: 0.00876 -> 0.01331: 1.5187x larger (N = 400)
52
53Running 'query_all_multifield' benchmark ...
54Min: 0.177597 -> 0.177254: 1.0019x faster
55Avg: 0.195446 -> 0.188215: 1.0384x faster
56Significant (t=3.777409)
57Stddev: 0.03400 -> 0.01761: 1.9302x smaller (N = 400)
58
59Running 'query_annotate' benchmark ...
60Min: 0.001865 -> 0.001858: 1.0037x faster
61Avg: 0.001895 -> 0.001890: 1.0028x faster
62Not significant
63Stddev: 0.00004 -> 0.00005: 1.0631x larger (N = 400)
64
65Running 'query_complex_filter' benchmark ...
66Min: 0.000553 -> 0.000547: 1.0113x faster
67Avg: 0.000563 -> 0.000558: 1.0096x faster
68Significant (t=3.994850)
69Stddev: 0.00002 -> 0.00002: 1.0276x smaller (N = 400)
70
71Running 'query_count' benchmark ...
72Min: 0.000692 -> 0.000690: 1.0028x faster
73Avg: 0.000706 -> 0.000702: 1.0060x faster
74Significant (t=2.212235)
75Stddev: 0.00003 -> 0.00003: 1.0079x larger (N = 400)
76
77Running 'query_dates' benchmark ...
78Min: 0.002038 -> 0.002045: 1.0034x slower
79Avg: 0.002070 -> 0.002079: 1.0047x slower
80Significant (t=-3.135644)
81Stddev: 0.00004 -> 0.00005: 1.2307x larger (N = 400)
82
83Running 'query_delete' benchmark ...
84Min: 0.000656 -> 0.000657: 1.0015x slower
85Avg: 0.000668 -> 0.000670: 1.0041x slower
86Not significant
87Stddev: 0.00003 -> 0.00004: 1.5238x larger (N = 400)
88
89Running 'query_distinct' benchmark ...
90Min: 0.001142 -> 0.001147: 1.0044x slower
91Avg: 0.001161 -> 0.001168: 1.0057x slower
92Significant (t=-2.953399)
93Stddev: 0.00003 -> 0.00003: 1.1240x larger (N = 400)
94
95Running 'query_exclude' benchmark ...
96Min: 0.001479 -> 0.001467: 1.0081x faster
97Avg: 0.001529 -> 0.001493: 1.0245x faster
98Significant (t=3.152908)
99Stddev: 0.00023 -> 0.00003: 6.7476x smaller (N = 400)
100
101Running 'query_exists' benchmark ...
102Min: 0.003177 -> 0.003173: 1.0014x faster
103Avg: 0.003230 -> 0.003239: 1.0029x slower
104Not significant
105Stddev: 0.00006 -> 0.00024: 3.9544x larger (N = 400)
106
107Running 'query_filter' benchmark ...
108Min: 0.001131 -> 0.001145: 1.0127x slower
109Avg: 0.001184 -> 0.001168: 1.0130x faster
110Not significant
111Stddev: 0.00039 -> 0.00005: 7.3639x smaller (N = 400)
112
113Running 'query_get' benchmark ...
114Min: 0.001638 -> 0.001644: 1.0038x slower
115Avg: 0.001721 -> 0.002283: 1.3268x slower
116Significant (t=-5.577942)
117Stddev: 0.00019 -> 0.00201: 10.6955x larger (N = 400)
118
119Running 'query_get_or_create' benchmark ...
120Min: 0.003827 -> 0.003863: 1.0094x slower
121Avg: 0.003950 -> 0.003942: 1.0021x faster
122Not significant
123Stddev: 0.00087 -> 0.00028: 3.1542x smaller (N = 400)
124
125Running 'query_in_bulk' benchmark ...
126Min: 0.001082 -> 0.001088: 1.0057x slower
127Avg: 0.001173 -> 0.001111: 1.0556x faster
128Not significant
129Stddev: 0.00069 -> 0.00005: 15.2823x smaller (N = 400)
130
131Running 'query_iterator' benchmark ...
132Min: 0.000765 -> 0.000770: 1.0065x slower
133Avg: 0.000780 -> 0.000822: 1.0547x slower
134Not significant
135Stddev: 0.00002 -> 0.00047: 18.8103x larger (N = 400)
136
137Running 'query_latest' benchmark ...
138Min: 0.001282 -> 0.001275: 1.0056x faster
139Avg: 0.001332 -> 0.001295: 1.0288x faster
140Not significant
141Stddev: 0.00039 -> 0.00004: 9.0008x smaller (N = 400)
142
143Running 'query_none' benchmark ...
144Min: 0.000083 -> 0.000083: no change
145Avg: 0.000086 -> 0.000086: 1.0009x faster
146Not significant
147Stddev: 0.00001 -> 0.00001: 1.3948x smaller (N = 400)
148
149Running 'query_order_by' benchmark ...
150Min: 0.001223 -> 0.001222: 1.0008x faster
151Avg: 0.001246 -> 0.001245: 1.0010x faster
152Not significant
153Stddev: 0.00005 -> 0.00004: 1.1513x smaller (N = 400)
154
155Running 'query_raw' benchmark ...
156Min: 0.062628 -> 0.062044: 1.0094x faster
157Avg: 0.066457 -> 0.064237: 1.0346x faster
158Significant (t=3.542193)
159Stddev: 0.01157 -> 0.00481: 2.4039x smaller (N = 400)
160
161Running 'query_raw_deferred' benchmark ...
162Min: 0.063556 -> 0.063586: 1.0005x slower
163Avg: 0.067137 -> 0.065748: 1.0211x faster
164Significant (t=2.409999)
165Stddev: 0.00987 -> 0.00594: 1.6623x smaller (N = 400)
166
167Running 'query_select_related' benchmark ...
168Min: 0.000992 -> 0.000996: 1.0041x slower
169Avg: 0.001016 -> 0.001022: 1.0054x slower
170Not significant
171Stddev: 0.00011 -> 0.00011: 1.0005x larger (N = 400)
172
173Running 'query_update' benchmark ...
174Min: 0.000828 -> 0.000836: 1.0098x slower
175Avg: 0.000842 -> 0.001079: 1.2809x slower
176Significant (t=-3.259733)
177Stddev: 0.00003 -> 0.00145: 55.2237x larger (N = 400)
178
179Running 'query_values' benchmark ...
180Min: 0.000967 -> 0.000966: 1.0010x faster
181Avg: 0.001859 -> 0.001018: 1.8254x faster
182Significant (t=8.129374)
183Stddev: 0.00203 -> 0.00041: 4.9356x smaller (N = 400)
184
185Running 'query_values_list' benchmark ...
186Min: 0.000931 -> 0.000927: 1.0044x faster
187Avg: 0.000948 -> 0.000942: 1.0059x faster
188Significant (t=2.604915)
189Stddev: 0.00003 -> 0.00003: 1.0703x smaller (N = 400)
190
191Running 'startup' benchmark ...
1920.322627 -> 0.295430: 1.0921x faster
193
194Running 'template_compilation' benchmark ...
195Min: 0.001854 -> 0.001858: 1.0022x slower
196Avg: 0.002026 -> 0.002030: 1.0019x slower
197Not significant
198Stddev: 0.00284 -> 0.00284: 1.0015x smaller (N = 400)
199
200Running 'template_render' benchmark ...
201Min: 0.034337 -> 0.034169: 1.0049x faster
202Avg: 0.035131 -> 0.035166: 1.0010x slower
203Not significant
204Stddev: 0.00296 -> 0.00390: 1.3190x larger (N = 400)
205
206Running 'template_render_simple' benchmark ...
207Min: 0.000304 -> 0.000306: 1.0063x slower
208Avg: 0.000453 -> 0.000453: 1.0004x faster
209Not significant
210Stddev: 0.00283 -> 0.00282: 1.0033x smaller (N = 400)
211
212Running 'url_resolve' benchmark ...
213Min: 0.000513 -> 0.000512: 1.0019x faster
214Avg: 0.000537 -> 0.000541: 1.0080x slower
215Not significant
216Stddev: 0.00024 -> 0.00025: 1.0280x larger (N = 400)
217
218Running 'url_reverse' benchmark ...
219Min: 0.000390 -> 0.000392: 1.0055x slower
220Avg: 0.000420 -> 0.000421: 1.0025x slower
221Not significant
222Stddev: 0.00044 -> 0.00043: 1.0030x smaller (N = 400)
223
Back to Top