Code

Ticket #10498: bench.txt

File bench.txt, 7.3 KB (added by akaariai, 2 years ago)

djangobench log between 1.3.1 and r17672

Line 
1Running all benchmarks
2Control: Django 1.3.1 SVN-17428 (in django-control)
3Experiment: Django 1.4c1 (in django-experiment)
4
5Running 'default_middleware' benchmark ...
6Min: -0.000069 -> -0.000018: 0.2586x slower
7Avg: 0.000456 -> 0.000543: 1.1914x slower
8Not significant
9Stddev: 0.00343 -> 0.00120: 2.8571x smaller (N = 100)
10
11Running 'form_clean' benchmark ...
12Min: 0.000028 -> 0.000028: no change
13Avg: 0.000034 -> 0.000035: 1.0364x slower
14Not significant
15Stddev: 0.00002 -> 0.00003: 1.4440x larger (N = 100)
16
17Running 'form_create' benchmark ...
18Min: 0.000018 -> 0.000053: 2.9211x slower
19Avg: 0.000065 -> 0.000063: 1.0291x faster
20Not significant
21Stddev: 0.00002 -> 0.00001: 1.3612x smaller (N = 100)
22
23Running 'l10n_render' benchmark ...
24Min: 0.005449 -> 0.005963: 1.0944x slower
25Avg: 0.006950 -> 0.006772: 1.0263x faster
26Not significant
27Stddev: 0.00145 -> 0.00117: 1.2325x smaller (N = 100)
28
29Running 'model_creation' benchmark ...
30Min: 0.000112 -> 0.000134: 1.1957x slower
31Avg: 0.000203 -> 0.000206: 1.0154x slower
32Not significant
33Stddev: 0.00011 -> 0.00010: 1.1487x smaller (N = 100)
34
35Running 'multi_value_dict' benchmark ...
36Min: 0.000016 -> -0.000004: -3.6667x faster
37Avg: 0.000124 -> 0.000192: 1.5388x slower
38Not significant
39Stddev: 0.00010 -> 0.00070: 7.0714x larger (N = 100)
40
41Running 'qs_filter_chaining' benchmark ...
42Min: 0.001896 -> 0.001741: 1.0890x faster
43Avg: 0.002431 -> 0.002896: 1.1916x slower
44Significant (t=-4.290463)
45Stddev: 0.00037 -> 0.00102: 2.7618x larger (N = 100)
46
47Running 'query_aggregate' benchmark ...
48Min: 0.000038 -> 0.000045: 1.1750x slower
49Avg: 0.000288 -> 0.000276: 1.0469x faster
50Not significant
51Stddev: 0.00014 -> 0.00005: 2.5378x smaller (N = 100)
52
53Running 'query_all' benchmark ...
54Min: 0.021516 -> 0.024808: 1.1530x slower
55Avg: 0.026032 -> 0.030944: 1.1887x slower
56Significant (t=-5.668286)
57Stddev: 0.00516 -> 0.00696: 1.3479x larger (N = 100)
58
59Running 'query_all_multifield' benchmark ...
60Min: 0.043492 -> 0.053683: 1.2343x slower
61Avg: 0.049113 -> 0.061782: 1.2580x slower
62Significant (t=-11.048640)
63Stddev: 0.00686 -> 0.00919: 1.3382x larger (N = 100)
64
65Running 'query_annotate' benchmark ...
66Min: 0.000344 -> 0.000219: 1.5702x faster
67Avg: 0.000803 -> 0.000866: 1.0795x slower
68Not significant
69Stddev: 0.00038 -> 0.00040: 1.0645x larger (N = 100)
70
71Running 'query_complex_filter' benchmark ...
72Min: 0.000056 -> 0.000044: 1.2703x faster
73Avg: 0.000179 -> 0.000186: 1.0421x slower
74Not significant
75Stddev: 0.00004 -> 0.00010: 2.6444x larger (N = 100)
76
77Running 'query_count' benchmark ...
78Min: 0.000076 -> 0.000073: 1.0425x faster
79Avg: 0.000232 -> 0.000239: 1.0286x slower
80Not significant
81Stddev: 0.00004 -> 0.00003: 1.0441x smaller (N = 100)
82
83Running 'query_dates' benchmark ...
84Min: 0.000232 -> 0.000346: 1.4913x slower
85Avg: 0.000628 -> 0.001046: 1.6644x slower
86Significant (t=-9.163837)
87Stddev: 0.00015 -> 0.00043: 2.8262x larger (N = 100)
88
89Running 'query_delete' benchmark ...
90Min: 0.000183 -> 0.000118: 1.5515x faster
91Avg: 0.000461 -> 0.000251: 1.8347x faster
92Significant (t=2.292371)
93Stddev: 0.00091 -> 0.00009: 10.5890x smaller (N = 100)
94
95Running 'query_distinct' benchmark ...
96Min: 0.000146 -> 0.000114: 1.2803x faster
97Avg: 0.000358 -> 0.000394: 1.1011x slower
98Significant (t=-2.727245)
99Stddev: 0.00004 -> 0.00013: 2.8052x larger (N = 100)
100
101Running 'query_exclude' benchmark ...
102Min: 0.000250 -> 0.000168: 1.4886x faster
103Avg: 0.000527 -> 0.000498: 1.0568x faster
104Not significant
105Stddev: 0.00012 -> 0.00012: 1.0592x smaller (N = 100)
106
107Running 'query_exists' benchmark ...
108Min: 0.000589 -> 0.000816: 1.3854x slower
109Avg: 0.001064 -> 0.001639: 1.5414x slower
110Significant (t=-9.287342)
111Stddev: 0.00017 -> 0.00060: 3.4986x larger (N = 100)
112
113Running 'query_filter' benchmark ...
114Min: 0.000264 -> 0.000153: 1.7270x faster
115Avg: 0.000739 -> 0.000408: 1.8099x faster
116Significant (t=10.240275)
117Stddev: 0.00029 -> 0.00014: 2.1514x smaller (N = 100)
118
119Running 'query_get' benchmark ...
120Min: 0.027968 -> 0.028000: 1.0011x slower
121Avg: 0.035184 -> 0.030973: 1.1360x faster
122Significant (t=4.751685)
123Stddev: 0.00832 -> 0.00305: 2.7306x smaller (N = 100)
124
125Running 'query_get_or_create' benchmark ...
126Min: 0.000833 -> 0.000884: 1.0616x slower
127Avg: 0.001271 -> 0.001377: 1.0834x slower
128Significant (t=-3.042809)
129Stddev: 0.00023 -> 0.00026: 1.1360x larger (N = 100)
130
131Running 'query_in_bulk' benchmark ...
132Min: 0.000029 -> 0.000141: 4.8443x slower
133Avg: 0.000400 -> 0.000399: 1.0035x faster
134Not significant
135Stddev: 0.00014 -> 0.00011: 1.3016x smaller (N = 100)
136
137Running 'query_iterator' benchmark ...
138Min: 0.000063 -> 0.000105: 1.6705x slower
139Avg: 0.000251 -> 0.000255: 1.0159x slower
140Not significant
141Stddev: 0.00011 -> 0.00005: 2.0956x smaller (N = 100)
142
143Running 'query_latest' benchmark ...
144Min: 0.000182 -> 0.000037: 4.8910x faster
145Avg: 0.000399 -> 0.000417: 1.0472x slower
146Not significant
147Stddev: 0.00016 -> 0.00014: 1.2016x smaller (N = 100)
148
149Running 'query_none' benchmark ...
150Min: 0.000029 -> 0.000030: 1.0331x slower
151Avg: 0.000034 -> 0.000036: 1.0530x slower
152Not significant
153Stddev: 0.00001 -> 0.00001: 1.1133x larger (N = 100)
154
155Running 'query_order_by' benchmark ...
156Min: 0.000087 -> 0.000119: 1.3671x slower
157Avg: 0.000398 -> 0.000405: 1.0197x slower
158Not significant
159Stddev: 0.00012 -> 0.00009: 1.3884x smaller (N = 100)
160
161Running 'query_raw' benchmark ...
162Min: 0.014185 -> 0.017529: 1.2357x slower
163Avg: 0.015806 -> 0.029309: 1.8543x slower
164Significant (t=-9.200864)
165Stddev: 0.00137 -> 0.01461: 10.6480x larger (N = 100)
166
167Running 'query_raw_deferred' benchmark ...
168Min: 0.015319 -> 0.015920: 1.0392x slower
169Avg: 0.016947 -> 0.017143: 1.0115x slower
170Not significant
171Stddev: 0.00139 -> 0.00156: 1.1192x larger (N = 100)
172
173Running 'query_select_related' benchmark ...
174Min: 0.005626 -> 0.006284: 1.1170x slower
175Avg: 0.006364 -> 0.007066: 1.1102x slower
176Significant (t=-11.357409)
177Stddev: 0.00043 -> 0.00044: 1.0245x larger (N = 100)
178
179Running 'query_update' benchmark ...
180Min: 0.000047 -> 0.000035: 1.3401x faster
181Avg: 0.000293 -> 0.000280: 1.0447x faster
182Not significant
183Stddev: 0.00009 -> 0.00008: 1.0836x smaller (N = 100)
184
185Running 'query_values' benchmark ...
186Min: 0.000061 -> 0.000223: 3.6523x slower
187Avg: 0.000324 -> 0.000334: 1.0315x slower
188Not significant
189Stddev: 0.00011 -> 0.00008: 1.4061x smaller (N = 100)
190
191Running 'query_values_list' benchmark ...
192Min: 0.000072 -> 0.000062: 1.1615x faster
193Avg: 0.000316 -> 0.000336: 1.0625x slower
194Not significant
195Stddev: 0.00012 -> 0.00009: 1.3643x smaller (N = 100)
196
197Running 'startup' benchmark ...
1980.076804 -> 0.148288: 1.9307x slower
199
200Running 'template_compilation' benchmark ...
201Min: 0.000270 -> 0.000243: 1.1119x faster
202Avg: 0.000634 -> 0.000711: 1.1209x slower
203Not significant
204Stddev: 0.00103 -> 0.00205: 1.9883x larger (N = 100)
205
206Running 'template_render' benchmark ...
207Min: 0.009377 -> 0.009335: 1.0045x faster
208Avg: 0.010307 -> 0.010590: 1.0275x slower
209Not significant
210Stddev: 0.00088 -> 0.00133: 1.5003x larger (N = 100)
211
212Running 'template_render_simple' benchmark ...
213Min: 0.000086 -> 0.000058: 1.4754x faster
214Avg: 0.000220 -> 0.000311: 1.4128x slower
215Not significant
216Stddev: 0.00118 -> 0.00207: 1.7519x larger (N = 100)
217
218Running 'url_resolve' benchmark ...
219Min: 0.000085 -> 0.000070: 1.2150x faster
220Avg: 0.000113 -> 0.000171: 1.5123x slower
221Significant (t=-2.424447)
222Stddev: 0.00016 -> 0.00018: 1.1331x larger (N = 100)
223
224Running 'url_reverse' benchmark ...
225Min: 0.000043 -> 0.000060: 1.3923x slower
226Avg: 0.000132 -> 0.000187: 1.4236x slower
227Not significant
228Stddev: 0.00025 -> 0.00028: 1.0968x larger (N = 100)
229