Ticket #32312: results.txt

File results.txt, 10.0 KB (added by David Smith, 17 months ago)

Djangobench_benchmarks

Line 
1> djangobench --experiment=a415ce70bef6d91036b00dd2c8544aed7aeeaaed --control=cce47ff65a4dd3786c049ec14ee889e128ca7de9
2Running all benchmarks
3Control: Django 3.0.dev20190620094849 (in git branch cce47ff65a4dd3786c049ec14ee889e128ca7de9)
4Experiment: Django 3.0.dev20190620102943 (in git branch a415ce70bef6d91036b00dd2c8544aed7aeeaaed)
5
6Running 'query_dates' benchmark ...
7Min: 0.001606 -> 0.001775: 1.1051x slower
8Avg: 0.001655 -> 0.001846: 1.1153x slower
9Significant (t=-9.536159)
10Stddev: 0.00010 -> 0.00010: 1.0812x larger (N = 50)
11
12Running 'url_resolve_nested' benchmark ...
13Min: 0.000218 -> 0.000254: 1.1657x slower
14Avg: 0.000739 -> 0.001145: 1.5495x slower
15Not significant
16Stddev: 0.00366 -> 0.00625: 1.7107x larger (N = 50)
17
18Running 'query_update' benchmark ...
19Min: 0.000251 -> 0.000326: 1.3017x slower
20Avg: 0.000271 -> 0.000347: 1.2813x slower
21Significant (t=-9.417966)
22Stddev: 0.00004 -> 0.00004: 1.2209x smaller (N = 50)
23
24Running 'query_filter' benchmark ...
25Min: 0.000818 -> 0.000947: 1.1588x slower
26Avg: 0.000867 -> 0.000993: 1.1450x slower
27Significant (t=-9.670772)
28Stddev: 0.00007 -> 0.00006: 1.2558x smaller (N = 50)
29
30Running 'query_latest' benchmark ...
31Min: 0.000846 -> 0.000912: 1.0786x slower
32Avg: 0.000889 -> 0.000968: 1.0884x slower
33Significant (t=-4.917320)
34Stddev: 0.00008 -> 0.00008: 1.1260x larger (N = 50)
35
36Running 'url_resolve_flat' benchmark ...
37Min: 0.168138 -> 0.185167: 1.1013x slower
38Avg: 0.174532 -> 0.188692: 1.0811x slower
39Significant (t=-5.142500)
40Stddev: 0.01697 -> 0.00954: 1.7789x smaller (N = 50)
41
42Running 'raw_sql' benchmark ...
43Min: 0.000079 -> 0.000129: 1.6284x slower
44Avg: 0.000085 -> 0.000140: 1.6438x slower
45Significant (t=-12.105940)
46Stddev: 0.00002 -> 0.00003: 1.5285x larger (N = 50)
47
48Running 'form_create' benchmark ...
49Min: 0.000080 -> 0.000115: 1.4410x slower
50Avg: 0.000114 -> 0.000151: 1.3214x slower
51Not significant
52Stddev: 0.00021 -> 0.00021: 1.0082x smaller (N = 50)
53
54Running 'url_reverse' benchmark ...
55Min: 0.000240 -> 0.000568: 2.3714x slower
56Avg: 0.000456 -> 0.000796: 1.7473x slower
57Not significant
58Stddev: 0.00149 -> 0.00151: 1.0169x larger (N = 50)
59
60Running 'query_aggregate' benchmark ...
61Min: 0.000530 -> 0.000634: 1.1961x slower
62Avg: 0.000565 -> 0.000667: 1.1808x slower
63Significant (t=-8.232631)
64Stddev: 0.00006 -> 0.00006: 1.0545x smaller (N = 50)
65
66Running 'multi_value_dict' benchmark ...
67Min: 0.000082 -> 0.000082: 1.0018x slower
68Avg: 0.000138 -> 0.000156: 1.1318x slower
69Not significant
70Stddev: 0.00004 -> 0.00013: 3.5026x larger (N = 50)
71
72Running 'query_prefetch_related' benchmark ...
73Min: 0.185224 -> 0.209212: 1.1295x slower
74Avg: 0.198212 -> 0.219117: 1.1055x slower
75Significant (t=-5.596483)
76Stddev: 0.02276 -> 0.01341: 1.6973x smaller (N = 50)
77
78Running 'query_exists' benchmark ...
79Min: 0.001489 -> 0.001786: 1.1994x slower
80Avg: 0.001549 -> 0.001904: 1.2292x slower
81Significant (t=-17.690485)
82Stddev: 0.00008 -> 0.00012: 1.5316x larger (N = 50)
83
84Running 'query_values' benchmark ...
85Min: 0.000460 -> 0.000526: 1.1428x slower
86Avg: 0.000489 -> 0.000557: 1.1392x slower
87Significant (t=-6.435646)
88Stddev: 0.00005 -> 0.00005: 1.0406x larger (N = 50)
89
90Running 'template_compilation' benchmark ...
91Min: 0.001122 -> 0.001123: 1.0012x slower
92Avg: 0.001291 -> 0.001275: 1.0120x faster
93Not significant
94Stddev: 0.00097 -> 0.00093: 1.0442x smaller (N = 50)
95
96Running 'query_all_converters' benchmark ...
97Min: 0.003720 -> 0.003900: 1.0482x slower
98Avg: 0.003840 -> 0.004097: 1.0669x slower
99Significant (t=-6.437233)
100Stddev: 0.00011 -> 0.00026: 2.3865x larger (N = 50)
101
102Running 'query_select_related' benchmark ...
103Min: 0.099899 -> 0.100411: 1.0051x slower
104Avg: 0.104357 -> 0.106177: 1.0174x slower
105Not significant
106Stddev: 0.00897 -> 0.01143: 1.2746x larger (N = 50)
107
108Running 'url_resolve_flat_i18n_off' benchmark ...
109Min: 0.167083 -> 0.189748: 1.1357x slower
110Avg: 0.169900 -> 0.194429: 1.1444x slower
111Significant (t=-13.818209)
112Stddev: 0.00920 -> 0.00854: 1.0763x smaller (N = 50)
113
114Running 'template_render_simple' benchmark ...
115Min: 0.000196 -> 0.000193: 1.0165x faster
116Avg: 0.000334 -> 0.000326: 1.0254x faster
117Not significant
118Stddev: 0.00093 -> 0.00089: 1.0472x smaller (N = 50)
119
120Running 'query_exclude' benchmark ...
121Min: 0.001017 -> 0.001183: 1.1631x slower
122Avg: 0.001130 -> 0.001245: 1.1013x slower
123Significant (t=-3.272947)
124Stddev: 0.00023 -> 0.00008: 2.7382x smaller (N = 50)
125
126Running 'startup' benchmark ...
127Skipped: Django 1.9 and later has changed app loading. This benchmark needs fixing anyway.
128
129Running 'query_order_by' benchmark ...
130Min: 0.000846 -> 0.000938: 1.1085x slower
131Avg: 0.000887 -> 0.000996: 1.1218x slower
132Significant (t=-7.212963)
133Stddev: 0.00007 -> 0.00008: 1.2756x larger (N = 50)
134
135Running 'query_all_multifield' benchmark ...
136Min: 0.091016 -> 0.088657: 1.0266x faster
137Avg: 0.096679 -> 0.095110: 1.0165x faster
138Not significant
139Stddev: 0.01005 -> 0.01066: 1.0597x larger (N = 50)
140
141Running 'template_render' benchmark ...
142Min: 0.005744 -> 0.006217: 1.0825x slower
143Avg: 0.007830 -> 0.008224: 1.0502x slower
144Not significant
145Stddev: 0.01269 -> 0.01233: 1.0295x smaller (N = 50)
146
147Running 'model_save_existing' benchmark ...
148Min: 0.020492 -> 0.025256: 1.2325x slower
149Avg: 0.021420 -> 0.026055: 1.2164x slower
150Significant (t=-32.109733)
151Stddev: 0.00080 -> 0.00063: 1.2665x smaller (N = 50)
152
153Running 'default_middleware' benchmark ...
154Min: -0.000001 -> -0.000007: 0.1436x faster
155Avg: 0.001445 -> 0.001505: 1.0420x slower
156Not significant
157Stddev: 0.01015 -> 0.01061: 1.0461x larger (N = 50)
158
159Running 'qs_filter_chaining' benchmark ...
160Min: 0.001312 -> 0.001669: 1.2721x slower
161Avg: 0.001367 -> 0.001769: 1.2941x slower
162Significant (t=-9.852406)
163Stddev: 0.00014 -> 0.00025: 1.8671x larger (N = 50)
164
165Running 'query_get_or_create' benchmark ...
166Min: 0.002449 -> 0.002925: 1.1942x slower
167Avg: 0.002634 -> 0.003081: 1.1699x slower
168Significant (t=-3.417605)
169Stddev: 0.00082 -> 0.00043: 1.9345x smaller (N = 50)
170
171Running 'query_in_bulk' benchmark ...
172Min: 0.000937 -> 0.001120: 1.1953x slower
173Avg: 0.000997 -> 0.001184: 1.1878x slower
174Significant (t=-8.731875)
175Stddev: 0.00011 -> 0.00010: 1.1355x smaller (N = 50)
176
177Running 'query_distinct' benchmark ...
178Min: 0.000611 -> 0.000688: 1.1252x slower
179Avg: 0.000647 -> 0.000735: 1.1360x slower
180Significant (t=-6.419391)
181Stddev: 0.00006 -> 0.00007: 1.1989x larger (N = 50)
182
183Running 'locale_from_request' benchmark ...
184Min: 0.000386 -> 0.000423: 1.0969x slower
185Avg: 0.000462 -> 0.000501: 1.0840x slower
186Not significant
187Stddev: 0.00046 -> 0.00047: 1.0221x larger (N = 50)
188
189Running 'query_get' benchmark ...
190Min: 0.001648 -> 0.002113: 1.2826x slower
191Avg: 0.001726 -> 0.008590: 4.9764x slower
192Significant (t=-5.990221)
193Stddev: 0.00012 -> 0.00810: 68.3286x larger (N = 50)
194
195Running 'query_iterator' benchmark ...
196Min: 0.000557 -> 0.000664: 1.1921x slower
197Avg: 0.000594 -> 0.000706: 1.1881x slower
198Significant (t=-7.739740)
199Stddev: 0.00007 -> 0.00007: 1.0311x larger (N = 50)
200
201Running 'query_all' benchmark ...
202Min: 0.053971 -> 0.054368: 1.0073x slower
203Avg: 0.058942 -> 0.059746: 1.0136x slower
204Not significant
205Stddev: 0.00962 -> 0.01066: 1.1076x larger (N = 50)
206
207Running 'model_delete' benchmark ...
208Min: 0.000724 -> 0.000877: 1.2125x slower
209Avg: 0.000778 -> 0.001258: 1.6172x slower
210Significant (t=-15.177560)
211Stddev: 0.00012 -> 0.00019: 1.6624x larger (N = 50)
212
213Running 'query_count' benchmark ...
214Min: 0.000444 -> 0.000529: 1.1923x slower
215Avg: 0.000482 -> 0.000571: 1.1847x slower
216Significant (t=-5.878392)
217Stddev: 0.00008 -> 0.00007: 1.0769x smaller (N = 50)
218
219Running 'query_values_10000' benchmark ...
220Min: 0.036362 -> 0.034332: 1.0591x faster
221Avg: 0.055256 -> 0.050081: 1.1033x faster
222Not significant
223Stddev: 0.01706 -> 0.02402: 1.4079x larger (N = 50)
224
225Running 'query_none' benchmark ...
226Min: 0.000286 -> 0.000345: 1.2070x slower
227Avg: 0.000364 -> 0.000418: 1.1467x slower
228Not significant
229Stddev: 0.00038 -> 0.00014: 2.7519x smaller (N = 50)
230
231Running 'query_delete_related' benchmark ...
232Min: 0.000581 -> 0.000799: 1.3738x slower
233Avg: 0.000698 -> 0.000919: 1.3165x slower
234Not significant
235Stddev: 0.00057 -> 0.00063: 1.1152x larger (N = 50)
236
237Running 'model_save_new' benchmark ...
238Min: 0.020373 -> 0.024828: 1.2186x slower
239Avg: 0.021451 -> 0.026129: 1.2181x slower
240Significant (t=-9.691248)
241Stddev: 0.00242 -> 0.00241: 1.0060x smaller (N = 50)
242
243Running 'query_raw_deferred' benchmark ...
244Min: 0.025999 -> 0.026282: 1.0109x slower
245Avg: 0.027795 -> 0.027985: 1.0068x slower
246Not significant
247Stddev: 0.00535 -> 0.00562: 1.0505x larger (N = 50)
248
249Running 'query_delete' benchmark ...
250Min: 0.000622 -> 0.000596: 1.0430x faster
251Avg: 0.000891 -> 0.000632: 1.4105x faster
252Significant (t=8.517416)
253Stddev: 0.00020 -> 0.00007: 2.8441x smaller (N = 50)
254
255Running 'url_resolve' benchmark ...
256Min: 0.017158 -> 0.026667: 1.5541x slower
257Avg: 0.017560 -> 0.027022: 1.5388x slower
258Significant (t=-36.435728)
259Stddev: 0.00128 -> 0.00131: 1.0230x larger (N = 50)
260
261Running 'form_clean' benchmark ...
262Min: 0.000031 -> 0.000032: 1.0159x slower
263Avg: 0.000034 -> 0.000034: 1.0050x faster
264Not significant
265Stddev: 0.00001 -> 0.00001: 1.5007x smaller (N = 50)
266
267Running 'model_creation' benchmark ...
268Min: 0.000381 -> 0.000440: 1.1566x slower
269Avg: 0.000469 -> 0.000482: 1.0270x slower
270Not significant
271Stddev: 0.00045 -> 0.00008: 5.7454x smaller (N = 50)
272
273Running 'query_raw' benchmark ...
274Min: 0.033103 -> 0.033827: 1.0219x slower
275Avg: 0.034986 -> 0.035563: 1.0165x slower
276Not significant
277Stddev: 0.00564 -> 0.00565: 1.0032x larger (N = 50)
278
279Running 'query_complex_filter' benchmark ...
280Min: 0.000232 -> 0.000277: 1.1898x slower
281Avg: 0.000245 -> 0.000291: 1.1915x slower
282Significant (t=-8.527667)
283Stddev: 0.00003 -> 0.00003: 1.1290x larger (N = 50)
284
285Running 'query_values_list' benchmark ...
286Min: 0.000439 -> 0.000518: 1.1796x slower
287Avg: 0.000471 -> 0.000547: 1.1623x slower
288Significant (t=-6.546009)
289Stddev: 0.00006 -> 0.00006: 1.0484x smaller (N = 50)
290
291Running 'query_annotate' benchmark ...
292Min: 0.001019 -> 0.001121: 1.0996x slower
293Avg: 0.001079 -> 0.001216: 1.1271x slower
294Significant (t=-3.289610)
295Stddev: 0.00010 -> 0.00028: 2.8625x larger (N = 50)
296
297Running 'l10n_render' benchmark ...
298Min: 0.005730 -> 0.005903: 1.0301x slower
299Avg: 0.007294 -> 0.008301: 1.1379x slower
300Not significant
301Stddev: 0.00974 -> 0.00992: 1.0192x larger (N = 50)
Back to Top