Opened 22 months ago

Closed 4 weeks ago

#28520 closed New feature (fixed)

Add --start-at/after options to runtests.py

Reported by: Marten Kenbeek Owned by: Hasan Ramezani
Component: Core (Other) Version: master
Severity: Normal Keywords:
Cc: Triage Stage: Ready for checkin
Has patch: yes Needs documentation: no
Needs tests: no Patch needs improvement: no
Easy pickings: no UI/UX: no

Description

When making changes that affect large parts of Django, there can often be a lot of test failures. I commonly use the --failfast option to tackle these one at a time. After encountering a test failure, I want to do one of two things:

  • Fix the error and test again.
  • Skip the error and look for the next one.

In both cases you often have to rerun a large part of the test suite of which you are fairly certain it passes, which can take a lot of time. In the second case you either have to remove --failfast and manually check for errors, or mark the test as an expected failure or skipped test.

I propose to add two options to Django's internal test suite, --start-at and --start-after. Both allow you to specify a top-level module where the test suite should start running tests. --start-at includes the specified module, --start-after excludes it.

Change History (8)

comment:1 Changed 22 months ago by Marten Kenbeek

Has patch: set
Owner: changed from nobody to Marten Kenbeek
Status: newassigned
Version 0, edited 22 months ago by Marten Kenbeek (next)

comment:2 Changed 21 months ago by Tim Graham

Component: UncategorizedCore (Other)
Needs documentation: set
Triage Stage: UnreviewedAccepted

A note in docs/internals/contributing/writing-code/unit-tests.txt would be useful.

comment:3 Changed 4 weeks ago by Hasan Ramezani

Needs documentation: unset
Owner: changed from Marten Kenbeek to Hasan Ramezani
Last edited 4 weeks ago by felixxm (previous) (diff)

comment:4 Changed 4 weeks ago by felixxm

Patch needs improvement: set

comment:5 Changed 4 weeks ago by Hasan Ramezani

Patch needs improvement: unset

comment:6 Changed 4 weeks ago by felixxm

Triage Stage: AcceptedReady for checkin

comment:7 Changed 4 weeks ago by Mariusz Felisiak <felisiak.mariusz@…>

In ef7e0ae5:

Refs #28520 -- Added _module_match_label() hook to runtests.py.

comment:8 Changed 4 weeks ago by Mariusz Felisiak <felisiak.mariusz@…>

Resolution: fixed
Status: assignedclosed

In e2de49ec:

Fixed #28520 -- Added --start-at/--start-after options to runtests.py.

Note: See TracTickets for help on using tickets.
Back to Top