Opened 7 years ago

Closed 5 years ago

#28520 closed New feature (fixed)

Add --start-at/after options to runtests.py

Reported by: Marten Kenbeek Owned by: Hasan Ramezani
Component: Core (Other) Version: dev
Severity: Normal Keywords:
Cc: Triage Stage: Ready for checkin
Has patch: yes Needs documentation: no
Needs tests: no Patch needs improvement: no
Easy pickings: no UI/UX: no

Description

When making changes that affect large parts of Django, there can often be a lot of test failures. I commonly use the --failfast option to tackle these one at a time. After encountering a test failure, I want to do one of two things:

  • Fix the error and test again.
  • Skip the error and look for the next one.

In both cases you often have to rerun a large part of the test suite of which you are fairly certain it passes, which can take a lot of time. In the second case you either have to remove --failfast and manually check for errors, or mark the test as an expected failure or skipped test.

I propose to add two options to Django's internal test suite, --start-at and --start-after. Both allow you to specify a top-level module where the test suite should start running tests. --start-at includes the specified module, --start-after excludes it.

Change History (8)

comment:1 by Marten Kenbeek, 7 years ago

Has patch: set
Owner: changed from nobody to Marten Kenbeek
Status: newassigned
Version 0, edited 7 years ago by Marten Kenbeek (next)

comment:2 by Tim Graham, 6 years ago

Component: UncategorizedCore (Other)
Needs documentation: set
Triage Stage: UnreviewedAccepted

A note in docs/internals/contributing/writing-code/unit-tests.txt would be useful.

comment:3 by Hasan Ramezani, 5 years ago

Needs documentation: unset
Owner: changed from Marten Kenbeek to Hasan Ramezani
Last edited 5 years ago by Mariusz Felisiak (previous) (diff)

comment:4 by Mariusz Felisiak, 5 years ago

Patch needs improvement: set

comment:5 by Hasan Ramezani, 5 years ago

Patch needs improvement: unset

comment:6 by Mariusz Felisiak, 5 years ago

Triage Stage: AcceptedReady for checkin

comment:7 by Mariusz Felisiak <felisiak.mariusz@…>, 5 years ago

In ef7e0ae5:

Refs #28520 -- Added _module_match_label() hook to runtests.py.

comment:8 by Mariusz Felisiak <felisiak.mariusz@…>, 5 years ago

Resolution: fixed
Status: assignedclosed

In e2de49ec:

Fixed #28520 -- Added --start-at/--start-after options to runtests.py.

Note: See TracTickets for help on using tickets.
Back to Top