{"title":"Advanced testing topics","version":"1.11","locale":"el","docname":"topics/testing/advanced","url":"/el/1.11/topics/testing/advanced/","canonical":"https://djangodocs.dev/el/1.11/topics/testing/advanced/","summary":"The request factory Link to this heading # class RequestFactory Link to this definition # The RequestFactory shares the same API as the test client. However,…","html":"<h1>Advanced testing topics<a class=\"heading-anchor\" href=\"#advanced-testing-topics\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h1>\n<section id=\"the-request-factory\">\n<h2>The request factory<a class=\"heading-anchor\" href=\"#the-request-factory\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<dl class=\"py class\">\n<dt class=\"sig sig-object py\" id=\"django.test.RequestFactory\">\n<em class=\"property\"><span class=\"k\"><span class=\"pre\">class</span></span><span class=\"w\"> </span></em><span class=\"sig-name descname\"><span class=\"pre\">RequestFactory</span></span><a class=\"heading-anchor\" href=\"#django.test.RequestFactory\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd></dd></dl>\n\n<p>The <a class=\"reference internal\" href=\"#django.test.RequestFactory\" title=\"django.test.RequestFactory\"><code class=\"xref py py-class docutils literal notranslate\"><span class=\"pre\">RequestFactory</span></code></a> shares the same API as\nthe test client. However, instead of behaving like a browser, the\nRequestFactory provides a way to generate a request instance that can\nbe used as the first argument to any view. This means you can test a\nview function the same way as you would test any other function – as\na black box, with exactly known inputs, testing for specific outputs.</p>\n<p>The API for the <a class=\"reference internal\" href=\"#django.test.RequestFactory\" title=\"django.test.RequestFactory\"><code class=\"xref py py-class docutils literal notranslate\"><span class=\"pre\">RequestFactory</span></code></a> is a slightly\nrestricted subset of the test client API:</p>\n<ul class=\"simple\">\n<li><p>It only has access to the HTTP methods <a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.get\" title=\"django.test.Client.get\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">get()</span></code></a>,\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.post\" title=\"django.test.Client.post\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">post()</span></code></a>, <a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.put\" title=\"django.test.Client.put\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">put()</span></code></a>,\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.delete\" title=\"django.test.Client.delete\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">delete()</span></code></a>, <a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.head\" title=\"django.test.Client.head\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">head()</span></code></a>,\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.options\" title=\"django.test.Client.options\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">options()</span></code></a>, and <a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.Client.trace\" title=\"django.test.Client.trace\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">trace()</span></code></a>.</p></li>\n<li><p>These methods accept all the same arguments <em>except</em> for\n<code class=\"docutils literal notranslate\"><span class=\"pre\">follow</span></code>. Since this is just a factory for producing\nrequests, it’s up to you to handle the response.</p></li>\n<li><p>It does not support middleware. Session and authentication\nattributes must be supplied by the test itself if required\nfor the view to function properly.</p></li>\n</ul>\n<section id=\"example\">\n<h3>Example<a class=\"heading-anchor\" href=\"#example\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h3>\n<p>The following is a simple unit test using the request factory:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.contrib.auth.models</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">AnonymousUser</span><span class=\"p\">,</span> <span class=\"n\">User</span>\n<span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.test</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">TestCase</span><span class=\"p\">,</span> <span class=\"n\">RequestFactory</span>\n\n<span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">.views</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">MyView</span><span class=\"p\">,</span> <span class=\"n\">my_view</span>\n\n<span class=\"k\">class</span><span class=\"w\"> </span><span class=\"nc\">SimpleTest</span><span class=\"p\">(</span><span class=\"n\">TestCase</span><span class=\"p\">):</span>\n    <span class=\"k\">def</span><span class=\"w\"> </span><span class=\"nf\">setUp</span><span class=\"p\">(</span><span class=\"bp\">self</span><span class=\"p\">):</span>\n        <span class=\"c1\"># Every test needs access to the request factory.</span>\n        <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">factory</span> <span class=\"o\">=</span> <span class=\"n\">RequestFactory</span><span class=\"p\">()</span>\n        <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">user</span> <span class=\"o\">=</span> <span class=\"n\">User</span><span class=\"o\">.</span><span class=\"n\">objects</span><span class=\"o\">.</span><span class=\"n\">create_user</span><span class=\"p\">(</span>\n            <span class=\"n\">username</span><span class=\"o\">=</span><span class=\"s1\">&#39;jacob&#39;</span><span class=\"p\">,</span> <span class=\"n\">email</span><span class=\"o\">=</span><span class=\"s1\">&#39;jacob@…&#39;</span><span class=\"p\">,</span> <span class=\"n\">password</span><span class=\"o\">=</span><span class=\"s1\">&#39;top_secret&#39;</span><span class=\"p\">)</span>\n\n    <span class=\"k\">def</span><span class=\"w\"> </span><span class=\"nf\">test_details</span><span class=\"p\">(</span><span class=\"bp\">self</span><span class=\"p\">):</span>\n        <span class=\"c1\"># Create an instance of a GET request.</span>\n        <span class=\"n\">request</span> <span class=\"o\">=</span> <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">factory</span><span class=\"o\">.</span><span class=\"n\">get</span><span class=\"p\">(</span><span class=\"s1\">&#39;/customer/details&#39;</span><span class=\"p\">)</span>\n\n        <span class=\"c1\"># Recall that middleware are not supported. You can simulate a</span>\n        <span class=\"c1\"># logged-in user by setting request.user manually.</span>\n        <span class=\"n\">request</span><span class=\"o\">.</span><span class=\"n\">user</span> <span class=\"o\">=</span> <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">user</span>\n\n        <span class=\"c1\"># Or you can simulate an anonymous user by setting request.user to</span>\n        <span class=\"c1\"># an AnonymousUser instance.</span>\n        <span class=\"n\">request</span><span class=\"o\">.</span><span class=\"n\">user</span> <span class=\"o\">=</span> <span class=\"n\">AnonymousUser</span><span class=\"p\">()</span>\n\n        <span class=\"c1\"># Test my_view() as if it were deployed at /customer/details</span>\n        <span class=\"n\">response</span> <span class=\"o\">=</span> <span class=\"n\">my_view</span><span class=\"p\">(</span><span class=\"n\">request</span><span class=\"p\">)</span>\n        <span class=\"c1\"># Use this syntax for class-based views.</span>\n        <span class=\"n\">response</span> <span class=\"o\">=</span> <span class=\"n\">MyView</span><span class=\"o\">.</span><span class=\"n\">as_view</span><span class=\"p\">()(</span><span class=\"n\">request</span><span class=\"p\">)</span>\n        <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">assertEqual</span><span class=\"p\">(</span><span class=\"n\">response</span><span class=\"o\">.</span><span class=\"n\">status_code</span><span class=\"p\">,</span> <span class=\"mi\">200</span><span class=\"p\">)</span>\n</code></pre></div>\n</section>\n</section>\n<section id=\"tests-and-multiple-host-names\">\n<span id=\"topics-testing-advanced-multiple-hosts\"></span><h2>Tests and multiple host names<a class=\"heading-anchor\" href=\"#tests-and-multiple-host-names\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<p>The <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-ALLOWED_HOSTS\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span></code></a> setting is validated when running tests. This\nallows the test client to differentiate between internal and external URLs.</p>\n<p>Projects that support multitenancy or otherwise alter business logic based on\nthe request’s host and use custom host names in tests must include those hosts\nin <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-ALLOWED_HOSTS\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span></code></a>.</p>\n<p>The first and simplest option to do so is to add the hosts to your settings\nfile. For example, the test suite for docs.djangoproject.com includes the\nfollowing:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.test</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">TestCase</span>\n\n<span class=\"k\">class</span><span class=\"w\"> </span><span class=\"nc\">SearchFormTestCase</span><span class=\"p\">(</span><span class=\"n\">TestCase</span><span class=\"p\">):</span>\n    <span class=\"k\">def</span><span class=\"w\"> </span><span class=\"nf\">test_empty_get</span><span class=\"p\">(</span><span class=\"bp\">self</span><span class=\"p\">):</span>\n        <span class=\"n\">response</span> <span class=\"o\">=</span> <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">client</span><span class=\"o\">.</span><span class=\"n\">get</span><span class=\"p\">(</span><span class=\"s1\">&#39;/en/dev/search/&#39;</span><span class=\"p\">,</span> <span class=\"n\">HTTP_HOST</span><span class=\"o\">=</span><span class=\"s1\">&#39;docs.djangoproject.dev:8000&#39;</span><span class=\"p\">)</span>\n        <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">assertEqual</span><span class=\"p\">(</span><span class=\"n\">response</span><span class=\"o\">.</span><span class=\"n\">status_code</span><span class=\"p\">,</span> <span class=\"mi\">200</span><span class=\"p\">)</span>\n</code></pre></div>\n<p>and the settings file includes a list of the domains supported by the project:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">ALLOWED_HOSTS</span> <span class=\"o\">=</span> <span class=\"p\">[</span>\n    <span class=\"s1\">&#39;www.djangoproject.dev&#39;</span><span class=\"p\">,</span>\n    <span class=\"s1\">&#39;docs.djangoproject.dev&#39;</span><span class=\"p\">,</span>\n    <span class=\"o\">...</span>\n<span class=\"p\">]</span>\n</code></pre></div>\n<p>Another option is to add the required hosts to <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-ALLOWED_HOSTS\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span></code></a> using\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.override_settings\" title=\"django.test.override_settings\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">override_settings()</span></code></a> or\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/tools/#django.test.SimpleTestCase.modify_settings\" title=\"django.test.SimpleTestCase.modify_settings\"><code class=\"xref py py-attr docutils literal notranslate\"><span class=\"pre\">modify_settings()</span></code></a>. This option may be\npreferable in standalone apps that can’t package their own settings file or\nfor projects where the list of domains is not static (e.g., subdomains for\nmultitenancy). For example, you could write a test for the domain\n<code class=\"docutils literal notranslate\"><span class=\"pre\">http://otherserver/</span></code> as follows:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.test</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">TestCase</span><span class=\"p\">,</span> <span class=\"n\">override_settings</span>\n\n<span class=\"k\">class</span><span class=\"w\"> </span><span class=\"nc\">MultiDomainTestCase</span><span class=\"p\">(</span><span class=\"n\">TestCase</span><span class=\"p\">):</span>\n    <span class=\"nd\">@override_settings</span><span class=\"p\">(</span><span class=\"n\">ALLOWED_HOSTS</span><span class=\"o\">=</span><span class=\"p\">[</span><span class=\"s1\">&#39;otherserver&#39;</span><span class=\"p\">])</span>\n    <span class=\"k\">def</span><span class=\"w\"> </span><span class=\"nf\">test_other_domain</span><span class=\"p\">(</span><span class=\"bp\">self</span><span class=\"p\">):</span>\n        <span class=\"n\">response</span> <span class=\"o\">=</span> <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">client</span><span class=\"o\">.</span><span class=\"n\">get</span><span class=\"p\">(</span><span class=\"s1\">&#39;http://otherserver/foo/bar/&#39;</span><span class=\"p\">)</span>\n</code></pre></div>\n<p>Disabling <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-ALLOWED_HOSTS\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span></code></a> checking (<code class=\"docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span> <span class=\"pre\">=</span> <span class=\"pre\">['*']</span></code>) when\nrunning tests prevents the test client from raising a helpful error message if\nyou follow a redirect to an external URL.</p>\n<aside class=\"version-note version-changed\" data-version=\"1.11\">\n<p class=\"version-note-title\">Changed in Django 1.11</p><p>Older versions didn’t validate <code class=\"docutils literal notranslate\"><span class=\"pre\">ALLOWED_HOSTS</span></code> while testing so these\ntechniques weren’t necessary.</p>\n</aside>\n</section>\n<section id=\"tests-and-multiple-databases\">\n<span id=\"topics-testing-advanced-multidb\"></span><h2>Tests and multiple databases<a class=\"heading-anchor\" href=\"#tests-and-multiple-databases\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<section id=\"testing-primary-replica-configurations\">\n<span id=\"topics-testing-primaryreplica\"></span><h3>Testing primary/replica configurations<a class=\"heading-anchor\" href=\"#testing-primary-replica-configurations\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h3>\n<p>If you’re testing a multiple database configuration with primary/replica\n(referred to as master/slave by some databases) replication, this strategy of\ncreating test databases poses a problem.\nWhen the test databases are created, there won’t be any replication,\nand as a result, data created on the primary won’t be seen on the\nreplica.</p>\n<p>To compensate for this, Django allows you to define that a database is\na <em>test mirror</em>. Consider the following (simplified) example database\nconfiguration:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">DATABASES</span> <span class=\"o\">=</span> <span class=\"p\">{</span>\n    <span class=\"s1\">&#39;default&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"s1\">&#39;ENGINE&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;django.db.backends.mysql&#39;</span><span class=\"p\">,</span>\n        <span class=\"s1\">&#39;NAME&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;myproject&#39;</span><span class=\"p\">,</span>\n        <span class=\"s1\">&#39;HOST&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;dbprimary&#39;</span><span class=\"p\">,</span>\n         <span class=\"c1\"># ... plus some other settings</span>\n    <span class=\"p\">},</span>\n    <span class=\"s1\">&#39;replica&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"s1\">&#39;ENGINE&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;django.db.backends.mysql&#39;</span><span class=\"p\">,</span>\n        <span class=\"s1\">&#39;NAME&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;myproject&#39;</span><span class=\"p\">,</span>\n        <span class=\"s1\">&#39;HOST&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;dbreplica&#39;</span><span class=\"p\">,</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;MIRROR&#39;</span><span class=\"p\">:</span> <span class=\"s1\">&#39;default&#39;</span><span class=\"p\">,</span>\n        <span class=\"p\">},</span>\n        <span class=\"c1\"># ... plus some other settings</span>\n    <span class=\"p\">}</span>\n<span class=\"p\">}</span>\n</code></pre></div>\n<p>In this setup, we have two database servers: <code class=\"docutils literal notranslate\"><span class=\"pre\">dbprimary</span></code>, described\nby the database alias <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code>, and <code class=\"docutils literal notranslate\"><span class=\"pre\">dbreplica</span></code> described by the\nalias <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code>. As you might expect, <code class=\"docutils literal notranslate\"><span class=\"pre\">dbreplica</span></code> has been configured\nby the database administrator as a read replica of <code class=\"docutils literal notranslate\"><span class=\"pre\">dbprimary</span></code>, so in\nnormal activity, any write to <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code> will appear on <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code>.</p>\n<p>If Django created two independent test databases, this would break any\ntests that expected replication to occur. However, the <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code>\ndatabase has been configured as a test mirror (using the\n<a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_MIRROR\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">MIRROR</span></code></a> test setting), indicating that under\ntesting, <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code> should be treated as a mirror of <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code>.</p>\n<p>When the test environment is configured, a test version of <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code>\nwill <em>not</em> be created. Instead the connection to <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code>\nwill be redirected to point at <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code>. As a result, writes to\n<code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code> will appear on <code class=\"docutils literal notranslate\"><span class=\"pre\">replica</span></code> – but because they are actually\nthe same database, not because there is data replication between the\ntwo databases.</p>\n</section>\n<section id=\"controlling-creation-order-for-test-databases\">\n<span id=\"topics-testing-creation-dependencies\"></span><h3>Controlling creation order for test databases<a class=\"heading-anchor\" href=\"#controlling-creation-order-for-test-databases\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h3>\n<p>By default, Django will assume all databases depend on the <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code>\ndatabase and therefore always create the <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code> database first.\nHowever, no guarantees are made on the creation order of any other\ndatabases in your test setup.</p>\n<p>If your database configuration requires a specific creation order, you\ncan specify the dependencies that exist using the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_DEPENDENCIES\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DEPENDENCIES</span></code></a> test setting. Consider the following (simplified)\nexample database configuration:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">DATABASES</span> <span class=\"o\">=</span> <span class=\"p\">{</span>\n    <span class=\"s1\">&#39;default&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"c1\"># ... db settings</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;DEPENDENCIES&#39;</span><span class=\"p\">:</span> <span class=\"p\">[</span><span class=\"s1\">&#39;diamonds&#39;</span><span class=\"p\">],</span>\n        <span class=\"p\">},</span>\n    <span class=\"p\">},</span>\n    <span class=\"s1\">&#39;diamonds&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"c1\"># ... db settings</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;DEPENDENCIES&#39;</span><span class=\"p\">:</span> <span class=\"p\">[],</span>\n        <span class=\"p\">},</span>\n    <span class=\"p\">},</span>\n    <span class=\"s1\">&#39;clubs&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"c1\"># ... db settings</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;DEPENDENCIES&#39;</span><span class=\"p\">:</span> <span class=\"p\">[</span><span class=\"s1\">&#39;diamonds&#39;</span><span class=\"p\">],</span>\n        <span class=\"p\">},</span>\n    <span class=\"p\">},</span>\n    <span class=\"s1\">&#39;spades&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"c1\"># ... db settings</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;DEPENDENCIES&#39;</span><span class=\"p\">:</span> <span class=\"p\">[</span><span class=\"s1\">&#39;diamonds&#39;</span><span class=\"p\">,</span> <span class=\"s1\">&#39;hearts&#39;</span><span class=\"p\">],</span>\n        <span class=\"p\">},</span>\n    <span class=\"p\">},</span>\n    <span class=\"s1\">&#39;hearts&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n        <span class=\"c1\"># ... db settings</span>\n        <span class=\"s1\">&#39;TEST&#39;</span><span class=\"p\">:</span> <span class=\"p\">{</span>\n            <span class=\"s1\">&#39;DEPENDENCIES&#39;</span><span class=\"p\">:</span> <span class=\"p\">[</span><span class=\"s1\">&#39;diamonds&#39;</span><span class=\"p\">,</span> <span class=\"s1\">&#39;clubs&#39;</span><span class=\"p\">],</span>\n        <span class=\"p\">},</span>\n    <span class=\"p\">}</span>\n<span class=\"p\">}</span>\n</code></pre></div>\n<p>Under this configuration, the <code class=\"docutils literal notranslate\"><span class=\"pre\">diamonds</span></code> database will be created first,\nas it is the only database alias without dependencies. The <code class=\"docutils literal notranslate\"><span class=\"pre\">default</span></code> and\n<code class=\"docutils literal notranslate\"><span class=\"pre\">clubs</span></code> alias will be created next (although the order of creation of this\npair is not guaranteed), then <code class=\"docutils literal notranslate\"><span class=\"pre\">hearts</span></code>, and finally <code class=\"docutils literal notranslate\"><span class=\"pre\">spades</span></code>.</p>\n<p>If there are any circular dependencies in the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_DEPENDENCIES\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DEPENDENCIES</span></code></a> definition, an\n<a class=\"reference internal\" href=\"/el/1.11/ref/exceptions/#django.core.exceptions.ImproperlyConfigured\" title=\"django.core.exceptions.ImproperlyConfigured\"><code class=\"xref py py-exc docutils literal notranslate\"><span class=\"pre\">ImproperlyConfigured</span></code></a> exception will be raised.</p>\n</section>\n</section>\n<section id=\"advanced-features-of-transactiontestcase\">\n<h2>Advanced features of <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code><a class=\"heading-anchor\" href=\"#advanced-features-of-transactiontestcase\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<dl class=\"py attribute\">\n<dt class=\"sig sig-object py\" id=\"django.test.TransactionTestCase.available_apps\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">TransactionTestCase.</span></span><span class=\"sig-name descname\"><span class=\"pre\">available_apps</span></span><a class=\"heading-anchor\" href=\"#django.test.TransactionTestCase.available_apps\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><aside class=\"admonition admonition-warning\" role=\"note\">\n<p class=\"admonition-title\">Προειδοποίηση</p>\n<p>This attribute is a private API. It may be changed or removed without\na deprecation period in the future, for instance to accommodate changes\nin application loading.</p>\n<p>It’s used to optimize Django’s own test suite, which contains hundreds\nof models but no relations between models in different applications.</p>\n</aside>\n<p>By default, <code class=\"docutils literal notranslate\"><span class=\"pre\">available_apps</span></code> is set to <code class=\"docutils literal notranslate\"><span class=\"pre\">None</span></code>. After each test, Django\ncalls <a class=\"reference internal\" href=\"/el/1.11/ref/django-admin/#django-admin-flush\"><code class=\"xref std std-djadmin docutils literal notranslate\"><span class=\"pre\">flush</span></code></a> to reset the database state. This empties all tables\nand emits the <a class=\"reference internal\" href=\"/el/1.11/ref/signals/#django.db.models.signals.post_migrate\" title=\"django.db.models.signals.post_migrate\"><code class=\"xref py py-data docutils literal notranslate\"><span class=\"pre\">post_migrate</span></code></a> signal, which\nre-creates one content type and three permissions for each model. This\noperation gets expensive proportionally to the number of models.</p>\n<p>Setting <code class=\"docutils literal notranslate\"><span class=\"pre\">available_apps</span></code> to a list of applications instructs Django to\nbehave as if only the models from these applications were available. The\nbehavior of <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code> changes as follows:</p>\n<ul class=\"simple\">\n<li><p><a class=\"reference internal\" href=\"/el/1.11/ref/signals/#django.db.models.signals.post_migrate\" title=\"django.db.models.signals.post_migrate\"><code class=\"xref py py-data docutils literal notranslate\"><span class=\"pre\">post_migrate</span></code></a> is fired before each\ntest to create the content types and permissions for each model in\navailable apps, in case they’re missing.</p></li>\n<li><p>After each test, Django empties only tables corresponding to models in\navailable apps. However, at the database level, truncation may cascade to\nrelated models in unavailable apps. Furthermore\n<a class=\"reference internal\" href=\"/el/1.11/ref/signals/#django.db.models.signals.post_migrate\" title=\"django.db.models.signals.post_migrate\"><code class=\"xref py py-data docutils literal notranslate\"><span class=\"pre\">post_migrate</span></code></a> isn’t fired; it will be\nfired by the next <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code>, after the correct set of\napplications is selected.</p></li>\n</ul>\n<p>Since the database isn’t fully flushed, if a test creates instances of\nmodels not included in <code class=\"docutils literal notranslate\"><span class=\"pre\">available_apps</span></code>, they will leak and they may\ncause unrelated tests to fail. Be careful with tests that use sessions;\nthe default session engine stores them in the database.</p>\n<p>Since <a class=\"reference internal\" href=\"/el/1.11/ref/signals/#django.db.models.signals.post_migrate\" title=\"django.db.models.signals.post_migrate\"><code class=\"xref py py-data docutils literal notranslate\"><span class=\"pre\">post_migrate</span></code></a> isn’t emitted after\nflushing the database, its state after a <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code> isn’t the\nsame as after a <code class=\"docutils literal notranslate\"><span class=\"pre\">TestCase</span></code>: it’s missing the rows created by listeners\nto <a class=\"reference internal\" href=\"/el/1.11/ref/signals/#django.db.models.signals.post_migrate\" title=\"django.db.models.signals.post_migrate\"><code class=\"xref py py-data docutils literal notranslate\"><span class=\"pre\">post_migrate</span></code></a>. Considering the\n<a class=\"reference internal\" href=\"/el/1.11/topics/testing/overview/#order-of-tests\"><span class=\"std std-ref\">order in which tests are executed</span></a>, this isn’t an\nissue, provided either all <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code> in a given test suite\ndeclare <code class=\"docutils literal notranslate\"><span class=\"pre\">available_apps</span></code>, or none of them.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">available_apps</span></code> is mandatory in Django’s own test suite.</p>\n</dd></dl>\n\n<dl class=\"py attribute\">\n<dt class=\"sig sig-object py\" id=\"django.test.TransactionTestCase.reset_sequences\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">TransactionTestCase.</span></span><span class=\"sig-name descname\"><span class=\"pre\">reset_sequences</span></span><a class=\"heading-anchor\" href=\"#django.test.TransactionTestCase.reset_sequences\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Setting <code class=\"docutils literal notranslate\"><span class=\"pre\">reset_sequences</span> <span class=\"pre\">=</span> <span class=\"pre\">True</span></code> on a <code class=\"docutils literal notranslate\"><span class=\"pre\">TransactionTestCase</span></code> will make\nsure sequences are always reset before the test run:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"k\">class</span><span class=\"w\"> </span><span class=\"nc\">TestsThatDependsOnPrimaryKeySequences</span><span class=\"p\">(</span><span class=\"n\">TransactionTestCase</span><span class=\"p\">):</span>\n    <span class=\"n\">reset_sequences</span> <span class=\"o\">=</span> <span class=\"kc\">True</span>\n\n    <span class=\"k\">def</span><span class=\"w\"> </span><span class=\"nf\">test_animal_pk</span><span class=\"p\">(</span><span class=\"bp\">self</span><span class=\"p\">):</span>\n        <span class=\"n\">lion</span> <span class=\"o\">=</span> <span class=\"n\">Animal</span><span class=\"o\">.</span><span class=\"n\">objects</span><span class=\"o\">.</span><span class=\"n\">create</span><span class=\"p\">(</span><span class=\"n\">name</span><span class=\"o\">=</span><span class=\"s2\">&quot;lion&quot;</span><span class=\"p\">,</span> <span class=\"n\">sound</span><span class=\"o\">=</span><span class=\"s2\">&quot;roar&quot;</span><span class=\"p\">)</span>\n        <span class=\"c1\"># lion.pk is guaranteed to always be 1</span>\n        <span class=\"bp\">self</span><span class=\"o\">.</span><span class=\"n\">assertEqual</span><span class=\"p\">(</span><span class=\"n\">lion</span><span class=\"o\">.</span><span class=\"n\">pk</span><span class=\"p\">,</span> <span class=\"mi\">1</span><span class=\"p\">)</span>\n</code></pre></div>\n<p>Unless you are explicitly testing primary keys sequence numbers, it is\nrecommended that you do not hard code primary key values in tests.</p>\n<p>Using <code class=\"docutils literal notranslate\"><span class=\"pre\">reset_sequences</span> <span class=\"pre\">=</span> <span class=\"pre\">True</span></code> will slow down the test, since the primary\nkey reset is an relatively expensive database operation.</p>\n</dd></dl>\n\n</section>\n<section id=\"using-the-django-test-runner-to-test-reusable-applications\">\n<span id=\"testing-reusable-applications\"></span><h2>Using the Django test runner to test reusable applications<a class=\"heading-anchor\" href=\"#using-the-django-test-runner-to-test-reusable-applications\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<p>If you are writing a <a class=\"reference internal\" href=\"/el/1.11/intro/reusable-apps/\"><span class=\"doc\">reusable application</span></a>\nyou may want to use the Django test runner to run your own test suite\nand thus benefit from the Django testing infrastructure.</p>\n<p>A common practice is a <em>tests</em> directory next to the application code, with the\nfollowing structure:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">runtests</span><span class=\"o\">.</span><span class=\"n\">py</span>\n<span class=\"n\">polls</span><span class=\"o\">/</span>\n    <span class=\"fm\">__init__</span><span class=\"o\">.</span><span class=\"n\">py</span>\n    <span class=\"n\">models</span><span class=\"o\">.</span><span class=\"n\">py</span>\n    <span class=\"o\">...</span>\n<span class=\"n\">tests</span><span class=\"o\">/</span>\n    <span class=\"fm\">__init__</span><span class=\"o\">.</span><span class=\"n\">py</span>\n    <span class=\"n\">models</span><span class=\"o\">.</span><span class=\"n\">py</span>\n    <span class=\"n\">test_settings</span><span class=\"o\">.</span><span class=\"n\">py</span>\n    <span class=\"n\">tests</span><span class=\"o\">.</span><span class=\"n\">py</span>\n</code></pre></div>\n<p>Let’s take a look inside a couple of those files:</p>\n<figure class=\"code-block code-block-captioned\" data-language=\"default\"><figcaption class=\"code-block-caption\"><code>runtests.py</code></figcaption><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"runtests.py\"><code><span class=\"ch\">#!/usr/bin/env python</span>\n<span class=\"kn\">import</span><span class=\"w\"> </span><span class=\"nn\">os</span>\n<span class=\"kn\">import</span><span class=\"w\"> </span><span class=\"nn\">sys</span>\n\n<span class=\"kn\">import</span><span class=\"w\"> </span><span class=\"nn\">django</span>\n<span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.conf</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">settings</span>\n<span class=\"kn\">from</span><span class=\"w\"> </span><span class=\"nn\">django.test.utils</span><span class=\"w\"> </span><span class=\"kn\">import</span> <span class=\"n\">get_runner</span>\n\n<span class=\"k\">if</span> <span class=\"vm\">__name__</span> <span class=\"o\">==</span> <span class=\"s2\">&quot;__main__&quot;</span><span class=\"p\">:</span>\n    <span class=\"n\">os</span><span class=\"o\">.</span><span class=\"n\">environ</span><span class=\"p\">[</span><span class=\"s1\">&#39;DJANGO_SETTINGS_MODULE&#39;</span><span class=\"p\">]</span> <span class=\"o\">=</span> <span class=\"s1\">&#39;tests.test_settings&#39;</span>\n    <span class=\"n\">django</span><span class=\"o\">.</span><span class=\"n\">setup</span><span class=\"p\">()</span>\n    <span class=\"n\">TestRunner</span> <span class=\"o\">=</span> <span class=\"n\">get_runner</span><span class=\"p\">(</span><span class=\"n\">settings</span><span class=\"p\">)</span>\n    <span class=\"n\">test_runner</span> <span class=\"o\">=</span> <span class=\"n\">TestRunner</span><span class=\"p\">()</span>\n    <span class=\"n\">failures</span> <span class=\"o\">=</span> <span class=\"n\">test_runner</span><span class=\"o\">.</span><span class=\"n\">run_tests</span><span class=\"p\">([</span><span class=\"s2\">&quot;tests&quot;</span><span class=\"p\">])</span>\n    <span class=\"n\">sys</span><span class=\"o\">.</span><span class=\"n\">exit</span><span class=\"p\">(</span><span class=\"nb\">bool</span><span class=\"p\">(</span><span class=\"n\">failures</span><span class=\"p\">))</span>\n</code></pre></figure>\n<p>This is the script that you invoke to run the test suite. It sets up the\nDjango environment, creates the test database and runs the tests.</p>\n<p>For the sake of clarity, this example contains only the bare minimum\nnecessary to use the Django test runner. You may want to add\ncommand-line options for controlling verbosity, passing in specific test\nlabels to run, etc.</p>\n<figure class=\"code-block code-block-captioned\" data-language=\"default\"><figcaption class=\"code-block-caption\"><code>tests/test_settings.py</code></figcaption><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"tests/test_settings.py\"><code><span class=\"n\">SECRET_KEY</span> <span class=\"o\">=</span> <span class=\"s1\">&#39;fake-key&#39;</span>\n<span class=\"n\">INSTALLED_APPS</span> <span class=\"o\">=</span> <span class=\"p\">[</span>\n    <span class=\"s2\">&quot;tests&quot;</span><span class=\"p\">,</span>\n<span class=\"p\">]</span>\n</code></pre></figure>\n<p>This file contains the <a class=\"reference internal\" href=\"/el/1.11/topics/settings/\"><span class=\"doc\">Django settings</span></a>\nrequired to run your app’s tests.</p>\n<p>Again, this is a minimal example; your tests may require additional\nsettings to run.</p>\n<p>Since the <em>tests</em> package is included in <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-INSTALLED_APPS\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">INSTALLED_APPS</span></code></a> when\nrunning your tests, you can define test-only models in its <code class=\"docutils literal notranslate\"><span class=\"pre\">models.py</span></code>\nfile.</p>\n</section>\n<section id=\"using-different-testing-frameworks\">\n<span id=\"other-testing-frameworks\"></span><h2>Using different testing frameworks<a class=\"heading-anchor\" href=\"#using-different-testing-frameworks\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<p>Clearly, <a class=\"reference external\" href=\"https://docs.python.org/3/library/unittest.html#module-unittest\" title=\"(στη Python έκδοση 3.14)\"><code class=\"xref py py-mod docutils literal notranslate\"><span class=\"pre\">unittest</span></code></a> is not the only Python testing framework. While Django\ndoesn’t provide explicit support for alternative frameworks, it does provide a\nway to invoke tests constructed for an alternative framework as if they were\nnormal Django tests.</p>\n<p>When you run <code class=\"docutils literal notranslate\"><span class=\"pre\">./manage.py</span> <span class=\"pre\">test</span></code>, Django looks at the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_RUNNER\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">TEST_RUNNER</span></code></a>\nsetting to determine what to do. By default, <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_RUNNER\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">TEST_RUNNER</span></code></a> points to\n<code class=\"docutils literal notranslate\"><span class=\"pre\">'django.test.runner.DiscoverRunner'</span></code>. This class defines the default Django\ntesting behavior. This behavior involves:</p>\n<ol class=\"arabic simple\">\n<li><p>Performing global pre-test setup.</p></li>\n<li><p>Looking for tests in any file below the current directory whose name matches\nthe pattern <code class=\"docutils literal notranslate\"><span class=\"pre\">test*.py</span></code>.</p></li>\n<li><p>Creating the test databases.</p></li>\n<li><p>Running <code class=\"docutils literal notranslate\"><span class=\"pre\">migrate</span></code> to install models and initial data into the test\ndatabases.</p></li>\n<li><p>Running the <a class=\"reference internal\" href=\"/el/1.11/topics/checks/\"><span class=\"doc\">system checks</span></a>.</p></li>\n<li><p>Running the tests that were found.</p></li>\n<li><p>Destroying the test databases.</p></li>\n<li><p>Performing global post-test teardown.</p></li>\n</ol>\n<aside class=\"version-note version-changed\" data-version=\"1.11\">\n<p class=\"version-note-title\">Changed in Django 1.11</p><p>Running the system checks was added.</p>\n</aside>\n<p>If you define your own test runner class and point <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_RUNNER\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">TEST_RUNNER</span></code></a> at\nthat class, Django will execute your test runner whenever you run\n<code class=\"docutils literal notranslate\"><span class=\"pre\">./manage.py</span> <span class=\"pre\">test</span></code>. In this way, it is possible to use any test framework\nthat can be executed from Python code, or to modify the Django test execution\nprocess to satisfy whatever testing requirements you may have.</p>\n<section id=\"defining-a-test-runner\">\n<span id=\"topics-testing-test-runner\"></span><h3>Defining a test runner<a class=\"heading-anchor\" href=\"#defining-a-test-runner\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h3>\n<p>A test runner is a class defining a <code class=\"docutils literal notranslate\"><span class=\"pre\">run_tests()</span></code> method. Django ships\nwith a <code class=\"docutils literal notranslate\"><span class=\"pre\">DiscoverRunner</span></code> class that defines the default Django testing\nbehavior. This class defines the <code class=\"docutils literal notranslate\"><span class=\"pre\">run_tests()</span></code> entry point, plus a\nselection of other methods that are used to by <code class=\"docutils literal notranslate\"><span class=\"pre\">run_tests()</span></code> to set up,\nexecute and tear down the test suite.</p>\n<dl class=\"py class\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner\">\n<em class=\"property\"><span class=\"k\"><span class=\"pre\">class</span></span><span class=\"w\"> </span></em><span class=\"sig-name descname\"><span class=\"pre\">DiscoverRunner</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">pattern</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">'test*.py'</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">top_level</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">None</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">verbosity</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">1</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">interactive</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">True</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">failfast</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">keepdb</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">reverse</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">debug_mode</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">debug_sql</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p><code class=\"docutils literal notranslate\"><span class=\"pre\">DiscoverRunner</span></code> will search for tests in any file matching <code class=\"docutils literal notranslate\"><span class=\"pre\">pattern</span></code>.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">top_level</span></code> can be used to specify the directory containing your\ntop-level Python modules. Usually Django can figure this out automatically,\nso it’s not necessary to specify this option. If specified, it should\ngenerally be the directory containing your <code class=\"docutils literal notranslate\"><span class=\"pre\">manage.py</span></code> file.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">verbosity</span></code> determines the amount of notification and debug information\nthat will be printed to the console; <code class=\"docutils literal notranslate\"><span class=\"pre\">0</span></code> is no output, <code class=\"docutils literal notranslate\"><span class=\"pre\">1</span></code> is normal\noutput, and <code class=\"docutils literal notranslate\"><span class=\"pre\">2</span></code> is verbose output.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">interactive</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, the test suite has permission to ask the\nuser for instructions when the test suite is executed. An example of this\nbehavior would be asking for permission to delete an existing test\ndatabase. If <code class=\"docutils literal notranslate\"><span class=\"pre\">interactive</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code>, the test suite must be able to\nrun without any manual intervention.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">failfast</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, the test suite will stop running after the\nfirst test failure is detected.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">keepdb</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, the test suite will use the existing database,\nor create one if necessary. If <code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code>, a new database will be created,\nprompting the user to remove the existing one, if present.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">reverse</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, test cases will be executed in the opposite\norder. This could be useful to debug tests that aren’t properly isolated\nand have side effects. <a class=\"reference internal\" href=\"/el/1.11/topics/testing/overview/#order-of-tests\"><span class=\"std std-ref\">Grouping by test class</span></a> is\npreserved when using this option.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">debug_mode</span></code> specifies what the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DEBUG\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DEBUG</span></code></a> setting should be\nset to prior to running tests.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">debug_sql</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, failing test cases will output SQL queries\nlogged to the <a class=\"reference internal\" href=\"/el/1.11/topics/logging/#django-db-logger\"><span class=\"std std-ref\">django.db.backends logger</span></a> as well\nas the traceback. If <code class=\"docutils literal notranslate\"><span class=\"pre\">verbosity</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">2</span></code>, then queries in all tests are\noutput.</p>\n<p>Django may, from time to time, extend the capabilities of the test runner\nby adding new arguments. The <code class=\"docutils literal notranslate\"><span class=\"pre\">**kwargs</span></code> declaration allows for this\nexpansion. If you subclass <code class=\"docutils literal notranslate\"><span class=\"pre\">DiscoverRunner</span></code> or write your own test\nrunner, ensure it accepts <code class=\"docutils literal notranslate\"><span class=\"pre\">**kwargs</span></code>.</p>\n<p>Your test runner may also define additional command-line options.\nCreate or override an <code class=\"docutils literal notranslate\"><span class=\"pre\">add_arguments(cls,</span> <span class=\"pre\">parser)</span></code> class method and add\ncustom arguments by calling <code class=\"docutils literal notranslate\"><span class=\"pre\">parser.add_argument()</span></code> inside the method, so\nthat the <a class=\"reference internal\" href=\"/el/1.11/ref/django-admin/#django-admin-test\"><code class=\"xref std std-djadmin docutils literal notranslate\"><span class=\"pre\">test</span></code></a> command will be able to use those arguments.</p>\n<aside class=\"version-note version-added\" data-version=\"1.11\">\n<p class=\"version-note-title\">New in Django 1.11</p><p>The <code class=\"docutils literal notranslate\"><span class=\"pre\">debug_mode</span></code> keyword argument was added.</p>\n</aside>\n</dd></dl>\n\n<section id=\"attributes\">\n<h4>Attributes<a class=\"heading-anchor\" href=\"#attributes\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h4>\n<dl class=\"py attribute\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.test_suite\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">test_suite</span></span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.test_suite\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>The class used to build the test suite. By default it is set to\n<code class=\"docutils literal notranslate\"><span class=\"pre\">unittest.TestSuite</span></code>. This can be overridden if you wish to implement\ndifferent logic for collecting tests.</p>\n</dd></dl>\n\n<dl class=\"py attribute\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.test_runner\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">test_runner</span></span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.test_runner\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>This is the class of the low-level test runner which is used to execute\nthe individual tests and format the results. By default it is set to\n<code class=\"docutils literal notranslate\"><span class=\"pre\">unittest.TextTestRunner</span></code>. Despite the unfortunate similarity in\nnaming conventions, this is not the same type of class as\n<code class=\"docutils literal notranslate\"><span class=\"pre\">DiscoverRunner</span></code>, which covers a broader set of responsibilities. You\ncan override this attribute to modify the way tests are run and reported.</p>\n</dd></dl>\n\n<dl class=\"py attribute\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.test_loader\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">test_loader</span></span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.test_loader\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>This is the class that loads tests, whether from TestCases or modules or\notherwise and bundles them into test suites for the runner to execute.\nBy default it is set to <code class=\"docutils literal notranslate\"><span class=\"pre\">unittest.defaultTestLoader</span></code>. You can override\nthis attribute if your tests are going to be loaded in unusual ways.</p>\n</dd></dl>\n\n</section>\n<section id=\"methods\">\n<h4>Methods<a class=\"heading-anchor\" href=\"#methods\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h4>\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.run_tests\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">run_tests</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">test_labels</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">extra_tests</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">None</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.run_tests\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Run the test suite.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">test_labels</span></code> allows you to specify which tests to run and supports\nseveral formats (see <a class=\"reference internal\" href=\"#django.test.runner.DiscoverRunner.build_suite\" title=\"django.test.runner.DiscoverRunner.build_suite\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">DiscoverRunner.build_suite()</span></code></a> for a list of\nsupported formats).</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">extra_tests</span></code> is a list of extra <code class=\"docutils literal notranslate\"><span class=\"pre\">TestCase</span></code> instances to add to the\nsuite that is executed by the test runner. These extra tests are run\nin addition to those discovered in the modules listed in <code class=\"docutils literal notranslate\"><span class=\"pre\">test_labels</span></code>.</p>\n<p>This method should return the number of tests that failed.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.add_arguments\">\n<em class=\"property\"><span class=\"k\"><span class=\"pre\">classmethod</span></span><span class=\"w\"> </span></em><span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">add_arguments</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">parser</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.add_arguments\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Override this class method to add custom arguments accepted by the\n<a class=\"reference internal\" href=\"/el/1.11/ref/django-admin/#django-admin-test\"><code class=\"xref std std-djadmin docutils literal notranslate\"><span class=\"pre\">test</span></code></a> management command. See\n<a class=\"reference external\" href=\"https://docs.python.org/3/library/argparse.html#argparse.ArgumentParser.add_argument\" title=\"(στη Python έκδοση 3.14)\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">argparse.ArgumentParser.add_argument()</span></code></a> for details about adding\narguments to a parser.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.setup_test_environment\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">setup_test_environment</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.setup_test_environment\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Sets up the test environment by calling\n<a class=\"reference internal\" href=\"#django.test.utils.setup_test_environment\" title=\"django.test.utils.setup_test_environment\"><code class=\"xref py py-func docutils literal notranslate\"><span class=\"pre\">setup_test_environment()</span></code></a> and setting\n<a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DEBUG\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DEBUG</span></code></a> to <code class=\"docutils literal notranslate\"><span class=\"pre\">self.debug_mode</span></code> (defaults to <code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code>).</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.build_suite\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">build_suite</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">test_labels</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">extra_tests</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">None</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.build_suite\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Constructs a test suite that matches the test labels provided.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">test_labels</span></code> is a list of strings describing the tests to be run. A test\nlabel can take one of four forms:</p>\n<ul class=\"simple\">\n<li><p><code class=\"docutils literal notranslate\"><span class=\"pre\">path.to.test_module.TestCase.test_method</span></code> – Run a single test method\nin a test case.</p></li>\n<li><p><code class=\"docutils literal notranslate\"><span class=\"pre\">path.to.test_module.TestCase</span></code> – Run all the test methods in a test\ncase.</p></li>\n<li><p><code class=\"docutils literal notranslate\"><span class=\"pre\">path.to.module</span></code> – Search for and run all tests in the named Python\npackage or module.</p></li>\n<li><p><code class=\"docutils literal notranslate\"><span class=\"pre\">path/to/directory</span></code> – Search for and run all tests below the named\ndirectory.</p></li>\n</ul>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">test_labels</span></code> has a value of <code class=\"docutils literal notranslate\"><span class=\"pre\">None</span></code>, the test runner will search for\ntests in all files below the current directory whose names match its\n<code class=\"docutils literal notranslate\"><span class=\"pre\">pattern</span></code> (see above).</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">extra_tests</span></code> is a list of extra <code class=\"docutils literal notranslate\"><span class=\"pre\">TestCase</span></code> instances to add to the\nsuite that is executed by the test runner. These extra tests are run\nin addition to those discovered in the modules listed in <code class=\"docutils literal notranslate\"><span class=\"pre\">test_labels</span></code>.</p>\n<p>Returns a <code class=\"docutils literal notranslate\"><span class=\"pre\">TestSuite</span></code> instance ready to be run.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.setup_databases\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">setup_databases</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.setup_databases\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Creates the test databases by calling\n<a class=\"reference internal\" href=\"#django.test.utils.setup_databases\" title=\"django.test.utils.setup_databases\"><code class=\"xref py py-func docutils literal notranslate\"><span class=\"pre\">setup_databases()</span></code></a>.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.run_checks\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">run_checks</span></span><span class=\"sig-paren\">(</span><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.run_checks\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><aside class=\"version-note version-added\" data-version=\"1.11\">\n<p class=\"version-note-title\">New in Django 1.11</p></aside>\n<p>Runs the <a class=\"reference internal\" href=\"/el/1.11/topics/checks/\"><span class=\"doc\">system checks</span></a>.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.run_suite\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">run_suite</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">suite</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.run_suite\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Runs the test suite.</p>\n<p>Returns the result produced by the running the test suite.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.get_test_runner_kwargs\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">get_test_runner_kwargs</span></span><span class=\"sig-paren\">(</span><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.get_test_runner_kwargs\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><aside class=\"version-note version-added\" data-version=\"1.11\">\n<p class=\"version-note-title\">New in Django 1.11</p></aside>\n<p>Returns the keyword arguments to instantiate the\n<code class=\"docutils literal notranslate\"><span class=\"pre\">DiscoverRunner.test_runner</span></code> with.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.teardown_databases\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">teardown_databases</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">old_config</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.teardown_databases\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Destroys the test databases, restoring pre-test conditions by calling\n<a class=\"reference internal\" href=\"#django.test.utils.teardown_databases\" title=\"django.test.utils.teardown_databases\"><code class=\"xref py py-func docutils literal notranslate\"><span class=\"pre\">teardown_databases()</span></code></a>.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.teardown_test_environment\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">teardown_test_environment</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.teardown_test_environment\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Restores the pre-test environment.</p>\n</dd></dl>\n\n<dl class=\"py method\">\n<dt class=\"sig sig-object py\" id=\"django.test.runner.DiscoverRunner.suite_result\">\n<span class=\"sig-prename descclassname\"><span class=\"pre\">DiscoverRunner.</span></span><span class=\"sig-name descname\"><span class=\"pre\">suite_result</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">suite</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">result</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.runner.DiscoverRunner.suite_result\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Computes and returns a return code based on a test suite, and the result\nfrom that test suite.</p>\n</dd></dl>\n\n</section>\n</section>\n<section id=\"testing-utilities\">\n<h3>Testing utilities<a class=\"heading-anchor\" href=\"#testing-utilities\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h3>\n<section id=\"module-django.test.utils\">\n<span id=\"django-test-utils\"></span><h4><code class=\"docutils literal notranslate\"><span class=\"pre\">django.test.utils</span></code><a class=\"heading-anchor\" href=\"#module-django.test.utils\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h4>\n<p>To assist in the creation of your own test runner, Django provides a number of\nutility methods in the <code class=\"docutils literal notranslate\"><span class=\"pre\">django.test.utils</span></code> module.</p>\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.test.utils.setup_test_environment\">\n<span class=\"sig-name descname\"><span class=\"pre\">setup_test_environment</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">debug</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">None</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.utils.setup_test_environment\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Performs global pre-test setup, such as installing instrumentation for the\ntemplate rendering system and setting up the dummy email outbox.</p>\n<p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">debug</span></code> isn’t <code class=\"docutils literal notranslate\"><span class=\"pre\">None</span></code>, the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DEBUG\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DEBUG</span></code></a> setting is updated to its\nvalue.</p>\n<aside class=\"version-note version-changed\" data-version=\"1.11\">\n<p class=\"version-note-title\">Changed in Django 1.11</p><p>The <code class=\"docutils literal notranslate\"><span class=\"pre\">debug</span></code> argument was added.</p>\n</aside>\n</dd></dl>\n\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.test.utils.teardown_test_environment\">\n<span class=\"sig-name descname\"><span class=\"pre\">teardown_test_environment</span></span><span class=\"sig-paren\">(</span><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.utils.teardown_test_environment\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Performs global post-test teardown, such as removing instrumentation from\nthe template system and restoring normal email services.</p>\n</dd></dl>\n\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.test.utils.setup_databases\">\n<span class=\"sig-name descname\"><span class=\"pre\">setup_databases</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">verbosity</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">interactive</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">keepdb</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">debug_sql</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">parallel</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">0</span></span></em>, <em class=\"sig-param\"><span class=\"o\"><span class=\"pre\">**</span></span><span class=\"n\"><span class=\"pre\">kwargs</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.utils.setup_databases\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><aside class=\"version-note version-added\" data-version=\"1.11\">\n<p class=\"version-note-title\">New in Django 1.11</p></aside>\n<p>Creates the test databases.</p>\n<p>Returns a data structure that provides enough detail to undo the changes\nthat have been made. This data will be provided to the\n<a class=\"reference internal\" href=\"#django.test.utils.teardown_databases\" title=\"django.test.utils.teardown_databases\"><code class=\"xref py py-func docutils literal notranslate\"><span class=\"pre\">teardown_databases()</span></code></a> function at the conclusion of testing.</p>\n</dd></dl>\n\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.test.utils.teardown_databases\">\n<span class=\"sig-name descname\"><span class=\"pre\">teardown_databases</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">old_config</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">parallel</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">0</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">keepdb</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.test.utils.teardown_databases\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><aside class=\"version-note version-added\" data-version=\"1.11\">\n<p class=\"version-note-title\">New in Django 1.11</p></aside>\n<p>Destroys the test databases, restoring pre-test conditions.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">old_config</span></code> is a data structure defining the changes in the database\nconfiguration that need to be reversed. It’s the return value of the\n<a class=\"reference internal\" href=\"#django.test.utils.setup_databases\" title=\"django.test.utils.setup_databases\"><code class=\"xref py py-meth docutils literal notranslate\"><span class=\"pre\">setup_databases()</span></code></a> method.</p>\n</dd></dl>\n\n</section>\n<section id=\"django-db-connection-creation\">\n<h4><code class=\"docutils literal notranslate\"><span class=\"pre\">django.db.connection.creation</span></code><a class=\"heading-anchor\" href=\"#django-db-connection-creation\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h4>\n<p>The creation module of the database backend also provides some utilities that\ncan be useful during testing.</p>\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.db.connection.creation.create_test_db\">\n<span class=\"sig-name descname\"><span class=\"pre\">create_test_db</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">verbosity</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">1</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">autoclobber</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">serialize</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">True</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">keepdb</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.db.connection.creation.create_test_db\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Creates a new test database and runs <code class=\"docutils literal notranslate\"><span class=\"pre\">migrate</span></code> against it.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">verbosity</span></code> has the same behavior as in <code class=\"docutils literal notranslate\"><span class=\"pre\">run_tests()</span></code>.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">autoclobber</span></code> describes the behavior that will occur if a\ndatabase with the same name as the test database is discovered:</p>\n<ul class=\"simple\">\n<li><p>If <code class=\"docutils literal notranslate\"><span class=\"pre\">autoclobber</span></code> is <code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code>, the user will be asked to\napprove destroying the existing database. <code class=\"docutils literal notranslate\"><span class=\"pre\">sys.exit</span></code> is\ncalled if the user does not approve.</p></li>\n<li><p>If autoclobber is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, the database will be destroyed\nwithout consulting the user.</p></li>\n</ul>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">serialize</span></code> determines if Django serializes the database into an\nin-memory JSON string before running tests (used to restore the database\nstate between tests if you don’t have transactions). You can set this to\n<code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code> to speed up creation time if you don’t have any test classes\nwith <a class=\"reference internal\" href=\"/el/1.11/topics/testing/overview/#test-case-serialized-rollback\"><span class=\"std std-ref\">serialized_rollback=True</span></a>.</p>\n<p>If you are using the default test runner, you can control this with the\nthe <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-TEST_SERIALIZE\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">SERIALIZE</span></code></a> entry in the <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DATABASE-TEST\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">TEST</span></code></a> dictionary.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">keepdb</span></code> determines if the test run should use an existing\ndatabase, or create a new one. If <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, the existing\ndatabase will be used, or created if not present. If <code class=\"docutils literal notranslate\"><span class=\"pre\">False</span></code>,\na new database will be created, prompting the user to remove\nthe existing one, if present.</p>\n<p>Returns the name of the test database that it created.</p>\n<p><code class=\"docutils literal notranslate\"><span class=\"pre\">create_test_db()</span></code> has the side effect of modifying the value of\n<a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-NAME\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">NAME</span></code></a> in <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DATABASES\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DATABASES</span></code></a> to match the name of the test\ndatabase.</p>\n</dd></dl>\n\n<dl class=\"py function\">\n<dt class=\"sig sig-object py\" id=\"django.db.connection.creation.destroy_test_db\">\n<span class=\"sig-name descname\"><span class=\"pre\">destroy_test_db</span></span><span class=\"sig-paren\">(</span><em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">old_database_name</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">verbosity</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">1</span></span></em>, <em class=\"sig-param\"><span class=\"n\"><span class=\"pre\">keepdb</span></span><span class=\"o\"><span class=\"pre\">=</span></span><span class=\"default_value\"><span class=\"pre\">False</span></span></em><span class=\"sig-paren\">)</span><a class=\"heading-anchor\" href=\"#django.db.connection.creation.destroy_test_db\"><span class=\"visually-hidden\">Link to this definition</span><span aria-hidden=\"true\">#</span></a></dt>\n<dd><p>Destroys the database whose name is the value of <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-NAME\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">NAME</span></code></a> in\n<a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-DATABASES\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">DATABASES</span></code></a>, and sets <a class=\"reference internal\" href=\"/el/1.11/ref/settings/#std-setting-NAME\"><code class=\"xref std std-setting docutils literal notranslate\"><span class=\"pre\">NAME</span></code></a> to the value of\n<code class=\"docutils literal notranslate\"><span class=\"pre\">old_database_name</span></code>.</p>\n<p>The <code class=\"docutils literal notranslate\"><span class=\"pre\">verbosity</span></code> argument has the same behavior as for\n<a class=\"reference internal\" href=\"#django.test.runner.DiscoverRunner\" title=\"django.test.runner.DiscoverRunner\"><code class=\"xref py py-class docutils literal notranslate\"><span class=\"pre\">DiscoverRunner</span></code></a>.</p>\n<p>If the <code class=\"docutils literal notranslate\"><span class=\"pre\">keepdb</span></code> argument is <code class=\"docutils literal notranslate\"><span class=\"pre\">True</span></code>, then the connection to the\ndatabase will be closed, but the database will not be destroyed.</p>\n</dd></dl>\n\n</section>\n</section>\n</section>\n<section id=\"integration-with-coverage-py\">\n<span id=\"topics-testing-code-coverage\"></span><h2>Integration with <code class=\"docutils literal notranslate\"><span class=\"pre\">coverage.py</span></code><a class=\"heading-anchor\" href=\"#integration-with-coverage-py\"><span class=\"visually-hidden\">Link to this heading</span><span aria-hidden=\"true\">#</span></a></h2>\n<p>Code coverage describes how much source code has been tested. It shows which\nparts of your code are being exercised by tests and which are not. It’s an\nimportant part of testing applications, so it’s strongly recommended to check\nthe coverage of your tests.</p>\n<p>Django can be easily integrated with <a class=\"reference external\" href=\"http://coverage.readthedocs.io/\">coverage.py</a>, a tool for measuring code\ncoverage of Python programs. First, <a class=\"reference external\" href=\"https://pypi.python.org/pypi/coverage\">install coverage.py</a>. Next, run the\nfollowing from your project folder containing <code class=\"docutils literal notranslate\"><span class=\"pre\">manage.py</span></code>:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">coverage</span> <span class=\"n\">run</span> <span class=\"o\">--</span><span class=\"n\">source</span><span class=\"o\">=</span><span class=\"s1\">&#39;.&#39;</span> <span class=\"n\">manage</span><span class=\"o\">.</span><span class=\"n\">py</span> <span class=\"n\">test</span> <span class=\"n\">myapp</span>\n</code></pre></div>\n<p>This runs your tests and collects coverage data of the executed files in your\nproject. You can see a report of this data by typing following command:</p>\n<div class=\"code-block\" data-language=\"default\"><div class=\"code-block-toolbar\"><span class=\"code-block-language\">Code</span><button type=\"button\" class=\"copy-button\" data-copy hidden><span class=\"copy-button-label\">Copy</span></button></div><pre role=\"group\" tabindex=\"0\" aria-label=\"Code code\"><code><span class=\"n\">coverage</span> <span class=\"n\">report</span>\n</code></pre></div>\n<p>Note that some Django code was executed while running tests, but it is not\nlisted here because of the <code class=\"docutils literal notranslate\"><span class=\"pre\">source</span></code> flag passed to the previous command.</p>\n<p>For more options like annotated HTML listings detailing missed lines, see the\n<a class=\"reference external\" href=\"http://coverage.readthedocs.io/\">coverage.py</a> docs.</p>\n</section>","rootId":"advanced-testing-topics","toc":[{"title":"The request factory","anchor":"the-request-factory","children":[{"title":"Example","anchor":"example","children":[]}]},{"title":"Tests and multiple host names","anchor":"tests-and-multiple-host-names","children":[]},{"title":"Tests and multiple databases","anchor":"tests-and-multiple-databases","children":[{"title":"Testing primary/replica configurations","anchor":"testing-primary-replica-configurations","children":[]},{"title":"Controlling creation order for test databases","anchor":"controlling-creation-order-for-test-databases","children":[]}]},{"title":"Advanced features of TransactionTestCase","anchor":"advanced-features-of-transactiontestcase","children":[]},{"title":"Using the Django test runner to test reusable applications","anchor":"using-the-django-test-runner-to-test-reusable-applications","children":[]},{"title":"Using different testing frameworks","anchor":"using-different-testing-frameworks","children":[{"title":"Defining a test runner","anchor":"defining-a-test-runner","children":[{"title":"Attributes","anchor":"attributes","children":[]},{"title":"Methods","anchor":"methods","children":[]}]},{"title":"Testing utilities","anchor":"testing-utilities","children":[{"title":"django.test.utils","anchor":"module-django.test.utils","children":[]},{"title":"django.db.connection.creation","anchor":"django-db-connection-creation","children":[]}]}]},{"title":"Integration with coverage.py","anchor":"integration-with-coverage-py","children":[]}],"breadcrumbs":[{"docname":"topics/index","title":"Using Django","url":"/el/1.11/topics/"},{"docname":"topics/testing/index","title":"Testing in Django","url":"/el/1.11/topics/testing/"}],"prev":{"docname":"topics/testing/tools","title":"Testing tools","url":"/el/1.11/topics/testing/tools/"},"next":{"docname":"topics/auth/index","title":"User authentication in Django","url":"/el/1.11/topics/auth/"},"formats":{"html":"/el/1.11/topics/testing/advanced/","markdown":"/el/1.11/topics/testing/advanced.md","json":"/el/1.11/topics/testing/advanced.json"},"source":"https://github.com/django/django/blob/stable/1.11.x/docs/topics/testing/advanced.txt","official":"https://docs.djangoproject.com/el/1.11/topics/testing/advanced/","inVersions":["6.1","6.0","5.2","5.1","5.0","4.2","4.1","4.0","3.2","3.1","3.0","2.2","2.1","2.0","1.11","1.10"],"inLocales":["en","fr","ja","id","pt-br","ko","es","el","pl"]}