GitHub - AArnott/TUnit: A modern, fast and flexible .NET testing framework

A modern, flexible and fast testing framework for .NET 8 and up. With Native AOT and Trimmed Single File application support included!

TUnit is designed to aid with all testing types:

Unit
Integration
Acceptance
and more!

Documentation

See here: https://thomhurst.github.io/TUnit/

Modern and Fast

TUnit leverages source generators to locate and register your tests as opposed to reflection. You'll have a slight bump in build time, but a speedier runtime.

TUnit also builds upon the newer Microsoft.Testing.Platform, whereas most other frameworks you'll have used will use VSTest. The new platform was reconstructed from the ground up to address pain points, be more extensible, and be faster.

Hooks, Events and Lifecycles

One of the most powerful parts of TUnit is the information you have available to you because of the source generation and the events you can subscribe to. Because tests are constructed at the point of discovery, and not at runtime, you know all your arguments, properties, etc. upfront.

You can then register to be notified about various events such as test registered (scheduled to run in this test session at some point in the future), test started, test finished, etc.

Say we injected an external object into our tests: By knowing how many tests are registered, we could count them up, and then on a test end event, we could decrease the count. When hitting 0, we know our object isn't going to be used by any other tests, so we can dispose of it. We know when we can handle the lifecycle, and this prevents it from living till the end of the test session where it could be hanging on to precious resources.

Built in Analyzers

TUnit tries to help you write your tests correctly with analyzers. If something isn't quite right, an analyzer should tell you what's wrong.

IDE

TUnit is built on top of the newer Microsoft.Testing.Platform, as opposed to the older VSTest platform. Because the infrastructure behind the scenes is new and different, you may need to enable some settings. This should just be a one time thing.

Visual Studio

Visual Studio is supported. The "Use testing platform server mode" option must be selected in Tools > Manage Preview Features.

Rider

Rider is supported. The Enable Testing Platform support option must be selected in Settings > Build, Execution, Deployment > Unit Testing > VSTest.

VS Code

Visual Studio Code is supported.

Install the extension Name: C# Dev Kit
Go to the C# Dev Kit extension's settings
Enable Dotnet > Test Window > Use Testing Platform Protocol

CLI

dotnet CLI - Fully supported. Tests should be runnable with dotnet test, dotnet run, dotnet exec or executing an executable directly. See the docs for more information!

Packages

TUnit.Core

To be used when you want to define re-useable components, such as a test library, but it wouldn't be run as its own test suite.

TUnit.Engine

For test suites. This contains the test execution logic and test adapter. Only install this on actual test projects you intend to run, not class libraries.

TUnit.Assertions

This is independent from the framework and can be used wherever - Even in other test frameworks. It is just an assertion library used to assert data is as you expect. It uses an asychronous syntax which may be different to other assertion libraries you may have used.

TUnit

This is a helper package to combine the above 3 packages. If you just want a standard test app where you can write, run and assert tests, just install this!

TUnit.Playwright

This provides you base classes, similarly to Microsoft.Playwright.NUnit or Microsoft.Playwright.MSTest, to automatically create and dispose of Playwright objects in tests, to make it easier for you to write tests without worrying about lifecycles or disposing. The base classes are named the same as the other libraries: PageTest, ContextTest, BrowserTest, and PlaywrightTest.

Features

Native AOT / Trimmed Single File application support
Source generated tests
Property injection
Full async support
Parallel by default, with mechanisms to:
- Run specific tests completely on their own
- Run specific tests not in parallel with other specific tests
- Limit the parallel limit on a per-test, class or assembly level
Tests can depend on other tests to form chains, useful for if one test depends on state from another action. While not recommended for unit tests, this can be useful in integration testing where state matters
Easy to read assertions - though you're also free to use whichever assertion library you like
Injectable test data via classes, methods, compile-time args, or matrices
Hooks before and after:
- TestDiscover
- TestSession
- Assembly
- Class
- Test
Designed to avoid common pitfalls such as leaky test states
Dependency injection support (See here)
Ability to view and interrogate metadata and results from various assembly/class/test context objects

Installation

dotnet add package TUnit --prerelease

Example test

    private static readonly TimeOnly Midnight = TimeOnly.FromTimeSpan(TimeSpan.Zero);
    private static readonly TimeOnly Noon = TimeOnly.FromTimeSpan(TimeSpan.FromHours(12));
    
    [Test]
    public async Task IsMorning()
    {
        var time = GetTime();

        await Assert.That(time).IsAfterOrEqualTo(Midnight)
            .And.IsBefore(Noon);
    }

or with more complex test orchestration needs

    [Before(Class)]
    public static async Task ClearDatabase(ClassHookContext context) { ... }

    [After(Class)]
    public static async Task AssertDatabaseIsAsExpected(ClassHookContext context) { ... }

    [Before(Test)]
    public async Task CreatePlaywrightBrowser(TestContext context) { ... }

    [After(Test)]
    public async Task DisposePlaywrightBrowser(TestContext context) { ... }

    [Retry(3)]
    [Test, DisplayName("Register an account")]
    [MethodData(nameof(GetAuthDetails))]
    public async Task Register(string username, string password) { ... }

    [Repeat(5)]
    [Test, DependsOn(nameof(Register))]
    [MethodData(nameof(GetAuthDetails))]
    public async Task Login(string username, string password) { ... }

    [Test, DependsOn(nameof(Login), [typeof(string), typeof(string)])]
    [MethodData(nameof(GetAuthDetails))]
    public async Task DeleteAccount(string username, string password) { ... }

    [Category("Downloads")]
    [Timeout(300_000)]
    [Test, NotInParallel(Order = 1)]
    public async Task DownloadFile1() { ... }

    [Category("Downloads")]
    [Timeout(300_000)]
    [Test, NotInParallel(Order = 2)]
    public async Task DownloadFile2() { ... }

    [Repeat(10)]
    [Test]
    [Arguments(1)]
    [Arguments(2)]
    [Arguments(3)]
    [DisplayName("Go to the page numbered $page")]
    public async Task GoToPage(int page) { ... }

    [Category("Cookies")]
    [Test, Skip("Not yet built!")]
    public async Task CheckCookies() { ... }

    [Test, Explicit, WindowsOnlyTest, RetryHttpServiceUnavailable(5)]
    [Property("Some Key", "Some Value")]
    public async Task Ping() { ... }

    [Test]
    [ParallelLimit<LoadTestParallelLimit>]
    [Repeat(1000)]
    public async Task LoadHomepage() { ... }

    public static IEnumerable<(string Username, string Password)> GetAuthDetails()
    {
        yield return ("user1", "password1");
        yield return ("user2", "password2");
        yield return ("user3", "password3");
    }

    public class WindowsOnlyTestAttribute : SkipAttribute
    {
        public WindowsOnlyTestAttribute() : base("Windows only test")
        {
        }

        public override Task<bool> ShouldSkip(TestContext testContext)
        {
            return Task.FromResult(!OperatingSystem.IsWindows());
        }
    }

    public class RetryHttpServiceUnavailableAttribute : RetryAttribute
    {
        public RetryHttpServiceUnavailableAttribute(int times) : base(times)
        {
        }

        public override Task<bool> ShouldRetry(TestInformation testInformation, Exception exception, int currentRetryCount)
        {
            return Task.FromResult(exception is HttpRequestException { StatusCode: HttpStatusCode.ServiceUnavailable });
        }
    }

    public class LoadTestParallelLimit : IParallelLimit
    {
        public int Limit => 50;
    }

Motivations

TUnit is inspired by NUnit and xUnit - two of the most popular testing frameworks for .NET.

It aims to build upon the useful features of both while trying to address any pain points that they may have.

Prerelease

You'll notice that version 1.0 isn't out yet. While this framework is mostly feature complete, I'm waiting for a few things:

Full Rider support for all features
Full VS support for all features
Open to feedback on existing features
Open to ideas on new features

As such, the API may change. I'll try to limit this but it's a possibility.

Benchmark

Scenario: Building the test project

macos-latest


BenchmarkDotNet v0.14.0, macOS Sonoma 14.7.1 (23H222) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
Build_TUnit	924.0 ms	18.39 ms	18.88 ms
Build_NUnit	804.8 ms	11.88 ms	10.53 ms
Build_xUnit	807.6 ms	12.57 ms	11.14 ms
Build_MSTest	845.0 ms	14.03 ms	24.19 ms

ubuntu-latest


BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
Build_TUnit	1.831 s	0.0314 s	0.0480 s
Build_NUnit	1.498 s	0.0280 s	0.0300 s
Build_xUnit	1.496 s	0.0266 s	0.0248 s
Build_MSTest	1.578 s	0.0191 s	0.0179 s

windows-latest


BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2966) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
Build_TUnit	1.798 s	0.0346 s	0.0340 s
Build_NUnit	1.479 s	0.0203 s	0.0180 s
Build_xUnit	1.483 s	0.0200 s	0.0177 s
Build_MSTest	1.518 s	0.0253 s	0.0237 s

Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)

macos-latest


BenchmarkDotNet v0.14.0, macOS Sonoma 14.7.1 (23H222) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev	Median
TUnit_AOT	97.65 ms	3.628 ms	10.29 ms	92.83 ms
TUnit	544.54 ms	10.825 ms	12.89 ms	544.58 ms
NUnit	859.98 ms	39.954 ms	117.80 ms	842.99 ms
xUnit	853.58 ms	24.124 ms	70.37 ms	847.92 ms
MSTest	683.68 ms	17.086 ms	48.47 ms	672.34 ms

ubuntu-latest


BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
TUnit_AOT	31.83 ms	0.634 ms	1.591 ms
TUnit	835.79 ms	16.215 ms	19.913 ms
NUnit	1,328.99 ms	15.859 ms	14.834 ms
xUnit	1,312.12 ms	24.084 ms	22.528 ms
MSTest	1,181.15 ms	12.132 ms	11.348 ms

windows-latest


BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2966) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
TUnit_AOT	74.31 ms	1.482 ms	2.673 ms
TUnit	819.85 ms	16.038 ms	20.854 ms
NUnit	1,284.14 ms	10.942 ms	10.235 ms
xUnit	1,254.43 ms	8.474 ms	7.076 ms
MSTest	1,144.93 ms	7.446 ms	5.813 ms

Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)

macos-latest


BenchmarkDotNet v0.14.0, macOS Sonoma 14.7.1 (23H222) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), Arm64 RyuJIT AdvSIMD

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
TUnit_AOT	262.2 ms	11.91 ms	35.11 ms
TUnit	644.3 ms	18.53 ms	54.65 ms
NUnit	14,180.3 ms	280.24 ms	468.22 ms
xUnit	14,242.8 ms	282.46 ms	386.63 ms
MSTest	14,345.6 ms	286.87 ms	524.56 ms

ubuntu-latest


BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
TUnit_AOT	99.54 ms	1.981 ms	5.684 ms
TUnit	897.53 ms	17.232 ms	25.792 ms
NUnit	6,501.85 ms	27.661 ms	25.874 ms
xUnit	6,509.89 ms	37.669 ms	35.236 ms
MSTest	6,466.27 ms	19.420 ms	16.216 ms

windows-latest


BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2966) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 9.0.101
  [Host]   : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2
  .NET 9.0 : .NET 9.0.0 (9.0.24.52809), X64 RyuJIT AVX2

Job=.NET 9.0  Runtime=.NET 9.0

Method	Mean	Error	StdDev
TUnit_AOT	132.6 ms	2.63 ms	7.26 ms
TUnit	902.4 ms	17.72 ms	25.41 ms
NUnit	7,484.0 ms	16.19 ms	15.14 ms
xUnit	7,459.3 ms	21.94 ms	20.52 ms
MSTest	7,430.7 ms	32.38 ms	30.29 ms

Name		Name	Last commit message	Last commit date
Latest commit History 2,615 Commits
.github		.github
.idea/.idea.TUnit/.idea		.idea/.idea.TUnit/.idea
.vscode		.vscode
TUnit.Analyzers.Roslyn44		TUnit.Analyzers.Roslyn44
TUnit.Analyzers.Roslyn47		TUnit.Analyzers.Roslyn47
TUnit.Analyzers.Tests		TUnit.Analyzers.Tests
TUnit.Analyzers		TUnit.Analyzers
TUnit.Assertions.Analyzers.CodeFixers		TUnit.Assertions.Analyzers.CodeFixers
TUnit.Assertions.Analyzers.Tests		TUnit.Assertions.Analyzers.Tests
TUnit.Assertions.Analyzers		TUnit.Assertions.Analyzers
TUnit.Assertions.Tests		TUnit.Assertions.Tests
TUnit.Assertions.UnitTests		TUnit.Assertions.UnitTests
TUnit.Assertions		TUnit.Assertions
TUnit.Core.SourceGenerator.Roslyn44		TUnit.Core.SourceGenerator.Roslyn44
TUnit.Core.SourceGenerator.Roslyn47		TUnit.Core.SourceGenerator.Roslyn47
TUnit.Core.SourceGenerator.Tests		TUnit.Core.SourceGenerator.Tests
TUnit.Core.SourceGenerator		TUnit.Core.SourceGenerator
TUnit.Core		TUnit.Core
TUnit.Engine.Tests		TUnit.Engine.Tests
TUnit.Engine		TUnit.Engine
TUnit.Example.WebProject.Tests		TUnit.Example.WebProject.Tests
TUnit.Example.WebProject		TUnit.Example.WebProject
TUnit.Pipeline		TUnit.Pipeline
TUnit.Playwright.Tests		TUnit.Playwright.Tests
TUnit.Playwright		TUnit.Playwright
TUnit.RpcTests		TUnit.RpcTests
TUnit.TestProject.Library		TUnit.TestProject.Library
TUnit.TestProject		TUnit.TestProject
TUnit.UnitTests		TUnit.UnitTests
TUnit		TUnit
assets		assets
docs		docs
tools		tools
.editorconfig		.editorconfig
.gitattributes		.gitattributes
.gitignore		.gitignore
Directory.Build.props		Directory.Build.props
Directory.Build.targets		Directory.Build.targets
Directory.Packages.props		Directory.Packages.props
GitVersion.yml		GitVersion.yml
LICENSE		LICENSE
README.md		README.md
README_Template.md		README_Template.md
TUnit.sln		TUnit.sln
renovate.json		renovate.json
rider.png		rider.png

License

AArnott/TUnit

Folders and files

Latest commit

History

Repository files navigation

Documentation

Modern and Fast

Hooks, Events and Lifecycles

Built in Analyzers

IDE

Visual Studio

Rider

VS Code

CLI

Packages

TUnit.Core

TUnit.Engine

TUnit.Assertions

TUnit

TUnit.Playwright

Features

Installation

Example test

Motivations

Prerelease

Benchmark

Scenario: Building the test project

macos-latest

ubuntu-latest

windows-latest

Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)

macos-latest

ubuntu-latest

windows-latest

Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)

macos-latest

ubuntu-latest

windows-latest

About

Resources

License

Stars

Watchers

Forks

Releases

Packages 0

Languages

Packages