Ward: Modern Test Framework for Python(github.com)
github.com
Ward: Modern Test Framework for Python
https://github.com/darrenburns/ward
17 comments
Absolutely love the idea of using default params to identify fixtures. That part of pytest has always rubbed me the wrong way.
Thanks :) That's one of my biggest gripes with pytest too, and was one of the main things I was looking to solve.
Not knocking this but what exactly is meant by "modern"?
Modern in tech usually is synonymous with new, but the authors also try to associate it with something better than established approaches. In the last ten years, many modern technologies have failed at the latter and instead offer something different with tradeoffs. No more.
"recent" and doing "something new".
Maybe (a) no test classes inheriting from Test case, (b) asyncio?
It's a good question!
It's a good question!
I love the look of that output in the first screenshot... will be giving this a go :)
I'm not so keen on the way that parameterised tests are defined though. Having a separate `each(...)` call per kwarg, which are then expected to have the same number of elements, feels a bit off. If I'd guessed how that would work before reading the docs I would have expected that form to test the product of those arg value sets against each other.
I'm not so keen on the way that parameterised tests are defined though. Having a separate `each(...)` call per kwarg, which are then expected to have the same number of elements, feels a bit off. If I'd guessed how that would work before reading the docs I would have expected that form to test the product of those arg value sets against each other.
Author of Ward here! Thanks for the feedback. It's a common piece of feedback I hear and I do agree.
I haven't documented this yet, but due to the way Ward works you can actually write your tests inside a loop in order to parameterise them (see below). This is a little more explicit, and lets you build up your test data using things like itertools (if you like):
If you give Ward a try or just have any other general feedback, please let me know if you have any issues/suggestions on GitHub.
I haven't documented this yet, but due to the way Ward works you can actually write your tests inside a loop in order to parameterise them (see below). This is a little more explicit, and lets you build up your test data using things like itertools (if you like):
for lhs, rhs, res in [
(1, 1, 2),
(2, 3, 5),
]:
@test("simple addition")
def _(left=lhs, right=rhs, result=res):
assert left + right == result
If you give Ward a try or just have any other general feedback, please let me know if you have any issues/suggestions on GitHub.
How do you represent the test ID for complex arguments? In Pytest, that's easily done with `pytest.param`:
@pytest.parametrize("a,b", [
pytest.param(..., id="thing1"),
pytest.param(..., id="thing2"),
])
def test_foo(a, b):
...Probably the closest thing would be to add a unique tag to each instance of the test:
Since multiple tests can share the same tag in Ward, if you wanted to narrow things down to ensure you're only selecting from the tests generated in this loop you could do something like `ward --search 'simple addition' --tags thing2`.
You can also select multiple instances at once with `ward --tags 'thing1 or thing3'`.
for lhs, rhs, res, tag in [
(1, 1, 2, "thing1"),
(2, 3, 5, "thing2"),
(3, 4, 7, "thing3"),
]:
@test("simple addition", tags=[tag])
def _(left=lhs, right=rhs, result=res):
assert left + right == result
Since multiple tests can share the same tag in Ward, if you wanted to narrow things down to ensure you're only selecting from the tests generated in this loop you could do something like `ward --search 'simple addition' --tags thing2`.
You can also select multiple instances at once with `ward --tags 'thing1 or thing3'`.
FWIW I think this interface is slightly nicer than the pytest one https://pypi.org/project/parameterized/
Some of my tests have dozens of parameter sets with a half-dozen parameters. Getting those all aligned with individual 'each' statements would be interesting.
Just saw https://github.com/darrenburns/pytest-clarity and also pytest fork on Darren's github profile.
@Darren, did you consider extending/improving pytest over starting from scratch? if yes, what were you biggest drivers to start a new test framework
@Darren, did you consider extending/improving pytest over starting from scratch? if yes, what were you biggest drivers to start a new test framework
One of my first questions was how it compares to Pytest, that is answered here: https://wardpy.com/guide/pytest-comparison
i wonder how does this compare to pytest ?