英文:
How to run golang tests sequentially?
问题
当我运行go test
时,我的输出如下:
--- FAIL: TestGETSearchSuccess (0.00s)
位置:drivers_api_test.go:283
错误:不相等:200(期望)
!= 204(实际)
--- FAIL: TestGETCOSearchSuccess (0.00s)
位置:drivers_api_test.go:391
错误:不相等:200(期望)
!= 204(实际)
但是当我再次运行go test
时,所有的测试都通过了。
只有当我重置我的mysql数据库,然后第一次运行go test
时,测试才会失败。
对于每个GET
请求,在执行之前我都会进行一个POST
请求,以确保在数据库中创建了数据。
有人可以帮我解决如何确保测试按顺序运行吗?也就是说,在执行GET
请求之前先执行POST
请求?
英文:
When I run go test
, my output:
--- FAIL: TestGETSearchSuccess (0.00s)
Location: drivers_api_test.go:283
Error: Not equal: 200 (expected)
!= 204 (actual)
--- FAIL: TestGETCOSearchSuccess (0.00s)
Location: drivers_api_test.go:391
Error: Not equal: 200 (expected)
!= 204 (actual)
But after I run go test
again, all my tests pass.
Tests fail only when I reset my mysql database, and then run go test
for the first time.
For every GET
request, I do a POST
request before to ensure that there is data created in the DB.
Could anyone help me with how to make sure that tests are run sequentially? That is the POST
requests are run before the GET
requests?
答案1
得分: 44
你不能/不应该依赖测试的执行顺序。测试的执行顺序是不确定的,并且通过使用测试标志,可以排除某些测试的运行,所以不能保证它们会全部运行。
例如,以下命令只会运行名称中包含字母W
的测试:
go test -run W
还要注意,如果某些测试函数使用T.Parallel()
方法标记自己可以并行执行,go工具将重新排序测试,首先运行非并行测试,然后在某些情况下(由测试标志如-p
控制)并行运行并行测试。你可以在这个答案中看到这方面的例子:https://stackoverflow.com/questions/44325232/are-tests-executed-in-parallel-in-go-or-one-by-one/44326377#44326377
测试应该是相互独立的。如果一个测试函数有前提条件,那么这个条件不能在另一个测试函数中实现。
在运行测试函数之前执行其他任务的选项:
- 你可以将其放在测试函数本身中。
- 你可以将其放在包的
init()
函数中,在_test.go
文件中。这将在执行测试函数之前运行一次。 - 你可以选择实现一个
TestMain()
函数,它将首先被调用,在调用M.Run()
触发测试函数的执行之前,你可以在其中进行额外的设置。 - 你可以混合使用上述选项。
在你的情况下,在包的init()
或TestMain()
函数中,你应该检查你的数据库是否已初始化(是否插入了测试记录),如果没有,则插入测试记录。
请注意,从Go 1.7开始,你可以使用子测试来定义子测试的执行顺序。详细信息请参阅博文:使用子测试和子基准测试,以及testing
包的文档。
英文:
You can't / shouldn't rely on test execution order. The order in which tests are executed is not defined, and with the use of testing flags it is possible to exclude tests from running, so you have no guarantee that they will run at all.
For example the following command will only run tests whose name contains a 'W'
letter:
go test -run W
Also note that if some test functions mark themselves eligible for parallel execution using the T.Parallel()
method, the go tool will reorder the tests to first run non-parallel tests, and then run parallel tests in parallel under certain circumstances (controlled by test flags like -p
). You can see examples of this in this answer: https://stackoverflow.com/questions/44325232/are-tests-executed-in-parallel-in-go-or-one-by-one/44326377#44326377
Tests should be independent from each other. If a test function has prerequisites, that cannot be done/implemented in another test function.
Options to do additional tasks before a test function is run:
- You may put it in the test function itself
- You may put it in a package
init()
function, in the_test.go
file itself. This will run once before execution of test functions begins. - You may choose to implement a
TestMain()
function which will be called first and in which you may do additional setup before you callM.Run()
to trigger the execution of test functions. - You may mix the above options.
In your case in package init()
or TestMain()
you should check if your DB is initialized (there are test records inserted), and if not, insert the test records.
Note that starting with Go 1.7, you may use subtests in which you define execution order of subtests. For details see blog post: Using Subtests and Sub-benchmarks, and the package doc of the testing
package.
答案2
得分: 43
对于像我一样因为同时运行多个并发测试而遇到问题的人,我找到了一种限制最大并行运行测试数量的方法:
go test -p 1
使用这个命令,你的测试将按顺序一个接一个地运行。
英文:
For those who as I am is getting problems because of multiple concurring tests running simultaneously. I found a way to limit the maximum number of test running in parallel:
go test -p 1
With this, your test will run sequentially one by one.
答案3
得分: 24
除了像Convey和Ginkgo这样的第三方库之外,使用纯粹的Golang 1.7,你可以按顺序运行测试。你可以在这里阅读更多信息。
func TestFoo(t *testing.T) {
// <setup code>
t.Run("A=1", func(t *testing.T) { ... })
t.Run("A=2", func(t *testing.T) { ... })
t.Run("B=1", func(t *testing.T) { ... })
// <tear-down code>
}
你可以使用以下方式有条件地运行它们:
go test -run '' # 运行所有测试。
go test -run Foo # 运行与"Foo"匹配的顶级测试,例如"TestFooBar"。
go test -run Foo/A= # 对于与"Foo"匹配的顶级测试,运行与"A="匹配的子测试。
go test -run /A=1 # 对于所有顶级测试,运行与"A=1"匹配的子测试。
假设你从一个REST API中获得了一个user
包,你想要测试它。你需要测试创建处理程序,以便能够测试登录处理程序。通常,我会将以下代码放在user_test.go
文件中:
type UserTests struct { Test *testing.T}
func TestRunner(t *testing.T) {
t.Run("A=create", func(t *testing.T) {
test := UserTests{Test: t}
test.TestCreateRegularUser()
test.TestCreateConfirmedUser()
test.TestCreateMasterUser()
test.TestCreateUserTwice()
})
t.Run("A=login", func(t *testing.T) {
test := UserTests{Test: t}
test.TestLoginRegularUser()
test.TestLoginConfirmedUser()
test.TestLoginMasterUser()
})
}
然后,我可以在任何_test.go
文件中为UserTest类型附加方法,这些方法不会被go test
命令执行:
func (t *UserTests) TestCreateRegularUser() {
registerRegularUser := util.TableTest{
Method: "POST",
Path: "/iot/users",
Status: http.StatusOK,
Name: "registerRegularUser",
Description: "register Regular User has to return 200",
Body: SerializeUser(RegularUser),
}
response := util.SpinSingleTableTests(t.Test, registerRegularUser)
util.LogIfVerbose(color.BgCyan, "IOT/USERS/TEST", response)
}
英文:
Apart for 3rd party libraries like Convey and Ginkgo, with plain Golang 1.7 you can run tests sequentially. You can read more here
func TestFoo(t *testing.T) {
// <setup code>
t.Run("A=1", func(t *testing.T) { ... })
t.Run("A=2", func(t *testing.T) { ... })
t.Run("B=1", func(t *testing.T) { ... })
// <tear-down code>
}
And you can run them conditionally with:
go test -run '' # Run all tests.
go test -run Foo # Run top-level tests matching "Foo", such as "TestFooBar".
go test -run Foo/A= # For top-level tests matching "Foo", run subtests matching "A=".
go test -run /A=1 # For all top-level tests, run subtests matching "A=1".
So lets say you got an user
package from a REST api that you want to test. You need to test the create handler in order to be able to test the login handler. Usually I would have this on the user_test.go
type UserTests struct { Test *testing.T}
func TestRunner(t *testing.T) {
t.Run("A=create", func(t *testing.T) {
test:= UserTests{Test: t}
test.TestCreateRegularUser()
test.TestCreateConfirmedUser()
test.TestCreateMasterUser()
test.TestCreateUserTwice()
})
t.Run("A=login", func(t *testing.T) {
test:= UserTests{Test: t}
test.TestLoginRegularUser()
test.TestLoginConfirmedUser()
test.TestLoginMasterUser()
})
}
Then I can append methods to the UserTest type that wont be executed by the go test
command in any _test.go
file
func (t *UserTests) TestCreateRegularUser() {
registerRegularUser := util.TableTest{
Method: "POST",
Path: "/iot/users",
Status: http.StatusOK,
Name: "registerRegularUser",
Description: "register Regular User has to return 200",
Body: SerializeUser(RegularUser),
}
response := util.SpinSingleTableTests(t.Test, registerRegularUser)
util.LogIfVerbose(color.BgCyan, "IOT/USERS/TEST", response)
}
答案4
得分: 4
要实现这一点的最佳方法是创建一个TestMain
,如此处所示:链接。
import (
"testing"
"os"
)
func TestMain(m *testing.M) {
// 在这里执行你的操作
os.Exit(m.Run())
}
英文:
The best way to achieve that is to create a TestMain
, as presented here.
import (
"testing"
"os"
)
func TestMain(m *testing.M) {
// Do your stuff here
os.Exit(m.Run())
}
答案5
得分: 2
也可以使用等待组(wait groups)来同步测试:
awaitRootElement := sync.WaitGroup{}
awaitRootElement.Add(1)
t.Run("it should create root element", func(t0 *testing.T) {
// 进行创建根元素的测试
awaitRootElement.Done()
})
awaitRootElement.Wait()
t.Run("it should act on root element somehow", func(t0 *testing.T) {
// 进行依赖于根元素的测试
})
请注意,在安排测试之前,应该先等待,因为异步测试执行可能会导致死锁(测试例程正在等待另一个永远不会运行的测试)。
英文:
It's also possible to synchronize the test using wait groups:
awaitRootElement := sync.WaitGroup{}
awaitRootElement.Add(1)
t.Run("it should create root element", func(t0 *testing.T) {
// do the test which creates root element
awaitRootElement.Done()
})
awaitRootElement.Wait()
t.Run("it should act on root element somehow", func(t0 *testing.T) {
// do tests which depend on root element
})
Note that you should wait before scheduling the tests, since the asynchronous test execution otherwise might deadlock (the test routine is awaiting another test which never gets to run).
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论