英文:
Golang: http server leaving open goroutines
问题
我在Go中搭建了一个HTTP服务器,每天有一千多个访问者。现在我遇到了一个累积的Goroutine问题。在一天的过程中,我似乎从HTTP服务器中获得了一千多个新的Goroutine。
我不确定我是如何搞砸处理程序的。
http.Handle("/", http.FileServer(http.Dir(config.htdocs_path)))
下面是堆栈中的一个Goroutine
goroutine 1582 [chan receive]:
net.(*pollServer).WaitRead(0xf84007f680, 0xf84066dea0, 0xf84007aa80, 0xb, 0x1, ...)
/home/ec2-user/go/src/pkg/net/fd.go:268 +0x73
net.(*netFD).Read(0xf84066dea0, 0xf840ec1000, 0x100000001000, 0x7f7effffffff, 0xf84007c0f0, ...)
/home/ec2-user/go/src/pkg/net/fd.go:428 +0x1ec
net.(*TCPConn).Read(0xf84068aff8, 0xf840ec1000, 0x100000001000, 0xf800000002, 0x0, ...)
/home/ec2-user/go/src/pkg/net/tcpsock_posix.go:87 +0xce
io.(*LimitedReader).Read(0xf840d1bc20, 0xf840ec1000, 0x100000001000, 0xdcb00000000, 0x0, ...)
/home/ec2-user/go/src/pkg/io/io.go:394 +0xc1
bufio.(*Reader).fill(0xf8405b0900, 0xdcb00000000)
/home/ec2-user/go/src/pkg/bufio/bufio.go:77 +0xf0
bufio.(*Reader).ReadSlice(0xf8405b0900, 0xf840d1bc0a, 0x0, 0x0, 0x0, ...)
/home/ec2-user/go/src/pkg/bufio/bufio.go:257 +0x1b6
bufio.(*Reader).ReadLine(0xf8405b0900, 0x0, 0x0, 0x0, 0x0, ...)
/home/ec2-user/go/src/pkg/bufio/bufio.go:283 +0x5b
net/textproto.(*Reader).readLineSlice(0xf840730660, 0xc0, 0x100000000, 0x7f7e00000001)
/home/ec2-user/go/src/pkg/net/textproto/reader.go:55 +0x4f
net/textproto.(*Reader).ReadLine(0xf840730660, 0xf84061f300, 0x0, 0x48411c)
/home/ec2-user/go/src/pkg/net/textproto/reader.go:36 +0x25
net/http.ReadRequest(0xf8405b0900, 0xf84061f300, 0x0, 0x0, 0x100000400ccf60, ...)
/home/ec2-user/go/src/pkg/net/http/request.go:457 +0xb1
net/http.(*conn).readRequest(0xf8402b2b40, 0xf8400e3fc0, 0x0, 0x0, 0xf8405b0a80, ...)
/home/ec2-user/go/src/pkg/net/http/server.go:240 +0xa8
net/http.(*conn).serve(0xf8402b2b40, 0x0)
/home/ec2-user/go/src/pkg/net/http/server.go:594 +0x145
created by net/http.(*Server).Serve
/home/ec2-user/go/src/pkg/net/http/server.go:1040 +0x430
看起来连接在读取状态下被卡住了。就像HTTP服务器没有超时一样。默认服务器没有读取超时吗?
go version go1
英文:
I've put up an http server written in Go and it's getting a little over a thousand visitors a day. I have an accumulating Goroutine problem now. Over the course of a day I seem to get a little over a thousand new Goroutines from the http server.
I'm not sure how I could mess up the handler.
http.Handle("/", http.FileServer(http.Dir(config.htdocs_path)))
Below is one of the goroutines from the stack
goroutine 1582 [chan receive]:
net.(*pollServer).WaitRead(0xf84007f680, 0xf84066dea0, 0xf84007aa80, 0xb, 0x1, ...)
/home/ec2-user/go/src/pkg/net/fd.go:268 +0x73
net.(*netFD).Read(0xf84066dea0, 0xf840ec1000, 0x100000001000, 0x7f7effffffff, 0xf84007c0f0, ...)
/home/ec2-user/go/src/pkg/net/fd.go:428 +0x1ec
net.(*TCPConn).Read(0xf84068aff8, 0xf840ec1000, 0x100000001000, 0xf800000002, 0x0, ...)
/home/ec2-user/go/src/pkg/net/tcpsock_posix.go:87 +0xce
io.(*LimitedReader).Read(0xf840d1bc20, 0xf840ec1000, 0x100000001000, 0xdcb00000000, 0x0, ...)
/home/ec2-user/go/src/pkg/io/io.go:394 +0xc1
bufio.(*Reader).fill(0xf8405b0900, 0xdcb00000000)
/home/ec2-user/go/src/pkg/bufio/bufio.go:77 +0xf0
bufio.(*Reader).ReadSlice(0xf8405b0900, 0xf840d1bc0a, 0x0, 0x0, 0x0, ...)
/home/ec2-user/go/src/pkg/bufio/bufio.go:257 +0x1b6
bufio.(*Reader).ReadLine(0xf8405b0900, 0x0, 0x0, 0x0, 0x0, ...)
/home/ec2-user/go/src/pkg/bufio/bufio.go:283 +0x5b
net/textproto.(*Reader).readLineSlice(0xf840730660, 0xc0, 0x100000000, 0x7f7e00000001)
/home/ec2-user/go/src/pkg/net/textproto/reader.go:55 +0x4f
net/textproto.(*Reader).ReadLine(0xf840730660, 0xf84061f300, 0x0, 0x48411c)
/home/ec2-user/go/src/pkg/net/textproto/reader.go:36 +0x25
net/http.ReadRequest(0xf8405b0900, 0xf84061f300, 0x0, 0x0, 0x100000400ccf60, ...)
/home/ec2-user/go/src/pkg/net/http/request.go:457 +0xb1
net/http.(*conn).readRequest(0xf8402b2b40, 0xf8400e3fc0, 0x0, 0x0, 0xf8405b0a80, ...)
/home/ec2-user/go/src/pkg/net/http/server.go:240 +0xa8
net/http.(*conn).serve(0xf8402b2b40, 0x0)
/home/ec2-user/go/src/pkg/net/http/server.go:594 +0x145
created by net/http.(*Server).Serve
/home/ec2-user/go/src/pkg/net/http/server.go:1040 +0x430
It seems like connections are getting stuck in the read state. Like the http server isn't timing them out. Does the default server not have a read timeout?
go version go1
答案1
得分: 58
所有这些goroutine都在读取的原因是保持连接。当浏览器发送一个保持连接的头部时,服务器会保持连接以接受更多的请求。当客户端请求许多小文件且TCP连接是重要开销时,这是一件好事。读取超时将确保在请求之间没有保持连接的时间超过一定时间。这将关闭保持连接的连接,但也防止某人上传超过超时时间。不幸的是,目前还没有保持连接特定的超时选项。
默认情况下,没有超时。您可以在Server结构中设置超时http://golang.org/pkg/net/http/#Server
srv := &http.Server{
Handler: http.FileServer(http.Dir(config.htdocs_path)),
ReadTimeout: 30*time.Second,
}
srv.ListenAndServe()
英文:
The reason all these goroutines are reading is keep-alive. When a browser sends a keep-alive header, the server keeps the connection open to accept more requests. This is a good thing when the client is requesting many small files and the TCP connection is significant overhead. A read timeout would ensure that no connection was kept alive more than a certain time between requests. This would close keep alive connections but also prevent someone from uploading for longer than the timeout. Unfortunately, there is no keep-alive specific timeout option yet.
By default, there is no timeout. You can set a timeout in the Server struct http://golang.org/pkg/net/http/#Server
srv := &http.Server{
Handler: http.FileServer(http.Dir(config.htdocs_path)),
ReadTimeout: 30*time.Second,
}
srv.ListenAndServe()
答案2
得分: 0
在使用HTTP连接时要小心使用ReadTimeout和WriteTimeout。我认为它们不会按照你的期望工作。特别是,它们有可能使连接处于不可用状态,而不是实际关闭连接。请参考https://groups.google.com/forum/#!topic/golang-nuts/oBIh_R7-pJQ了解详细信息,特别是我看到有些情况下,ReadTimeout会使连接不可用,并在HTTP处理程序超过超时时间时导致响应被丢弃。如果将超时时间设置为超过任何处理程序的响应时间的大值,可能会没问题。
英文:
Be careful about using ReadTimeout and WriteTimeout on HTTP connections. I don't think they do what you expect them to. In particular, they have a tendency to leave connections in an unusable state without actually closing them. See https://groups.google.com/forum/#!topic/golang-nuts/oBIh_R7-pJQ for details, in particular, I see cases where a ReadTimeout makes connections unusable and causes responses to be dropped on the floor when the HTTP handler time exceeds the timeout. If you set the timeout to a large value that exceeds the response time of any handler you may be OK.
答案3
得分: 0
Stephen的答案对我只有在与以下内容结合使用时才有效:服务器可以告诉客户端它不希望或不支持保持连接。为此,在提供服务之前设置相应的标志:
server := &http.Server{
// ... 参见Stephen的答案
}
server.SetKeepAlivesEnabled(false)
server.ListenAndServe()
这将设置响应头Connection: close
,并且大多数客户端将从他们的一侧终止连接。
英文:
Stephen's answer worked for me only in combination with the following: the server can tell its clients that it does not wish or support to keep connections open. To do so, set the according flag before serving:
server := &http.Server{
// ... see Stephen's answer
}
server.SetKeepAlivesEnabled(false)
server.ListenAndServe()
This will set the response header Connection: close
and most clients will terminate the connection from their side.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论