英文:
Golang Logrus Enable Opentelemetry Trace ID and Span ID in all Application Logs
问题
我正在尝试为每个应用程序日志启用 Trace ID 和 Span ID。我正在使用 opentelemetry API 进行注入,并使用 logrus 库进行日志记录。以下是一个示例代码,我能够在所有日志中启用跟踪和跨度条目,但跟踪和跨度 ID 的值始终为 0。
在代码中,你可以尝试以下几点来解决问题:
-
确保你的代码中正确初始化了 TracerProvider,并将其设置为全局的 TracerProvider。你可以使用
sdktrace.NewTracerProvider
方法来创建 TracerProvider,并使用sdktrace.WithSampler
、sdktrace.WithBatcher
和sdktrace.WithResource
方法来配置采样器、批处理器和资源属性。 -
确保你正确设置了文本映射传播器。在你的代码中,你使用了
go.opentelemetry.io/contrib/propagators/b3
包中的 B3 传播器。确保你正确地设置了传播器,以便将跟踪和跨度信息注入到日志中。 -
确保你在日志记录器中正确提取和设置跟踪和跨度 ID。在你的代码中,你使用了自定义的日志记录器
customLogger
,在其中提取了跟踪和跨度 ID,并将其添加到日志条目的数据中。确保你正确提取了跟踪和跨度 ID,并将其设置为日志条目的字段。 -
确保你在请求处理程序中正确使用了 OpenTelemetry 中间件。在你的代码中,你使用了
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp
包中的otelhttp.NewHandler
方法来创建请求处理程序,并将其包装在 OpenTelemetry 中间件中。确保你正确使用了中间件,并在请求处理程序中记录日志。
如果你仍然遇到问题,可以进一步检查你的代码和配置,确保所有的依赖项和设置都正确。你还可以查阅 OpenTelemetry 和 logrus 的文档,以获取更多关于日志记录和跟踪的信息。希望这些提示能帮助你找到解决问题的方向。
英文:
I am trying to enable Trace ID and Span ID for every application log. I am using opentelemtry APIs to inject and logrus labrary for logging. Below is an example code where i am able to enable trace/span entried to all logs but the trace and span id values are always 0's.
#Server.go#
package main
import (
log "github.com/sirupsen/logrus"
"fmt"
"context"
"os"
"net/http"
"go.opentelemetry.io/otel/trace"
stdout "go.opentelemetry.io/otel/exporters/stdout/stdouttrace"
sdktrace "go.opentelemetry.io/otel/sdk/trace"
"go.opentelemetry.io/otel/sdk/resource"
semconv "go.opentelemetry.io/otel/semconv/v1.10.0"
"go.opentelemetry.io/otel"
"go.opentelemetry.io/contrib/propagators/b3"
"go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp"
)
func init() {
log.SetFormatter(customLogger{
formatter: log.JSONFormatter{FieldMap: log.FieldMap{
"msg": "message",
}},
})
log.SetOutput(os.Stdout)
log.SetLevel(log.InfoLevel)
}
func initTracer() (*sdktrace.TracerProvider, error) {
exporter, err := stdout.New(stdout.WithPrettyPrint())
if err != nil {
return nil, err
}
tp := sdktrace.NewTracerProvider(
sdktrace.WithSampler(sdktrace.AlwaysSample()),
sdktrace.WithBatcher(exporter),
sdktrace.WithResource(resource.NewWithAttributes(semconv.SchemaURL, semconv.ServiceNameKey.String("PreferencesService"))),
)
otel.SetTracerProvider(tp)
b3 := b3.New()
otel.SetTextMapPropagator(b3)
return tp, err
}
func main() {
ctx := context.Background()
tp, err := initTracer()
if err != nil {
log.Error(err)
}
defer func() {
if err := tp.Shutdown(ctx); err != nil {
log.Error("Error shutting down tracer provider: %v", err)
}
}()
otelHandler := otelhttp.NewHandler(http.HandlerFunc(func(w http.ResponseWriter, _ *http.Request) {
log.Info("About End Point Printning...")
fmt.Fprintln(w, "about page")
}),"About")
http.Handle("/about", otelHandler)
log.Info("Listening...")
log.Fatal(http.ListenAndServe(":8080", nil))
}
type customLogger struct {
formatter log.JSONFormatter
}
func (l customLogger) Format(entry *log.Entry) ([]byte, error) {
span := trace.SpanFromContext(entry.Context)
entry.Data["trace_id"] = span.SpanContext().TraceID().String()
entry.Data["span_id"] = span.SpanContext().SpanID().String()
//Below injection is Just to understand what Context has
entry.Data["Context"] = span.SpanContext()
return l.formatter.Format(entry)
}
#Client.go#
package main
import (
"fmt"
"io/ioutil"
"log"
"net/http"
)
func main() {
resp, err := http.Get("http://localhost:8080/about")
if err != nil {
log.Fatal(err)
}
defer resp.Body.Close()
body, err := ioutil.ReadAll(resp.Body)
if err != nil {
log.Fatal(err)
}
fmt.Println(string(body))
}
#Output :#
{"Context":{"TraceID":"00000000000000000000000000000000","SpanID":"0000000000000000","TraceFlags":"00","TraceState":"","Remote":false},"level":"info","message":"Listening...","span_id":"0000000000000000","time":"2022-06-30T12:34:21+05:30","trace_id":"00000000000000000000000000000000"}
{"Context":
**Below Line Should have Proper Trace ID and Span ID**
{"TraceID":"00000000000000000000000000000000","SpanID":"0000000000000000","TraceFlags":"00","TraceState":"","Remote":false},"level":"info","message":"About End Point Printning...","span_id":"0000000000000000","time":"2022-06-30T12:34:28+05:30","trace_id":"00000000000000000000000000000000"}
{
"Name": "About",
"SpanContext": {
"TraceID": "cb4dc4953a633fbe9b41c19a0870e9d6",
"SpanID": "b7346b7aba15e074",
"TraceFlags": "01",
"TraceState": "",
"Remote": false
},
"Parent": {
"TraceID": "00000000000000000000000000000000",
"SpanID": "0000000000000000",
"TraceFlags": "00",
"TraceState": "",
"Remote": false
},
"SpanKind": 2,
"StartTime": "2022-06-30T12:34:28.838523497+05:30",
"EndTime": "2022-06-30T12:34:28.838858989+05:30",
"Attributes": [
{
"Key": "net.transport",
"Value": {
"Type": "STRING",
"Value": "ip_tcp"
}
},
{
"Key": "net.peer.ip",
"Value": {
"Type": "STRING",
"Value": "127.0.0.1"
}
},
{
"Key": "net.peer.port",
"Value": {
"Type": "INT64",
"Value": 41900
}
},
{
"Key": "net.host.name",
"Value": {
"Type": "STRING",
"Value": "localhost"
}
},
{
"Key": "net.host.port",
"Value": {
"Type": "INT64",
"Value": 8080
}
},
{
"Key": "http.method",
"Value": {
"Type": "STRING",
"Value": "GET"
}
},
{
"Key": "http.target",
"Value": {
"Type": "STRING",
"Value": "/about"
}
},
{
"Key": "http.server_name",
"Value": {
"Type": "STRING",
"Value": "About"
}
},
{
"Key": "http.user_agent",
"Value": {
"Type": "STRING",
"Value": "Go-http-client/1.1"
}
},
{
"Key": "http.scheme",
"Value": {
"Type": "STRING",
"Value": "http"
}
},
{
"Key": "http.host",
"Value": {
"Type": "STRING",
"Value": "localhost:8080"
}
},
{
"Key": "http.flavor",
"Value": {
"Type": "STRING",
"Value": "1.1"
}
},
{
"Key": "http.wrote_bytes",
"Value": {
"Type": "INT64",
"Value": 11
}
},
{
"Key": "http.status_code",
"Value": {
"Type": "INT64",
"Value": 200
}
}
],
"Events": null,
"Links": null,
"Status": {
"Code": "Unset",
"Description": ""
},
"DroppedAttributes": 0,
"DroppedEvents": 0,
"DroppedLinks": 0,
"ChildSpanCount": 0,
"Resource": [
{
"Key": "service.name",
"Value": {
"Type": "STRING",
"Value": "PreferencesService"
}
}
],
"InstrumentationLibrary": {
"Name": "go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp",
"Version": "semver:0.32.0",
"SchemaURL": ""
}
}
Not Sure where/what is the mistake but it will be helpful if someone route me to the right direction, how i can inject Trace ID and Span ID to all logs..
Note: I don't want to pass request context to all the functions. Looking for other options
答案1
得分: 1
问题是 span := trace.SpanFromContext(entry.Context)
无法获取到 span 上下文。
也许你应该将 req.Context()
注入到 logrus 中,然后打印日志。
otelHandler := otelhttp.NewHandler(http.HandlerFunc(func(w http.ResponseWriter, req *http.Request) {
//log.Info("About End Point Printning...")
// 注入 req.Context
log.WithContext(req.Context()).Info("About End Point Printning...")
fmt.Fprintln(w, "about page")
}), "About")
运行 server.go
,然后运行 client.go
,输出结果为
{"Context":{"TraceID":"00000000000000000000000000000000","SpanID":"0000000000000000","TraceFlags":"00","TraceState":"","Remote":false},"level":"info","message":"Listening...","span_id":"0000000000000000","time":"2022-07-02T21:39:49+08:00","trace_id":"00000000000000000000000000000000"}
{"Context":{"TraceID":"7cab2739ea2c5b2d3e6a08cfb57858a9","SpanID":"ec5ba151b6823658","TraceFlags":"01","TraceState":"","Remote":false},"level":"info","message":"About End Point Printning...","span_id":"ec5ba151b6823658","time":"2022-07-02T21:39:54+08:00","trace_id":"7cab2739ea2c5b2d3e6a08cfb57858a9"}
注意:第一行没有打印 TraceId 是因为没有请求。
希望对你有帮助。
英文:
the problem is span := trace.SpanFromContext(entry.Context)
can not get span context.
maybe you should inject req.Context()
to logrus then print log
otelHandler := otelhttp.NewHandler(http.HandlerFunc(func(w http.ResponseWriter, req *http.Request) {
//log.Info("About End Point Printning...")
// inject req.Context
log.WithContext(req.Context()).Info("About End Point Printning...")
fmt.Fprintln(w, "about page")
}), "About")
run the server.go
, and then run client.go
, the output is
{"Context":{"TraceID":"00000000000000000000000000000000","SpanID":"0000000000000000","TraceFlags":"00","TraceState":"","Remote":false},"level":"info","message":"Listening...","span_id":"0000000000000000","time":"2022-07-02T21:39:49+08:00","trace_id":"00000000000000000000000000000000"}
{"Context":{"TraceID":"7cab2739ea2c5b2d3e6a08cfb57858a9","SpanID":"ec5ba151b6823658","TraceFlags":"01","TraceState":"","Remote":false},"level":"info","message":"About End Point Printning...","span_id":"ec5ba151b6823658","time":"2022-07-02T21:39:54+08:00","trace_id":"7cab2739ea2c5b2d3e6a08cfb57858a9"}
notice: the first line not print traceId is because there is no request
hope it is helpful for you.
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库,让每个人都能够通过互相帮助和分享经验来进步。
评论