Go語言的Http 中間件實現
英文原文鏈接: http://www.alexedwards.net/blog/making-and-using-middleware
當你正在構建一個Web應用程序有可能要運行許多(甚至全部)的HTTP請求一些共享功能,你可能想記錄每一個request,gzip壓縮的每個response,或者做一些繁重的處理或者緩存檢查。
實現這個共享功能的一種方法是將其設置為中間件,他可以作為一個獨立的程序,在正常的handlers處理之前。根本不需要重寫代碼:如果你想用一個中間件,就把它加上應用中;如果你改變主意了,去掉就好了。就這么簡單。
ServeMux => Middleware Handler => Application Handler
ServeMux => MiddlewareHandler => ApplicationHandler
這篇文章,我會給大家介紹怎么自己去實現一個自定義的middleware模式。以及通過使用第三方的中間件軟件包的一些具體的實例。
基本原則:
在Go語言中實現和使用middleware是非常簡單的。
- 使我們的中間件能搞滿足 http.handlers 這個接口
- 建立一個 handlers 鏈,使其能夠滿足中間件的 handler 和 正常應用的 handler,并且能夠注冊到 http.ServeMux
我來解釋如何實現:
首先你要知道go 的http handle,這里假設你是知道的
func messageHandler(message string) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
w.Write([]byte(message)
})
}funcmessageHandler(messagestring) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
w.Write([]byte(message)
})
}這上面這個代碼片段里面我們的邏輯很簡單只是一個簡單的 w.Write() 然后我們使用 http.HandlerFunc 適配器來轉化這個閉包,并返回。
我們可以使用一個相同的方法來創建一個 handler 鏈。可以使用 handler 代替參數 string 傳進閉包,然后把控制 handler 給傳進來的 handler,并且調用 ServeHTTP() 方法。
這給了我們一個完整的模式構建中間件:
func exampleMiddleware(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
// Our middleware logic goes here...
next.ServeHTTP(w, r)
})
}funcexampleMiddleware(nexthttp.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
// Our middleware logic goes here...
next.ServeHTTP(w, r)
})
}你注意到這個中間件有一個這樣的函數結構 func(http.Handler) http.Handler 。它接受一個 handler 作為參數,并且返回一個 handler。這里有兩個很有用的原因:
- 因為這個函數返回一個句柄可以直接供中間件注冊
- 我們可以建立任意長度的 handler 鏈來通過中間件的方法互相嵌套
比如:
http.Handle("/", middlewareOne(middlewareTwo(finalHandler)))http.Handle("/", middlewareOne(middlewareTwo(finalHandler)))控制流說明:
讓我們來看一個帶有多個中間件的例子,并且把日志輸出到控制臺:
package main
import (
"log"
"net/http"
)
func middlewareOne(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
log.Println("Executing middlewareOne")
next.ServeHTTP(w, r)
log.Println("Executing middlewareOne again")
})
}
func middlewareTwo(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
log.Println("Executing middlewareTwo")
if r.URL.Path != "/" {
return
}
next.ServeHTTP(w, r)
log.Println("Executing middlewareTwo again")
})
}
func final(w http.ResponseWriter, r *http.Request) {
log.Println("Executing finalHandler")
w.Write([]byte("OK"))
}
func main() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", middlewareOne(middlewareTwo(finalHandler)))
http.ListenAndServe(":3000", nil)
}package main
import (
"log"
"net/http"
)
funcmiddlewareOne(nexthttp.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
log.Println("Executing middlewareOne")
next.ServeHTTP(w, r)
log.Println("Executing middlewareOne again")
})
}
funcmiddlewareTwo(nexthttp.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
log.Println("Executing middlewareTwo")
if r.URL.Path != "/" {
return
}
next.ServeHTTP(w, r)
log.Println("Executing middlewareTwo again")
})
}
funcfinal(w http.ResponseWriter, r *http.Request) {
log.Println("Executing finalHandler")
w.Write([]byte("OK"))
}
funcmain() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", middlewareOne(middlewareTwo(finalHandler)))
http.ListenAndServe(":3000", nil)
}然后我們執行 go run main.go 在瀏覽器打開http://localhost:3000。 你會看到下面的輸出。
我們能夠很清楚的看到handle的流程控制。我們嵌套他們的返回順序。我們可以通過中間件中得 return 隨時停止handle鏈的控制。
在上面的代碼中我們在 middlewareTwo function包含了retrun 語句。我們在瀏覽器中打開http://localhost:3000/foo,我們會看到。
2015/12/19 04:21:57 Executing middlewareOne 2015/12/19 04:21:57 Executing middlewareTwo 2015/12/19 04:21:57 Executing middlewareOne again 2015/12/19 04:21:57 Executing middlewareOne 2015/12/19 04:21:57 Executing middlewareTwo 2015/12/19 04:21:57 Executing middlewareOne again
2015/12/19 04:21:57 ExecutingmiddlewareOne 2015/12/19 04:21:57 ExecutingmiddlewareTwo 2015/12/19 04:21:57 ExecutingmiddlewareOneagain 2015/12/19 04:21:57 ExecutingmiddlewareOne 2015/12/19 04:21:57 ExecutingmiddlewareTwo 2015/12/19 04:21:57 ExecutingmiddlewareOneagain
我們實現一個真實的項目的示例:
我們實現一個判斷請求是不是XMl的功能,我們要實現一個中間件。用來檢查的請求體的存在。檢查請求體,以確保它是XML。如果其中檢查失敗,我希望我們的中間件輸出錯誤信息然后終止我們的handle處理。
package main
import (
"bytes"
"net/http"
)
func enforceXMLHandler(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
// Check for a request body
if r.ContentLength == 0 {
http.Error(w, http.StatusText(400), 400)
return
}
// Check its MIME type
buf := new(bytes.Buffer)
buf.ReadFrom(r.Body)
if http.DetectContentType(buf.Bytes()) != "text/xml; charset=utf-8" {
http.Error(w, http.StatusText(415), 415)
return
}
next.ServeHTTP(w, r)
})
}
func main() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", enforceXMLHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}
func final(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}package main
import (
"bytes"
"net/http"
)
funcenforceXMLHandler(nexthttp.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
// Check for a request body
if r.ContentLength == 0 {
http.Error(w, http.StatusText(400), 400)
return
}
// Check its MIME type
buf := new(bytes.Buffer)
buf.ReadFrom(r.Body)
if http.DetectContentType(buf.Bytes()) != "text/xml; charset=utf-8" {
http.Error(w, http.StatusText(415), 415)
return
}
next.ServeHTTP(w, r)
})
}
funcmain() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", enforceXMLHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}
funcfinal(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}為了檢驗我們的中間件是否實現了這個功能,我們首先創建一個XML文件。
$ cat > books.xml
<?xml version="1.0"?>
<books>
<book>
<author>H. G. Wells</author>
<title>The Time Machine</title>
<price>8.50</price>
</book>
</books>$ cat > books.xml <?xmlversion="1.0"?> <books> <book> <author>H. G. Wells</author> <title>TheTimeMachine</title> <price>8.50</price> </book> </books>
然后通過使用cURL來進行模擬請求:
$ curl -i localhost:3000 HTTP/1.1 400 Bad Request Content-Type: text/plain; charset=utf-8 Content-Length: 12 Bad Request $ curl -i -d "This is not XML" localhost:3000 HTTP/1.1 415 Unsupported Media Type Content-Type: text/plain; charset=utf-8 Content-Length: 23 Unsupported Media Type $ curl -i -d @books.xml localhost:3000 HTTP/1.1 200 OK Date: Fri, 17 Oct 2014 13:42:10 GMT Content-Length: 2 Content-Type: text/plain; charset=utf-8 OK
$ curl -i localhost:3000 HTTP/1.1 400 BadRequest Content-Type: text/plain; charset=utf-8 Content-Length: 12 BadRequest $ curl -i -d "This is not XML" localhost:3000 HTTP/1.1 415 UnsupportedMediaType Content-Type: text/plain; charset=utf-8 Content-Length: 23 UnsupportedMediaType $ curl -i -d @books.xmllocalhost:3000 HTTP/1.1 200 OK Date: Fri, 17 Oct 2014 13:42:10 GMT Content-Length: 2 Content-Type: text/plain; charset=utf-8 OK
接下來給大家介紹一下第三方中間件的使用:
秉承不造輪子的原則,其實在Github上有很多實現了一些功能的中間件。比如這里給大家介紹2個基礎驗證的中間件 goji/httpauth 和Gorilla’s LoggingHandler
首先我們需要引入第三方包
$ go get github.com/goji/httpauth
$ gogetgithub.com/goji/httpauth
package main
import (
"github.com/goji/httpauth"
"net/http"
)
func main() {
finalHandler := http.HandlerFunc(final)
authHandler := httpauth.SimpleBasicAuth("username", "password")
http.Handle("/", authHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}
func final(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}package main
import (
"github.com/goji/httpauth"
"net/http"
)
funcmain() {
finalHandler := http.HandlerFunc(final)
authHandler := httpauth.SimpleBasicAuth("username", "password")
http.Handle("/", authHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}
funcfinal(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}如果你運行這個例子,你應該得到你所期望的有效和無效的憑證響應
$ curl -i username:password@localhost:3000 HTTP/1.1 200 OK Content-Length: 2 Content-Type: text/plain; charset=utf-8 OK $ curl -i username:wrongpassword@localhost:3000 HTTP/1.1 401 Unauthorized Content-Type: text/plain; charset=utf-8 Www-Authenticate: Basic realm=""Restricted"" Content-Length: 13 Unauthorized
$ curl -i username:password@localhost:3000 HTTP/1.1 200 OK Content-Length: 2 Content-Type: text/plain; charset=utf-8 OK $ curl -i username:wrongpassword@localhost:3000 HTTP/1.1 401 Unauthorized Content-Type: text/plain; charset=utf-8 Www-Authenticate: Basicrealm=""Restricted"" Content-Length: 13 Unauthorized
Gorilla’s LoggingHandler和 Apache-style logs 有一些區別
以下是我們在其中寫入日志到server.log文件一個簡單的例子:
首先還是引入第三包
go get github.com/gorilla/handlers
gogetgithub.com/gorilla/handlers
package main
import (
"github.com/gorilla/handlers"
"net/http"
"os"
)
func main() {
finalHandler := http.HandlerFunc(final)
logFile, err := os.OpenFile("server.log", os.O_WRONLY|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
http.Handle("/", handlers.LoggingHandler(logFile, finalHandler))
http.ListenAndServe(":3000", nil)
}
func final(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}package main
import (
"github.com/gorilla/handlers"
"net/http"
"os"
)
funcmain() {
finalHandler := http.HandlerFunc(final)
logFile, err := os.OpenFile("server.log", os.O_WRONLY|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
http.Handle("/", handlers.LoggingHandler(logFile, finalHandler))
http.ListenAndServe(":3000", nil)
}
funcfinal(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}在一個簡單的情況下,這樣我們的代碼是相當清楚的。但是,如果我們想用LoggingHandler作為一個更大的中間件鏈中的一部分會發生什么?我們可以很容易地結束了一個聲明,看起來像這樣:
http.Handle("/", handlers.LoggingHandler(logFile, authHandler(enforceXMLHandler(finalHandler))))http.Handle("/", handlers.LoggingHandler(logFile, authHandler(enforceXMLHandler(finalHandler))))不過這看起來太糟糕了。
我們可以通過創建一個構造函數打來整理一下我們給它取名為(myLoggingHandler)
和signature func(http.Handler) http.Handler .這樣就會是我們的代碼更加整潔和可讀性:
func myLoggingHandler(h http.Handler) http.Handler {
logFile, err := os.OpenFile("server.log", os.O_WRONLY|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
return handlers.LoggingHandler(logFile, h)
}
func main() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", myLoggingHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}funcmyLoggingHandler(h http.Handler) http.Handler {
logFile, err := os.OpenFile("server.log", os.O_WRONLY|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
return handlers.LoggingHandler(logFile, h)
}
funcmain() {
finalHandler := http.HandlerFunc(final)
http.Handle("/", myLoggingHandler(finalHandler))
http.ListenAndServe(":3000", nil)
}$ cat server.log 127.0.0.1 - - [21/Oct/2014:18:56:43 +0100] "GET / HTTP/1.1" 200 2 127.0.0.1 - - [21/Oct/2014:18:56:36 +0100] "POST / HTTP/1.1" 200 2 127.0.0.1 - - [21/Oct/2014:18:56:43 +0100] "PUT / HTTP/1.1" 200 2
$ catserver.log 127.0.0.1 - - [21/Oct/2014:18:56:43 +0100] "GET / HTTP/1.1" 200 2 127.0.0.1 - - [21/Oct/2014:18:56:36 +0100] "POST / HTTP/1.1" 200 2 127.0.0.1 - - [21/Oct/2014:18:56:43 +0100] "PUT / HTTP/1.1" 200 2
這里還有一個比較完整結構的中間件使用的示例:
package main
import (
"bytes"
"github.com/goji/httpauth"
"github.com/gorilla/handlers"
"net/http"
"os"
)
func enforceXMLHandler(next http.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
if r.ContentLength == 0 {
http.Error(w, http.StatusText(400), 400)
return
}
buf := new(bytes.Buffer)
buf.ReadFrom(r.Body)
if http.DetectContentType(buf.Bytes()) != "text/xml; charset=utf-8" {
http.Error(w, http.StatusText(415), 415)
return
}
next.ServeHTTP(w, r)
})
}
func myLoggingHandler(h http.Handler) http.Handler {
logFile, err := os.OpenFile("server.log", os.O_RDWR|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
return handlers.LoggingHandler(logFile, h)
}
func main() {
indexHandler := http.HandlerFunc(index)
authHandler := httpauth.SimpleBasicAuth("username", "password")
http.Handle("/", myLoggingHandler(authHandler(enforceXMLHandler(indexHandler))))
http.ListenAndServe(":3000", nil)
}
func index(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}package main
import (
"bytes"
"github.com/goji/httpauth"
"github.com/gorilla/handlers"
"net/http"
"os"
)
funcenforceXMLHandler(nexthttp.Handler) http.Handler {
return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
if r.ContentLength == 0 {
http.Error(w, http.StatusText(400), 400)
return
}
buf := new(bytes.Buffer)
buf.ReadFrom(r.Body)
if http.DetectContentType(buf.Bytes()) != "text/xml; charset=utf-8" {
http.Error(w, http.StatusText(415), 415)
return
}
next.ServeHTTP(w, r)
})
}
funcmyLoggingHandler(h http.Handler) http.Handler {
logFile, err := os.OpenFile("server.log", os.O_RDWR|os.O_CREATE|os.O_APPEND, 0666)
if err != nil {
panic(err)
}
return handlers.LoggingHandler(logFile, h)
}
funcmain() {
indexHandler := http.HandlerFunc(index)
authHandler := httpauth.SimpleBasicAuth("username", "password")
http.Handle("/", myLoggingHandler(authHandler(enforceXMLHandler(indexHandler))))
http.ListenAndServe(":3000", nil)
}
funcindex(w http.ResponseWriter, r *http.Request) {
w.Write([]byte("OK"))
}有很多人不太喜歡中間件的設計模式,不過我還是慢喜歡的。
Go語言的Http 中間件實現