script

README

lua scripts

LUA-scripts can be used as filters in skipper. The current implementation supports Lua 5.1.

A script can be given as file (ending with .lua) or as inline code. The script needs to be the first parameter for the lua filter, e.g.

• file lua("/path/to/file.lua") - if a file path is not absolute, the path is relative to skipper's working directory.
• inline lua("function request(c, p); print(c.request.url); end")

Any other additional parameters for the filter must be key=value strings. These will be passed as table to the called functions as second parameter. NOTE: Any parameter starting with "lua-" should not be used to pass values for the script - those will be used for configuring the filter.

A filter script needs at least one global function: request or response. If present, they are called with a skipper filter context and the params passed in the route as table like

-- route looks like
--
-- any: * -> lua("./test.lua", "myparam=foo", "other=bar") -> <shunt>
--
function request(ctx, params)
    print(ctx.request.method .. " " .. ctx.request.url .. " -> " .. params.myparam)
end

The following modules have been preloaded and can be used with e.g. local http = require("http"), see also the examples below

• http gluahttp - TODO: configurable with something different than &http.Client{}
• url gluaurl
• json gopher-json
• base64 lua base64

There is no guarantee that the request() and response() functions of a lua script run in the same lua state during one request. Setting a variable in the request and accessing it in the response will lead to hard debuggable errors. Use the ctx.state_bag to propagate values from request to response - and any other filter in the chain.

Request

Headers

Request headers can be accessed by accessing the ctx.request.header map like

ua = ctx.request.header["user-agent"]

Header names are normalized by the net/http go module like usual. Setting header is done by assigning to the headers map. Setting a header to nil or an empty string deletes the header - setting to nil is preferred.

ctx.request.header["user-agent"] = "skipper.lua/0.0.1"
ctx.request.header["Authorization"] = nil -- delete authorization header

Response headers work the same way by accessing / assigning to ctx.response.header - this is of course only valid in the response() phase.

Other request fields

• backend_url - (read only) returns the backend url specified in the route or an empty value in case it's a shunt or loopback
• outgoing_host - (read/write) the host that will be set for the outgoing proxy request as the 'Host' header.
• remote_addr - (read only) the remote host, usually IP:port
• content_length - (read only) content lenght
• proto - (read only) something like "HTTP/1.1"
• method - (read only) request method, e.g. "GET" or "POST"
• url - (read/write) request URL as string

Serving requests from lua

• serve(table) - table needs status_code (number) and header (table) keys - more to come :), see redirect example below, TODO: add body

StateBag

The state bag can be used to pass values from one filter to another in the same chain. It is shared by all filters in one request.

function request(ctx, params)
    -- the value of "mykey" will be available to all filters in the chain now:
    ctx.state_bag["mykey"] = "foo"
end

function response(ctx, params)
    print(ctx.state_bag["mykey"])
end

Examples

Note: the examples serve as examples. If there is a go based plugin available, use that instead. The overhead of calling lua is 4-5 times slower than pure go.

OAuth2 token as basic auth password

local base64 = require("base64")

function request(ctx, params)
    token = string.gsub(ctx.request.header["Authorization"], "^%s*[Bb]earer%s+", "", 1)
    user = ctx.request.header["x-username"]
    if user == "" then
        user = params.username
    end
    ctx.request.header["Authorization"] = "Basic " .. base64.encode(user .. ":"  .. token)
    -- print(ctx.request.header["Authorization"])
end

validate token

local http = require("http")
function request(ctx, params)
    token = string.gsub(ctx.request.header["Authorization"], "^%s*[Bb]earer%s+", "", 1)
    if token == "" then
        ctx.serve({status_code=401})
        return
    end
    -- do not use in production, no circuit breaker ...
    res, err = http.get("https://auth.example.com/oauth2/tokeninfo?access_token="..token)
    if err ~= nil then
        print("Failed to get tokeninfo: " .. err)
        ctx.serve({status_code=401})
        return
    end
    if res.status_code ~= 200 then
        ctx.serve({status_code=401})
        return
    end
end

strip query

function request(ctx, params)
    ctx.request.url = string.gsub(ctx.request.url, "%?.*$", "")
    -- print("URL="..ctx.request.url)
end

redirect

function request(ctx, params)
    ctx.serve({
        status_code=302,
        header={
            location="http://www.example.org/",
        },
    })
end

Benchmark

redirectTo vs lua redirect

See skptesting/benchmark-lua.sh

Route for "skipper" is * -> redirectTo("http://localhost:9980") -> <shunt>, route for "lua" is * -> lua("function request(c,p); c.serve({status_code=302, header={location='http://localhost:9980'}});end") -> <shunt>

[benchmarking skipper]
Running 12s test @ http://127.0.0.1:9990/lorem.html
  2 threads and 128 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.75ms   14.22ms 260.28ms   92.19%
    Req/Sec    23.87k     2.93k   32.22k    70.42%
  572695 requests in 12.06s, 100.49MB read
  Non-2xx or 3xx responses: 572695
Requests/sec:  47474.31
Transfer/sec:      8.33MB
[benchmarking skipper done]

[benchmarking lua]
Running 12s test @ http://127.0.0.1:9991/lorem.html
  2 threads and 128 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    38.31ms   53.48ms 580.80ms   83.69%
    Req/Sec     5.44k     1.03k    8.23k    71.25%
  130123 requests in 12.01s, 20.97MB read
Requests/sec:  10831.94
Transfer/sec:      1.75MB
[benchmarking lua done]

The benchmark was run with the default pool size of script.InitialPoolSize = 3; script.MaxPoolSize = 10. With script.InitialPoolSize = 128; script.MaxPoolSize = 128 (tweaked for this benchmark) you get about 12k req/s in lua.

Similar results are achieved when testing stripQuery() vs the lua version from above.

Documentation

Overview

Package script provides lua scripting for skipper

Index

• Variables
• func NewLuaScript() filters.Spec

Variables

var InitialPoolSize int = 3

InitialPoolSize is the number of lua states created initially per route

var MaxPoolSize int = 10

MaxPoolSize is the number of lua states stored per route - there may be more parallel requests, but only this number is cached.

Functions

func NewLuaScript

func NewLuaScript() filters.Spec

NewLuaScript creates a new filter spec for skipper