gdaxfeeder

README

GDAX Data Fetcher

This module builds a MarketStore background worker which fetches historical price data of cryptocurrencies from GDAX public API. It runs as a goroutine behind the MarketStore process and keeps writing to the disk.

Configuration

gdaxfeeder.so comes with the server by default, so you can simply configure it in MarketStore configuration file.

Options

Name	Type	Default	Description
query_start	string	none	The point in time from which to start fetching price data
base_timeframe	string	1Min	The bar aggregation duration
symbols	slice of strings	[BTC, ETH, LTC, BCH]	The symbols to retrieve data for

Query Start

The fetcher keeps filling data up to the current time eventually and writes new data as it is generated. Once data starts to fetch, it restarts from the last-written data timestamp even after the server is restarted. You can specify fewer symbols if you don't need others. Since GDAX API has rate limit, this may help to fill the historical data if you start from old. Note that the data fetch timestamp is identical among symbols, so if one symbol lags other fetches may not be up to speed.

Base Timeframe

The daily bars are written at the boundary of system timezone configured in the same file.

Example

Add the following to your config file:

bgworkers:
  - module: gdaxfeeder.so
    config:
      query_start: "2018-01-01 00:00"
      symbols:
        - BTC
      base_timeframe: "1D"

Build

If you need to change the fetcher, you can build it by:

$ make configure
$ make all

It installs the new .so file to the first GOPATH/bin directory.

Caveat

Since this is implemented based on the Go's plugin mechanism, it is supported only on Linux & MacOS as of Go 1.10