rebuilddb2

command
v2.0.4+incompatible Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Aug 2, 2018 License: ISC Imports: 27 Imported by: 0

README

Command line app rebuilddb2

The rebuilddb2 app is used for maintenance of dcrdata's dcrpg database that uses PostgreSQL to store a nearly complete record of the Decred blockchain data.

IMPORTANT: When performing a bulk data import (e.g. full chain scan from genesis block), be sure to configure PostgreSQL appropriately. Please see postgresql-tuning.conf for tips.

Installation

Be able to build dcrdata (see ../../README.md). In short:

  • Install dep, the dependency management tool

    go get -u -v github.com/golang/dep/cmd/dep
    
  • Clone the dcrdata repository

    git clone https://github.com/decred/dcrdata $GOPATH/src/github.com/decred/dcrdata
    
  • Populate vendor folder with dep ensure

    cd $GOPATH/src/github.com/decred/dcrdata
    dep ensure
    
  • Build rebuilddb2

    # build rebuilddb2 executable in workspace:
    cd $GOPATH/src/github.com/decred/dcrdata/cmd/rebuilddb2
    go build
    # or to install dcrdata and other tools into $GOPATH/bin:
    go install ./cmd/rebuilddb2
    

Usage

First edit rebuilddb2.conf, using sample-rebuilddb2.conf to start. You will need to follow a typical PostgreSQL setup process, creating a new database/scheme and a new role that has permissions/owns that database.

A fresh rebuild of the database is accomplished via:

./rebuilddb2 -D  # drop any existing tables
./rebuilddb2     # rebuild tables from scratch

Remember to update your PostgreSQL config (postgresql.conf) before and after bulk data imports. Namely, before normal dcrdata operation, ensure that fsync=true and other setting are adjusted for efficient queries.

Details

Rebuilding the dcrdata tables from scratch involves the following steps:

  • Connect to the PostgreSQL database using the settings in rebuilddb2.conf
  • Create the tables (i.e. "blocks", "transactions", "vins", etc).
  • Starting from genesis block, process each block and store in tables.
  • Create indexes for each table.

See rebuilddb2 --help for more information on how to tweak the operating mode.

License

See LICENSE at the base of the dcrdata repository.

Documentation

The Go Gopher

There is no documentation for this package.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL