Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Checkpoint ¶
type Checkpoint struct {
// contains filtered or unexported fields
}
Checkpoint stores and retreives the last evaluated key from a DDB scan
func New ¶
func New(appName, tableName string, opts ...Option) (*Checkpoint, error)
New returns a checkpoint that uses DynamoDB for underlying storage
func (*Checkpoint) GetCheckpoint ¶
func (c *Checkpoint) GetCheckpoint(streamName, shardID string) (string, error)
GetCheckpoint determines if a checkpoint for a particular Shard exists. Typically used to determine whether we should start processing the shard with TRIM_HORIZON or AFTER_SEQUENCE_NUMBER (if checkpoint exists).
func (*Checkpoint) SetCheckpoint ¶
func (c *Checkpoint) SetCheckpoint(streamName, shardID, sequenceNumber string) error
SetCheckpoint stores a checkpoint for a shard (e.g. sequence number of last record processed by application). Upon failover, record processing is resumed from this point.
func (*Checkpoint) Shutdown ¶
func (c *Checkpoint) Shutdown() error
Shutdown the checkpoint. Save any in-flight data.
type DefaultRetryer ¶
type DefaultRetryer struct {
Retryer
}
DefaultRetryer .
func (*DefaultRetryer) ShouldRetry ¶
func (r *DefaultRetryer) ShouldRetry(err error) bool
ShouldRetry when error occured
type Option ¶
type Option func(*Checkpoint)
Option is used to override defaults when creating a new Checkpoint
func WithDynamoClient ¶
func WithDynamoClient(svc dynamodbiface.DynamoDBAPI) Option
WithDynamoClient sets the dynamoDb client
func WithMaxInterval ¶
WithMaxInterval sets the flush interval
Source Files