spark

Documentation

Index

• type Config
  • func (c *Config) PythonConfig() *python.Config
  • func (c *Config) Validate() error
• type Monitor
  • func (m *Monitor) Configure(conf *Config) error

Types

type Config

type Config struct {
	config.MonitorConfig `yaml:",inline" acceptsEndpoints:"true"`

	Host string `yaml:"host" validate:"required"`
	Port uint16 `yaml:"port" validate:"required"`
	// Set to `true` when monitoring a master Spark node
	IsMaster bool `yaml:"isMaster" default:"false"`
	// Should be one of `Standalone` or `Mesos` or `Yarn`.  Cluster metrics will
	// not be collected on Yarn.  Please use the collectd/hadoop monitor to gain
	// insights to your cluster's health.
	ClusterType               sparkClusterType `yaml:"clusterType" validate:"required"`
	CollectApplicationMetrics *bool            `yaml:"collectApplicationMetrics" default:"false"`
	EnhancedMetrics           *bool            `yaml:"enhancedMetrics" default:"false"`
	// contains filtered or unexported fields
}

Config is the monitor-specific config with the generic config embedded

func (*Config) PythonConfig

func (c *Config) PythonConfig() *python.Config

PythonConfig returns the embedded python.Config struct from the interface

func (*Config) Validate

func (c *Config) Validate() error

Validate will check the config for correctness.

type Monitor

type Monitor struct {
	python.PyMonitor
}

Monitor is the main type that represents the monitor

func (*Monitor) Configure

func (m *Monitor) Configure(conf *Config) error

Configure configures and runs the plugin in python