Documentation ¶
Overview ¶
Copyright 2012 The Walk Authors. All rights reserved. Use of this source code is governed by a BSD-style license that can be found in the LICENSE file.
[spider frame (golang)] Pholcus(幽灵蛛)是一款纯Go语言编写的高并发、分布式、重量级爬虫软件,支持单机、服务端、客户端三种运行模式,拥有Web、GUI、命令行三种操作界面;规则简单灵活、批量任务并发、输出方式丰富(mysql/mongodb/csv/excel等)、有大量Demo共享;同时她还支持横纵向两种抓取模式,支持模拟登录和任务暂停、取消等一系列高级功能; (官方QQ群:Go大数据 42731170,欢迎加入我们的讨论)。 GUI界面版。
Index ¶
- Constants
- Variables
- func Init()
- func Run()
- func SetTaskConf()
- func SpiderNames() (names []string)
- func SpiderPrepare()
- type Inputor
- type KV
- type LogView
- func (lv *LogView) AppendText(value string)
- func (self *LogView) Clean()
- func (*LogView) LayoutFlags() walk.LayoutFlags
- func (*LogView) MinSizeHint() walk.Size
- func (lv *LogView) PostAppendText(value string)
- func (*LogView) SizeHint() walk.Size
- func (lv *LogView) WndProc(hwnd win.HWND, msg uint32, wParam, lParam uintptr) uintptr
- func (lv *LogView) Write(p []byte) (int, error)
Constants ¶
View Source
const TEM_APPENDTEXT = win.WM_USER + 6
Variables ¶
View Source
var GuiOpt = struct { Mode []*KV Pausetime []*KV ProxyMinute []*KV }{ Mode: []*KV{ {Key: "单机", Int: status.OFFLINE}, {Key: "服务器", Int: status.SERVER}, {Key: "客户端", Int: status.CLIENT}, }, Pausetime: []*KV{ {Key: "无暂停", Int64: 0}, {Key: "0.1 秒", Int64: 100}, {Key: "0.3 秒", Int64: 300}, {Key: "0.5 秒", Int64: 500}, {Key: "1 秒", Int64: 1000}, {Key: "3 秒", Int64: 3000}, {Key: "5 秒", Int64: 5000}, {Key: "10 秒", Int64: 10000}, {Key: "15 秒", Int64: 15000}, {Key: "20 秒", Int64: 20000}, {Key: "30 秒", Int64: 30000}, {Key: "60 秒", Int64: 60000}, }, ProxyMinute: []*KV{ {Key: "不使用代理", Int64: 0}, {Key: "1 分钟", Int64: 1}, {Key: "3 分钟", Int64: 3}, {Key: "5 分钟", Int64: 5}, {Key: "10 分钟", Int64: 10}, {Key: "15 分钟", Int64: 15}, {Key: "20 分钟", Int64: 20}, {Key: "30 分钟", Int64: 30}, {Key: "45 分钟", Int64: 45}, {Key: "60 分钟", Int64: 60}, {Key: "120 分钟", Int64: 120}, {Key: "180 分钟", Int64: 180}, }, }
暂停时间选项及运行模式选项
Functions ¶
func SetTaskConf ¶
func SetTaskConf()
func SpiderNames ¶
func SpiderNames() (names []string)
func SpiderPrepare ¶
func SpiderPrepare()
Types ¶
type LogView ¶
type LogView struct { walk.WidgetBase // contains filtered or unexported fields }
func (*LogView) AppendText ¶
func (*LogView) LayoutFlags ¶
func (*LogView) LayoutFlags() walk.LayoutFlags
func (*LogView) MinSizeHint ¶
func (*LogView) PostAppendText ¶
Source Files ¶
Click to show internal directories.
Click to hide internal directories.