Documentation
¶
Overview ¶
Package csv reads and writes comma-separated values (CSV) files. There are many kinds of CSV files; this package supports the format described in RFC 4180.
A csv file contains zero or more records of one or more fields per record. Each record is separated by the newline character. The final record may optionally be followed by a newline character.
field1,field2,field3
White space is considered part of a field.
Carriage returns before newline characters are silently removed.
Blank lines are ignored. A line with only whitespace characters (excluding the ending newline character) is not considered a blank line.
Fields which start and stop with the quote character " are called quoted-fields. The beginning and ending quote are not part of the field.
The source:
normal string,"quoted-field"
results in the fields
{`normal string`, `quoted-field`}
Within a quoted-field a quote character followed by a second quote character is considered a single quote.
"the ""word"" is true","a ""quoted-field"""
results in
{`the "word" is true`, `a "quoted-field"`}
Newlines and commas may be included in a quoted-field
"Multi-line field","comma is ,"
results in
{`Multi-line
field`, `comma is ,`}
Index ¶
Examples ¶
Constants ¶
This section is empty.
Variables ¶
var ( ErrBareQuote = errors.New("bare \" in non-quoted-field") ErrQuote = errors.New("extraneous or missing \" in quoted-field") ErrFieldCount = errors.New("wrong number of fields") )
These are the errors that can be returned in ParseError.Err.
Functions ¶
This section is empty.
Types ¶
type ParseError ¶
type ParseError struct {
StartLine int // Line where the record starts
Line int // Line where the error occurred
Column int // Column (rune index) where the error occurred
Err error // The actual error
}
A ParseError is returned for parsing errors. Line numbers are 1-indexed and columns are 0-indexed.
func (*ParseError) Format ¶
func (e *ParseError) Format(s fmt.State, verb rune)
Format implements fmt.Formatter.
func (*ParseError) FormatError ¶
func (e *ParseError) FormatError(p errors.Printer) error
FormatError implements errors.Formatter.
type Reader ¶
type Reader struct {
// Comma is the field delimiter.
// It is set to comma (',') by NewReader.
Comma rune
// Comment, if not 0, is the comment character. Lines beginning with the
// Comment character without preceding whitespace are ignored.
// With leading whitespace the Comment character becomes part of the
// field, even if TrimLeadingSpace is true.
Comment rune
// FieldsPerRecord is the number of expected fields per record.
// If FieldsPerRecord is positive, Read requires each record to
// have the given number of fields. If FieldsPerRecord is 0, Read sets it to
// the number of fields in the first record, so that future records must
// have the same field count. If FieldsPerRecord is negative, no check is
// made and records may have a variable number of fields.
FieldsPerRecord int
// If LazyQuotes is true, a quote may appear in an unquoted field and a
// non-doubled quote may appear in a quoted field.
LazyQuotes bool
// If TrimLeadingSpace is true, leading white space in a field is ignored.
// This is done even if the field delimiter, Comma, is white space.
TrimLeadingSpace bool
// ReuseRecord controls whether calls to Read may return a slice sharing
// the backing array of the previous call's returned slice for performance.
// By default, each call to Read returns newly allocated memory owned by the caller.
ReuseRecord bool
// contains filtered or unexported fields
}
A Reader reads records from a CSV-encoded file.
As returned by NewReader, a Reader expects input conforming to RFC 4180. The exported fields can be changed to customize the details before the first call to Read or ReadAll.
Example ¶
package main
import (
"context"
"fmt"
"io"
"strings"
"github.com/ruiaylin/pgparser/utils/encoding/csv"
"github.com/ruiaylin/pgparser/utils/log"
)
func main() {
ctx := context.Background()
in := `first_name,last_name,username
"Rob","Pike",rob
Ken,Thompson,ken
"Robert","Griesemer","gri"
`
r := csv.NewReader(strings.NewReader(in))
for {
record, err := r.Read()
if err == io.EOF {
break
}
if err != nil {
log.Fatalf(ctx, "%v", err)
}
fmt.Println(record)
}
}
Output: [first_name last_name username] [Rob Pike rob] [Ken Thompson ken] [Robert Griesemer gri]
Example (Options) ¶
This example shows how csv.Reader can be configured to handle other types of CSV files.
package main
import (
"context"
"fmt"
"strings"
"github.com/ruiaylin/pgparser/utils/encoding/csv"
"github.com/ruiaylin/pgparser/utils/log"
)
func main() {
ctx := context.Background()
in := `first_name;last_name;username
"Rob";"Pike";rob
# lines beginning with a # character are ignored
Ken;Thompson;ken
"Robert";"Griesemer";"gri"
`
r := csv.NewReader(strings.NewReader(in))
r.Comma = ';'
r.Comment = '#'
records, err := r.ReadAll()
if err != nil {
log.Fatalf(ctx, "%v", err)
}
fmt.Print(records)
}
Output: [[first_name last_name username] [Rob Pike rob] [Ken Thompson ken] [Robert Griesemer gri]]
func (*Reader) Read ¶
Read reads one record (a slice of fields) from r. If the record has an unexpected number of fields, Read returns the record along with the error ErrFieldCount. Except for that case, Read always returns either a non-nil record or a non-nil error, but not both. If there is no data left to be read, Read returns nil, io.EOF. If ReuseRecord is true, the returned slice may be shared between multiple calls to Read.
func (*Reader) ReadAll ¶
ReadAll reads all the remaining records from r. Each record is a slice of fields. A successful call returns err == nil, not err == io.EOF. Because ReadAll is defined to read until EOF, it does not treat end of file as an error to be reported.
Example ¶
package main
import (
"context"
"fmt"
"strings"
"github.com/ruiaylin/pgparser/utils/encoding/csv"
"github.com/ruiaylin/pgparser/utils/log"
)
func main() {
ctx := context.Background()
in := `first_name,last_name,username
"Rob","Pike",rob
Ken,Thompson,ken
"Robert","Griesemer","gri"
`
r := csv.NewReader(strings.NewReader(in))
records, err := r.ReadAll()
if err != nil {
log.Fatalf(ctx, "%v", err)
}
fmt.Print(records)
}
Output: [[first_name last_name username] [Rob Pike rob] [Ken Thompson ken] [Robert Griesemer gri]]
type Writer ¶
type Writer struct {
Comma rune // Field delimiter (set to ',' by NewWriter)
UseCRLF bool // True to use \r\n as the line terminator
// contains filtered or unexported fields
}
A Writer writes records to a CSV encoded file.
As returned by NewWriter, a Writer writes records terminated by a newline and uses ',' as the field delimiter. The exported fields can be changed to customize the details before the first call to Write or WriteAll.
Comma is the field delimiter.
If UseCRLF is true, the Writer ends each record with \r\n instead of \n.
Example ¶
package main
import (
"context"
"os"
"github.com/ruiaylin/pgparser/utils/encoding/csv"
"github.com/ruiaylin/pgparser/utils/log"
)
func main() {
ctx := context.Background()
records := [][]string{
{"first_name", "last_name", "username"},
{"Rob", "Pike", "rob"},
{"Ken", "Thompson", "ken"},
{"Robert", "Griesemer", "gri"},
}
w := csv.NewWriter(os.Stdout)
for _, record := range records {
if err := w.Write(record); err != nil {
log.Fatalf(ctx, "error writing record to csv: %v\n", err)
}
}
// Write any buffered data to the underlying writer (standard output).
w.Flush()
if err := w.Error(); err != nil {
log.Fatalf(ctx, "%v", err)
}
}
Output: first_name,last_name,username Rob,Pike,rob Ken,Thompson,ken Robert,Griesemer,gri
func (*Writer) Flush ¶
func (w *Writer) Flush()
Flush writes any buffered data to the underlying io.Writer. To check if an error occurred during the Flush, call Error.
func (*Writer) Write ¶
Writer writes a single CSV record to w along with any necessary quoting. A record is a slice of strings with each string being one field.
func (*Writer) WriteAll ¶
WriteAll writes multiple CSV records to w using Write and then calls Flush.
Example ¶
package main
import (
"context"
"os"
"github.com/ruiaylin/pgparser/utils/encoding/csv"
"github.com/ruiaylin/pgparser/utils/log"
)
func main() {
ctx := context.Background()
records := [][]string{
{"first_name", "last_name", "username"},
{"Rob", "Pike", "rob"},
{"Ken", "Thompson", "ken"},
{"Robert", "Griesemer", "gri"},
}
w := csv.NewWriter(os.Stdout)
if err := w.WriteAll(records); err != nil { // calls Flush internally
log.Fatalf(ctx, "error writing csv: %v\n", err)
}
if err := w.Error(); err != nil {
log.Fatalf(ctx, "error writing csv: %v\n", err)
}
}
Output: first_name,last_name,username Rob,Pike,rob Ken,Thompson,ken Robert,Griesemer,gri
Source Files