UNPKG

ffc-pay-etl-framework

Version:

A framework for creating ETL pipelines in node

github.com/DEFRA/ffc-pay-etl-framework

DEFRA/ffc-pay-etl-framework

82 lines (56 loc) • 1.77 kB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
# Validators Validators are expected to check specific columns within each row against specific validation rules Currently supported destinations are : - RequiredValidator - UniqueValidator - MultiToolValidator ## RequiredValidator ### Options | option | description | | -------------- | ------------------------------------------------------------- | | columns | Array of column indexes | ### Usage ```js Validators.RequiredValidator({ columns: [0] }) ``` ### Example examples/csv-required-validator.js ## UniqueValidator ### Options | option | description | | -------------- | ------------------------------------------------------------- | | column | Column to be tested for uniqueness | ### Usage ```js Validators.UniqueValidator( { column: "field_one" } ) ``` ### Example examples/csv-unique-validator.js ## MultiToolValidator ### Options | option | description | | -------------- | ------------------------------------------------------------- | | column | Column to be tested for validity and validator specification | NB Any validators specified [here](https://github.com/validatorjs/validator.js) can be used ### Usage ```js Validators.MultiToolValidator( { columns: [ { name: "SOIL TYPE PERCENT (Percent)", validator: "isAlphanumeric", args: { locale: "en-GB", options: { ignore: "-;%/ " } } } ] }) ``` ### Example examples/csv-multi-tool-validator.js