datalib.DataProcessor¶
- class datalib.DataProcessor(config)¶
- StableCore
Process data records.
Note¶
Just a sample class
Parameters¶
- configdict
Configuration mapping.
- __init__(config)¶
Methods
__init__(config)filter_records(data, predicate)Return records that satisfy a predicate.
merge(left, right[, on])Merge two datasets on a common key.
preview(data[, n])Return a beta preview of processed output.
run(data)Execute the processing pipeline.
summarize(data, field)Compute basic summary statistics for a numeric field.
to_dict(data)Convert a list of records to a column-oriented dictionary.
validate(data[, schema])Validate records against a schema.