Projects per year
Documentation and guidelines about the data requirements provide guidance in this process and enable to communicate what to expect from the data, but are mostly intended for humans only. To facilitate the harmonization process, we propose the usage of a specification file, describing the constraints to which the data should comply. Its syntax is human- and machine-readable, so it can be used to communicate expected data quality/conformity and to validate data automatically. The scope of the set of specifications can be specific to a dataset, researcher or research community, which allows bottom-up and top-down adoption. As an example, we apply the specifications to verify data mapped to the biodiversity information standard Darwin Core.
In this talk, we will present "whip", a proposed syntax and format to express data specifications. Whip allows to define column-based constraints for tabular (tidy) data with a number of rules. We will also demonstrate a software application (called "pywhip") to validate data sets using these specifications. We hope it will trigger a discussion on how to express data specifications and communicate data quality expectations.
|Number of pages||1|
|Publication status||Published - 24-Sep-2018|
- Species and biotopes
EWI Biomedical sciences
- 1 Active
Aelterman, B., Goossens, C., Fostier, C., Van den Bergh, E., Azijn, K., Pollet, M., Desmet, P., Van Hoey, S., Milotic, T., Noé, N., Oldoni, D., Reyserhove, L., Casaer, J., Cools, N., De Dobbelaer, T., Pauwels, I., Spanoghe, G., Stienen, E., Verhelst, P. & Wouters, J.
1/01/12 → 31/12/24