2022-04-07 12:55:07,264 INFO : 2022-04-07 12:55:07,264 INFO : 2022-04-07 12:55:07,264 INFO : 2022-04-07 12:55:07,265 INFO : === Processing: dwca_config/dwca_harbourseal_nat.yaml 2022-04-07 12:55:07,269 INFO : 2022-04-07 12:55:07,269 INFO : === Preparing data === 2022-04-07 12:55:07,275 INFO : 2022-04-07 12:55:07,276 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1988_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,281 INFO : - Rows used: 44 filtered: 0 total: 44 2022-04-07 12:55:07,282 INFO : 2022-04-07 12:55:07,283 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1989_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,298 INFO : - Rows used: 24 filtered: 0 total: 24 2022-04-07 12:55:07,298 INFO : 2022-04-07 12:55:07,299 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1990_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,306 INFO : - Rows used: 68 filtered: 10 total: 78 2022-04-07 12:55:07,307 INFO : 2022-04-07 12:55:07,308 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1991_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,316 INFO : - Rows used: 63 filtered: 12 total: 75 2022-04-07 12:55:07,316 INFO : 2022-04-07 12:55:07,317 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1992_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,325 INFO : - Rows used: 46 filtered: 5 total: 51 2022-04-07 12:55:07,326 INFO : 2022-04-07 12:55:07,327 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1993_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,335 INFO : - Rows used: 69 filtered: 6 total: 75 2022-04-07 12:55:07,336 INFO : 2022-04-07 12:55:07,337 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1994_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,348 INFO : - Rows used: 70 filtered: 4 total: 74 2022-04-07 12:55:07,349 INFO : 2022-04-07 12:55:07,349 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1995_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,358 INFO : - Rows used: 68 filtered: 7 total: 75 2022-04-07 12:55:07,359 INFO : 2022-04-07 12:55:07,360 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1996_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,368 INFO : - Rows used: 70 filtered: 8 total: 78 2022-04-07 12:55:07,369 INFO : 2022-04-07 12:55:07,370 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1998_MNHS_version_2022-03-30.zip 2022-04-07 12:55:07,380 INFO : - Rows used: 80 filtered: 4 total: 84 2022-04-07 12:55:07,381 INFO : 2022-04-07 12:55:07,382 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_1999_2012_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,409 INFO : - Rows used: 5861 filtered: 12690 total: 18551 2022-04-07 12:55:08,410 INFO : 2022-04-07 12:55:08,410 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2013_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,507 INFO : - Rows used: 603 filtered: 1064 total: 1667 2022-04-07 12:55:08,508 INFO : 2022-04-07 12:55:08,509 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2014_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,556 INFO : - Rows used: 660 filtered: 0 total: 660 2022-04-07 12:55:08,557 INFO : 2022-04-07 12:55:08,557 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2015_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,643 INFO : - Rows used: 413 filtered: 3 total: 416 2022-04-07 12:55:08,644 INFO : 2022-04-07 12:55:08,645 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2016_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,761 INFO : - Rows used: 675 filtered: 1144 total: 1819 2022-04-07 12:55:08,763 INFO : 2022-04-07 12:55:08,763 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2017_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,809 INFO : - Rows used: 612 filtered: 8 total: 620 2022-04-07 12:55:08,811 INFO : 2022-04-07 12:55:08,811 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2018_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,846 INFO : - Rows used: 435 filtered: 1 total: 436 2022-04-07 12:55:08,847 INFO : 2022-04-07 12:55:08,848 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2019_MNHS_version_2022-03-30.zip 2022-04-07 12:55:08,892 INFO : - Rows used: 582 filtered: 1 total: 583 2022-04-07 12:55:08,893 INFO : 2022-04-07 12:55:08,893 INFO : Adding dataset: data_in\datasets\SHARK_HarbourSeal_2020_MNHS_version_2022-04-07.zip 2022-04-07 12:55:08,931 INFO : - Rows used: 517 filtered: 0 total: 517 2022-04-07 12:55:09,615 INFO : 2022-04-07 12:55:09,615 INFO : === Creating DwC-A === 2022-04-07 12:55:11,923 ERROR : Duplicates: DatasetSHARK_HarbourSeal_2017_MNHS Row: 410 Key for param/unit: shark_sample_id_md5:d760f0ea05b038e8643d6fba4fd62d8d,scientific_name:Phoca vitulina,param:# counted,unit:ind 2022-04-07 12:55:12,125 WARNING : eMoF: Number of duplicates found: 1 2022-04-07 12:55:14,133 INFO : 2022-04-07 12:55:14,148 INFO : === Finished: dwca_config/dwca_harbourseal_nat.yaml