Fact Deduplication¶

Duplicate facts criteria are defined by the OIM specification. Arelle detects duplicate facts by first grouping facts into duplicate sets, as defined here. From there, Arelle can detect if any, all, or none of the facts contained in each set are of the various types of duplicates defined by OIM: inconsistent, consistent, and complete. Using this information, Arelle can trigger warnings or remove duplicate facts as described below.

Duplicate Fact Validation¶

CLI¶

To detect and trigger warnings when duplicate facts are encountered, use --validateDuplicateFacts in conjunction with --validate. The valid choices to pass with --validateDuplicateFacts are:

Argument	Duplicate set fires warning…
`none`	Never
`inconsistent`	If any facts in set are NOT consistent duplicates
`consistent`	If any facts in set are consistent duplicates
`incomplete`	If any facts in set are NOT complete duplicates
`complete`	If any facts in set are complete duplicates
`all`	Always

Example:

python arelleCmdLine.py --file instance.xbrl --validate --validateDuplicateFacts inconsistent

GUI¶

This feature is also available in the GUI by selecting an option under Tools > Validation > Warn on duplicate facts…

Deduplicating Traditional XBRL Instance¶

To save a copy of an instance document with duplicate facts removed, use --saveDeduplicatedInstance. Optionally, provide --deduplicateFacts with an argument to specify the logic to use for deduplication. The default is complete.

Argument	Deduplication result
`complete`	One fact for each complete subset
`consistent-pairs`	After `complete` deduplication, excludes any fact that has a consistent duplicate of higher precision
`consistent-sets`	If the set is fully consistent, only the highest precision fact is kept. Otherwise, same as `complete`

Example:

python arelleCmdLine.py --file instance.xbrl --deduplicateFacts consistent-pairs --saveDeduplicatedInstance output.xbrl