add option to directly load the deduplicated, outlier-removed version in `load_data`

[whiskey0504]

and print /log results about how many data were removed.

[kaveriC]

Update outlier handling utility to use duckDB/polars @vaishvikc