Remove human reads from sequencing data
Host DNA contaminates most metagenomes. Archives require it gone before submission; ethics and GDPR rules often require it gone before sharing at all.
.unmatched is your cleaned sample. .matched is what was
removed — so you can check the tool, not trust it.
1 · Reference
Downloaded straight into this tab from Zenodo and unpacked on the fly — nothing is written to disk, nothing goes through a proxy. Or drop files you already have further down.
Zenodo also hosts an exact human index, not listed here: it is a
3-way bucketed hash table (.hash) rather than a cuckoo filter
(.filter), which this build does not read. It covers the same genome as the
probabilistic one above. The human index needs memory64 and ~7 GB of free RAM;
the ribosomal one runs anywhere.
Data: Zenodo.
Already have the files? Unpack the archive
(tar xf cleanifier_*.tar) and drop the .filter and .info here.
*.filter and *.infoThe human index needs memory64 and enough free RAM — about 7 GB resident for the probabilistic one. The ribosomal index runs comfortably on any machine.
Spaced seeds tolerate substitutions better than contiguous k-mers of the same weight: on synthetic reads at 10% divergence, the Cleanifier seed recovered 14.6 points more matching reads than a contiguous k=29. They cost roughly 3× in throughput.
2 · Samples
_1/_2 and
_R1/_R2 pairs are grouped automaticallyFor a pair, the worse mate decides both reads — splitting one without its mate would break mate pairing downstream.
Both sides are written. Each sample yields
*.matched.fastq (reads found in the reference) and
*.unmatched.fastq (the rest). Which one you keep is your call — the tool does not
assume that matching the reference means contamination.
3 · Output folder
Files are written straight to disk as they are produced. This avoids browser storage, whose quota would not hold a large FASTQ.
Compression happens in the same stream, so nothing extra is held in memory. It costs some throughput but roughly a third of the disk space.
Log
Please cite
This tool reimplements the method described in the following work. If you use it, please cite:
If you use their pre-built index: