Real-time search of all bacterial and viral genomic data

Phelim Bradley (1) , Henk C den Bakker (2) , Eduardo P C Rocha (3) , Gil Mcvean (4) , Zamin Iqbal (1, 5)

1 The Wellcome Trust Centre for Human Genetics [Oxford]
2 Center for Food Safety, Department of Food Science andTechnology [Griffin]
3 Génomique évolutive des Microbes / Microbial Evolutionary Genomics
4 Big Data Institute
5 EMBL-EBI - European Bioinformatics Institute [Hinxton]

Genome sequencing of pathogens is becoming ubiquitous in microbiology, and automated diagnostics will soon appear. The genome sequence archives, already growing exponentially, are currently not searchable for arbitrary sequence. Such an ability would unlock this resource for science and could underpin global real-time genomic epidemiology and surveillance. We combine knowledge about bacterial genetic variation with ideas used in web-search, to build a DNA search engine for microbial data that can grow incrementally. We index the complete corpus of bacterial and viral whole genome sequence data as of December 2016 (447,833 genomes, 176 Terabytes), using four orders of magnitude less storage than previous methods, making the global archive for the first time accessible to search, and scaling to millions of genomes. We demonstrate its usefulness with three applications: ultra-fast search for resistance genes MCR1-3, host-range determination for 2827 plasmids, and quantification of the rise of antibiotic resistance prevalence in the archives.

Domains: Bacteriology; Populations and Evolution [q-bio.PE]; Quantitative Methods [q-bio.QM]; Genomics [q-bio.GN]; Populations and Evolution [q-bio.PE]; Bioinformatics [q-bio.QM]

Phelim Bradley, Henk C den Bakker, Eduardo P C Rocha, Gil Mcvean, Zamin Iqbal. Real-time search of all bacterial and viral genomic data. Nature Biotechnology, 2019, 37 (2), pp.152-159. ⟨10.1038/s41587-018-0010-1⟩. ⟨hal-02329753⟩