MetaGraph: Transforming DNA Search for Genetic Research

MetaGraph: A New DNA Search Engine Revolutionizing Genetic Research

DNA sequencing is essential to understanding genetic diseases like cancer, diabetes, and neurodegenerative disorders. However, the field faces a significant challenge due to the overwhelming amount of data generated. Scientists are producing massive datasets stored in repositories like the American Sequence Read Archive and the European Nucleotide Archive. These datasets are so large that they contain nearly as much information as all the text on the internet. To address this issue, researchers at ETH Zurich have developed a DNA search engine called MetaGraph, which allows scientists to efficiently look up and isolate genetic sequences.

Understanding the Challenge of Massive Datasets

The DNA sequencing industry has grown rapidly since Nobel laureate Fred Sanger’s methods in the 1970s. Today, next-generation sequencing technologies enable the identification of infections and the cataloging of genomes, including the SARS-CoV-2 virus responsible for COVID-19. However, the sheer volume of data makes it hard for researchers to find specific information. This is where MetaGraph comes in.

How MetaGraph Works

ETH Zurich has been working on MetaGraph since 2020. The engine can streamline searches through DNA and RNA sequencing data by compressing it into full-text searchable indexes. This reduces the average data size by 300 times, allowing researchers to manage vast amounts of information. For example, they can compress datasets like GTEx and TCGA from 100 terabytes to just 10 gigabytes.

• MetaGraph handles virus, microbe, fungi, plant, bacteria, and human DNA sequences.
• It includes human gut metagenome and metazoan samples.
• Researchers added raw metagenomic data and other crucial datasets.

Benefits of Using MetaGraph

One of the most significant advantages of MetaGraph is that it allows researchers to search through datasets without the need to download large volumes of information. Previously, downloading individual datasets was time-consuming and costly. Now, searching is much more efficient and affordable.

Cost-Effective Searching

The entire scope of publicly available biological sequencing data can now fit on just a few hard drives. Each search costs only a few cents, bringing the total cost down to about $2,500.

Future Prospects and Scalability

Currently, about half of the world’s sequencing datasets are accessible through MetaGraph’s search functions. The team at ETH Zurich plans to have the rest of the publicly available datasets online by the end of 2025. The scalable nature of MetaGraph ensures that users will continue to enjoy high search speeds as the dataset expands.

Open Source and Diverse Users

MetaGraph is an open-source resource that aims to attract a wide range of users, including pharmaceutical companies, educators, scientists, and private individuals. Dr. André Kahles from ETH Zurich notes the potential for everyday applications, saying, “In the early days, even Google didn’t know exactly what a search engine was good for.” He believes that as DNA sequencing continues to advance, it could help identify everyday plants with precision.

Impact on Genetic Research and Future Developments

The developers of MetaGraph hope their program will enhance genetic research. For example, genomic sequencers have already mapped the SARS-CoV-2 virus, aiding in the development of COVID vaccines. Others have studied earthworm DNA to learn about evolution. With MetaGraph, researchers can quickly search, organize, and analyze genetic sequences, making future genome sequencing technologies better, cheaper, and healthier.

“MetaGraph could facilitate research by making it easier to search, structure, and test genome sequences more quickly and cheaply.” – A researcher at ETH Zurich

Exploring MetaGraph

For those interested in experimenting with MetaGraph, you can access its Open Data repository to perform searches within the cloud database. The platform provides visualizations of famous proteins and antimicrobial resistance genes, helping users understand the results and applications of genetic research.