Source proof for Genome Institute of Singapore accelerates whole genome processing with Databricks

Customer Story: Genome Institute of Singapore | Databricks Skip to main content Login Why Databricks Discover For App Developers For Execu…

…nt’s efforts to transform healthcare in Singapore and improve patient outcomes, the Agency for Science, Technology and Research (A*STAR)’s Genome Institute of Singapore (GIS) is partnering with Precision Health Research, Singapore (PRECISE) to implement the National Precision Medicine (NPM) strategy. With precision medicine as a key focus, their aim is to use genomic sciences to…

…nt experience, the data engineers were always beside us to address any queries. The platform enabled us to run 10,000 genomes in less than 72 hours, which was a 15x improvement as compared to before,” said Nicolas. Leveraging the Databricks Data + AI Platform, GIS accelerated processing of thi…

…accelerating the algorithm with Apache Spark™ alone will not solve the problem. Continuous integration and analytics of new genomes can be achieved at this scale by incorporating Delta Lake and Glow, two other open source libraries developed at Databricks. “Databricks provides us with the necessary platform to strengthen our data capa…

…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / Genome Institute of Singapore CUSTOMER STORY Combining whole genomes to improve patient outcomes As part of t…

…of Singapore CUSTOMER STORY Combining whole genomes to improve patient outcomes As part of the government’s efforts to transform healthcare in Singapore and improve patient outcomes, the Agency for Science, Technology and Research (A*STAR)’s Genome Institute of…

…apore population through data analytics,” said Nicolas. Share this post Details Industry : Healthcare and Life Sciences Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , A…

…n new insights into Asian genome and data-driven healthcare solutions. However, conducting genomic variant discovery for 10,000 individuals was not efficient with the current technology they had on hand. With the Databricks Data + AI Platform, GIS was able to aggregate and mine gen…

…t, we performed whole genome sequencing on smaller numbers of genomes. However, the results generated from these smaller cohorts were unsatisfactory and not comprehensive. What we required was a solution to complete 10,000 whole genomes via joint calling so that this data can be used to effectively predict which treatment and preven…

…le,” said Nicolas Bertin, Program Manager at the Genome Institute of Singapore. The research institute needed a new way to scale and process the genomic data to reach a deeper understanding of how diseases develop and discover better prevention and treatment plans. 15x improvement in processing of whole genome data Databricks partnered with GI…

…ing the Databricks Data + AI Platform, GIS accelerated processing of this data. The research institute also used the interactive notebooks as the primary interface to set up the analytics pipeline and to explore the data. “It was crucial that the data generated by our Singaporean NPM had to be compat…

…e over two years to process data at this scale using the old GATK approach, and accelerating the algorithm with Apache Spark™ alone will not solve the problem. Continuous integration and analytics of new genomes can be achieved at this scale by incorporating Delta Lake and Glow, two other open source libraries developed at Databricks. “Databricks provides us with the necessary platform to strengthen our data capa…

…t (GATK),” said Nicolas. Extracting life-saving insights from whole genome data Databricks led the development of the platform and was able to develop a prototype that was deployed on the Genomics Database within six weeks — a feat that used to take them six months. This greatly enhanced the efficienc…

…nt experience, the data engineers were always beside us to address any queries. The platform enabled us to run 10,000 genomes in less than 72 hours, which was a 15x improvement as compared to before,” said Nicolas. Leveraging the Databricks Data + AI Platform, GIS accelerated processing of thi…

…t (GATK),” said Nicolas. Extracting life-saving insights from whole genome data Databricks led the development of the platform and was able to develop a prototype that was deployed on the Genomics Database within six weeks — a feat that used to take them six months. This greatly enhanced the efficiency in which the GIS data teams accessed the d…

…y at a population of over 10,000 individuals, a major milestone of the program. The team is now moving on to the next phase of the NPM, collaborating with PRECISE to sequence the genomes of 100,000 healthy Singaporeans, some of whom have specific diseases. PRECISE is the central entity set up to coordinate this whole-government effort…

…uired was a solution to complete 10,000 whole genomes via joint calling so that this data can be used to effectively predict which treatment and prevention strategies will work for different groups of people,” said Nicolas Bertin, Program Manager at the Genome Institute of Singapore. Th…

…e over two years to process data at this scale using the old GATK approach, and accelerating the algorithm with Apache Spark™ alone will not solve the problem. Continuous integration and analytics of new genomes can be achieved at this scale by incorporating Delta Lake and Glow, two other open source libraries developed at Databricks. “Databricks provides us with the necessary platform to strengthen our data capa…

…thcare and Life Sciences Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , Agent Bricks Ready to get started? Try Databricks for free Learn more about our product Talk…

…ustry : Healthcare and Life Sciences Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , Agent Bricks Ready to get started? Try Databricks for fr…

…ustry : Healthcare and Life Sciences Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , Agent Bricks Ready to get started? Try Databricks for fr…

…nt experience, the data engineers were always beside us to address any queries. The platform enabled us to run 10,000 genomes in less than 72 hours, which was a 15x improvement as compared to before,” said Nicolas. Leveraging the Databricks Data + AI Platform, GIS accelerated processing of thi…

…he current technology they had on hand. With the Databricks Data + AI Platform, GIS was able to aggregate and mine genetic variants at population scale, which can then better enable Singapore to deliver precision medicine that improves patient outcomes. Challenges in scaling to 10,000 whole genome sequences Singapore has a rapidly…