Tag Archives: James Knight

Supercomputing capability at home with Graphical Processing Units (GPUs)

Researchers at the University of Sussex (in the UK) have found a way to make your personal computer as powerful as a supercomputer according to a February 2, 2021 University of Sussex press release (also on EurekAlert),

University of Sussex academics have established a method of turbocharging desktop PCs to give them the same capability as supercomputers worth tens of millions of pounds.

Dr James Knight and Prof Thomas Nowotny from the University of Sussex’s School of Engineering and Informatics used the latest Graphical Processing Units (GPUs) to give a single desktop PC the capacity to simulate brain models of almost unlimited size.

The researchers believe the innovation, detailed in Nature Computational Science, will make it possible for many more researchers around the world to carry out research on large-scale brain simulation, including the investigation of neurological disorders.

Currently, the cost of supercomputers is so prohibitive they are only affordable to very large institutions and government agencies and so are not accessible for large numbers of researchers.

As well as shaving tens of millions of pounds off the costs of a supercomputer, the simulations run on the desktop PC require approximately 10 times less energy bringing a significant sustainability benefit too.

Dr Knight, Research Fellow in Computer Science at the University of Sussex, said: “I think the main benefit of our research is one of accessibility. Outside of these very large organisations, academics typically have to apply to get even limited time on a supercomputer for a particular scientific purpose. This is quite a high barrier for entry which is potentially holding back a lot of significant research.

“Our hope for our own research now is to apply these techniques to brain-inspired machine learning so that we can help solve problems that biological brains excel at but which are currently beyond simulations.

“As well as the advances we have demonstrated in procedural connectivity in the context of GPU hardware, we also believe that there is also potential for developing new types of neuromorphic hardware built from the ground up for procedural connectivity. Key components could be implemented directly in hardware which could lead to even more truly significant compute time improvements.”

The research builds on the pioneering work of US researcher Eugene Izhikevich who pioneered a similar method for large-scale brain simulation in 2006.

At the time, computers were too slow for the method to be widely applicable meaning simulating large-scale brain models has until now only been possible for a minority of researchers privileged to have access to supercomputer systems.

The researchers applied Izhikevich’s technique to a modern GPU, with approximately 2,000 times the computing power available 15 years ago, to create a cutting-edge model of a Macaque’s visual cortex (with 4.13 × 106 neurons and 24.2 × 109 synapse) which previously could only be simulated on a supercomputer.

The researchers’ GPU accelerated spiking neural network simulator uses the large amount of computational power available on a GPU to ‘procedurally’ generate connectivity and synaptic weights ‘on the go’ as spikes are triggered – removing the need to store connectivity data in memory.

Initialization of the researchers’ model took six minutes and simulation of each biological second took 7.7 min in the ground state and 8.4 min in the resting state- up to 35 % less time than a previous supercomputer simulation. In 2018, one rack of an IBM Blue Gene/Q supercomputer initialization of the model took around five minutes and simulating one second of biological time took approximately 12 minutes.

Prof Nowotny, Professor of Informatics at the University of Sussex, said: “Large-scale simulations of spiking neural network models are an important tool for improving our understanding of the dynamics and ultimately the function of brains. However, even small mammals such as mice have on the order of 1 × 1012 synaptic connections meaning that simulations require several terabytes of data – an unrealistic memory requirement for a single desktop machine.

“This research is a game-changer for computational Neuroscience and AI researchers who can now simulate brain circuits on their local workstations, but it also allows people outside academia to turn their gaming PC into a supercomputer and run large neural networks.”

Here’s a link to and a citation for the paper,

Larger GPU-accelerated brain simulations with procedural connectivity by James C. Knight & Thomas Nowotny. Nature Computational Science (2021) DOI: DOIhttps://doi.org/10.1038/s43588-020-00022-7 Published: 01 February 2021

This paper is behind a paywall.

What about innovation in Canada? Financial Post live chat on June 28, 2012

I can tell you what at least one issue with Canada and innovation is just by looking at the Financial Post’s notice about their ‘Why can’t Canada do anything with its big ideas?‘ live chat on Thursday, June 28, 2012 at 2 pm (presumably EST). Hint: those of us who live in the ‘other’ parts of the country like it when the timezone is specified since it makes it easier for us to participate. (Yes, I did happen to glance at the bottom of the notice where there is a computer-generated note informing me that the chat starts at 11 am in my timezone [PST] but that’s not enough. I [and likely others] don’t always catch those unobtrusive notices.)

Let’s take at the panel,

Craig Alexander
Mr. Alexander is the senior vice president and chief economist for TD Bank Group. He has 15 years of experience in the private sector as an economic and financial forecaster, and serves as a regular commentator on public policy. Mr. Alexander is regularly called upon by the media to provide perspective on economic and policy issues and writes on a wide range of subjects. In addition to his work in the private sector, Mr. Alexander spent four years as an economist at Statistics Canada, affording him unique perspective on the inner workings of both the public and private sectors.

James Knight
Mr. Knight has been president and CEO of the Association of Canadian Community Colleges since 2007. He is the current Chair of the World Federation of Colleges and Polytechnics (WFCP), an international network of colleges and their associations. Mr. Knight brings more than 25 years of leadership with the Federation of Canadian Municipalities (FCM), as well as prior experience with the federal government in Indian and Northern Affairs Canada and Environment Canada, and as Associate Director of the Heritage Canada Foundation, Mr. Knight brings a depth of national, international and community-oriented expertise to ACCC.

Joel Liederman
Mr. Liederman is the vice president of Business Development and Physical Sciences at MaRS. He carries out technology due diligence, project manages IP development and proof-of-principle projects, develops and executes commercialization plans, and helps launch companies in information and communication technology. Mr. Liederman was a managing partner and company builder with Primaxis Technology Ventures, an early-stage venture capital company focused on the physical and engineering sciences. Prior to Primaxis, he held positions in engineering design, project engineering management, marketing, sales and business development for various high-profile organizations, including General Electric, Atomic Energy of Canada Ltd., Alcatel and Spar Aerospace.

Derek Lothian
Mr. Lothian is the national manager of communications and innovation for Canadian Manufacturers & Exporters (CME) – Canada’s largest trade and industry association. CME’s membership network accounts for more than 82 per cent of total manufacturing production and 90 per cent of all goods and services exports. As the voice of manufacturing and global business in Canada, CME directly represents approximately 10,000 companies, and spearheads initiatives such as the establishment of the Canadian Manufacturing Coalition, which touches more than 100,000 companies across the country.

A banker who used to work for Statistics Canada as an economist, an academic and once government bureaucrat for the federal departments of Indian and Northern Affair and of the Environment, a former venture capitalist with an engineering degree who worked for very large enterprises, and a representative from a trade association are the people they’ve chosen (or is it persuaded?) to talk about capitalizing on Canadian innovation.

I don’t see any experience in this group that directly relates to the question the Financial Post has posed. I have my own question, why not ask me to be on the panel? I don’t have any experience either, I’m perfectly happy to talk about this, and I could add some diversity to the panel not being a male making over $100,000/yr.  in a salaried position. [Final sentence reworded June 27, 2012.]