Tag Archives: Mercedes Benz

Neuromorphic (brainlike) computing and your car (a Mercedes Benz Vision AVTR concept car)

Leave a reply

If you’ve ever fantasized about a batmobile of your own, the dream could come true soon,

Mercedes Berz VISION AVTR [downloaded from https://www.mercedes-benz.com/en/innovation/concept-cars/vision-avtr/]

It was the mention of neuromorphic computing in a television ad sometime in September 2022 that sent me on a mission to find out what Mercedes Benz means when they use neuromorphic computing to describe a feature found in their Vision AVTR concept car. First, a little bit about the car (from the Vision AVTR webpage accessed in October 2022),

VISION AVTR – inspired by AVATAR.

The name of the groundbreaking concept vehicle stands not only for the close collaboration in developing the show car together with the AVATAR team but also for ADVANCED VEHICLE TRANSFORMATION. This concept vehicle embodies the vision of Mercedes-Benz designers, engineers and trend researchers for mobility in the distant future.

,,,

Organic battery technology.

The VISION AVTR was designed in line with its innovative electric drive. This is based on a particularly powerful and compact high-voltage battery. For the first time, the revolutionary battery technology is based on graphene-based [emphasis mine] organic cell chemistry and thus completely eliminates rare, toxic and expensive earths such as metals. Electromobility thus becomes independent of fossil resources. An absolute revolution is also the recyclability by composting, which is 100% recyclable due to the materiality. As a result, Mercedes-Benz underlines the high relevance of a future circular economy in the raw materials sector.

…

Masterpiece of efficiency.

At Mercedes-Benz, the consideration of efficiency goes far beyond the drive concept, because with increasing digitalisation, the performance of the large number of so-called secondary consumers also comes into focus – along with their efficient energy supply, without negatively affecting the drive power of the vehicle itself. Energy consumption per computing operation is already a key target in the development of new computer chips. This trend will continue in the coming years with the growth of sensors and artificial intelligence in the automotive industry. The neuro-inspired approach of the VISION AVTR, including so-called neuromorphic hardware, promises to minimise the energy requirements of sensors, chips and other components to a few watts. [emphasis mine] Their energy supply is provided by the cached current of the integrated solar plates on the back of the VISION AVTR. The 33 multi-directionally movable surface elements act as “bionic flaps”.

Interior and exterior merge.

For the first time, Mercedes-Benz has worked with a completely new design approach in the design of the VISION AVTR. The holistic concept combines the design disciplines interior, exterior and UX [user experience] from the first sketch. Man and human perception are the starting point of a design process from the inside out. The design process begins with the experience of the passengers and consciously focuses on the perception and needs of the passengers. The goal was to create a car that prolongs the perception of its passengers. It was also a matter of creating an immersive experience space in which passengers connect with each other, with the vehicle and the surrounding area [emphasis mine ] in a unique way.

…

Intuitive control.

The VISION AVTR already responds to the approach of the passengers by visualising the energy and information flow of the environment with digital neurons that flow through the grille through the wheels to the rear area. The first interaction in the interior between man and vehicle happens completely intuitively via the control unit: by placing the hand on the centre console, the interior comes to life and the vehicle recognises the driver by his breathing. This is made visible on the instrument panel and on the user’s hand. The VISION AVTR thus establishes a biometric connection with the driver [emphasis mine] and increases his awareness of the environment. The digital neurons flow from the interior into the exterior and visualise the flow of energy and information. For example, when driving, the neurons flow over the outside of the vehicle. [emphasis mine] When changing direction, the energy flows to the corresponding side of the vehicle.

The vehicle as an immersive experience space.

The visual connection between passengers and the outside world is created by the curved display module, which replaces a conventional dashboard. The outside world around the vehicle and the surrounding area is shown in real-time 3D graphics and at the same time shows what is happening on the road in front of the vehicle. Combined with energy lines, these detailed real-time images bring the interior to life and allow passengers to discover and interact with the environment in a natural way with different views of the outside world. Three wonders of nature – the Huangshan Mountains of China, the 115-metre-high Hyperion Tree found in the United States and the pink salt Lake Hillier from Australia – can be explored in detail. Passengers become aware of various forces of nature that are not normally visible to the human eye, such as magnetic fields, bioenergy or ultraviolet light.

The curved display module in the Mercedes-Benz VISION AVTR – inspired by AVATAR
[downloaded from https://www.mercedes-benz.com/en/innovation/concept-cars/vision-avtr/]

Bionic formal language.

When the boundaries between vehicle and living beings are lifted, Mercedes-Benz combines luxury and sustainability and works to make the vehicles as resource-saving as possible. With the VISION AVTR, the brand is now showing how a vehicle can blend harmoniously into its environment and communicate with it. In the ecosystem of the future, the ultimate luxury is the fusion of human and nature with the help of technology. The VISION AVTR is thus an example of sustainable luxury in the field of design. As soon as you get in, the car becomes an extension of your own body and a tool to discover the environment much as in the film humans can use avatars to extend and expand their abilities.

A few thoughts

The movie, Avatar, was released in 2009 and recently rereleased in movie houses in anticipation of the sequel, Avatar: The Way of Water to be released in December 2022 (Avatar [2009 film] Wikipedia entry). The timing, Avatar and AVTR, is interesting, oui?

Moving onto ‘organic’, which means carbon-based in this instance and, specifically, graphene. Commercialization of graphene is likely top-of-mind for the folks (European Commission) who bet 1B Euros in 2013 with European Union money to fund the Graphene Flagship project. This battery from German company Mercedes Benz must be exciting news for the funders and for people who want to lessen dependency on rare earths. Your battery can be composted safely (according to the advertising).

The other piece of good news, is the neuromorphic computing,

“The neuro-inspired approach of the VISION AVTR, including so-called neuromorphic hardware, promises to minimise the energy requirements of sensors, chips and other components to a few watts.”

On the other hand and keeping in mind the image above (a hand with what looks like an embedded object), it seems a little disconcerting to merge with one’s car, “… passengers connect with each other, with the vehicle and the surrounding area …” which becomes even more disconcerting when this appears in the advertising,

… VISION AVTR thus establishes a biometric connection with the driver … The digital neurons flow from the interior into the exterior and visualise the flow of energy and information. For example, when driving, the neurons flow over the outside of the vehicle.

Are these ‘digital neurons’ flowing around the car like a water current? Also, the car is visualizing? Hmm …

I did manage to find a bit more information about neuromorphic computing although it’s for a different Mercedes Benz concept car (there’s no mention of flowing digital neurons) in a January 18, 2022 article by Sally Ward-Foxton for EE Times (Note: A link has been removed),

The Mercedes Vision EQXX concept car, promoted as “the most efficient Mercedes-Benz ever built,” incorporates neuromorphic computing to help reduce power consumption and extend vehicle range. To that end, BrainChip’s Akida neuromorphic chip enables in-cabin keyword spotting as a more power-efficient way than existing AI-based keyword detection systems.

…

“Working with California-based artificial intelligence experts BrainChip, Mercedes-Benz engineers developed systems based on BrainChip’s Akida hardware and software,” Mercedes noted in a statement describing the Vision EQXX. “The example in the Vision EQXX is the “Hey Mercedes” hot-word detection. Structured along neuromorphic principles, it is five to ten times more efficient than conventional voice control,” the carmaker claimed.

…

That represents validation of BrainChip’s technology by one of its early-access customers. BrainChip’s Akida chip accelerates spiking neural networks (SNNs) and convolutional neural networks (via conversion to SNNs). It is not limited to a particular application, and also run [sic] person detection, voice or face recognition SNNs, for example, that Mercedes could also explore.

…

This January 6, 2022 article by Nitin Dahad for embedded.com describes what were then the latest software innovations in the automotive industry and segues into a description of spiking neural networks (Note: A link has been removed),

The electric vehicle (EV) has clearly become a key topic of discussion, with EV range probably the thing most consumers are probably worried about. To address the range concern, two stories emerged this week – one was Mercedes-Benz’ achieving a 1,000 km range with its VISION EQXX prototype, albeit as a concept car, and General Motors announcing during a CES [Consumer Electronics Show] 2022 keynote its new Chevrolet Silverado EV with 400-mile (640 km) range.

In briefings with companies, I often hear them talk about the software-defined car and the extensive use of software simulation (or we could also call it a digital twin). In the case of both the VISION EQXX and the Silverado EV, software plays a key part. I also spoke to BlackBerry about its IVY platform and how it is laying the groundwork for software-defined vehicles.

…

Neuromorphic computing for infotainment

This efficiency is not just being applied to enhancing range though. Mercedes-Benz also points out that its infotainment system uses neuromorphic computing to enable the car to take to “take its cue from the way nature thinks”.

Mercedes-Benz VISION EQXXMercedes-Benz VISION EQXX

The hardware runs spiking neural networks, in which data is coded in discrete spikes and energy only consumed when a spike occurs, reducing energy consumption by orders of magnitude. In order to deliver this, the carmaker worked with BrainChip, developing the systems based on its Akida processor. In the VISION EQXX, this technology enables the “Hey Mercedes” hot-word detection five to ten times more efficiently than conventional voice control. Mercedes-Benz said although neuromorphic computing is still in its infancy, systems like these will be available on the market in just a few years. When applied on scale throughout a vehicle, they have the potential to radically reduce the energy needed to run the latest AI technologies.

…

For anyone curious about BrainChip, you can find out more here.

It took a little longer than I hoped but I’m glad that I found out a little more about neuromorphic computing and one application in the automotive industry.

Studying quantum conductance in memristive devices

Leave a reply

A September 27, 2022 news item on phys.org provides an introduction to the later discussion of quantum effects in memristors,

At the nanoscale, the laws of classical physics suddenly become inadequate to explain the behavior of matter. It is precisely at this juncture that quantum theory comes into play, effectively describing the physical phenomena characteristic of the atomic and subatomic world. Thanks to the different behavior of matter on these length and energy scales, it is possible to develop new materials, devices and technologies based on quantum effects, which could yield a real quantum revolution that promises to innovate areas such as cryptography, telecommunications and computation.

The physics of very small objects, already at the basis of many technologies that we use today, is intrinsically linked to the world of nanotechnologies, the branch of applied science dealing with the control of matter at the nanometer scale (a nanometer is one billionth of a meter). This control of matter at the nanoscale is at the basis of the development of new electronic devices.

…

A September 27, 2022 Istituto Nazionale di Ricerca Metrologica (INRIM) press release (summary, PDF, and also on EurekAlert), which originated the news item, provides more information about the research,

Among these, memrisistors are considered promising devices for the realization of new computational architectures emulating functions of our brain, allowing the creation of increasingly efficient computation systems suitable for the development of the entire artificial intelligence sector, as recently shown by INRiM researchers in collaboration with several international universities and research institutes [1,2].

In this context, the EMPIR MEMQuD project, coordinated by INRiM, aims to study the quantum effects in such devices in which the electronic conduction properties can be manipulated allowing the observation of quantized conductivity phenomena at room temperature. In addition to analyzing the fundamentals and recent developments, the review work “Quantum Conductance in Memristive Devices: Fundamentals, Developments, and Applications” recently published in the prestigious international journal Advanced Materials (https://doi.org/10.1002/adma.202201248) analyzes how these effects can be used for a wide range of applications, from metrology to the development of next-generation memories and artificial intelligence.

Here’s a link to and a citation for the paper,

Quantum Conductance in Memristive Devices: Fundamentals, Developments, and Applications by Gianluca Milano, Masakazu Aono, Luca Boarino, Umberto Celano, Tsuyoshi Hasegawa, Michael Kozicki, Sayani Majumdar, Mariela Menghini, Enrique Miranda, Carlo Ricciardi, Stefan Tappertzhofen, Kazuya Terabe, Ilia Valov. Advanced Materials Volume 34, Issue32 August 11, 2022 2201248 DOI: https://doi.org/10.1002/adma.202201248 First published: 11 April 2022

This paper is open access.

You can find the EMPIR (European Metrology Programme for Innovation and Research) MEMQuD (quantum effects in memristive devices) project here, from the homepage,

Memristive devices are electrical resistance switches that couple ionics (i.e. dynamics of ions) with electronics. These devices offer a promising platform to observe quantum effects in air, at room temperature, and without an applied magnetic field. For this reason, they can be traced to fundamental physics constants fixed in the revised International System of Units (SI) for the realization of a quantum-based standard of resistance. However, as an emerging technology, memristive devices lack standardization and insights into the fundamental physics underlying its working principles.

The overall aim of the project is to investigate and exploit quantized conductance effects in memristive devices that operate reliably, in air and at room temperature. In particular, the project will focus on the development of memristive model systems and nanometrological characterization techniques at the nanoscale level of memristive devices, in order to better understand and control the quantized effects in memristive devices. Such an outcome would enable not only the development of neuromorphic systems but also the realization of a standard of resistance implementable on-chip for self-calibrating systems with zero-chain traceability in the spirit of the revised SI.

…

I’m starting to see mention of ‘neuromorphic computing’ in advertisements (specifically a Mercedes Benz car). I will have more about these first mentions of neuromorphic computing in consumer products in a future posting.

University of Victoria’s (Canada) microscope, world’s most powerful, unveiled

Leave a reply

This new microscope at the University of Victoria (UVic) was supposed to be unveiled in 2011 according to my July 28, 2009 posting about the purchase,

In other BC news, the University of Victoria (Canada) will be getting a new microscope which senses at subatomic levels. (From the media release on Azonano),

The new microscope-called a Scanning Transmission Electron Holography Microscope (STEHM) — will use an electron beam and holography techniques to observe the inside of materials and their surfaces to an expected resolution as small as one-fiftieth the size of an atom.

This is being done in collaboration with Hitachi High-Technologies which is building the microscope in Japan and installing it at U Vic in late 2010. The microscope will be located in a specially adapted room where work to prepare and calibrate it will continue until it becomes operational sometime in 2011.

I had been wondering if I’d ever hear of the microscope again, so finding a June 18, 2013 news item on Nanowerk announcing the world’s most powerful microscope at the University of Victoria (British Columbia, Canada) answered the question for me (Note: A link has been removed),

The world’s most powerful microscope, which resides in a specially constructed room at the University of Victoria, has now been fully assembled and tested, and has a lineup of scientists and businesses eager to use it.

The seven-tonne, 4.5-metre tall Scanning Transmission Electron Holography Microscope (STEHM), the first such microscope of its type in the world, came to the university in parts last year,. A team from Hitachi, which constructed the ultra high-resolution, ultra-stable instrument, spent one year painstakingly assembling the STEHM in a carefully controlled lab in the basement of the Bob Wright Centre.

The wait was worth it, says Rodney Herring, a professor of mechanical engineering and director of UVic’s Advanced Microscopy Facility. [emphasis mine]

The June 17, 2013 University of Victoria news release, which originated the news item, doesn’t address the two year delay directly as Herring’s quote seems to be in reference to the one-year assembly period. The news release goes on to describe the microscope’s resolution,

Herring viewed gold atoms through the microscope at a resolution of 35 picometres. One picometre is a trillionth of a metre. This resolution is much better than the previous best image with 49-picometre resolution taken at the Lawrence Berkley National Laboratory in California, and is about 20 million times human sight.

The STEHM allows researchers to see the atoms in a manner never before possible. It has full analytical capabilities that can determine the types and number or elements present, and high-resolution cameras for collecting data.

It will be used by researchers of many science and engineering disciplines for projects requiring knowledge of small atomic scale structures (nanoscience) and nanotechnology. Dr. Vincenzo Grillo from the Istituto Nanoscienze Consiglio Nazionale Delle Ricerche in Modena [Italy] will be the first visiting researcher later this month.

A line-up seems to have formed (from the news release),

Local scientists and businesses are also eager to use it. Ned Djilali, a UVic professor of mechanical engineering, is working with the National Research Council, Ballard Power Systems in Vancouver and Mercedes-Benz on fuel cell research. The STEHM “opens up entirely new possibilities” in fuel cell technology, says Djilali.

Redlen Technologies, a local company that manufactures high resolution semiconductor radiation detectors that are used for such things as nuclear cardiology, CT scanning, baggage scanning and dirty bomb detection, has been waiting for the STEHM to open for the company’s research and development.

If you are curious but don’t have any special influence, you can find out about the microscope (and perhaps view it?) later this week (from the news release),

Herring will give details of the results at a microscopy conference this week at UVic, as well as during a talk Thursday, June 20, that is open to the public. [emphasis mine] It is from 4:30 to 5 p.m. at the Bob Wright Centre, in Flury Hall, room B150.

I don’t usually include funding information but since I am from British Columbia, I have more of an interest than usual (from the news release),

The STEHM microscope is supported by $9.2 million in funding from the government of Canada through the Canadian Foundation for Innovation, the BC Knowledge Development Fund and UVic, as well as significant in-kind support from Hitachi.

Since microscopes and big equipment (in general) are weirdly fascinating to me, here are some details from UVic’s STEHM backgrounder,

The Scanning Transmission Electron Holography Microscope (STEHM) is the highest resolution microscope ever built and the only one of its kind in the world. It’s arrival makes the University of Victoria a global leader in the competitive field of advanced microscopy.

Unlike conventional microscopes, which use light to peer at specimens, the STEHM uses an electron beam and holography techniques to observe the inside of materials and their surfaces to an expected resolution smaller than the size of an atom.

The STEHM will see materials beyond the nanoscale to the picoscale. A nanometer is one-billionth of a metre, while a picometre is one-trillionth of a metre. Atoms are typically between 62 and 520 picometres in diameter.

…

The STEHM will not only see individual atoms, but it will indicate what type of atoms they are. It also features an electron vortex beam, which researchers can use like tweezers to manipulate individual atoms in a specimen.

The microscope itself is a 4.5-metre tall cylinder encased in metal shielding to block magnetic fields. It has a footprint of six square metres and weighs seven tonnes.

The microscope is so huge that researchers will climb a stepladder to insert their specimens through a tiny airlock into the vacuum of the column. They’ll then leave the room, wait for the air currents in the room to calm, and then operate the microscope remotely from an adjoining room.

The microscope is so sensitive that its image could be affected by little more than a passing cloud. …

I don’t know how many times the public will have any access to this microscope given its extreme sensitivity so you might want to make a point of attending the public talk on Thursday, June 20, 2013 at the University of Victoria.

One final comment, I find it a bit disconcerting that the only ‘academic’ research mentioned seems to be Italian and that the ‘Canadian’ research is primarily commercial. It’s very nice that Dr. Herring saw a gold nanoparticle but are there any local or Canadian publicly funded academic researchers using this microscope, which seems to have been paid for by taxpayers? Hopefully, this is a case where excitement took over and the writer who almost always focuses on local, academic research got carried away with the international involvement and big name companies (Mercedes Benz).