Lifeboat Foundation

It takes more than a galaxy merger to make a black hole grow and new stars form: machine learning shows cold gas is needed too to initiate rapid growth — new research finds.

When they are active, supermassive black holes play a crucial role in the way galaxies evolve. Until now, growth was thought to be triggered by the violent collision of two galaxies followed by their merger, however new research led by the University of Bath suggests galaxy mergers alone are not enough to fuel a black hole — a reservoir of cold gas at the centre the host galaxy is needed too.

The new study, published this week in the journal Monthly Notices of the Royal Astronomical Society is believed to be the first to use machine learning to classify galaxy mergers with the specific aim of exploring the relationship between galaxy mergers, supermassive black-hole accretion and star formation. Until now, mergers were classified (often incorrectly) through human observation alone.

Nvidia on Monday announced a hardware and software platform for building human-like robots that includes generative artificial intelligence features.

Nvidia’s Blackwell isn’t taking any prisoners.

A monster of a chip that combines two dies.

Continue reading “‘We Created a Processor for the Generative AI Era,’ NVIDIA CEO Says” »

Nvidia, the $2 trillion AI giant, is moving to lap the market once again.

In this study, we use the latest advances in natural language processing to build tractable models of the ability to interpret instructions to guide actions in novel settings and the ability to produce a description of a task once it has been learned. RNNs can learn to perform a set of psychophysical tasks simultaneously using a pretrained language transformer to embed a natural language instruction for the current task. Our best-performing models can leverage these embeddings to perform a brand-new model with an average performance of 83% correct. Instructed models that generalize performance do so by leveraging the shared compositional structure of instruction embeddings and task representations, such that an inference about the relations between practiced and novel instructions leads to a good inference about what sensorimotor transformation is required for the unseen task. Finally, we show a network can invert this information and provide a linguistic description for a task based only on the sensorimotor contingency it observes.

Our models make several predictions for what neural representations to expect in brain areas that integrate linguistic information in order to exert control over sensorimotor areas. Firstly, the CCGP analysis of our model hierarchy suggests that when humans must generalize across (or switch between) a set of related tasks based on instructions, the neural geometry observed among sensorimotor mappings should also be present in semantic representations of instructions. This prediction is well grounded in the existing experimental literature where multiple studies have observed the type of abstract structure we find in our sensorimotor-RNNs also exists in sensorimotor areas of biological brains^3,36,37. Our models theorize that the emergence of an equivalent task-related structure in language areas is essential to instructed action in humans. One intriguing candidate for an area that may support such representations is the language selective subregion of the left inferior frontal gyrus. This area is sensitive to both lexico-semantic and syntactic aspects of sentence comprehension, is implicated in tasks that require semantic control and lies anatomically adjacent to another functional subregion of the left inferior frontal gyrus, which is implicated in flexible cognition^38,39,40,41. We also predict that individual units involved in implementing sensorimotor mappings should modulate their tuning properties on a trial-by-trial basis according to the semantics of the input instructions, and that failure to modulate tuning in the expected way should lead to poor generalization. This prediction may be especially useful to interpret multiunit recordings in humans. Finally, given that grounding linguistic knowledge in the sensorimotor demands of the task set improved performance across models (Fig. 2e), we predict that during learning the highest level of the language processing hierarchy should likewise be shaped by the embodied processes that accompany linguistic inputs, for example, motor planning or affordance evaluation⁴².

One notable negative result of our study is the relatively poor generalization performance of GPTNET (XL), which used at least an order of magnitude more parameters than other models. This is particularly striking given that activity in these models is predictive of many behavioral and neural signatures of human language processing^10,11. Given this, future imaging studies may be guided by the representations in both autoregressive models and our best-performing models to delineate a full gradient of brain areas involved in each stage of instruction following, from low-level next-word prediction to higher-level structured-sentence representations to the sensorimotor control that language informs.

Amidst rapid technological advancements, Tiny AI is emerging as a silent powerhouse. Imagine algorithms compressed to fit microchips yet capable of recognizing faces, translating languages, and predicting market trends. Tiny AI operates discreetly within our devices, orchestrating smart homes and propelling advancements in personalized medicine.

Tiny AI excels in efficiency, adaptability, and impact by utilizing compact neural networks, streamlined algorithms, and edge computing capabilities. It represents a form of artificial intelligence that is lightweight, efficient, and positioned to revolutionize various aspects of our daily lives.

Looking into the future, quantum computing and neuromorphic chips are new technologies taking us into unexplored areas. Quantum computing works differently than regular computers, allowing for faster problem-solving, realistic simulation of molecular interactions, and quicker decryption of codes. It is not just a sci-fi idea anymore; it’s becoming a real possibility.

In the rapidly evolving landscape of artificial intelligence, the quest for hardware that can keep pace with the burgeoning computational demands is relentless. A significant breakthrough in this quest has been achieved through a collaborative effort spearheaded by Purdue University, alongside the University of California San Diego (UCSD) and École Supérieure de Physique et de Chimie Industrielles (ESPCI) in Paris. This collaboration marks a pivotal advancement in the field of neuromorphic computing, a revolutionary approach that seeks to emulate the human brain’s mechanisms within computing architecture.

The Challenges of Current AI Hardware

The rapid advancements in AI have ushered in complex algorithms and models, demanding an unprecedented level of computational power. Yet, as we delve deeper into the realms of AI, a glaring challenge emerges: the inadequacy of current silicon-based computer architectures in keeping pace with the evolving demands of AI technology.

Scientific Reports –a crucial aspect of language acquisition. Prior experimental studies proved that artificial grammars can be learnt by human subjects after little exposure and often without explicit knowledge of the underlying rules. We tested four grammars with different complexity levels both in humans and in feedforward and recurrent networks. Our results show that both architectures can “learn” (via error back-propagation) the grammars after the same number of training sequences as humans do, but recurrent networks perform closer to humans than feedforward ones, irrespective of the grammar complexity level. Moreover, similar to visual processing, in which feedforward and recurrent architectures have been related to unconscious and conscious processes, the difference in performance between architectures over ten regular grammars shows that simpler and more explicit grammars are better learnt by recurrent architectures, supporting the hypothesis that explicit learning is best modeled by recurrent networks, whereas feedforward networks supposedly capture the dynamics involved in implicit learning.

Herbert Ong Brighter with Herbert.