Aug 31, 2024
A new way to build neural networks could make AI more understandable
Posted by Dan Breeden in category: robotics/AI
The simplified approach makes it easier to see how neural networks produce the outputs they do.
The simplified approach makes it easier to see how neural networks produce the outputs they do.
The standard model of the universe relies on just six numbers. Using a new approach powered by artificial intelligence, researchers at the Flatiron Institute and their colleagues extracted information hidden in the distribution of galaxies to estimate the values of five of these so-called cosmological parameters with incredible precision.
Forward-looking: We’re approaching a point where traditional copper interconnections won’t be able to carry enough data to keep GPUs and other specialized chips fully utilized. The AI market is urgently demanding a next-generation solution to this interconnection bottleneck, and Broadcom appears to be working on an optics-based solution that is closer to the chip itself.
Broadcom is developing new silicon photonics technology aimed at significantly increasing the bandwidth available to GPUs and other AI accelerators. By utilizing co-packaged optics (CPOs), the fabless chip manufacturer aims to integrate optical connectivity components directly into GPUs, enabling higher data rates while simultaneously reducing power requirements.
The company has been working on CPO solutions for several years and showcased its latest advancements at the recent Hot Chips convention. Broadcom’s “optical engine” reportedly delivers a total interconnect bandwidth of 1.6 TB/sec, equivalent to 6.4 Tbit/sec or 800 GB/sec in each direction.
Nvidia may have a sizable lead, but money is an excellent motivator, and tech companies old and new are striving to end its dominance of the AI chip market — or at least secure themselves a sizable slice of it.
While some of these groups, including AMD, are following Nvidia’s lead and optimizing GPUs for generative AI, others are exploring alternative chip architectures.
Continue reading “The AI chip startup that could take down Nvidia” »
As the last man standing, he was tasked with fixing-up all the AI-generated articles that once would’ve been composed by dozens of writers.
PINNACLE predicts protein functions in cells and tissues, can help improve drug discovery.
Last month, reports emerged indicating that OpenAI is running on fumes and could be on the brink of bankruptcy within 12 months, with projections of $5 billion in losses. Despite the discounted access to Microsoft’s Azure services and approximately $3.5 billion generated in revenue, the ChatGPT maker might need another round of funding to remain afloat.
And now, according to a report by CNBC, OpenAI is in talks to raise funding which could push its market valuation to over $100 billion. The company’s valuation has significantly grown over the past years — from $29 billion in 2023 to $80 billion earlier this year.
Humanity is on the verge of AGI (Artificial General Intelligence). Futurist Ray Kurzweil predicted decades ago that we would reach AGI in 2029. AI and Large Language Models could reach AGI sooner than 2029. However, the definitions of artificial intelligence that surpasses individual humans has issues around definitions and measurement.
Kurzweil also predicted the Singularity in 2045. He defined that as having cumulative artificial intelligence beyond the total intelligence of humanity.
Beyond the Singularity is Computronium and the limits of technology and the limits of computing.
TOC 00:00:00 Intro 00:03:38 Reasoning 00:13:09 Potential AI Breakthroughs Reducing Computation Needs 00:20:39 Memorization vs. Generalization in AI 00:25:19 Approach to the ARC Challenge 00:29:10 Perceptions of Chat GPT and AGI 00:58:45 Abstract Principles of Jurgen’s Approach 01:04:17 Analogical…
Jürgen Schmidhuber, the father of generative AI shares his groundbreaking work in deep learning and artificial intelligence. In this exclusive interview, he discusses the history of AI, some of his contributions to the field, and his vision for the future of intelligent machines. Schmidhuber offers unique insights into the exponential growth of technology and the potential impact of AI on humanity and the universe.
Continue reading “Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs” »