Institute Output

What’s Really Going On in Machine Learning? Some Minimal Models
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What’s Really Going On in Machine Learning? Some Minimal Models

Stephen Wolfram

It’s surprising how little is known about the foundations of machine learning. Yes, from an engineering point of view, an immense amount has been figured out about how to build neural nets that do all kinds of impressive and sometimes almost magical things. But at a fundamental level we still don’t really know why neural nets “work”—and we don’t have any kind of “scientific big picture” of what’s going on inside them.

Read More
Ruliology of the “Forgotten” Code 10
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Ruliology of the “Forgotten” Code 10

Stephen Wolfram

For several years I’d been studying the question of “where complexity comes from”, for example in nature. I’d realized there was something very computational about it (and that had even led me to the concept of computational irreducibility—a term I coined just a few days before June 1, 1984). But somehow I had imagined that “true complexity” must come from something already complex or at least random. Yet here in this picture, plain as anything, complexity was just being “created”, basically from nothing. And all it took was following a very simple rule, starting from a single black cell. 

Read More
Why Does Biological Evolution Work? A Minimal Model for Biological Evolution and Other Adaptive Processes
Research Paper Stephen Wolfram Research Paper Stephen Wolfram

Why Does Biological Evolution Work? A Minimal Model for Biological Evolution and Other Adaptive Processes

Stephen Wolfram

Why does biological evolution work? And, for that matter, why does machine learning work? Both are examples of adaptive processes that surprise us with what they manage to achieve. So what’s the essence of what’s going on? I’m going to concentrate here on biological evolution, though much of what I’ll discuss is also relevant to machine learning—but I’ll plan to explore that in more detail elsewhere.

Read More
Can AI Solve Science?
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Can AI Solve Science?

Stephen Wolfram

Particularly given its recent surprise successes, there’s a somewhat widespread belief that eventually AI will be able to “do everything”, or at least everything we currently do. So what about science? Over the centuries we humans have made incremental progress, gradually building up what’s now essentially the single largest intellectual edifice of our civilization. But despite all our efforts, there are still all sorts of scientific questions that remain. So can AI now come in and just solve all of them?

Read More
General Relativistic Hydrodynamics in Discrete Spacetime: Perfect Fluid Accretion onto Static and Spinning Black Holes
Research Paper Jonathan Gorard Research Paper Jonathan Gorard

General Relativistic Hydrodynamics in Discrete Spacetime: Perfect Fluid Accretion onto Static and Spinning Black Holes

Jonathan Gorard

This study investigates the effect of spacetime discretization on accretion dynamics of a relativistic fluid onto a spinning black hole, specifically noting that accretion rates decrease with increased discretization scale and that drag force sensitivity and instabilities intensify at critical discretization values.

Read More
Computational General Relativity in the Wolfram Language using Gravitas II: ADM Formalism and Numerical Relativity
Research Paper Jonathan Gorard Research Paper Jonathan Gorard

Computational General Relativity in the Wolfram Language using Gravitas II: ADM Formalism and Numerical Relativity

Jonathan Gorard

This paper introduces the Gravitas computational general relativity framework's numerical subsystem, emphasizing its ability to perform 3 + 1 spacetime decompositions via the ADM formalism, handle complex simulations of gravitational phenomena like binary black hole mergers, and leverage adaptive refinement algorithms based on hypergraph rewriting within the Wolfram Language.

Read More
Observer Theory
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Observer Theory

Stephen Wolfram

We call it perception. We call it measurement. We call it analysis. But in the end it’s about how we take the world as it is, and derive from it the impression of it that we have in our minds.

Read More
Ruliology: Linking Computation, Observers and Physical Law
Research Paper Xerxes D. Arsiwalla Research Paper Xerxes D. Arsiwalla

Ruliology: Linking Computation, Observers and Physical Law

Dean Rickles, Hatem Elshatlawy, Xerxes D. Arsiwalla

Physical laws arise from the sampling of the Ruliad by observers (including us). This naturally leads to several conceptual issues, such as what kind of object is the Ruliad? What is the nature of the observers carrying out the sampling, and how do they relate to the Ruliad itself? What is the precise nature of the sampling? This paper provides a philosophical examination of these questions, and other related foundational issues, including the identification of a limitation that must face any attempt to describe or model reality in such a way that the modeller-observers are included.

Read More
What Is ChatGPT Doing … and Why Does It Work?
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What Is ChatGPT Doing … and Why Does It Work?

Stephen Wolfram

That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, and unexpected. But how does it do it? And why does it work? My purpose here is to give a rough outline of what’s going on inside ChatGPT—and then to explore why it is that it can do so well in producing what we might consider to be meaningful text.

Read More