Re: unboxed structure fields (or class slots)

"wojciech.pasieka (as wojciech dot pasieka at ai dot pressiton dot com)" <[email protected]> (Adrian W. Pasieka)
Newsgroups gmane.lisp.lispworks.general
Message-ID <[email protected]>
===================================================
From: Marco Antoniotti <[email protected]>
Date: Tue, 13 Jan 2026 07:09:00 +0100 
Plus, awful Common Lisp code….

Marco Antoniotti
https://dcb.disco.unimib.it
===========================

1) Yes, that was surprising, where did such code come from? (cf. “swords made of damp cardboard”).

The point is that LLMs do not appear to learn from their own prompted inventions at all.
They take the final IN grid, and extract the answer from their primary training data.


2) The 'arc-transformer' function is intended as an example of 'inductive logic programming' (ILP).
Perhaps Prof. Marco Antoniotti’s lab would be interested in following/collaborating on this project.

https://x.com/fchollet/status/2009657443396227307
https://jobs.helsinki.fi/job/Helsinki-Postdoctoral-Researcher-in-Logical-Reasoning-and-Machine-Learning-%28ARC-Challenge%29/1349801957/


3) Finally:
===================================================
From: David McClain <[email protected]>
To: Tim Bradshaw <[email protected]>

But I honestly don’t see a path for corrections to their database (i.e., Perceptron weight matrices) based on daily
interactions. Perhaps a local database is held whereby future interactions in the same login account will receive some
corrections along the way?
==========================


A possible partial answer may be found here: https://arxiv.org/abs/2601.06851  ;; (01.11.2026).

'While our results provide compelling evidence for a synergistic core in LLMs, several limitations
of our current approach warrant discussion. First, our analysis focused primarily on attention
heads and Mixture-of-Experts (MoE) modules as the fundamental units of information processing.

However, Multilayer Perceptrons (MLPs) constitute a significant portion of transformer
parameters and are hypothesized to store factual knowledge. Future work should apply
information decomposition techniques to MLP layers – potentially extending recent
methodologies which may reveal additional or complementary synergistic structures.'



p.s.
Sorry for merging threads, just trying to make it brief.



Kind Regards,
Adrian W. Pasieka
(unnamed) (message/rfc822, 9.5 KB) - not displayed
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.