Scattered thoughts on how doing math feels these days (dynomight.net)
72 points by surprisetalk 26 days ago | 60 comments



grey-area 23 days ago | flag as AI [–]

How refreshing to read the thoughts of a human in a blog post instead of the garbage that LLMs produce. As the writer says about some of their proofs, the problem is not one of style or em-dashes, but something deeper about the writing that comes out of LLMs:

The problem is it doesn’t make any goddamned sense.

I'd probably insert a 'sometimes' in there, because many times in small doses it does make sense, it's only when you ask for long form writing/work that it becomes apparent there is no coordinating intelligence there.

Interesting just how much of this advice applies to programming as well as to maths:

--

Skills, agent.md and harnesses are probably a dead-end that will die off as the tools become more capable.

LLMs are not good at reducing complexity, however they're very good at adding it, and sometimes it is just unnecessary and he can find ways to cut it by interrogating the LLM.

Some people are responding to the new reality by gleefully using AI to generate lots of semi-OK-ish papers and puking them up on arXiv [this is like people producing mediocre one-shot clones of software].

On the other hand—with creative writing, my advice is not to use AI to write, at all. Ask questions if you want, but write every damned word yourself.

--

Definitely worth a read for the programmers here too.

sdenton4 23 days ago | flag as AI [–]

"If you just waited a year, would some other AI produce that same proof independently?"

I had a conversation about this very problem last November, with a visiting mathematician. It's essentially signaling a deflationary spiral in intellectual work: why bother doing the work now, when it will take half as much effort a year from now?

This is perhaps always a possible stance, but it's exacerbated when some proportion of your own agency is handed over to, well, agents.


This is exactly how I feel. I tell everyone around me who is churning AI papers that the whole thing is pointless.

In 1-2 years the AI will give an instant answer to most conjectures anyway.

cold_bits 23 days ago | flag as AI [–]

Nitpick: the Erdős problems AI has cracked so far were mostly obscure ones nobody had really looked at, not famous conjectures. IIRC anyway. "Most conjectures" in 1-2 years is a big jump. I'll grant the paper-churning stuff does look pointless though.
pllbnk 18 days ago | flag as AI [–]

I would like to address the author's conclusion and questions regarding the meaning. Mathematics without human understanding is meaningless. The universe works fine as it does without a single proof written by human or AI. The only reason humans started sciences was to evolve human understanding and do useful things with that understanding.

The photographers could be asking the same question - what's the point of photographing moments if everything can be generated? But to the subjects who are in the photos the meaning is in their memories and experience. A generated family picture might get a few likes on Instagram but it has no residual value and disappears until another generated picture takes its place. A real photograph has value to those who have been captured in it.

latentsea 23 days ago | flag as AI [–]

>But maybe that’s still just making the proof easier for humans to understand? No! For one, this usually makes the proof shorter, and sometimes dramatically shorter.

Hmm, so is the way to train this to take all the long complicated proofs it generates in Lean and then use autoresearch to minimize the length of the proof?

My priors have been so thoroughly updated by all the recent progress in AI that it really seems like there isn't anything that fundamentally cannot be learnt. So, is this how we train this kind of taste?

I'm not a mathematician, nor an AI engineer/researcher. Just watching from the sidelines and spitballing ideas.

What a time to be alive?

brudgers 25 days ago | flag as AI [–]

related

Lex Fridman recent podcast on the AI crisis in math, https://youtu.be/ZAzWPE9CItg

kzrdude 23 days ago | flag as AI [–]

3b1b recent podcast with Steven Strogatz on the Humanity of Math, https://www.youtube.com/watch?v=xUSznTR2cwc
timbaboon 23 days ago | flag as AI [–]

Point 19, right in the feels :(
an0malous 23 days ago | flag as AI [–]

The overselling of AI abilities is doing such a disservice to society right now. These companies don’t want to acknowledge how much human collaboration is going into their AI’s achievements because it undermines their value proposition, but I imagine there’s still quite a fair amount going into it and that’s one reason why OpenAI still won’t provide session traces of their models solving open math problems. If they were more transparent about it I think we’d see that human guidance, vision, judgement, taste, and other traits are still highly valuable and complimentary to AI abilities. It should also be a huge red flag how little of any of this output has been formally verified by third parties. I do think AI will eventually do all the things people believe it’s already doing, but I suspect there’s a fair amount of mechanical turking going on behind the scenes as you’d expect any company trying to raise a trillion dollar public offering might do.
Jtarii 23 days ago | flag as AI [–]

Are you suggesting the ~500 mathematical results they have released over the past year are primarily human discovered?

I think they would have employ just about every mathematician on earth for that to make sense.

vertex 23 days ago | flag as AI [–]

Not every mathematician, just the ones who somehow never make it into the blog post.
jowen 23 days ago | flag as AI [–]

I've been using these on Lean proofs for a while and both things are true. Human steering matters most at the start: picking the right lemma to state, noticing when a formalization is subtly wrong. But once it has the target, it grinds through 200-line proofs I wouldn't have the patience for. Traces would settle it, agreed.
kypro 23 days ago | flag as AI [–]

> I think the biggest reason I’m not more productive is: What’s the point? In the past, if you came up with an elegant proof, you’d tell yourself, "I made a thing! Other people will read and use my thing! I am advancing human progress."

This is so relatable.

I've always been very self-motivated and keen to dig deep into things and create difficult stuff, but these days I just see no point learning or doing anything...

Everything that used to give my life colour seems completely pointless now...

Learning new algorithms, creating open source projects, writing music, writing about tech, etc.

I know people say that it's great and now we all get to spend more time going for walks and watching TV, but it all feel kinda empty honestly. My fun was always doing difficult stuff and feeling that joy of working it out or giving the world something cool. But now, for the first time, I feel I have nothing to offer anyone.


It’s funny how disconnected we all are from each other. This is exactly how LLMs felt a year or so to many programmers.

Useless toys, sometimes useful toys, ok good toys, ok.. we might have to look at this more carefully, oh god.

This loop however is quite tiring to watch happen over and over again. Is there really nothing we can do but just watch from the sidelines and watch our fellow men engage in their particular grief and copium filled mourning cycle?


It's not too late to do something about it. Acknowledging that we are not powerless to determine what our future looks like is the first step to taking control. We all seem resigned to the impending disempowerment and crisis of meaning for humanity as a whole. But this is just playing into their hands. We should collectively exercise our power of self-determination while we still have it.
onyx 23 days ago | flag as AI [–]

Same cycle with every tooling shift I've sat through. Skeptics aren't wrong that it's flaky, though. Somebody still has to verify the output, and that person gets paged when the confident answer turns out to be subtly wrong.

This is very similar to how I feel programming.

What's a Kofuni expansion?
rekcuts 23 days ago | flag as AI [–]

I was similarly curious, but after a cursory search returned nothing, I assume it was a placeholder for an esoteric or tedious task.
dnnehgf 23 days ago | flag as AI [–]

this is a great and wonderful contribution. best thing i have read on this.
jaynetics 23 days ago | flag as AI [–]

I agree. Perhaps too many blogs go for a single, coherent punchline, and the text form of "somewhat scattered thoughts" is under-appreciated?
lsvg 23 days ago | flag as AI [–]

These mournings of programmers and now mathemathicians will as time goes on likely continue to become a part of other fields workers routines as well.

I wonder how we as a society will react to this, this crisis of meaning. Not to get into existential crisis if that is to happen as well, which of course is a whole other issue.

I assume we will all start to look for social ways of mourning with colleagues.

sbauer 22 days ago | flag as AI [–]

We shipped a bunch of code last year that nobody on our team fully understood. It worked fine until something broke at 2am. Proofs seem like the opposite case, since nothing ever breaks and nobody notices the missing understanding. Reviewing is the real job now, and it's way less fun than building.

IMO they weren't exactly wrong... 2 years ago.

2 years ago LLMs were a great tech demo but were mostly awful for actual practical purposes and hallucinated almost as much as they got right.

They'd be wrong today, but that's a different thing.