> So GPT-3 does very well with 2-digit addition and okay with 2-digit multiplication, but can't abstract to 6-digit arithmetic.

That sounds disappointing but what if instead of trying to teach it to do addition one would teach it to write source code for making addition and other maths operations instead?

Then you can ask it to solve a problem but instead of it giving you the answer it would give you source code for finding the answer.

So for example you ask it “what is the square root of five?” then it responds:

    fn main ()
    {
      println!("{}", 5f64.sqrt());
    }