Where a trained model beats arithmetic, and where it doesn’t
Every comparison you have read was written by somebody selling one of the two. Here is the version written by somebody who had to implement the losing side properly.
What each one actually is
A resampling kernel is a weighted average with a good set of weights. Lanczos 3 takes seven source pixels along each axis and combines them along a windowed sinc curve, which is the closest a finite filter gets to the ideal reconstruction of a sampled signal. It has no knowledge of photographs, faces, letters or bricks. It has a curve.
A trained upscaling network is a stack of convolutions whose weights were fitted by showing it millions of pairs — a sharp picture, and the same picture made small. It has learned what usually sits under a particular kind of blur. It has no curve. It has an enormous amount of experience and no idea whether it is right.
The kernel produces the best available description of the pixels you have. The network produces the most likely picture given the pixels you have. Those are different jobs, and almost every disagreement about upscaling is people comparing them as though they were the same one.