I had always thought (but I do accept that I could be wrong) that they were at a standard dining room table, at which the diners would sit at the long sides of the table.
If you look from one side of the table, I picture, from left to right: Peter, Digory, Edmund, then Polly. From the other...