How?
Brighton finished 15, 16, and 9th in Potter's 3 seasons. His one season at Swansea in the Championship, they finished 10th.
That is not the CV of a manager for a top club in the PL.
Maybe not. But look at the records of Jol, Redknapp and Poch before they managed Spurs.
I think the most important thing now is finding the right fit.