After OMD, The Avengers no longer remembered Peter was Spidey. There was a whole scene in New Avengers about them not knowing who he is. How could he (and MJ) still have lived in Avengers Tower if no one knew he was Spider-Man?