Draco has a strong personal arc in this book. Up until now he's been Harry's nemesis but in a school kids way. Now Draco has his own arc, separate from how he's interacting with Harry, so those scenes without Harry in them all follow that arc. So, yeah, we really are at a point where we can't have Harry's PoV of the scene.