Celestials. Not every Time Lord is the Doctor.
In fact the Doctor and the Master are the only Time Lords with feats. The race of Time Lords only feat is loosing to the Darleks and being utterly destroyed. Considering one of their race defeated this race hundreds of times I wouldn't put much fail in the race as a whole.
For one thing the Doctor ( can't recall if it was the 3rd or 4th) was punished for his intervention in time ( the actual Time Lords being more like Watchers) and his punishment was being trapped for a period in so far as he could only travel the time line of Earth.
Also their most powerful attack is something they would never use. Opening the eye of a Tardis was only ever attenpted by the Master and The Doctor was hell bent on stopping him from doing so. The Doctor is the most out there off the cuff member of the TL's and if he wouldn't do it you can bet none of the others would.