Computer Shopper offers a guide to building a decent PC for $250. The parts are better than you think — ATHLON 64 3400+, 1 GB of RAM, 80 GB hard drive.

You may be able to buy a computer pre-built for around the same money, but probably not with the same features.