One of the easiest ways to get a hold of the Old and New Testament is with a ONT - theWord Bible Text Module. Used by theWord. ONT - theWord Bible Text Module offers a copy of both, in plain text format, and with tags marking up biblical text recognized by theWord.
And, brillianty, this software is completely free.
As if that's not good enough, ONT files are generally distributed as ".ont.exe" executable files, so there's no tricky installation either. Just click to open, and both the Old and the New Testament will self-install.