Hi,
you are not alone with this problem on 32 bit version of Windows, just search for "out of memory" in this forum.
Doing the math, your image should consume something like 550 MBytes=8000pxels*6000pixels*3channels*4bytes, so you would expect that this fits into your RAM. But since you are using a 32 bit OS, Windows at most will give you 3GB (sometimes only 2GB depending on your BIOS) and much of this is fragmented into smaller pieces.
For me, the situation got much better when I changed to Win7 64 bits, which would by my recommendation for you.
Georg