i just got a new Alienware
I'd be careful saying that around here mate

Anyway, what kind of overclocking knowledge do you have? Do you have enough to answer the following questions:
- How much (%) higher did you push each of the clocks on your cards?
- How much did you increase the voltage to the cards cores to accommodate these changes?
- How much power supply headroom did you have before tryong to overclock?
- Are both of the cards overclocked identically?
- Did you stress test each of your overclocks with 3Dmark or FurMark or some such program for over 12 hours?
This is the sort of information we need to be able to help mate.
From my experience, overclocking is about electricity and heat. If you can keep supplying more electricity to a component (overvolting) then you can push the clocks higher and higher (to a point), but, more juice = more heat. Parts are rearely designed to bleed off any more heat than absolutely necessary. This goes doubly for a prebuilt system like an alienware rig where they cut corners in every way possible to lower manufacturing price. Your either heating up too much or your cards dont have enough power.
To be brutally honest, you dont sound like you have enough technical knowledge to really be messing around with your components in the first place. I'm not saying dont overclock, I am just saying that you should do a lot of reading on the subject before you even attempt it. If we give you advice on here but you dont know the fundamentals of overclocking, then you will more than likely break one of your components, and I don't want that to happen.