Is there some possibility of getting caught using cracked apps? I mean: I have activated Live, marketplace with my real Live ID, and what if I get some achievement or something like this and MS saw that I have this app installed, but not bought?

[acefire]

Most likely they will ban your XBOX LIVE account.

It's recommended that you set XBOX LIVE to off. Although you don't get achievements, it will certainly cover your tracks.