It sounds like you might have an air leak in your intake. It could be a gap or a crack that closes as it warms up. A good way to check is to spray WD40 all around both sides of the intake while it is revving high. If the revs drop for a second or two, you found your leak.