I found that in the failure case, the bios was booting into the general booting process. While the success case, the kernel was booting into the resuming process. The failure one mentioned before can't be rebooted using the magic key and don't have any dmesg. However, the other one which booted into the kernel and have random artifacts can't be rebooted with magic key may be the graphics problem, which need more time to figure out.
I found that in the failure case, the bios was booting into the general booting process. While the success case, the kernel was booting into the resuming process. The failure one mentioned before can't be rebooted using the magic key and don't have any dmesg. However, the other one which booted into the kernel and have random artifacts can't be rebooted with magic key may be the graphics problem, which need more time to figure out.