Thanks for your response. I guess I have to do a trial and error. I will try it without the amp (connect the TV direct from the cable out and see if signal would improve). If it improves, it probably means that my splitter is junk or/and my signal amp is amplifying the noise coming out from the source. I'll try it also with just the splitter and then try it with just the signal amp.
BTW, according to this electronics store I asked, one should only use shielded RG6 cables and not the inferior RG59 to get improved signals. I thought this is only good for longs connections. My connections from the source to the TV is below 15' in length so would an RG6 make any improvements?