It is definitely the battery. Do you still have the original motorcraft battery?
My 05 5.4 F150 was doing this for about two months when it was cold out. Two days ago my battery died and i got a new Diehard Gold, it started better yesterday at 18 degrees than it ever has. (and no flickering anymore)