I connected the same PAC adapter with no problems. Here is what I did. 12v from battery to amp. Chassis ground to amp. Adapter remote wire to amp remote. Run RCA cables to amp. Then plug the adapter in to the factory wiring. There is only one way to connect. I am using this adapter to power by sub. My door speakers are still powered by the factory HU. When I install an amp for the door speakers I have to cut the door speaker wires from the HU and connect them to the new amp. Does your amp turn on when you power the HU? If so the remote is working properly. If not check your remote wiring/connections. Not sure if this helps.
2011 F-150 XLT SCrew - Blue w/ Silver Ingot accent, 5.0L, American Racing AR708, MPT 87 Performance Street Tune, Advent/Polk/Kicker audio.