When you present priority pass at the lounge counter, you only have to give the priority pass card and your boarding pass (soft copy or hard copy). No need to show the associated credit card.
They sometime ask is it just you or any guests included. Also sometimes they ask to do a digital signature on the swipe machine.
Once swiped, you collect your card and enter the lounge.