Terry also told Potter to decide on a “settled team.”
Chelsea were held to a 1-1 draw at struggling West Ham on Saturday.
Joao Felix scored his first goal for the Blues, but Emerson Palmieri levelled for the hosts.
It was a third successive draw for Potter’s men in the Premier League, meaning they remain ninth, 10 points outside the Champions League places.
When asked by a fan if he helped get Potter the Chelsea job, Terry said on Instagram: “Absolutely not.
“I tweeted that I loved watching Brighton play and his style of play. I have nothing to do with the first team. I’m working with the [Under] 18s and 21s and love my role.
“Clearly results are not good enough and we need to get a settled team.”