The loss has raised concerns about Potter's job security, with some fans expressing their dissatisfaction before the game by staging a protest.
Following the 2-1 defeat, Potter spoke with a reporter from talkSPORT, Ian Abrahams, who is also a West Ham fan.
Abrahams asked Potter if he still believed he was the right person for the job, to which Potter replied with a simple "yes."
Abrahams then asked a follow-up question about the team's poor start to the season, and Potter again replied with a single word: "yes."
After a brief exchange, Potter moved on to speak with other reporters present.