Context matters - and we don't know the context of the conversation.
If the commenter was being flippant or dismissive or generally uncaring in their conversation it could be taken as racist by someone sensitive to such things.
If the comment was delivered with zero malicious intent and was merely a throwaway observation then it's not racist and only someone looking for offense would take it that way.
Like I said, without background knowledge and context it's impossible to determine if it was a racist remark or not.