Afghan officials have said the removal of the flag and nameplate from the Taliban's Qatar office is not enough.
Afghan peace negotiators say they are unhappy with Taliban statements.
"It is a kind of Taliban establishment which we don't want," Muhammad Ismael Qasemyar, a member of Afghanistan's High Peace Council, told the BBC.
The comments come hours after US Secretary of State John Kerry rang Afghan President Hamid Karzai to try to defuse tensions.
He told the president the Taliban's office in Qatar was removing the flag, and that the sign designating the building as the Islamic Emirate of Afghanistan would be replaced by one saying Bureau of Peace Talks.
Mr Qasemyar said negotiators objected to the statement made by the Taliban when the office had been established, which had indicated it would have relations with external bodies such as the UN.
Be Part of Quality Journalism
Quality journalism takes a lot of time, money and hard work to produce and despite all the hardships we still do it. Our reporters and editors are working overtime in Kashmir and beyond to cover what you care about, break big stories, and expose injustices that can change lives. Today more people are reading Kashmir Observer than ever, but only a handful are paying while advertising revenues are falling fast.