Ash-Shaykh Bin Baaz, may Allah have mercy upon him, was aksed the following question:
The Question: The one who praises Ahlul Bid’ah and extols them is he to be added to them?
The Answer: “Yes, there is no doubt ,the one who praises them and extols them then he is a caller for them, he calls to them, this person is from their callers, we ask Allah for salvation”
The Source of Reference: On the Footnote of The book “Sharh Fadal al-Islam” ,page 16, print Sayd al-Fawaa’id, also the Book “ar-Radd alaa al-Mukaalif” ,page 7.

Imam Muqbil was asked:
There is a group here called Hizbut Tahreer they call to the Islamic Caliphate, they speak about the scholars, thus how can we refute them and what is the way to the guided Islamic caliphate? 
The Shaykhs answer: 
‎ الحمد لله و صلى الله و سلم على نبينا محمد و على آله و صحبه و من والاه و أشهد ان لا إله إلا الله وحده لا شريك له و أشهد ان محمدا عبده و سوله أما بعد :
“As for the affair of groups then the people are categorized in to two parties:
The party of Ar Rahman (The Most merciful) and the party of Ash Shaytan (the devil). As for the party of Ar Rahman, then it is not permissible for them to divide in the religion.
Allah says 
‎إِنَّ الَّذِينَ فَرَّقُواْ دِينَهُمْ وَكَانُواْ شِيَعاً لَّسْتَ مِنْهُمْ فِي شَيْءٍ إِنَّمَا أَمْرُهُمْ إِلَى اللّهِ ثُمَّ يُنَبِّئُهُم بِمَا كَانُواْ يَفْعَلُونَ(159) 
Verily, those who divide their religion and break up into sects (all kinds of religious sects) , you (O Muhammad) have no concern in them in the least. Their affair is only with Allah, Who then will tell them what they used to do [6:59].
The Messenger صلى الله عليه و سلم said the Jews split in to 71 groups, the Christians split in to 72 groups and this nation will split in to 73 groups. 

Abu Dawood reported it from the narration of Abu Huraira رضي الله عنه and Abu Dawood also reported it from the narration of Mu’awiyah رضي الله عنه similar to it and In it is “All of it are in the fire except a group. They said and who is it oh Messenger of Allah? He said The Jamaah (congregation)
Then he صلى الله عليه و سلم said:
“There will come a people who will be dominated by desires like rabies which penetrates its patient”.
Indeed that which the Prophet صلى الله عليه و سلم informed occurred for the desires have become many, and the groups have become many, and the Lord of Might says in his Noble Book: 
‎واعتصموا بحبل الله جميعا و لا تفرقوا
Hold tight to the rope of Allah all of you and don’t divide [3:103]
The Messenger صلى الله عليه و سلم said “You will follow the ways of those nations who were before you, span by span and cubit by cubit (i.e., inch by inch) so much so that even if they entered a hole of a mastigure, you would follow them.” We said, “O Allah’s Messenger (ﷺ)! (Do you mean) the Jews and the Christians?” He said, “Whom else?
And the Prophet صلى الله عليه و سلم said:
“A faithful believer to a faithful believer is like the bricks of a wall, enforcing each other.”
As for these partisan groups, they chase each other away, and disparage each other. Rather if one were to say that these groups have made a reality that which the enemies of Islam intend from the splitting of the nation, disrupting there unity, and weakening their strength, then he would be truthful. 
Hizbut Tahreer is an evil repulsive group, perhaps you find this statement to be great since I mentioned it in the beginning of my speech and it would of been more befitting if I had prepared the way for it (with an introduction). I say that it is an evil repulsive group!
It came about in Jordan and broke away from the Muslim Brotherhood. Thus, they corresponded with him (it’s leader) to return but he refused to return, and there leader was Taqiyud Deen An Nabhaani.
In regards to the matter of beliefs they say: It isn’t taken except from the intellect. If evidence from the Qur’an and Sunnah is found then it must be definite. Therefore, they reject the punishment of the grave, and the coming of the Maseeh Ad Dajaal.

Similarly they don’t pay concern to teaching the noble manners nor pay concern to knowledge. [They are ] a group who’s companions were brought about upon mere politics and opposition of the religion. We say to its leader why don’t we see from your group institutes for the memorization of the Qur’an? 
He will say: “I don’t want to bring about Dervishes!!” (I.e. A Sufi religious group known for poverty and asceticism) 
They rely upon politics and not knowledge, nor manners, nor heart softeners, just politics.
They permit for a man to shake a non-Mahram woman’s hand. They also permit for a woman to be a leader, or that she be in the state council. They permit for the disbeliever to be in the state council and that he be put in charge of some of the general administrative districts. It is a misguided group, rather in utmost misguidance. I am shocked at he who boasts and rejoices due to Hizbut Tahreer.
I advise every brother to distance from him and warn from him. If it wasn’t that we make excuses for them, that they misinterpret (the texts), we would have said they are disbelievers because they reject the punishment of the grave, the coming of the Maseeh ad Dajaal, and their leader says He doesn’t like to teach his students the Qur’an so that they don’t come out Dervishes…”
Source: http://www.muqbel.net/files.php?file_id=5&item_index=7

Narrated Abu Huraira:

Allah’s Messenger (ﷺ) said, “None of you should walk, wearing one shoe only; he should either put on both shoes or put on no shoes whatsoever.”

Reported by Imam Al Bukhari Muslim and others.

Ash Shaykh Abdurrazaq Al Badr mentions in the explanation of Shamaail An Nabi of Imam At Tirmithi page 101

“It is mentioned that a questioner asked Ash Shaykh Ibn Baaz رحمه الله he said:

If the second shoe is a footstep or two away from me should I walk towards it with one shoe?

The Shaykh Said: If you are able to not oppose the Sunnah even if it be with one step, then do that (meaning don’t oppose the Sunnah even if it be with one footstep) 
Majid Jawed Al Afghanee