The Residence of Pietro Speciale, a magistrate of Palermo in the second half of the 15th century, was built adjacent to the walls of the ancient city and was equipped with gardens.

Of the Gothic-Catalan facade, precious evidence remains in the form of several mullioned windows, including three above the current entrance, surmounted by the family crest bearing the insignia of the Order of Saint James of the Sword.

During the 17th century, following the marriage of the Prince of Raffadali to Eleonora Speciale, heir to the neighboring Palace of Viceroy Speciale, the two palaces were joined and renovated, taking on their current configuration. The vast atrium and the 17th-century staircase that adorns it, as well as the grand entrance portal, date back to that period.

Today, it is still inhabited by the Princes of Raffadali.