Originally a quadrilateral building with four turrets, giving it almost the appearance of a castle, today only the west and south sides and part of the north side remain of the palace in via Alboino. These sections feature a series of pointed windows with sills decorated with terracotta friezes.

On the south side are the remains of a series of 15th-century frescoes attributed to Giovanni da Senato, while under an archway is a painting with the inscription "Dominus defensor innocentiae".