The first historical record about the Castle dates back to 1187 and mention is made a Lord called Ivano. In 1228, the ruling by the Bishops and Counts of Feltre was over, Castel Ivano and lower Valsugana became the prey, for almost 200 years, of fights between a number of Lords, such as Ezzelino da Romano, the da Caminos, the Scaligeris from Verona, the Carraresis, and Gian Galeazzo Visconti. It was approximately 1375, under the Carraresis, the coat of arms of the House – four wheels and two bars of a cart - was put on the tower of Castel Ivano. In 1413, the lower stretch of the Valsugana was annexed to the County of Tyrol and became part of the Austrian House of Augsburg, and therefore Castel Ivano went under their ruling.
Castel Ivano first went under the ruling of the Captains of Faith, and later by the Tyrolian family of the Wolkenstein-Trostburg that managed the feud as a pawn for the money that was lent to the throne by them until 1750, when Empress Marie Therese of Austria granted in perpetuity the feud to the family. Catel Ivano was ruled by a number of Captains among whom Giorgio Pucler, killed by the local farmers during some riots, the so-called “war of the farmers” that began in 1525 in Tyrol and in the region of Trient against the aristocrats in an attempt by the farmers to free themselves from fuedal laws.