There is a minimum star multiplier bonus based on the highest rank floor you achieve in a season. Your MMR can award additional star multiplier. As MMR decay is slow, you might lose 1 star for low/inactive seasons, depending on how close t a break point you are, but it will take several months of inactivity to lose more than that.