there is no such thing as a negative prestige block.
But prestige is based on the “base prestige” (sum of prestige of blocks) + a bonus percentage based on various other parameters which may become worse due to adding a particular block.
so whilst the block doesnt have a negative prestige, adding it may cause the bonus to decrease so that the final prestige does go down.