You could use a scheduled JIRA Automation rule to look for issues with the label whose created date is more than x days ago, and then remove the label from it.
If you are on Cloud, you would have this already because Automation is included out-of-the-box now, but you may need to install it for Server\DC.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.