People are alarmed at plans for a 5,000-guest music festival at a remote spot on the Welsh border – for the next five years.