East Lothian farmer Jamie Wyllie says he's worried costs will get passed down the line to the food producers.