No, not remotely disturbing! It's a functional piece in a relevant colour - and it's a different material. It would be a shame if that prevented you from going for your desired colour.
This is not unlike the issuse some people have with Hethel Yellow not being the same as the yellow of the Lotus badge - you don't paint a car to match your brand colours as there are different factors at play in what looks good on the car.
So, for me, "matchy-matchy" is not a factor. But for anyone this is an issue for, it won't be hard to get the start button cage repainted- or get aftermarket neutral (black/white or black/silver) Lotus badges.