One helpful thing to learn about is to search your question on google, you might find the answer 🙂
If you're referring to the lightbar lights...
For the texture color of the lightbar itself (not the lights it emits), you can find them with OpenIV. Just search the model of your car on there, open the .ytd file up, and look at the textures on the bottom right part that lists what textures your vehicle uses (and it will direct you to them). If you want to edit textures, I strongly suggest making a mods folder for that, if you hadn't already (OpenIV will prompt you to do that if you try editing).
Though, I think the actual lights are controlled somewhere else, I'm not sure about changing those.
As for headlight color, iirc an update supports changing headlight color so you can change them with a trainer.