If you have disabled fields in the template and you give colors to the template fields the orders of the colors are wrong. Probably because it counts the disabled fields in the rendering.
FIELD1 = RED
FIELD2 = DISABLED
FIELD3 = GREEN
FIELD4 = YELLOW
FIELD5 = NO COLOR
Then the colors are shifted. So in the exported templates FIELD4 = Green and FIELD5 = Yellow.
Easily reproducable. Just disable one field and work with colors adn this is the result

EDIT:
Fixed it by adding
if($field->enabled == 0){
continue;
}
To the $fields as $field foreach loop in the csvimproved xlsx renderer.