Labels not working in boards tasks

I’m using boards to run my schedule/ sales/ notes etc

It seems that the labels are not working in tasks?? I count on the labels to stay organized with my team