set-up question with regard to action/string rattling

I have a fairly low action on my JP7, and in order to get there I adjusted the truss rod a while back to make the neck ‘straighter’ and lowered the string saddles on all strings (being careful to lower each of the about the same).
I am happy with the end result, however the high e-string still has a lot more string rattle than all the other strings, and this mostly occurs on all frets except for the higher frets (say fret 15 and higher).
My question: what would be the better way to resolve this, either adjust the truss rod a little more to straighten the neck a tad more? OR to raise only the saddle of the high e-string a bit? or maybe a bit of both?

Thanks for any input.