Not to sound like an ass, but is it too much gun for you? Is the high and right always high and right or sometimes not? Do you anticipate the trigger break? Do you "fear" the trigger break? I had a 300WM many years ago in an 8 pound gun and it hurt to shoot - so much so that I eventually sold it for something I enjoyed shooting. I am now back onto 300WMs but my light guns have very effective breaks.
Most precision builders float their barrels. In truth, a free-floated barrel can be very inaccurate for other reasons and a non-floated barrel can be accurate for that reason: there is no definitive checklist for what makes a rifle accurate and precise - though there is a long list of things that make them inaccurate.
My recommendation would be shoot with someone trained to spot problems. Maybe you align yourself wrong. Maybe you muscle the gun on target. Maybe you anticipate. Maybe you pull the trigger with the pad of your trigger finger and not the tip. Maybe you are using crap ammo. Maybe your barrel is very, very dirty. Maybe you aren't sitting correctly behind the scope. Maybe.Maybe.Maybe.
There are many, many things that can cause problems in long-range shooting.
And, in closing, the trigger weight on a Rem 700 is easy to adjust, take some weight off the break. Also, try to go shoot with someone who shoots long-range well. There are a few drills and tricks a knowledgeable shooter can use to diagnose your yips.
There are few things in life more satisfying than shooting very small groups at far-away targets. The endeavor is worth the time and energy. The first time your print a 3-inch group at 600 yards, you will be thankful you put forth the effort.