First you need to make sure that your company allows you to work abroad, which may mean that company information might be more accessible to foreign authorities. At my last job for a UK company, EU countries, especially more trustworthy ones would have been Ok but requiring company permission, South Korea would have been likely a "No" and North Korea an absolute "No".
Since you say UK resident - with pre-settled status you want to make sure that you are over six months of every 12 month period in the UK, or you might have trouble getting settled status. With settled status I can't remember if you can leave unlimited, or for five years, but nothing to worry about there.
Taxes... Well, you have two choices. You tell authorities that you work in France, or you don't. Not telling them is not quite legal, but makes life a lot easier because your company just continues paying you as they do now, and you won't need a visa. Yes, you are legally working in the place where your bum hits the chair, in your case that would be France. So you'd need a visa etc. etc. There may be a limit, maybe up to three months, where you don't need one.
Sorry, I forgot: If you are not a UK citizen but an EU citizen, that makes moving a lot easier, because you are free to move to any country in the EU and work there, but taxes would still be a problem if the authorities know.