Edge AI-Based Dynamic Treatment Strategy Generation Model for Consumer Healthcare Technology

Edge AI-based reinforcement learning is less reliant on mathematical models and relies on experience to help with the design and optimization of Consumer Technology models, making it ideal for learning dynamic treatment techniques. However, the current research still has the following problems: 1. The optimality of the learned strategy is considered without taking risks into account, leading to strategies with certain risks. 2. The issue of distribution shift is ignored, resulting in learned strategies that are completely different from those of doctors. 3. The patient’s historical observational data and treatments are ignored, making it difficult to accurately assess the patient’s state, which in turn leads to the inability to learn the optimal strategy. Based on this, we propose the DOSAC-DTR dynamic treatment strategy model, which integrates Dead-ends and offline monitoring into the Actor-Critic framework. First, we consider the risk of treatment actions recommended by the learned strategy and incorporate the concept of Dead-ends into the Actor-Critic framework. Second, to mitigate the distribution shift problem, we integrate physician monitoring into the Actor-Critic framework. This approach achieves better performance, resulting in lower estimated mortality rates and higher Jaccard index scores.