GoKawiilInsulin resistance is one of the most critical yet underdiagnosed drivers of modern metabolic disease. Predating the clinical onset of type 2 diabetes by years, impaired insulin sensitivity stealthily impairs vascular health, liver function, and energy metabolism long before fasting blood sugar rises into diagnostic ranges. Homeostasis Model Assessment for Insulin Resistance (HOMA-IR) models the feedback loop between liver glucose production and insulin secretion under steady-state fasting conditions, and a HOMA-IR score greater than 2.9 is considered insulin resistant based on epidemiological reviews. Recent studies demonstrate that multimodal machine learning frameworks integrating wearable sensor data with routine lab tests can accurately predict HOMA-IR to flag early metabolic risk. Integrating objective measures of body composition offers a vital complement to wearable technology; while wearables track daily physiological behaviors, body composition provides a distinct structural assessment of adiposity to form a complete picture of metabolic risk.
While knowing your total body fat percentage is a good baseline to measure adiposity versus lean mass, additional body composition biomarkers provide much deeper clinical insights. For instance, the Android-to-Gynoid fat ratio (A/G ratio) compares the fat stored in your trunk (an "apple" shape) versus your hips and thighs (a "pear" shape); the Visceral-to-Subcutaneous fat area ratio (V/S ratio) distinguishes between the highly metabolic internal fat surrounding your organs and the subcutaneous fat stored just beneath your skin. Elevated A/G ratios and higher visceral fat mass strongly correlate with insulin resistance prevalence. Currently, the gold standard for measuring true body composition is Dual-Energy X-Ray Absorptiometry (DXA) scans. These scans are incredibly precise, but aren't built for everyday screening because they are expensive, require specialized clinical infrastructure, and expose patients to low doses of radiation.
Building on the growing capability of smartphones to passively monitoring user health during daily use, such as continuous heart-rate monitoring, we introduce PhotoScan: an investigational deep learning framework that estimates three-dimensional body composition metrics including body fat percentage (BF%), A/G ratio and V/S ratio, directly from standard 2D smartphone photos. To build this, we pre-trained a deep neural network on over 35,000 participant records from the UK Biobank and fine-tuned it with a diverse new cohort of 677 adults. Validated across clinical cohorts, PhotoScan demonstrates higher body fat percentage accuracy than smartwatch-based bioelectrical impedance analysis (BIA) sensors while unlocking A/G and V/S ratios beyond BIA's capabilities, offering a scalable, non-invasive framework to predict insulin resistance with near-DXA accuracy.