Open3DLab says Roblox-linked crawler scraped 145GB of 3D assets
Open3DLab, along with sister sites SFMLab and SmutBase, says a web crawler using a Roblox-affiliated user agent referencing 'trellis2-data-sourcing' and a Roblox email address scanned nearly its entire catalog of 18,926 projects over 34 hours, making 26,429 requests. The crawler reportedly downloaded 1,027 files from 712 projects totaling 145.5GB, including adult content from SFMLab and SmutBase, despite the sites' robots.txt rules, terms of service, and creator licenses barring scraping and commercial use.