Why This Matters
This innovative project demonstrates how Apple's SHARP model can be run directly in the browser using ONNX Runtime Web, enabling users to generate and visualize Gaussian splats from images without server-side processing. It highlights the potential for more accessible, privacy-conscious AI applications that operate entirely on the client side, reducing reliance on cloud infrastructure. This development could accelerate the adoption of advanced AI tools in consumer-facing applications and inspire further browser-based AI innovations.
Key Takeaways
- Enables in-browser image processing with Apple's SHARP model using ONNX Runtime Web.
- Requires both the .onnx graph file and the separate .onnx.data weights file for proper functionality.
- Facilitates privacy-preserving AI workflows by eliminating the need for server-side computation.
A browser-based Gaussian splat generator built on top of Apple SHARP. ✨
This project lets you:
upload one image
generate Gaussian splats in the browser
preview the result
download a .ply file
Links
Project repo: bring-shrubbery/ml-sharp-web
Follow the author on X: @bringshrubberyy
Upstream SHARP repo (Apple): apple/ml-sharp
... continue reading