Karan Ganesan (@karanganesan)

Karan Ganesan

@karanganesan

• founding engineer at luma ai (@lumalabsai) • previously at flipkart camera, scapic • an eclectic person interested in technologies of the future

2 years ago

•

View on X

Luma AI

“Every once in a while, a revolutionary product comes along that changes everything.” - Steve Jobs I believe that one of the things that is going to change the course of history is #NeRF We are barely scratching the surface @lumalabsai #3D twitter.com/LumaLabsAI/status/1559650257012932608/video/1

Yesterday we shared one of our latest advances in real-time rendering of unbounded NeRF on the web (i.e. browser) unbounded = everything the camera sees during capture, as much as possible, as far as possible captures.lumalabs.ai/unbounded

pro tip: when visiting captures.lumalabs.ai/unbounded on a laptop/pc be sure to use AWSD keys to move around the scene, mouse to rotate around, Escape to reset scene, segmented & mesh view toggle on top right

but it's still possible to view unbounded scenes on mobile too with limited controls you can tap and move to rotate, 2 fingers to move scene, segmented, mesh view toggles, etc. too captures.lumalabs.ai/unbounded

Imagine re-living precious life moments exactly that way it happened anytime you want like the place you used to play around as a kid, the place in your high school, etc., that's the kind of things unbounded NeRFs bring to the table captures.lumalabs.ai/ebullient-reindeer-5X-387?mode=slf

You can basically walk around in VR (in the future, yes we have plans) in an unbounded NeRF capture captures.lumalabs.ai/delicious-ptarmigan-vd-385?mode=slf

It's just been amazing and mind boggling to see the use-cases people are talking to us about. this is the next evolution of 3D capture, reconstruction, rendering, etc. just look at Ben Affleck’s bike 🏍 twitter.com/gravicle/status/1559355279640211456/video/1

We also announced an amazing gallery of captures done using Luma app with links to the actual real-time viewer on the web. We will feature NeRF captures created with Luma by our early users and partners as a showcase of what’s possible. captures.lumalabs.ai/

Here is a link to one of the captures I did, look at how well the leafs have come out captures.lumalabs.ai/amuse-integral-8r-314

Be sure to checkout the Log boy too, it's my favorite ❤️ captures.lumalabs.ai/tamarin-bossy-941-194?mode=lf

so, let's take a step back and understand what exactly they are, I mean what is a NeRF in simple words. we all know what an image is, what jpegs, pngs, etc. are right, they're basically pixels / colors seen by a camera stored now imagine that for a 3D scene/captures

Each viewpoint is different for point in space for the capture, it's view dependent.

At last, we have openings for anyone interested in pushing the boundaries of NeRF (ML/CV), working on graphics, iOS and AR. DM if any questions, happy to answer and help however I can. 🔗 lumalabs.ai/join twitter.com/LumaLabsAI/status/1559653752637759488?s=20&t=kvmXYpqu6ZB49hv-XetGCg

be sure to give @lumalabsai a follow, to hear the latest developments and updates from our team.

You can read the unrolled version of this thread here: typefully.com/karanganesan/srvxVBpoc70q