Discover and read the best of Twitter Threads about #NeRF
Most recents (14)
1/ 🎉 Day 8 of #AllinAI: As someone who's always been fascinated by #AR #VR and 3D scanning, I'm excited to explore Neural Radiance Fields (#NeRF)! NeRF is a game-changing AI technique that has transformed the 3D scene reconstruction & rendering. Let's dive in!
2/ 📊 Traditional 3D scanning methods like #photogrammetry & #lidar faced challenges like noise, inconsistencies & limited detail. NeRF uses AI to help overcome these by creating high-quality 3D renderings from 2D images.
3/ 🌐 How it works: Take a few pictures of an object. NeRF's deep neural network optimizes the radiance field to match the 2D image, combining color & volume density to create a stunning, detailed 3D rendering.
Created using @LumaLabsAI @SirWrender 👇
Created using @LumaLabsAI @SirWrender 👇
Let's look into @NeRF_ERC20
$NERF is a new technology that allows 2D media to be rendered into a 3D environment, making it look like it's being filmed by a drone or crane! 🚁🎥
👇👇
$NERF is a new technology that allows 2D media to be rendered into a 3D environment, making it look like it's being filmed by a drone or crane! 🚁🎥
👇👇
🤖 The tech behind it is called Neural Radiance Fields (NeRFs), and it's a deep/machine learning tech that not many people can use yet. But fear not! $NeRF is here to change that.
👇👇
👇👇
🌐 $NeRF is building scalable platforms on Telegram and the web that will allow anyone to use this technology easily and conveniently. 💻
👇👇
👇👇
3D view synthesis with AI 🤯📽️
capturing a wild @franclucent in a tree
#NeRF @LumaLabsAI
What is a NeRF??? ⬇️ (1/4)
capturing a wild @franclucent in a tree
#NeRF @LumaLabsAI
What is a NeRF??? ⬇️ (1/4)
@franclucent @LumaLabsAI What in the world is a NeRF? (2/4)
Neural Radiance Fields or “NeRFs” use AI models to create new views given only a few inputs to start with. This helps us visualize what a scene looks like in 3D with complex geometry and lighting. Use cases range from VR animation to design
Neural Radiance Fields or “NeRFs” use AI models to create new views given only a few inputs to start with. This helps us visualize what a scene looks like in 3D with complex geometry and lighting. Use cases range from VR animation to design
@franclucent @LumaLabsAI How does this work? (3/4)
AI algorithms create new image views by “querying 5D coordinates along camera rays” to project depth and color in a new image using camera position and direction data
matthewtancik.com/nerf
AI algorithms create new image views by “querying 5D coordinates along camera rays” to project depth and color in a new image using camera position and direction data
matthewtancik.com/nerf
NeRF update: Dollyzoom is now possible using @LumaLabsAI
I shot this on my phone. NeRF is gonna empower so many people to get cinematic level shots
Tutorial below -
-
#NeRF #NeuralRadianceFields #artificialintelligence #LumaAI
I shot this on my phone. NeRF is gonna empower so many people to get cinematic level shots
Tutorial below -
-
#NeRF #NeuralRadianceFields #artificialintelligence #LumaAI
2/ First, stand still. Have a friend take a quick video of you
Capture the area in front of you and behind you
Capture the area in front of you and behind you
3/ Here's the raw footage btw for anyone curious
(Feel free to download it so you can follow along)
(Feel free to download it so you can follow along)
NeRFs are getting attention these days!
However widespread adoption is still slow. But why?
It comes down to a) file size and b) rendering.
An engineer's viewpoint:
TLDR: NeRFs are fundamentally a bad fit for today's edge device architectures.
Let's explain that in detail:
1/
However widespread adoption is still slow. But why?
It comes down to a) file size and b) rendering.
An engineer's viewpoint:
TLDR: NeRFs are fundamentally a bad fit for today's edge device architectures.
Let's explain that in detail:
1/
a) A quality NeRF can easily take up many GB of (dedicated) memory on the GPU. Most consumer devices today are miles away from this.
But even if devices could handle it (they can't) there is still the open question of delivery / transmission.
While you could, presumably
2/
But even if devices could handle it (they can't) there is still the open question of delivery / transmission.
While you could, presumably
2/
compress things down to a few 100 MB, that would still be > 20x larger than a textured mesh of the same scene.
But even if all of a sudden the whole world got 5G everywhere and loading a few 100 MB per NeRF was tolerable (it's not), such compression would likely be
3/
But even if all of a sudden the whole world got 5G everywhere and loading a few 100 MB per NeRF was tolerable (it's not), such compression would likely be
3/
1/ Now you can create "drone" shots from your phone footage, thanks to NeRF
Collab with @justLV / software @nerfstudioteam / see below for our process
#NeRF #neuralrendering #artificialintelligence #instantNeRF
Collab with @justLV / software @nerfstudioteam / see below for our process
#NeRF #neuralrendering #artificialintelligence #instantNeRF
2/ Here is the raw footage input (sped up 5x here) which we fed into NeRF Studio
3/ Then @justLV created a camera path inside NeRF studio.
The grey polygons are keyframes, the red line is the path that @nerfstudioteam auto-generates to smooth out the camera path
The grey polygons are keyframes, the red line is the path that @nerfstudioteam auto-generates to smooth out the camera path
NEW: This Post Was Written By #AI: sjtylr.net/2022/10/08/thi…
From idea to content and published post in under 30mins, using free tools. This tech is developing *fast* and will have implications for teaching, learning and our graduates.
#EdTech
From idea to content and published post in under 30mins, using free tools. This tech is developing *fast* and will have implications for teaching, learning and our graduates.
#EdTech
☝️Using tools from @playground_ai @peppertype_ai @AiWritesonic @copy_ai and inspired by @Suhail @kaifulee @FryRsquared @DeepMind @daniel_eckler and more. Follow them all for super-interesting news. #AI
GM! Here's the daily summary of trending projects on crypto GitHub. Curated by the greatest web3 developers ⭐️.
Check the 12 projects in the thread below 🧵👇🏻
Check the 12 projects in the thread below 🧵👇🏻
0xYYY and 5 others starred repo ScopeLift/scopelint (16 ⭐️)
An opinionated formatting and linting tool for foundry projects...
github.com/ScopeLift/scop…
An opinionated formatting and linting tool for foundry projects...
github.com/ScopeLift/scop…
abigger87 and 5 others starred repo vezenovm/simple_shield (22 ⭐️)
Basic Noir anonymous proof of membership...
github.com/vezenovm/simpl…
Basic Noir anonymous proof of membership...
github.com/vezenovm/simpl…
Do you love 3D maps, worlds & visualisations? Here are 24 world creators, mapmakers, or visuals I've come across recently. Brilliant and creative minds using many different tools! PART 1 #dataviz #GISchat #3dmaps #map #gis #3d 1/🧵
Steven Kay | @stevefaeembra creates many original and cool #3dmaps such as this great visualisation of Windturbines in the British Isles. Follow him! #Blender3D and #QGis are his tools. #SDGs #Wind #b3d 2/🧵
I would like to present a proposal to @Lasrevereth for the first community owned ecosystem product to be built in the $LSVR meta-verse...
Mood For Learning is a community owned education resource with the ambition of maximising opportunities for all and improving the global education market...
Education is failing humanity. In parts of East Zambia only one in a hundred children make it to secondary school, meanwhile in the UK 20 of 55 British Prime Ministers have been educated at the same school...
@zackfreedman @KousakuJ @Kousaku_Japan So what would be more interesting is a automatic racking system and a ballistics computer with distance measurement to correctly calculate the flight path of a #NERF dart...
In anticipation of the Intl. Conf. on Computer Vision (#ICCV2021) this week, I rounded up all papers that use Neural Radiance Fields (NeRFs) represented in the main #ICCV2021 conference here (1/N):
dellaert.github.io/NeRF21
dellaert.github.io/NeRF21
Many of the papers I discussed in my original blog-post on NerF (dellaert.github.io/NeRF/) made it into CVPR, but the sheer number of NeRF-style papers that appeared on Arxiv this year meant I could no longer keep up. 2/N
Conferences like #ICCV2021 (with CVPR, the top-tier Computer Vision conference) provide an (imperfect) filter, and I decided to read all the papers I could find in the ICCV main program. I share them with you below and in the archival blog post. Email me if any are missing! 3/N
Vous voulez adopter un #chien? Vous ne savez pas de quoi ça se nourrit ? Quelques conseils alimentaires avec un #berger australien ⬇️
Un de ses plats préférés : Une spatule de cuisine ,en bois de préférence , volée directement sur la table
Des fléchettes en mousse , mais uniquement des fléchettes #nerf attention
THREAD. Need some #physics ideas to go along with your holiday presents? I have you covered.
Here is my list of some cool physics experiments I have done with toys and stuff.
Here is my list of some cool physics experiments I have done with toys and stuff.
