nexus-6

Do you want your own replicant in the Metaverse?

Then look no further. All you need is your Google profile so you can access all of their free tools.

Just follow the instructions below and start cloning!

Instructions

Click on this item, below, to open the Colab file.

Make a copy of the file in your own drive.

Press the play icon to run the cell and remember to take note of the prompts and instructions.

Additional Resources.

PyTorch3d

You don't need to download a special application to use this AI. PyTorch3D is a library for deep learning, with 3D data, that Python can import.

RAM : A minimum of 16 GB RAM is required. You can also get on with a 8GB ram, but it has it’s own complications.

GPU : CUDA is compatible with almost all the models from 2006 but a minimum of GTX 1050ti, 1060 and above are required.

SSD or HDD : A SSD with at least 256GB is required for faster processing. The 128GB SSD falls short of space after the installation of the software.

Next Step

Before you start, check that your Runtime is set to GPU. Otherwise your program will probably crash. Also, at the end, if you want to render out a video of your model and it's process then you'll need to restart your runtime environment (Ctrl+M), it's in the same drop down.

Another Step

Import and Install all packages and libraries, don't be concerned if you get red warning messages if you have already done a previous task some of the packages will already be on your system.

Another Step

Upload your image using the button provided. Use a high-res image. The model is trained with 1024x1024 images. Use at least 512x512 with a good level of detail. Low-res images may result in unsatisfactory results. Use an image with a single person. If the image contains multiple people, reconstruction quality is likely degraded. Front facing, while standing works best. The entire body should be within the image. Make sure the image is well lit extremely dark, or a very bright image with strong shadows often create artefacts/mistakes. Leave space for cropping too.

Another Step

When downloading the trained model be prepared for a long wait, the 'ETA' is usually exaggerated, but it might be time to go make a cup of tea.

Last Step

Your files are located under the 'Files' icon in the left hand side tool bar, you'll probably have to open it up. You can download everything from there. You might have to wait a while for it to appear, depending on your machine. If you want to create more replicants, and why not, it's advised to close down and start from fresh each time. pifuhd>results>pifuhd_final>recon>FILE_NAME