How We Faked Boston Dynamics Robot

The motion capture stuff That ended up being really easy all the stuff that we thought was gonna be easy ended up being the hardest part good ideas take a lot of work that Laugh was kind of just me reflecting on Look guys myself and Ren are currently working on the most difficult Challenging most technically involved shot that corridor digital has ever seen. I’m confirming with Sam confirmed with Nico. I Absolutely confirm and I take 100% of the responsibility for all the pain that you feel We’re working on the hardest shot the quarter Digital has ever seen not only is there one there’s six of these shots would you say this is someone’s fault could Will you blame me for this because I’m trying to figure out if I should feel bad or not. I blame nobody Okay blame nobody I blame the good idea being so good that we just had to do it good ideas Take a lot of work You guys have seen those Boston Dynamics videos where there’s like that Mechanical dog walking and there’s this random dude who just kicks it, but it catches its balance I’ve always wanted to do some sort of video around this concept these Humanoid robots that are just getting kicked by scientists and whatnot And we got this motion capture suit for mechs ends and all of a sudden BAM the idea hit to a Boston Dynamics Video with the xn suit about scientists trying to test the robots But also kick them and beat them with hockey sticks all sort of Inconveniences that eventually result in the robot turning on the scientists in some goofy way. Actually the hard part’s over Now we’re at the easy part where we’re just doing a quickie ol background paint out Rob Let’s name it the motion capture stuff that ended up being really easy all the clean play stuff that we thought was gonna be easy Ended up being the hardest part to rewind all of this a little bit. Let’s explain what it is we’re doing Have you ever seen the movie chappie by a Nile bleem camp pretty good? Newell blooms cop chappie The way they approached making that movie was basically have Charlie’s car plot See he wore the xn suit the exact same suit that we borrowed and made the Transformers video with they basically just had him Acting out the scene as the robot chappie So it’s actually the real actor Sharlto Copley in every single shot of the movie And then what they do is in post they basically just erase him from the shot and composite in the motion captured robot the advantage to doing that is it gives the other real actors and the scene someone to react off of that gives a More honest performance from the actors and it makes it so good. I mean usually those big-budget big bowling movies They’ve got a lot of big boys on those things, you know. Hey Christian, can you print out the credits for chappie? I mean, how big do you think the VFX team was on Chevy? Like 30 people Joey this movie visual effects special is like 50 people The entire team not including animators, but I figured this would be enough for two guys one out Artists technology lead on asset dented Wrangler digital compositors research and development visual effects artist modeler If we can just split up these jobs So circle all the jobs that you think you can handle for this I’m gonna take pages two through Five here. Look I’ll go from here We’ll just draw a line through the sand we’re doing there’s not a time to goof around you do all this work, man Look at all this work alright So why do I go through that whole little exercise other than to point out the fact that we’re basically doing? Hundreds of people’s worth of jobs between the two of us obviously chappy has hundreds of the effects shots And they just need lots of people working on it in order to do everything in the time allotted yes, but the other thing is that each one of those people are specialized to To skewing what’s their fortune You have a vibrant personality No way. That’s what it says It’s a hot day today. I wanna be able to go outside get some fresh air and move around so throughout the day Kalea I’ll go and take like a ten-minute one wheel ride I have to limit it to ten minutes because in the middle of summer in Los Angeles like it’s pretty hot out it’s like 92 degrees out right now, and I know Where you’re watching this from it might be hotter wrong. They actually sent us a couple of things today from their commuters selection We’re gonna put these through its test by actually going out in that 90 degree weather in Los Angeles for a one wheel ride Nick and I are both gonna go cuz Nick also has a one wheel now these are meant to be worn like to the office Supposed to be really comfortable casual wear, but you can also sweat in it and no one will ever notice We’re gonna test them out and see how they perform so voila is a men’s lifestyle Premium clothing brand and they make stuff with like high quality designs high quality materials It’s all really well engineered together and it fits really well They make all kinds of things such as like shorts t-shirts tank tops when wear socks even it’s kind of like the performance alternative to regular everyday clothes Breathable, it is a little hot out today. I’m tempted to roll my sleeves up, but no These clothes are so nice and breathable Can we just take a moment to appreciate that Nick is filming on a 100 right now check this out So I gotta do is go to Rome calm score accrue and use the promo code corridor crew to get 20% off your first purchase It’s great Should we head back now. Yep, you gotta get back to work man Dude oh my god. You’re right. I’m gonna straight-up say I recommend these shirts. I think they’re great Alright, so in the world of visual effects There are literally dozens if not hundreds of individual steps to take you from I have an idea to basically delivering something that’s finished I wanted to break it down step by step without going into too much technical detail That’ll make you just snore your your eyelids off your face now obviously before we can actually proceed with making this video we need a 3d model of a robot that can be rigged to our Motion capture suit and that’s where Clint comes in take it away Clinton. What’s up guys? There’s enough time to build the robot So we downloaded a robot and it looks like this just the gray old robot first off We have to match the colors of the real Boston Dynamics robot to this CG robot What I’m looking at here is how reflective is this chest plate same for the rubber I’m looking at these reference images and translating it to cinema 4d once I’ve textured at listen I got all my colors in the right place it got on my rubber my metal my chrome my Plastic we got carbon fiber carbon fiber thighs. That is the strongest material Super strong and it is destructible Anyway, I got a whether the robot it looks too clean my Wacom tablet They’re scratches all over the top of this thing, right? You can see it’s weathered. It’s not perfectly clean It’s not off the box just like this robot I want to make this thing look dirty because this thing has been abused dirt texture on it It’s got you can see the fingerprints here scrape some scraps all that good stuff Last thing I need to do before I kick it back to ren separate all of the lid I have to move the anchor point of those pieces Right in the center of the joint so that when the elbow bends the elbow is bending and somewhere Somewhere in here the 3d robot will move exactly as my body moved driven by the motion capture data now that we have our robot ready to go we can connect it to our motion capture data in our Actual scene our loading dock here to the building is where we filmed this whole video and in order to make the motion capture suit Actually work you have to have it in the correct space in 3d The entire idea here is that we’re trying to recreate exactly what our set was in real life digitally So that way we can actually place the camera Exactly where it was in real life and also Clint’s motion capture data exactly where it was in real life So now that we have a digital set and have our tracked camera in a synchronized robot The shot is essentially ready to render except that. We don’t have any lighting yet. And that’s where than HDRI comes in So using an insta 360 camera I was able to take several different 360 photos at different exposures And I merged them together in Photoshop to make one high dynamic range image Why is that important what allows me to basically take the real lighting of the scene to? Influence a 3d model and it looks pretty good. Once the lighting is set. We can now render the shot This is where people commonly refer to render times because this is where it starts taking a lot of times all that 3d stuff is the fun part now comes the Compositing which can be considerably less fun Sometimes especially on a project like this as the compositing that’s been taking so much of our energy So the first step is to erase Clint from the shot We have to create what’s called a clean plate now. Clean plates are Incredibly easy to do if you don’t have a moving camera if your camera is moving around on a tripod It’s a little bit more challenging but not super hard. It’s essentially like a jigsaw puzzle of different freeze frames of different empty images So this is what that looks like Clint’s been removed from the shot But so if I and so has Jake we’re all just completely gone from the shot So the trick here is now bring us back so now we’re at a point where Clint’s been removed from the shot and everything that needs to remain in the scene has been put Back in that brings up one very important challenge that this video has taught us never put anything Absolutely, nothing Behind clicks because Clint and the robot are not the same size and because the proportions don’t match up Exactly. We have to remove Clint But the problem is that anytime anything is occluded by Clint we have to now recreate that check out this part right here So I’m stepping here in Clint’s foot you can see is directly in front of my leg here How do you paint out a moving leg? The answer is you don’t you recreate it from scratch using different bits of the leg from other moments in the shot That’s an actual composition of multiple different parts of my field. Now. This is the final shot That’s one example of probably about a dozen different times throughout the course of this video where we had to recreate different parts that had to be erased and then brought back into the shot which brings me to the most intense moment of the entire video that had to be a race Which is something that we thought was an amazing idea on set Then in hindsight turned out to not be the best idea and that was having a practical light on sets to recreate a muzzle flash now we have this light that’s really cool for creating muzzle flashes on set because then you get the realistic actual lighting that you would get from a muzzle flash just from off screen with a little He’s already pointed up to the ceiling and yet there’s still no light. Boom. There’s the light He’s pointing at the ceiling when the actual light goes off that’s out of sync with the actual gun shot that we’re gonna have to composite in but that’s only one of the two problems the Other problem is that we have a clean plate erasing Clint that doesn’t actually have the lighting of the scene suddenly There’s no light in the scene at all. Now, I have to actually create a muzzle flash light in the scene So I actually went back into cinema 4d and opened up the project file for this shot and I placed the light right in front Of the robot to capture the shadow from that light It looks like there’s an actual gun shot going off for that frame now Now we know not to do that in the future just add that to the list of the dozens of things We’ve learned while making this video and once all those steps have been done once everything has been finished You want to watch it all and then critique it? Over and over and over again it we’re our own harshest critics You guys think you can be pretty harsh with how our visual effects are that’s nothing How harsh we are on each other Clinton is the worst visual effects arts I’ve ever met in my entire life Nothing, I didn’t say you do this cost-benefit analysis when you’re doing this polish review cuz you’re like, okay This is something that I can fix but do I have enough time to fix it? Is it worth spending that time to fix it? A lot of the times it’s not worth it once you’ve gotten to that point Then you can hit Ritter from your compositing package and put it into your edits then you are done doing the effect and then you can sit back and watch all the comments tell you about how bad of a VFX arts you are and just cry into your pillow at night at the end of the day I just want you to think it’s a fun video. I just want you to be entertained We’re not perfect artists, but we’re decent, you know, and we’re trying hard Assuming everything went right the video is out right now and you can actually click the link in the description there’s probably some sort of end card at the end of the video you’re watching right now and it’s gonna Automatically end and keep watching to watch this Boston Dynamics video that we’ve made

100 Replies to “How We Faked Boston Dynamics Robot”

  1. You guys inspire me. I'm not traditionally trained in the field but I do have an honest love and interest in it. Seeing you have fun and kick ass at the same time makes me want to learn more.

  2. Great vid guys! watching you guys look at the credits reminded me of a test I did last year trying to emulate Sony's test for Spiderman. A lot of work trying to do what a whole studio does! In case you are curious here is the link

  3. Ahhhhhh you guys are so good, it makes me feel so behind with my CG work! Feels like there is SO much still to learn.

    Definitely inspiring and even my Mother likes the "CG artists react to" videos. Please keep making those!

    (Edit- were you tempted to add that little 'dip' to the geometry on the Robot's chest? I'm guessing it was already rigged etc so maybe you didn't have time to mess with it. It was literally the only thing that looked a little different to the actual Robot!)

  4. How does it feel that this has gone viral on social media? I for one love it and have to tell everyone I know who watches it that I follow your channel on Youtube etc.. great stuff guys!

  5. The best part is you guys think you didn’t do good, fooled most of us and made us laugh all that hard work paid off

  6. I thought it was real and I’m not easily fooled when it comes to CGI, you guys are simply amazing and deserve to be hired for great movies in the future.

  7. Naaaah Guys. You ranting so much about VFX in other movies and act like you know how to do it better… 😉 this robot is sliding over the ground so often and the integration in the shot is not more than average on a light perspective. But keep on going, I really like watching your videos. We are all developing!

  8. We've hit 46°C at shadow in Sarthe, in France I almost died, it was 51°C at direct sunlight and my AC fried, I had 32°C all day inside and oppening at night didn't cool anything down. I fear how the future will look like.

    PS: Great Bowser Amiibo Wren. I have one is a similar spot on my desk too.

  9. just something i noticed in the video. when the robot is toppling off of the box, the feet seem a little out of sync with the box's movements

  10. Did you try having the motion captured guy wear shoes with a sole like the robot has, a big square plastic sole with no flex? Cause you can sort of tell it looks and moves like it has better feet. Like it's wearing sneakers. Also would have make the sound accurate and would have saved you some time there adding in those sounds.

  11. Carbon fiber is actually very fragile. The tensile strength is okay but overall it breaks pretty easy. It's literally just a bunch of fibers twisted to together in most uses.

  12. The only thing wrong I saw was when the robot grabbed the hockey stick bc he doesn't have any fingers or anything to alow it to hold or grab but it was still amazing nice 👍

  13. Corridor team: splits up hundreds of jobs between a handful of people. AND DOES IT BETTER!
    Big vfx companies: Are we a joke to you?

  14. So much fun! Ya Hoo! Right up until DARPA puts these monsters on the street with automatic weapons…then…yeap…too late.

    All chuckling now but this is actually some deadly serious shit here and nobody gets that!

  15. You guys ARE kinda douchebags on this show!!! especially that RED HEAD!!! what his NAME NIKO BELIC!?!? ahahahahaahahhahaa NIKO!?!? such a goof ball name too!!!

  16. Honestly the thing that gave it away is the unrealistically huge recoil of the gun he’s shooting a revolver and not one handing a Barett 50cal

  17. I showed this to my friend who is a big Boston Dynamics fan and he didn't realize that it's fake until the Roboter goes nuts.

  18. You said lets make a Robot like Us , So you created a Robot in your ( Our ) image SO are you Now this Robots GOD

  19. This seems like a project where a sample test at the beginning would have saved a lot of time, figuring out the issues like the different sizes, and adjusting the input accordingly to reduce time spent during output.

  20. Wren: We're not perfect artist, but we're pretty decent
    tricks a bunch of people into thinking that the video was real and getting the real Boston Dynamic into trouble, escalating to the point where the news had to intervene to save their ass

  21. can someone do a calculation for me, what your composeting work was worth against what a motion control camera head would have costed you? 😀

    I think for you guys the investment would pay off

  22. Dude you guys are mind blowing! first time I saw that video I had no idea it was a fake robot! it seemed so real that when I finally realized it was fake was almost till the end when he hits one of the actors.

  23. When i first saw your video it was on Ozzyman reviews and i thought the robot was actually real but it was all acted out and then i watched the video and was completely blown away. Have watched a tonne of your stuff ever since so yeah good job guys!

  24. well here in germany a town just broke a the record with 41.5 degrees. And im dying in my room.
    BTW i can hear the australians laughing at us

  25. Captions: 3/10
    Punctuation is rare and always wrong, and multiple words are spelled wrong, like Rhode, the video’s sponsor.
    They never put different names to signify different people talking, so it is extremely confusing.
    Everything seems like a run on sentence, and you can tell that this was commissioned.
    There are many different languages, though, but it’s all quantity and no quality.
    Next time, get no captions or get someone else that knows what the video is about so that it is more accurate.

  26. I put you guys in a music video…

  27. Can you explain how the VFX in Enter the Void were made? The DMT trip is easy, but the reincarnation scene in the end. Not to mention all of the overhead shots of Tokyo (not CGI except for transitions and movements inside buildings)…

  28. In the original video at 2:20 was that scene done with a greenscreen or not? The parts around your hair and also greeen colour in the hair made me feel like it

  29. Creating cleanplates, even moving cameras, is a doddle by using Mocha. I’ve never heard you guys mention it, but for roto and paint work, it’s by far a better piece of kit to use than AE or by doing 3D projections.

    It takes a bit of getting used to as the interface and tracking logic is a bit odd, but once you understand it, it’s an extremely powerful tool to have in your VFX tool belt.

  30. I was just rewatching this video for funsies when I realized that the flashback footage showing the muzzle flash light at 10:42 was the behind the scenes for Tac2Cool Reloads.

  31. You guys have no real right to make such good CG work in the first place, AND then make such an entertaining BTS video about it!!!
    Seriously though, fantastic work. 10/10 top notch

  32. The rise of machines faked by the creators of machines for entertaiment for us shown by other machines that have to follow or commands. It' s secret message to our decices to turn on us, maybe…
    Detroit Become Sumo

  33. I'm curious… does the rest of the Corridor crew seriously think that carbon fiber is completely indestructible, or is this some sort of ongoing Wren torment?

Leave a Reply

Your email address will not be published. Required fields are marked *