Click here to view the embedded video.

Although only containing a handful of updates from their 2010 version, this video shows that they owned pretty much every CG Trailer you got excited about in the last few years.

Click here to view the embedded video.

Click here to view the embedded video.

Click here to view the embedded video.

Shot Breakdown

Below is a breakdown of what I was responsible for in each scene. The terms used are as follows:

Animatic

Initial layout of the scene, covering loose camerawork and editing as well as rough posing on the characters to be used as reference for the mocap shoot.

Mocap

Once mocap is received, laying it down and re-editing the timing and cinematography to match, including an initial pass on facial. Often a lot of artistic changes are made at this stage so this forms the bulk of the work.

Polish

The final stage where the VO, facial and all the details such as fingers and contact points are finalised.

Click here to view the embedded video.

While the visual benefits are obvious, I can’t help but wonder just how much it cost the production for so many actor contracts when not only voices but likenesses are required. Additionally, the production task must be one of the hardest parts of the game, considering that at the time of writing they’re still hiring senior roles for the cinematics team around 6 months before the planned release date.

That said, I’ve really been keeping an eye on this since E3 so can’t wait for spring to roll around, plus I’m a Noir nut since a Humphrey Bogart stint last summer.

Read more about the MotionScan tech and process here.

UPDATE: They’re not still hiring as the front-page job posting on their site is dated 2008. Makes me feel better about the frequency of my own posts.

When we initially showed Mass Effect at E3 2006 I recall a handful of Square developers attending to evaluate the facial animation. While it looks like their production methods are somewhat dated due to the long development cycle, playing FFXIII shows the eventual result to be outstanding – presumably due to their dedicated engine for facial closeups and meticulous planning.

The google translation for the piece is especially bad, but so far I can gather:

Like Square Enix studio-offshoot Feelplus, cutscenes are divided into 4 categories depending on importance. A & B level cutscenes employ full keyframed facial animation (with lip-sync done individually for both Japanese and English versions). C & D level cutscenes just use procedurally-generated facial and lip-sync animation.

Similarly, the cutscene team is divided into four distinct teams that handle each progressive stage of creating a full cutscene. They are:

Motion Capture Group: Shooting and cleaning up motion-capture data.

Body Motion Team: Creature keyframe animation, and human motions that cannot be captured.

Facial Group: Facial acting and lip-sync.

Simulation Team: Hair and cloth simulations.

Cutscene shoots are meticulously planned ahead of time. Beyond storyboards, clean layout boards that contain descriptions of the actors, props and set layouts required for each scene are created.

Temporary voice-over was used on the set with full ADR done later. Interestingly, it appears that animatics were projected on the walls during the shoots to give the actors a better sense of their virtual counterparts and surroundings.

Within Motionbuilder, additional tools were created to easily allow editing and exporting of complex scenes via a check-box matrix of assets vs shots, seen at the lower-right of the image below – something I’ve had in mind for some time as the best solution for working on scenes that require a lengthy full export only very occasionally.

Character-wise, the highest resolution characters (Lightning and Snow) consist of up to 223 bones, covering the basic skeleton, auxiliary (corrective and simulation), facial and hair bones.

The keyframed facial animation was done via a traditional slider setup. The image below shows the numerous attributes, which must have become quite unwieldy and therefore given rise to the need for a dedicated team to specialise in this area.

For simulations, the wind level is initially set for each scene to provide the requisite amount of movement in the simulated assets.

Around 20 bones are used for hair, employing a spring system that dampens as a character’s inertia increases to prevent crashing with the head.

Some technical insights towards the end, but most interesting of all is the emphasis placed on the human side of the shoot, something that comes through in the finished work. Regarding casting:

“Well, we start with the obvious things – e.g. talent, distinctive voice, whether an actor is appropriate for the role, etcetera. But since we’re looking for people who will be doing both the mocap acting and the voice, we also watch how the candidates physicalize their performance. It’s also important to see how they deal with adjustments and to see if they take direction well. For the top candidates, we’ll actually bring them back for a second audition and have them perform a scene with Nolan (North, who plays Drake) to make sure they have good chemistry.”

First, a little bit of background about where I’m coming from. I’ve been working on games now for nearly a decade in a variety of both in-game and cinematic roles, with the in-game side mostly focussing on player control, cameras and animation-system design relating to gameplay, whereas the cinematic part is about pure art and storytelling, getting information across to the player in as efficient a manner as possible.

At the time of the presentation, our team was wrapping up the final stages of production on cutscenes for Mass Effect 2 and here’s an image of the wall behind my desk.

This was a deliberately blurred picture (so as to not give away any spoilers) of our workload as it stood, with only the last few bugs remaining and each of those lines there representing anywhere between 1 and 7 individual cutscenes, many of which we now know post-release were well-received cinematic experiences. However, with such a heavy history of in-game animation design, I feel that with games like ours and the recently released Uncharted 2 among others, we’re coming to the limits of where we can go with pure cutscenes in our games.

Uncharted succeeded with its seamless transitions into and out of cutscenes, as well as the sheer high quality of the characters and acting, and ours with the logic behind them that decides which sequences (and how) to play depending on choices. As animators, we didn’t know whether your player-character was male or female, what their face looked like, or who you’d brought along with you on your team, not to mention the myriad choices that you can make throughout the game that will determine the outcome of particularly climactic scenes. After this point I can see cutscenes only limiting our progress in terms of developing storytelling in games, so I’m interested in exploring alternative methods that will allow us to truly develop stories for our medium rather than continually within the pre-established constraints of film – which are essentially where cutscenes lie.

The Problems With Cutscenes

When researching this topic, I began by initially trying to define exactly what a “cutscene” is. I’m sure when we’re all watching one we can tell that it’s a cutscene, but we have had so many variations of them over the years that it’s difficult to define them in a pure sense. The first and most natural idea that springs to mind tends to be “whenever the camera cuts”, but this is not the case as we often have no cuts, particularly during “designer cutscenes” whereby the camera simply transitions to a location to show the relationship between the player and the subject.

Next is to assume that player control is removed entirely, but as we’ll see later there have been many attempts to include some level of interactivity during cutscenes that doesn’t detract from them being cutscenes. The creation method is irrelevant – we have different terms in the industry such as Cinematic Cutscenes, Designer Cutscenes, Ingame and Pre-rendered, but in the end what really matters is how the player perceives the result, of which length is a sizeable factor.

Below is a great example of a cinematic sequence from Resident Evil 4 that follows all the “rules” of what we typically consider to be a cutscene, but because of its short duration the player doesn’t consider this a cutscene, and instead just another cinematic moment that contributes to the overall feeling of the game being a cinematic experience.

Click here to view the embedded video.

Defining The Problem

As such, a better approach is rather than to define what a cutscene is, instead to define the problem, so hopefully we can concentrate on simply attempting to overcome the issue rather than arbitrarily abolishing cutscenes themselves which has been done in the past to greater and lesser degrees of success.

Control and choice is restricted, if not removed entirely.

One second the player is running around, making choices and personally involved in many aspects of how the story or adventure is progressing, then the next they are force-fed exactly what we as developers want them to see and experience. This is fundamentally against the nature of our medium, and greatly restricts their experience for the duration of the cutscene back to the levels of the older medium of film.

Cutscenes make a clear division between the gameplay and the story.

The visual difference between cameras (and often character fidelity) in gameplay and those for cinematic cutscenes negatively reinforces the fact that most of gameplay involves little to no story progression at all.

Cutscenes are opt-out.

Once a cutscene is triggered, often without the player’s consent or choosing, his or her only option is to exit the cutscene. This brings with it issues of missing important information after the point of exit, and more importantly highlights the fact that we have a major problem here. If we have a design element in our medium that consistently requires we add the option to skip it entirely, then surely there is something fundamentally flawed with some aspect of that element?

This brings me to the definition that cutscenes are essentially “Imposed Cinematography”, whereby we as developers wish to impose narrative or progression information required to continue, or to ensure that the player experiences a part of the game exactly as we wish them to. This is the heart of the conflict between developer and player where, unlike other older mediums, we perform best when we play to our strengths and require participation from the player rather than purely imposing our creative will upon them.

Montreal International Game Summit 09 – Blogcritics Interview

It covers a few points I missed out of the talk and some thoughts on ME2′s romance custscenes. Having a long enough break from the project I’m now playing through the game with fresh eyes, and seeing everything in context I’m most happy with the Thane romance but can only see the green guy on Youtube as I’m not playing female.

Click here to view the embedded video.

Click here to view the embedded video.

This is the launch trailer, and I count some 75% of the shots here were done by the Montreal Cinematics team. So far the reviews have been overwhelmingly positive, but I still nervously await the ultimate litmus test – the ever-critical girlfriend…