Thursday 2 August 2012

009 - Working Title

I believe a good title is important. It's usually the first point of contact/entry for creative projects.

I knew I had to find a suitable title for this project. A title that would encapsulate the whole spectrum and scope of the project. I did some brainstorming exercises trying to come up with a suitable name, making numerous lists. In the end the title found me when I wasn't looking for it (as is so often the case).

Miasma.

I stumbled upon this word one day a few months ago whilst playing the video game Dark Souls on my PlayStation 3. A character mentioned the phrase, "A miasma of death and disease" during an opening cinematic cut-scene. I liked how the word sounded (plus it's morose connotations) so in my usual curious way I decided to research the word's meaning and history. I found the below quote from Wikipedia.

Miasma - 'In Greek mythology, a miasma is a contagious power that has an independent life of its own. Until purged by the sacrificial death of the wrongdoer, society would be chronically infected by catastrophe.'

This instantly it sent my imagination into overdrive. What could cause the Miasma? What could it represent? How could it be defeated? All these questions flowed through my mind during the initial idea and writing process. I realised I could fit my existing ideas into this title whilst developing the concept even further. The title informed the story as much as the story informed the title.


I designed a haphazard, hand-written style logo then made a few test screens (placing the logo on top of various photographs and backdrops) to see how the title could look in a visual sense at the start of the short film. I wanted to test it's impact and tone, set in the realistic space and ratio of the screen.

Initially I was not so impressed with how it looked on-screen but it has grown on me considerably since I first researched it months ago. I can't imagine calling this project by any other name.

008 - Motion Capture Software

We just recently got two copies of Qualisys Track Manager installed in our lab to process the 3D motion capture data we recorded. I've spent some time reviewing what we did and learning how to get the best output possible.

Me doing some contemporary dance movements
At first I though this was going to be a complicated process, but it's more fidgety and time-consuming than difficult. Every dot on my body that I wore during the motion capture recording is represented by a green or red dot in the program's view screen. Green dots are good because it means the software has automatically synced-up the correct positions. However if a red dot appears it means that dot has to be manually reassigned to it's proper body part.

Generating an 'AIM Model' can help in this process. Firstly you take a short piece of recorded footage from your data and correctly assign all the dot placements manually. Then you can export the model as an 'Aim Model' to apply to other raw capture data. The software uses the information saved in the Aim Model to automatically calculate and assign dot positions. It's not a perfect system as some dots lose their connections during complicated movements like turns and spins. However it does provide a good starting point to then get in there manually and fill in the blanks.


I personally like the feature of being able to add line streaks before or after the characters movement. It allows you to gauge the smoothness of limb movements and the quality of the capture. Jagged streaks would need some manual correction later on to smooth the end result.

The next stage will be taking this data into Autodesk Motion Builder and prepare it for connection to the 3ds Max character model.

Friday 20 July 2012

007 - Aspect Ratio

I spent a long time at the beginning of this project trying to decide upon what aspect ration to output the final video. There are numerous standards to choose from. (16:9) would be the smart choice here so as to conform with most modern television sets and PC monitors.

However after researching some feature length and short films I began to appreciate a more extreme widescreen format. I find the super widescreen experience you get at the cinema to be far more theatrical and exciting. From an artistic point of view I think there are opportunities for more dramatic close-ups and creative compositions.

The aspect ratio standards for general theatrical releases is (2.39:1), more than double in length than the height of the screen. Blu-ray disk release standards are very similar at (2.40:1), at a full HD resolution of 1920x800.

One thing I've had to be constantly aware of in this project is timescales. More specifically, animation render times. Careful management of the screen output size could alleviate severe render times. So in order to make a more informed decision about screen aspect ration and potential speed of frame outputs I though I'd work out how many pixels each option contains. Here were the results in order of total pixels:

16:9 1920x1080p Full HD = 2,073,600 pixels
2.40:1 1920x800p Full HD = 1,536,000 pixels
16:9 1280x720p HD = 921,600 pixels
2.40:1 1280x533p HD = 682,240 pixels

Diagram I did to investigate the differences in size between formats
You could argue that there is an advantage to using the 2:40 ratio as less pixels will be involved in the rendering process.

Example of how the final video will look proportion-wise
So the final output I've decided on will actually conform to the 16:9 ratio but will be letter-boxed to suit the 'Panavision' format. This should aid in ease of playback with most screen sizes, formats and internet video hosting sites.

Wednesday 18 July 2012

006 - Stereoscopic 3D

A significant part of this project is focused on the use of stereoscopic 3D in film, and more recently, video games. It's the same effect you see at the cinema when you don the 3D glasses.


At the inception of this project I'll admit I didn't know much at all about how 3D works in this way. It had always intrigued me, so I leapt at the chance to investigate it depth for this project.

I realised that in order for this effect to work there must be two completely separate views of the same scene/area. Each of these views represents the difference in space between the right and the left eye. Just like in real life when you focus on something in the foreground the background not only blurs out of focus but is also split in two horizontally. The same thing happens to a foreground object when focusing on the background except the horizontal split happens in the opposite direction.

This effect can then be harnessed by 3D technology to mimic the eye's natural methods. By setting up two cameras the right distance apart in a 3D modeling package like 3ds Max 2012 you can then composite the two views and create the illusion of depth. It tricks the eyes by forcing them to apply the rules of three-dimensional vision to a 2D flat surface.

First test with 2 Iphone photographs

I tried some initial experiments with this using several 3D characters I modeled. They all sit at different points on a flat surface, some closer to the camera, all of them a different size. The goal of the experiment was to see if the viewer could identify what characters were closer and what ones were in the distance. The effect works very well here with everyone I tested being able to correctly read the '3D' space.



I am hoping to do one scene or all of my final animation in stereoscopic 3D to further to further dramatise the on screen events and to push my own knowledge of using 3D systems.

(I suspect 3D will be a passing phase in general society, impressive as it is. It's a very clever gimmick, one that has been polished considerably in recent years. 3D TV sets have came right down in price yet they're still not a popular choice with today's consumers. I think this may be because people don't like wearing special glasses to watch television. I think it's the only barrier holding the technology back right now.)

005 - The Writing Process

I really wanted this project to have a solid foundation. A central idea or concept that would underpin all subsequent decisions and design choices. It should be a cohesive and 'complete' piece of work.



I therefore sought to write a screenplay-style script as though I was writing a piece for film. My thinking was that if I'm going to be creating a short film animation then I may as well get involved in the whole process from start to finish. To be the 3D Modeler, Animator, Director, Producer, Mo-Cap Choreographer etc. but also the Writer.

So I spent some time researching the conventions of writing for film. Reading over numerous guides, looking into character and plot development. I read some full-length film scripts (including one from my favorite film, Quentin Tarentino's Kill Bill Vol.1) to try and learn this whole new style of writing for the screen.

It really is a different style of writing. I'm used to creative writing in the form of essays and short stories. Even academic writing. But writing for the screen is a different beast entirely. You literally write what you want the view to see on the screen, at any given moment, no more, no less. At first I found it strange but then found it unusually liberating. It forced me to think about my project in different way. You can't write how a character feels, for example, but you can allude to how they feel by changing what we see on screen. It's that good advice 'Show, Don't Tell', but in a more literal sense. It also leaves the final work more open to interpretation.

I know my final written output from this exercise was only three pages long and definitely wont be winning any Oscars but the process itself brought out so many ideas.

The resulting script was then used to directly inform the story boarding part of this project. Some ideas have changed or had to be cut from the original scripting phase which I'm fine with. A project like this naturally evolves over time.

To be honest I probably spent far too much time on the writing. Having said that I know that there are ideas existing in this project that would not exist if it were not for me going through this deep and rigorous process. I'm glad I did it and would stress the importance of spending time with words.

Tuesday 17 July 2012

004 - Puddle Test

This was a test I conducted where the aim was trying to recreate a realistic ground surface with a puddle. It's a small scene taken directly from my storyboard where a pair of sneakers walks past our view over a puddle. I wanted to include this scene to further emphasize the gritty/rugged feeling of the street. You see the sneakers treading the ground, they're so close-up you could almost feel the grit under your own feet. It also acts as a teasing introduction to the main protagonist as you don't see him in his entirety until later in the film.

End result of puddle test
I began with numerous tests into how normal maps could be generated, especially in relation to the reflection values of materials. This I thought could be advantageous over actually 3D-modeling the ripples of a puddle (which could negatively impact polygon counts and render times). If I could also isolate the area of influence a normal map had on the puddle then I could perhaps control a ripple effect with an animated normal mapped material (looped). This was the theory anyway.


I started 'baking' the normal map data from high-poly ripple models in 3ds Max 2012. This then gave me a flat square output that I could then apply to a flat planar surface. I used Photoshop CS5 to cut a puddle shape and then mixed in a normal-mapped stone ground texture I created using Crazy Bump software. This layered with the diffuse material provided a rather satisfactory result.


However I thought it still looked quite fake. It didn't look 'wet'. I was after a more tactile feeling from this scene. Something more photo-realistic. I then looked at some more reference pictures and noticed the image was missing that slight rim of of dampness that puddles often have. Not shiny wet but very damp and dark-looking. I then added this rim to the diffuse material and really liked the effect from it.

The end result shown above is created with just one polygon. I wanted to see how far one polygon could be pushed in this test. So something that could potentially have been created with thousands of polygons can be created with just one (by using materials in a different way).



This effect was then animated over ten frames and looped to create the light rain drops in this animation.

I still think I could add more to this scene to make the rain drops more convincing. Perhaps altering the ripples and adding some 'splash back' for each drop of rain.

003 - Capturing Motion

As I suspected would happen, a significant amount of time has passed since my last update. This however doesn't mean that the project has not progressed. Quite the opposite! Things have moved on, grown, evolved and come-into-being etc. So let's not dwell on my time absent from this blog and let's focus on the task at hand and (more importantly) what has been happening in the last month or two.


Today was 'motion capture' day. I got covered in 35 white reflective balls (markers) and acted out a segment of the short film. 16 motion-sensing cameras recorded my movements, calculating them on-screen into a 3D representation of my body. We used the Qualisys Motion Capture System, a very sophisticated piece of kit used mostly for medical applications at the University. The system costs around £100,000.

Three of us were using this kit today. Myself and colleagues Kevin Smith and Sarah Martin took turns operating the software and performing the motion capture. Lecturer Stevie Anderson was also there to lend us a hand. The lab itself belongs to a lecturer named Danny. He was a great help to us today and walked us through the calibration and setup processes.

I wanted to perform my character's interpretive dance piece. I have always had an interest in dance and in my spare time I do Ballet and Street Dance classes. I thought I'd be able to use some of those skills for the short film. Part of me also really wanted to generally experience being the subject for motion capture.


One draw-back that concerned me about today was the fact that we were limited to a height restriction in the space. I couldn't raise my hands above my head or jump whilst performing. I felt very limited in my range of movement which isn't ideal for an expressive piece of dance. This was due to where the cameras were positioned. I feel this could have been rectified by moving most of the cameras further away to the sides of the room but Danny seemed reluctant to stray from their current setup (perhaps due to the fact that the current setup is designed for foot movement, an area this department focuses on). However we made the best of what we had.

So all the movement data has been captured but the files are still not ready for use with character animation. The data we sampled (in .qtm format)  is still not 'clean' as some of the marker positions have broken off from their assigned body part names. Tomorrow I'll go through all the files and reassign any broken positions and hopefully have a data-set that is ready for conversion to C3D, a format compatible with Autodesk Motion Builder.

Even then the work is not complete as I still have to attach the motion data to the actual character via a CAT (Character Animation Toolkit) Rig. So much to do!

Wednesday 2 May 2012

002 - Back at Uni

Went back to University today after a week off. Was good to see some other people in starting their projects. It feels like we've been off for a month.

It was another day of research, watching as many shorts as possible whilst jotting down notes and ideas. What I think works and what does not. I believe I'm coming to the realisation that I want a singular character to be central to the project. I'm attracted to the idea of using a character to create a strong relationship between the viewer and what's happening on screen.

I watched (for probably the 50th time) one of my favourite short-animations, 'Kara' by game developers Quantic Dream. It was only released a month or so ago but it really affected me. It's the story of a humanoid robot that fights for it's chance at life when it seems to show some defects.



I was left totally moved by both the accurately motion-captured performance of the robot and by the writing in general. Plus the fact that the whole film was made using live PlayStation 3 footage and not a single frame of pre-rendered CG. Advances in motion-capture technology have also clearly had a large impact on this project. The female robot is so life-like in it's movements and can covey so much with the slightest of body movements and gestures. I can't wait to see what Quantic Dream comes up with for their next big release.


This piece of work is exactly what I'd like to be producing. Something adult, that affects people and encourages discussion, that warrants several viewings and has a strong point of view. I understand that teams of people create these kind of animations, as evidenced once you arrive at the end credits. However that doesn't mean I shouldn't strive for the same level of quality or style.

I went to The Art Store on the way home to invest in a new sketchbook for the project. A3 sized. There's nothing quite like the feeling of opening up a blank sketchbook for the first time to make your first mark. It's daunting in many ways, I always feel I have to create something amazing on the first page so the rest of the content will follow suit. However it's also exciting to see so many blank pages of potential lying in wait.

Tuesday 1 May 2012

001 - Starting The Journey

It's May the 1st 2012. What better day to begin a four month masters project in the realms of 3D Design for Virtual Environments?

I allowed myself one week off after we all handed in our last coursework. To be honest I've found it hard to relax and wind-down without thinking what project/s I could be working on next.

I intend to keep track and log the progress of this project via this blog. Whether that takes the form of the written word, video posts, images or interviews etc I'm not sure yet. However at the end of this journey I want to be able to look back and see how it was shaped, how it all came together.

I only get to do this once, so I want to do it justice.

Today has been spent watching a plethora of animated shorts and short films. Purely to fire me up and provide some inspiration. I found the recent Oscar winner for 'Best Animated Short', entitled 'The Fantastic Flying Books of Mr. Morris Lessmore'.



It was simply amazing. Without going into too much detail I loved how it delicately balanced humour and tragedy plus the ending tied the whole piece together fantastically well. Totally deserving of the award.

I'm also doing some research into writing for short films and trying to brainstorm some ideas for the final project. I think one of the first challenges will be to write a complete script with scene breakdowns. I've found some really helpful advice online, currently I'm reading 'Script writing for short films: A Practical Guide In 8 Steps' by Stuart Hepburn. 'The Writer's Block' has always come in handy too for generating ideas.


I don't know if I'll post on this blog everyday, but I'd like to keep it as updated as humanly possible. Also not sure whether I should publish the posts as I go or keep them private then release them as a whole finished piece of work.