Customer Reviews

Real Sound Synthesis for Interactive Applications

5 star:		(5)
4 star:		(2)
3 star:		(0)
2 star:		(0)
1 star:		(0)

 

 

Are you a pretty good C++ programmer? Have you ever wanted to have your computer output sounds like footsteps or musical instruments that (a) sound real and (b) are continuously responsive to the user's control? Did you discover that it was basically impossible to do it by stitching together prerecorded samples, and you couldn't think of any other way to do it?

If so, Perry Cook has written just the book you have been looking for. In 250 pages, Cook explains everything, from the basics of digital filtering to the major alternatives for generating sounds: additive and subtractive synthesis, FM synthesis, and -- the real focus of the book -- physical modeling. Not only that, the accompanying CD-ROM includes lots of sound examples and the Synthesis ToolKit -- a pretty much platform-independent set of C++ classes and algorithms for writing your own code.

Not everything is perfect. Just as the first version of any program contains some bugs, the first printing of any book that uses mathematics contains some errors. In particular, typos in Appendix A could be very frustrating if this is your first exposure to Fourier analysis. (You might want to check Cook's web site for a promised list of errata and code updates.) And don't let the fact that the book is short, attractively produced, very well organized, unusually clear, and entertainingly written lead you to believe that you can master it in a weekend. Although Cook tries his best to make the underlying mathematics unintimidating, there is no getting around the fact that there are some rather deep concepts from wave physics and signals-and-systems theory behind what he has to say.

The good news is that the effort is richly repaid. Not only will you be able to write programs that can generate controllable sounds in real time, but you will develop insight into how physical instruments produce their distinctive sounds, and you will understand the basics of both the standard and the most advanced techniques that have been developed to model them. Highly recommended.

"Real Sound Synthesis for Interactive Applications" by Perry R. Cook describes elementary and advanced techniques to simulate the audio components of dynamic systems using physics. While the book is not specifically directed toward game development, the application to game development is clear. The book's organization of the major themes covered is easily to follow through three sections that detail digital audio, sound modeling, and simulation of real world instruments. The book spans sixteen chapters and appendices totaling 248 pages.

The first section (chapters 1-3) defines digital audio, compression, wave synthesis, and simple filtering techniques. The chapters form the foundation for the later sections and define the common asset formats and techniques currently used in games. Cook emphases that key components of sound manipulation are the sampling rate and quantization of the source audio. The text demonstrates how sounds with higher sampling rates allow for greater manipulation with fewer artifacts but incur a greater computational cost.

The second section (chapters 4-8) introduces sound modeling through simplified physical systems, such as an ideal spring, and Fourier series equations. While an understanding of college physics and calculus is helpful (especially if you'd like to code these methods), the book doesn't require it or bog down in theory or mathematical proofs. (For those interested in the details, they are provided in the appendices). The concepts described in this section are critical in creating computer sound models that represent real world objects.

The last section (chapters 7-16) provides physics equations that allow for the simulation of real world instruments (string instruments, tubes, and multi-dimensional objects). Each chapter describes a different system based on Fourier construction, filtering, and physics-based equations. It's the heart of the book and most interesting. The background in the two previous sections is essential to fully grasp the concepts Cook defines here.

Throughout each chapter, Cook couples clear concise writing with a touch of humor and illustrative diagrams. Cook provides a good initial foundation as the topics covered gradually build in complexity. The clean organizational layout made it easy for me to refer back to previous sections when I felt the need. In many cases, however, I found the writing to be a little too condensed and wished for a paragraph describing a concept rather than the sentence provided. Cook does supply references at the end of each chapter for those readers seeking additional detail.

The book also includes a CD containing audio samples of the topics discussed throughout the book. While reading the book, it was useful to be able to hear the point or technique made in the text. The CD also contains Cook's sound synthesis toolkit and several examples of instruments highlighted in the last section.

Unfortunately in current development, real-time sound synthesis in games has a limited place. Due to the complex calculations of Fourier series, fast digital signal processor chips are required to simulate the audio effects without impacting the rest of the game. Minimally, filters and other simple routines outlined in the book can be written for target hardware to accomplish specialized effects but this is nothing radically new.

However, Cook's research in simulating audio is extremely exciting. During the calculation of an object's dynamic behavior (such as collision response, striking, falling, moving, etc.) a minimal additional amount of time can be spent to determine the audio effects. According to Cook's findings, this amount is generally less than 5% of the total time required to simulate an object's physical behavior. Admittedly, these calculations are on the order of minutes versus milliseconds but eventually Moore's Law will catch up and simplifications will allow unparalleled audio effects in conjunction with physical simulation.

Developers and sound designers interested in the math and physics of creating real-time sounds should pick up this book. Those interested in a fascinating look at the mechanisms of dynamically producing sound might also want to give it a read provided it's with the understanding that the direct applicability to games is at least few years away.

This book is useful, enlightening, and fun. It covers many cutting-edge topics in lucid fashion, topics that can only be found otherwise in academic journals. The computer code (in the book and on the CD-ROM) is an invaluable resource for the ambitious reader, who can actually try out or modify the techniques. The CD-ROM also provides examples of these new techniques in action. Finally, the author's sense of humor comes through often (this is not a stiff, boring book!).

As a "digital-sound-artist" and someone who teaches this stuff at the university level, I highly recommend this book not only to those who want to learn about the most recent work going on in sound synthesis, but to those who want another perspective on more familiar topics (like the basics of PCM, fourier analysis, basic digital filtering, etc....).

This is not a book that introduces and uses signal processing concepts for the sake of itself. Instead, the goal of the book is to create sounds, learn the tools and theory behind creating such sounds, and grasp the essentials of many sophisticated physical modeling concepts in particular. The book is quite thin, but don't let this fool you. The author chose to leave out quite a few details so that this did not turn into another 1000 page treatise on computer music. Thus some basic topics in signals, systems, and filter design are not fleshed out to their fullest extent. To this end, the book has an extensive reference section so that if you are unfamiliar with a particular physics or DSP topic, you can research it yourself.

Chapter 1 briefly establishing the fundamentals of digital audio, and includes an introduction to the basics of quantization, compression, and Pulse-Code Modulation (PCM) sampling. Chapter 2 investigates sound synthesis starting with wavetable synthesis. In chapter 3, digital filters are introduced. Included is a concise but clear introduction to Linear Time Invariant (LTI) systems, convolution, Finite Impulse Response (FIR) filters, Infinite Impulse Response (IIR) filters, and Z transforms. The chapter culminates in an introduction to the BiQuad filter.

Chapter 4, which deals with modal synthesis, acts as a stepping-stone to the frequency domain, leading to chapter 5's discussion of the Fourier Transform. This chapter examines Discrete Fourier Transform (DFT), fast convolution, and Short Time Fourier Transform (STFT), and ends with examples of applications.

Chapters 6, 7, and 8 delve deeper into synthesis/analysis concepts such as Linear Predictive Coding (LPC), spectral modeling, additive/subtractive synthesis, noise signals, and inharmonicity, using the frequency domain techniques learned in previous chapters. You'll hardly turn a page without an accompanying picture or block diagram, a particularly valuable feature of this book.

Chapter 9 explores the physical modeling concepts of string vibrations and stiff bars. Modeling algorithms are introduced using basic physics perspectives centered around the familiar string, mass, and damper paradigms first introduced in chapter 4. Here again, rather than bombarding the reader with tons of equations, Mr. Cook explains ideas mainly through diagrams, sound examples, and block diagrams, which is very helpful for the software implementation of algorithms. The ready-to-compile C++ code for this section included on the CD-ROM provide models of a plucked string (Plucked.cpp), a mandolin (Mandolin.cpp), and a bowed string (Bowed.cpp).

In Chapter 11, Tubes and Air Cavities, the author introduces more models while leaving detailed mathematical derivations of equations for the appendix. He concludes chapter 11 with "Building and Blowing a Bottle Model", and includes code and sound examples, as usual. Going into chapter 12, more complex, higher dimensional models are introduced, with the traditional mass-spring model in the context of a meshed membrane starting off the chapter.

Chapter 13 introduces modeling and synthesizing particle interaction. Some of the topics covered include Formant Wave Functions (FOFs) for voice synthesis, single particle models, multi-particle systems, and statistical multi-particle systems such as a simple maraca model, implemented in less than 30 lines of C code with an accompanying block diagram.

Chapter 14 deals with the subtleties of exciting and controlling sound models. For example, Mr. Cook discusses the differences between exciting a string with a plectrum as opposed to using the fleshy part of the thumb. He also shows some fascinating effects of the striking conditions of the Tibetan prayer bowl, which exhibits very different spectra as a function of strike-direction while keeping strike-point constant. Other topics discussed include bowing, scraping, and frictional issues in synthesis. MIDI, OSC (Open Sound Control), and other standards for sound and multimedia control are also briefly examined.

Chapter 15 walks the reader through a complete system called PhOLISE (Physically Oriented Library of Interactive Sound Effects) that could possibly be applied to areas such as gaming, animation, and sound effects in film production. The five sections of the appendix go into greater detail regarding proofs, derivations, and properties of topics such as DFT properties, zero-padding, proof of fast convolution, and ideal string behaviors.

After you grasp the contents of this book, you might want to read "The Physics of Musical Instruments" and use some of Mr. Cook's techniques to synthesize the numerical models explained in that book.

One of the best volumes I've come across in the field of sound synthesis on personal computers. Provides a solid introduction to this field for those who wish to create sound on a PC (as opposed to play back previously- recorded sound).

This is a lucid explanation of sound synthesis on computer. However the source code and sound samples are no longer at the web address given in the book. Also some of the math suffers from poor proof reading. Example on page 145 book says sin(PI * t) + sin(1.01 * PI *t) = sin(1.005 * PI *t) * cos(0.01 * PI *t). The answer should read 2 * sin(1.005 * PI * t) * cos(0.005 * PI * t).

I very much like this book. Personally I find it very difficult. I do not have a background in programming or math but Perry R Cook seems to allow for this and you can still get a very detailed look at aspects of physical modeling. Bond Graph Method, Modal, Mass Spring Damping, Phase Vocoding and others are all dealt with in both words, math functions, c code and many graphs and illustrations.

I do find the book difficult but I keep re-reading various chapters and every time I go back it gets a little clearer. There is a lot in the book and you get different stuff when you back to it.