Refactoring SQL Applications (Paperback)

by Stephane Faroult (Author), Pascal L'Hermite (Author)
Key Phrases: statement refactoring, select accountid, select txid, The Two Gentlemen of Verona Shakespeare, Mother Bombie Lyly, Visual Basic (more...)

Editorial Reviews

Product Description
What can you do when database performance doesn't meet expectations? Before you turn to expensive hardware upgrades to solve the problem, reach for this book. Refactoring SQL Applications provides a set of tested options for making code modifications to dramatically improve the way your database applications function. Backed by real-world examples, you'll find quick fixes for simple problems, in-depth answers for more complex situations, and complete solutions for applications with extensive problems. Learn to:

• Determine if and where you can expect performance gains
• Apply quick fixes, such as limiting calls to the database in stored functions and procedures
• Refactor tasks, such as replacing application code by a stored procedure, or replacing iterative, procedural statements with sweeping SQL statements
• Refactor flow by increasing parallelism and switching business-inducted processing from synchronous to asynchronous
• Refactor design using schema extensions, regular views, materialized views, partitioning, and more
• Compare before and after versions of a program to ensure you get the same results once you make modifications

Refactoring SQL Applications teaches you to recognize and assess code that needs refactoring, and to understand the crucial link between refactoring and performance. If and when your application bogs down, this book will help you get it back up to speed.

About the Author
St phane Faroult first discovered relational databases and the SQL language back in 1983. He joined Oracle France in their early days (after a brief spell with IBM and a bout of teaching at the University of Ottawa) and soon developed an interest in performance and tuning topics. After leaving Oracle in 1988, he briefly tried to reform and did a bit of operational research, but after one year, he succumbed again to relational databases. He has been continuously performing database consultancy since then, and founded RoughSea Ltd in 1998.

Pascal L'Hermite has been working with relational databases in OLTP, production and development environments on Oracle Databases for the past 12 years and on Microsoft SQL Server for the past 5 years.

Product Details

• Paperback: 296 pages
• Publisher: O'Reilly Media, Inc.; illustrated edition edition (August 28, 2008)
• Language: English
• ISBN-10: 0596514972
• ISBN-13: 978-0596514976
• Product Dimensions: 9.2 x 7 x 0.8 inches
• Shipping Weight: 1 pounds (View shipping rates and policies)
• Average Customer Review: 3.3 out of 5 stars See all reviews (3 customer reviews)
• Amazon.com Sales Rank: #117,592 in Books (See Bestsellers in Books)

  Popular in this category: (What's this?)

  #37 in

  Books > Computers & Internet > Databases > Data Warehousing

Customer Reviews

Most Helpful Customer Reviews

3 of 3 people found the following review helpful:

4.0 out of 5 stars Its the context that counts, March 1, 2009

By	Tom Spitzer (Bay Area, CA, USA) - See all my reviews

Faroult and Hermite focus their attention on relatively classical SQL optimizations. The gist of their advice is that developers running SQL code need to leverage the database engine's optimizer. To do that, they offer relatively common advice: use set operations, avoiding procedural code in your sql code whenever possible; minimize the number of visits to a table; and minimize the number of times your code has to scan a given table. Most of the content of the book is spent offering techniques for achieving these objectives. For developers without a lot of experience writing SQL intensive applications, the authors provide a relatively accessible discussion of these techniques.

Outside of that, the authors include a chapter called `Testing Framework' that addresses one of the key requirements of any refactoring effort: creating and maintaining a library of unit tests that allows us to prove that our code is correct. When writing database code, and particular code whose performance may vary based on the amount of data being processed, unit testing can be a bit of a challenge due to the typical case where developers are developing locally on databases that contain small data sets. In this chapter Faroult and Hermite offer some data generation techniques and some mechanisms for automating the comparison of resulting outputs.

What I like about this book is that unlike books on optimizing the performance of a particular database product, this book tries to elevate the discussion to the level of optimizing the performance of an application that contains a substantial amount of realistic database code. It should enable developers to analyze their code in the context of the business objectives that it is trying to fulfill, rather than the context of the database engine in which it is executing. For that reason alone, I am recommending it to the database developers on my team.

5.0 out of 5 stars For some shops, THE book you need, July 16, 2009

By	R. Reid "tsimbler" (New York, NY USA) - See all my reviews (REAL NAME)

I'm at odds with the first two reviewers, but I think it depends on what you're looking for. This book is NOT about classical tuning. Classical tuning is "tune the server", and "tune the query".

The emphasis - in the preface and the excellent Chapter 6 - is that the real gains are usually elsewhere, when you have older code.

I work with a 25 year heritage of fairly well written apps. Many of them have the described situation - a single query that's been broken into two or more parts, with an outer loop and (at least one) inner loop. When server memories were 64K, or 1 Meg, or 4 Meg, and CPU's only came in packages of 1, and disk channels were slow, and networks were slower, this was often the only practical way to get a result.

The interplay changed over the years, but the old code worked. In the past few years, with 64-bit processors, cheap 64-CPU servers, and multi-io disk channels, a wierd thing happened. We found that moving to newer systems and faster hardware made things run SLOWER.

The answer time and again was in those "split loop queries". If we turned them back into one big query - the kind that you couldn't run before, we would see performance improvements of hundreds or thousands of times. In the end, the math proved - on powerful machines, most of the overhead is sending the query, compiling it, and sending it back. If one monster query takes a full second, but every query in the loop takes 1/4 second - if that inner loop runs 1000 times, you lose.

Meantime, that 64-core machine has every CPU working full blast - recompiling the same stupid statement over and over! The problem is, you try to tell this to a developer, they don't beleive you "I didn't change anything in the code".

And that's what this book is about. Changing the code. This book validates what I've been trying to tell my managers and coders; I am grateful to Faoult and L'Hermite for showing I was not making this up myself.

The second reviewer is just reading the wrong book for whatever it is they are trying to do.

This is an essential book for certain people, and is certainly of no interest whatsoever for others. (If you don't own a 1941 Plymouth, the 1941 Plymouth manual isn't much use - otherwise, it's a must).

7 of 17 people found the following review helpful:

1.0 out of 5 stars Too much focus on performance tuning, December 1, 2008

By	T. Nguyen - See all my reviews (REAL NAME)

Performance tuning of a database application is a minor part of refactoring a SQL application. In 2008, many programmers found themselves inheriting large applications running on thousands of stored procedures written in PL-SQL, TSQL - great stuff during the hey days of client-server programming era circa the 80s and 90s. For those who are looking for a book to help with the re-design, re-plumbing i.e. refactoring of SQL applications, this book will not help much.

Much of this book is focused on the issue of tuning data model, tuning SQL queries etc With the current server processing power, caching, bit-mapped indices, and a plethora of SQL tuning tools, performance tuning is no longer such a major concern in a SQL refactoring project.

If you are looking for discussion on building unit tests, building wrapper, sprout, identification of seams etc, you should look else where.