Harmonizing Non-Chord Tones
Passing Notes, Approach Notes, and the Art of Melodic Harmonization
Not Every Melody Note Belongs to the Chord
In the previous chapter, we explored how to harmonize a melody for a Big Band section using different voicing techniques.
But what happens when the melody contains notes that do not belong to the underlying chord?
This is a situation every arranger encounters.
A melody rarely consists entirely of chord tones. Passing notes, neighboring tones, and chromatic approach notes help create movement, expression, and musical direction.
The question is not whether these notes are allowed. They are an essential part of melodic writing.
The real question is: How should we harmonize them?
Do we keep the accompanying voices within the original chord, or should those voices move with the melody?
To explore this, we will return to our familiar composition, Just Take It Easy.
Rather than introducing a complicated collection of harmonic rules, I want to demonstrate how I approach these decisions in practice.
1. Identifying the Notes That Need Attention
Example 1 — Just Take It Easy: Melody and chord symbols, with non-chord tones highlighted in green and chromatic non-chord/non-scale tones in red.
In our first example, I have marked certain melody notes in two colors:
Green: Notes that do not belong to the underlying chord but can be understood within the prevailing scale.
Red: Notes that belong neither to the underlying chord nor to the prevailing scale.
These distinctions are useful because they help us recognize where the melody temporarily moves away from the established harmony.
The green notes can often be treated as passing or neighboring tones without requiring a new chord.
The red notes deserve particular attention. They introduce chromatic movement that may benefit from a temporary harmonic adjustment.
However, the color alone does not determine the harmonization. The musical context, the direction of the melody, and the intended sound remain important.
2. Returning to Our Chapter 8 Voicing
Example 2 — Ideal Voicing: The harmonized melody of Just Take It Easy, with non-chord tones highlighted in green and chromatic non-chord/non-scale tones in red.
Here we return to the voicing concept developed in Chapter 8.
I have highlighted the notes associated with our non-chord-tone discussion while retaining the established harmonic framework.
This gives us a useful starting point.
Instead of treating every passing note as an entirely new harmonic event, we can examine how the existing voices move and decide where an adjustment would improve the result.
Sometimes the original harmony is sufficient.
At other moments, a temporary passing chord provides a more convincing connection between the surrounding chords.
The important point is that we are not harmonizing individual notes in isolation. We are shaping a musical phrase.
3. Passing Chords: Allowing the Harmony to Move
Example 3 — Ideal Voicing with Passing Chords: Additional chord symbols illustrate the harmonization of chromatic passing notes. The rhythm section continues playing the underlying Gm7 harmony.
In this example, I have added chord symbols above the relevant notes to show my preferred passing harmonies.
An important distinction: These additional chord symbols are included to demonstrate how I harmonized the passing notes within the saxophone section. They do not represent changes to the underlying chord progression.
For example, while the saxophone voices move chromatically upward and downward through the passage, the rhythm section continues playing the original Gm7 harmony.
There is no need for the piano, guitar, or bass to follow every temporary chord suggested by the saxophone voicing.
The basic harmonic structure remains unchanged. The passing harmonies simply allow the individual saxophone voices to move more naturally within that framework.
This distinction is particularly useful for beginning arrangers: A passing chord used to harmonize a melodic line does not necessarily require a corresponding chord change in the rhythm section.
The purpose of these temporary harmonies is to support the melodic movement between the established chords.
A passing chord can create a smoother connection, introduce a moment of harmonic color, or allow the accompanying voices to move more naturally.
This does not mean that every chromatic melody note requires a new chord.
Sometimes maintaining the existing harmony is precisely the right choice.
But when several instruments are playing a harmonized melodic line, I generally pay close attention to the movement of each individual voice.
That brings us to the most important practical part of this chapter.
4. The Preferred Saxophone Section Voicing
Example 4 — Recommended Saxophone Voicing: All five saxophone parts move smoothly through the passing notes, preserving melodic continuity and a natural swing feel.
Here is my preferred harmonization for the saxophone section.
Instead of concentrating exclusively on the vertical chords, look at the horizontal movement of the individual instrumental parts.
The melody moves through its passing and approach notes, while the accompanying voices follow carefully selected paths.
This produces a more connected musical gesture.
The individual saxophone lines are not merely collections of notes belonging to the correct chords. They are melodic lines in their own right.
For me, this is an essential consideration when arranging for a section.
Each player should have a part that feels natural to perform, while the combined voices produce the harmonic effect I want.
Listen to the example while following the score.
Pay particular attention to the movement of the inner voices and the relationship between the melody and its harmonization.
5. When a Correct Voicing Is Not Necessarily the Best Voicing
Example 5 — Less Effective Saxophone Voicing: Keeping the accompanying voices on repeated chord tones creates additional tonguing and interrupts the smooth melodic flow. The effect becomes particularly noticeable at faster swing tempos.
Now let us examine an alternative approach.
In this version, I have retained several accompanying notes within the existing chord instead of allowing those voices to follow the melodic movement.
From a harmonic perspective, this can be a perfectly acceptable solution.
After all, the notes still belong to the underlying harmony.
But there is a practical problem.
Look particularly at the third measure of the saxophone example.
While the melody continues moving, several accompanying instruments repeat the same notes.
These repeated notes require the musicians to articulate successive attacks rather than simply maintaining a connected line.
In a medium swing tempo, this may still work reasonably well.
Nevertheless, it can interrupt the smooth musical flow that I want to achieve.
Depending on the phrasing, the repeated attacks can also prevent the accompanying parts from following the same slurred movement as the melody.
And what happens if we increase the tempo?
The problem becomes more noticeable.
I sometimes compare this effect to driving a car over cobblestones.
Instead of experiencing a smooth, flowing musical phrase, we begin to feel a succession of small interruptions.
The notes may all be harmonically correct, but the musical result is not necessarily convincing.
Compare this version with the first recording while following the two scores.
The point is not that repeated notes are forbidden in Big Band writing. They can be extremely effective when used intentionally.
The problem arises when they are an unintended consequence of keeping the accompanying voices fixed within the chord.
In this particular passage, I prefer the more connected movement of the first version.
6. What Happens at a Faster Tempo?
Finally, listen to the preferred voicing at a faster tempo.
This is an important test for any arranger.
A passage that appears comfortable on paper may behave quite differently when the tempo increases.
The individual instrumental lines, articulation, and overall sectional phrasing become increasingly important.
In our example, the preferred voicing was designed to support the movement of the melody without introducing unnecessary repeated notes into the accompanying parts.
That makes it a more suitable choice for the musical character I want to achieve.
Of course, every arrangement must be judged in its own context.
A short, rhythmically accented passage may benefit from repeated notes. A sustained or smoothly connected phrase may call for a different solution.
The arranger's responsibility is to recognize that distinction.
7. The Arranger's Real Responsibility
There is no single formula that will produce the ideal harmonization for every passing note or chromatic approach.
Different musical contexts require different solutions.
What matters is learning to hear beyond the chord symbols.
When I write for a saxophone, trumpet, or trombone section, I consider not only whether the combined notes form an acceptable harmony, but also how the individual players will perform their parts.
Are the lines comfortable?
Does the articulation support the intended phrase?
Do the voices move naturally?
And, most importantly, does the entire section sound and feel the way I intended?
These are questions that become increasingly important as we develop our arranging skills.
For readers who would like to explore more advanced voicing techniques and harmonic theory, I recommend returning to the reference material provided in Chapter 8.
For now, I would encourage you to experiment with a short melody of your own.
Try harmonizing a passing-note passage in two different ways: first by retaining the existing chord tones, and then by allowing the accompanying voices to move.
Play or listen to both versions.
You may discover that the difference between a correct arrangement and a convincing arrangement is often found in the smallest details.
Good arranging is not simply about finding the right notes. It is about understanding how those notes connect, how musicians will perform them, and how the entire section will sound and feel.
Coming Next — Chapter 10: Writing Big Band Vocal Charts — The Art of Serving the Vocal Artist
A successful Big Band vocal arrangement requires more than effective orchestration and sophisticated harmonies.
The arranger must understand the singer's vocal range, phrasing, interpretation, and individual musical personality.
How do we support a vocalist without overwhelming the melody? When should the ensemble provide subtle backgrounds, and when can the full power of the Big Band become part of the musical expression?
In Chapter 10, the final installment of Inside The Arrangement, we will explore the art of writing for vocalists, including practical considerations of instrumentation, dynamics, phrasing, and the relationship between singer and orchestra.
MusicMyLanguage — Learn. Practice. Perform.
Inside The Arrangement — An Educational Series on Professional Big Band Writing

