MIDIbox

User Tools

Site Tools

Trace: • piezo • envelope-follower-bissel-based • midi_io_matrix_board_parts_list • diode • seqv4plus_jog • seq_v4_plus • lcd • wcoref4_pcb • peterpressure • pickit2
korg_wavedrum_midification

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
korg_wavedrum_midification [2013/06/09 11:38] – typo midisaronkorg_wavedrum_midification [2015/02/09 17:55] (current) – [MIDIfying the Wavedrum - Software] Updated Software download midisaron
Line 1: Line 1:
 **The Korg Wavedrum MIDIfied** **The Korg Wavedrum MIDIfied**
  
-====History====+====History of the Wavedrum====
 In 1994 Korg released their first //Wavedrum//, an electronic percussion instrument. Unlike most other electronic drums this was not just a drum pad used to trigger samples. It was rather a physical modeling synthesizer, where the actual signals from the pickups were used as stimuli for various algorithms generating more or less drum-like sounds. Nevertheless, the //Wavedrum// had a MIDI interface, so it could be used to trigger external drum modules too. This //Wavedrum// was very expensive and only few were made.\\ In 1994 Korg released their first //Wavedrum//, an electronic percussion instrument. Unlike most other electronic drums this was not just a drum pad used to trigger samples. It was rather a physical modeling synthesizer, where the actual signals from the pickups were used as stimuli for various algorithms generating more or less drum-like sounds. Nevertheless, the //Wavedrum// had a MIDI interface, so it could be used to trigger external drum modules too. This //Wavedrum// was very expensive and only few were made.\\
 In 2009, Korg had stopped making Wavedrums a long time ago, a new //Wavedrum// came out, the //WD-X//. It is more capable of reproducing existing instruments' sounds than the 1994 model, since in addition to  physical modeling also samples are used. Still, the //WD-X// is way less expensive than its predecessor. In the following years Korg released several developments, the //Wavedrum Mini//, the //Wavedrum Oriental//, and, most recently, the //Wavedrum Global//. In 2009, Korg had stopped making Wavedrums a long time ago, a new //Wavedrum// came out, the //WD-X//. It is more capable of reproducing existing instruments' sounds than the 1994 model, since in addition to  physical modeling also samples are used. Still, the //WD-X// is way less expensive than its predecessor. In the following years Korg released several developments, the //Wavedrum Mini//, the //Wavedrum Oriental//, and, most recently, the //Wavedrum Global//.
Line 9: Line 9:
 To keep the price low, Korg had to cut cost wherever possible. All newer Wavedrums came with a very limited user interface (no text let alone graphics - only a 3-digit seven segment display! 8-o), and they had no MIDI or other computer interface at all! I felt the urgent need to do something about that. To keep the price low, Korg had to cut cost wherever possible. All newer Wavedrums came with a very limited user interface (no text let alone graphics - only a 3-digit seven segment display! 8-o), and they had no MIDI or other computer interface at all! I felt the urgent need to do something about that.
  
-====MIDIfying the Wavedrum==== +====MIDIfying the Wavedrum - Hardware==== 
-===Hardware=== +===Signals from the wavedrum===
-==Signals from the wavedrum==+
 The //WD-X//, the //Oriental// and the //Global// all (as far as I know) have one piezo pickup for the drumhead, two piezo pickups (just connected in series) for the rim, and a force sensor in the middle of the drumhead that can be used for instance to pitch up the drum sound by pressing down the head by hand. A Wavedrum patch can sound very different, depending not only on how strong the drum head is hit but also if it is hit at the centre or close to the rim, or if it is hit with a hard or a soft object. My goal is to transmit this information via MIDI as accurate as possible. The //WD-X//, the //Oriental// and the //Global// all (as far as I know) have one piezo pickup for the drumhead, two piezo pickups (just connected in series) for the rim, and a force sensor in the middle of the drumhead that can be used for instance to pitch up the drum sound by pressing down the head by hand. A Wavedrum patch can sound very different, depending not only on how strong the drum head is hit but also if it is hit at the centre or close to the rim, or if it is hit with a hard or a soft object. My goal is to transmit this information via MIDI as accurate as possible.
  
-==Interfacing the LPCXpresso board==+===Interfacing the LPCXpresso board===
 The LPC1769 microprocessor on the LPCXpresso board has an on-chip 12 bit A/D converter. Sampling both the head and the rim pickup at a rate of 10 kHz each, their waveforms can be captured quite accurately. While it would be possible to get the signals from the piezos directly, I decided to take them from the outputs of the buffer amplifiers located on the Wavedrum's KLM-2937 board: The LPC1769 microprocessor on the LPCXpresso board has an on-chip 12 bit A/D converter. Sampling both the head and the rim pickup at a rate of 10 kHz each, their waveforms can be captured quite accurately. While it would be possible to get the signals from the piezos directly, I decided to take them from the outputs of the buffer amplifiers located on the Wavedrum's KLM-2937 board:
  
Line 25: Line 24:
 {{:wavedrum_midi:internal_electronics.jpg?200|extra electronics fitted into the Wavedrum}} {{:wavedrum_midi:internal_electronics.jpg?200|extra electronics fitted into the Wavedrum}}
  
-==Power supply for the LPCXPresso board==+===Power supply for the LPCXPresso board===
 The Wavedrum is powered from an external 9V/1.7A wall wart supply. Since the Wavedrum draws much less current than 1.7 amps it is possible to power the LPCXpresso board from the wall wart too. I use a simple linear regulator to get 3.3 volts from the 9 volts. The LPCXpresso board is quite a current hog, so the LM317 runs rather hot and needs a small heat sink. I placed the regulator on an extra board, but with a clever layout perhaps it would be possible to fit it onto the board carrying the LPCXpresso and the preamp too.\\ The Wavedrum is powered from an external 9V/1.7A wall wart supply. Since the Wavedrum draws much less current than 1.7 amps it is possible to power the LPCXpresso board from the wall wart too. I use a simple linear regulator to get 3.3 volts from the 9 volts. The LPCXpresso board is quite a current hog, so the LM317 runs rather hot and needs a small heat sink. I placed the regulator on an extra board, but with a clever layout perhaps it would be possible to fit it onto the board carrying the LPCXpresso and the preamp too.\\
 The Wavedrum is a quite noisy (electrically) environment. There are several DC/DC converters in there. The ground connection to the extra circuitry is critical. After a few experiments I found that noise is suppressed best with a single heavy wire ground connection from the sheet metal that holds the KLM-2739 board to pin 1 of the LPCXpresso board. The 9 volts are taken from the small board with the power supply jack and the on/off switch. Maybe there are better options. The Wavedrum is a quite noisy (electrically) environment. There are several DC/DC converters in there. The ground connection to the extra circuitry is critical. After a few experiments I found that noise is suppressed best with a single heavy wire ground connection from the sheet metal that holds the KLM-2739 board to pin 1 of the LPCXpresso board. The 9 volts are taken from the small board with the power supply jack and the on/off switch. Maybe there are better options.
Line 31: Line 30:
 {{:wavedrum_midi:getting_9_volts.jpg?200|getting +9 volts}} {{:wavedrum_midi:getting_9_volts.jpg?200|getting +9 volts}}
  
-==Schematics==+===Schematics===
 {{:wavedrum_midi:wavedrum_midi_schematics.png?400|Schematics}} {{:wavedrum_midi:wavedrum_midi_schematics.png?400|Schematics}}
  
 {{:wavedrum_midi:midi_jack.jpg?200|A MIDI jack can be mounted in the bottom of the Wavedrum}} {{:wavedrum_midi:midi_jack.jpg?200|A MIDI jack can be mounted in the bottom of the Wavedrum}}
  
-==User interface==+===User interface===
 Sorry, no user interface yet. At the moment all user-alterable parameters can be edited via MIDI Sysex only. Sorry, no user interface yet. At the moment all user-alterable parameters can be edited via MIDI Sysex only.
  
-===Software===+====MIDIfying the Wavedrum - Software==== 
 +{{:wavedrum_midi:wavedrummidi.zip|Download the source code here}} This does include the FFT stuff. Still haven't tidied it up.m(
 ==Capturing the head's and the rim's signals== ==Capturing the head's and the rim's signals==
-The ADC takes a sample every 50 microseconds. When idle, the head piezo, the rim piezos and the force sensor are sampled in turns. When a trigger on the head or on the rim is detected, i. e. a threshold is crossed, the force sensor is temporarily not sampled until 64 samples on the triggered channel (head or rim) are recorded and the event is processed. During that time the non-trigered channel (i. e. head if rim is triggered and vice versa) can still be triggered, so "simultaneous" triggers on head and rim are possible. Because the force sensor is not sampled while the head or rim signal is recorded, the sample rate here is 10 kHz.+The ADC takes a sample every 50 microseconds. When idle, the head piezo, the rim piezos and the force sensor are sampled in turns. When a trigger on the head or on the rim is detected, i. e. a threshold is crossed, the force sensor is temporarily not sampled until 64 samples on the triggered channel (head or rim) are recorded and the event is processed. During that time the non-triggered channel (i. e. head if rim is triggered and vice versa) can still be triggered, so "simultaneous" triggers on head and rim are possible. Because the force sensor is not sampled while the head or rim signal is recorded, the sample rate here is 10 kHz.
  
-==Processing the signals== +Optionally all 64 samples are output via MIDI Sysex, so the recorded signal can be viewed. Here are a few examples recorded this way:
-When hit, a MIDI drum usually generates a Note On message with a fixed note number and a velocity value depending on how strong the drum was hit. To determine the strength I use the maximum deviation from idle level at the moment. Because the whole signal (64 samples) is available, many other ways are thinkable. Optionally all 64 samples are output via MIDI Sysex, so the recorded signal can be viewed. Here are a few examples recorded this way:+
  
 {{:wavedrum_midi:waveform_head_fingertips.jpg?200|head, hit with fingertips at the centre}} {{:wavedrum_midi:waveform_head_fingertips.jpg?200|head, hit with fingertips at the centre}}
Line 53: Line 52:
 (The screenshots are taken from SoundDiver. I'm still using Apple's ancient patch editor :-). The waveform display is made from 64 slider objects side by side.) (The screenshots are taken from SoundDiver. I'm still using Apple's ancient patch editor :-). The waveform display is made from 64 slider objects side by side.)
  
-==Auto-zero== 
-There are two trimpots to adjust the zero levels for the head and the rim signal (see schematics above). However, to determine the zero levels more precisely the levels at the three ADC inputs are measured on startup (after waiting for a few seconds, to allow for things to warm up). The zero levels of the head and the rim signals are also adjusted dynamically while waiting for trigger events. 
  
-==Crosstalk suppression==+===Crosstalk suppression===
 On the Wavedrum there is always crosstalk between head and rim. In some situations it may be desirable that only one MIDI message is generated when a trigger is detected on both pickups at the same time. When recording the head or rim signal is completed while on the other channel there's also some recording going on, the program waits until that recording is finished too and then outputs only one MIDI message for the stronger of the two signals. On the Wavedrum there is always crosstalk between head and rim. In some situations it may be desirable that only one MIDI message is generated when a trigger is detected on both pickups at the same time. When recording the head or rim signal is completed while on the other channel there's also some recording going on, the program waits until that recording is finished too and then outputs only one MIDI message for the stronger of the two signals.
  
-==Processing the force sensor== +===Processing the signals=== 
-When the voltage at the force sensor changes, a MIDI Control Change, Aftertouch or Pitch Bend message can be generated. It's thinkable that the note number of drum trigger events is varied depending on pressure, but this is not implemented yet.+After 64 samples of the head or rim signal have been captured, a FFT (Fast Fourier Transform) on these samples is performed. This results in 33 (usable) frequency bins representing the spectrum of the signal. I did not program the FFT myself but took it from NXP's  
 +[[http://www.nxp.com/documents/application_note/AN10913_CM3_DSP_library_v1_0_0.zip|AN10913]]. See below [[korg_wavedrum_midification#How to add the DSP library to the project]]. A short yet comprehensible introduction into the concept of the FFT including examples on how to use NXP's DSP library is given in [[http://www.nxp.com/documents/application_note/AN10943.zip|AN10943]]. 
 +I think it's amazing that the humble LPC1769 can calculate a 64-points-FFT so quickly that the delay is not noticable (at least to me). There are countless ways how the result of a FFT can be used. For the head signal, the high frequency components are stronger when the head is hit with a harder object (drumstick rather than hand), and when it's hit closer to the rim. This way a crude position detection is possible.\\ 
 +Only the absolute values of the complex frequency bin values are used. The correct formula would be 
 +<code>abs = √((real part)² + (imaginary part)²)</code> 
 +but I skip the square root to save execution time. So the squares of the absolute values are used rather than the absolute values themselves.\\ 
 +At the moment, I extract three parameters out of the FFT result: //amplitude//, //center frequency// and //variance//. //Amplitude// (better: energy) is the sum of the absolute values (or rather their squares, see above). //Center frequency// is sort of a "center of gravity" of the frequencies. It is calculated by summing up the products of the absolute values (their squares, that is) and the frequencies for the 33 bins and then dividing this sum by the amplitude calculated in the first step. //Variance//, finally, is a measure that shows whether the energy is focussed in a narrow frequency band or wide spread across many frequencies. Unlike as for center frequency, here the squares of the products of the absolute values and the frequencies are summed up. Then this sum is divided by the amplitude calculated in the first step. Finally the square of the center frequency calculated in the second step is subtracted.
  
-==MIDI== +===Auto-zero=== 
-When hit at the head or at the rim, a Note On message is sent. The note number and the MIDI channel can be set individually for the head and for the rim. If there's a pending note with that number and channel, a Note Off message is sent first. As mentioned above, the force sensor is able to generate Control Change, Aftertouch or Pitch Bend messages.\\+There are two trimpots to adjust the zero levels for the head and the rim signal (see schematics above). However, to determine the zero levels more precisely the levels at the three ADC inputs are measured on startup (after waiting for a few seconds, to allow for things to warm up). The zero levels of the head and the rim signals are also adjusted dynamically while waiting for trigger events. 
 + 
 +===Processing the force sensor=== 
 +When the voltage at the force sensor changes, a MIDI Control Change, Aftertouch or Pitch Bend message can be generated. Also the note number of drum trigger events can be varied depending on pressure. 
 + 
 +===MIDI=== 
 +This picture shows how the signals from the sensors are processed and converted to MIDI messages. At the same time this is how the SoundDiver editor window looks like: 
 + 
 +{{:wavedrum_midi:sd_screenshot.jpg?600|Signal flow}} 
 + 
 +==Note On== 
 +When the drum is hit at the head or at the rim, a Note On message is sent. The note number can be influenced by the //center frequency// of the FFT output (higher frequencies give higher note numbers), and by the pressure applied to the force sensor.\\ 
 +The velocity can be taken from the //amplitude// of the FFT output. Alternatively, the absolute maximum of the signal can be used.\\ 
 +The MIDI channel can be set individually for the head and for the rim. 
 + 
 +==Note Off== 
 +If there's a pending note with that number and channel, a Note Off message is sent first. At the moment this is the only case where Note Off messages are sent, so a note sounds infinitely until it is replaced by the same note. A programmable fixed or even velocity-dependent note length certainly would be nice, but this is not implemented yet. 
 + 
 +==Control Change, Aftertouch and Pitch Bend messages== 
 +In addition to the Note On message a CC# message representing the //variance// is sent. As mentioned above, the force sensor is able to generate Control Change, Aftertouch or Pitch Bend messages. 
 + 
 +==System Exclusive==
 Various user-settable parameters can be transmitted to the software via MIDI Sysex messages. The bulk dump format is as follows: Various user-settable parameters can be transmitted to the software via MIDI Sysex messages. The bulk dump format is as follows:
  
-$F0 $7D $57 $44 $4D $49 $20 $02 $00 $00 //$0h $0l....$0h $0l// $F7+$F0 $7D $57 $44 $4D $49 $20 $02 $00 $00 //$0l $0h....$0l $0h// $F7
  
-The //$0h $0l....$0h $0l// part designates a block of 512 MIDI bytes. These represent 256 parameter bytes ((as in SYSEX_FORMAT 1 in tutorial 025)) which are listed in the table below (numbered from 0 to 255). Some parameters are 16-bit, in these cases the LSByte is sent first.\\+The //$0l $0h....$0l $0h// part designates a block of 512 MIDI bytes. These represent 256 parameter bytes ((as in SYSEX_FORMAT 1 in tutorial 025)) which are listed in the table below (numbered from 0 to 255). Some parameters are 16-bit, in these cases the LSByte is sent first.\\
 When the software receives such a message, the parameters are updated. The internal settings can be requested with a dump request: When the software receives such a message, the parameters are updated. The internal settings can be requested with a dump request:
  
Line 101: Line 125:
 |191|ADC from which the waveform was recorded; 0=Rim, 1=Head|0, 1| |191|ADC from which the waveform was recorded; 0=Rim, 1=Head|0, 1|
 |192..255|waveform buffer|0..255((scaled down from 0..4095))| |192..255|waveform buffer|0..255((scaled down from 0..4095))|
 +
 +===How to add the DSP library to the project===
 +The FFT algorithm is taken from NXP's 
 +[[http://www.nxp.com/documents/application_note/AN10913_CM3_DSP_library_v1_0_0.zip|AN10913]]. This ZIP archive contains several files, the library which has to be linked to the MIDIBOX project is CodeRed/cr_dsplibFFTbin_cm3/libcr_dsplibFFT_cm3.a. To link this library to the project, the line <code> LIBS = libcr_dsplibFFT_cm3.a</code> is added to the makefile.
  
  
-===Future plans=== +====MIDIfying the Wavedrum - Future plans==== 
-==Replacing the force sensor==+===Replacing the force sensor===
 It's sometimes mentioned that the rebound of the Wavedrum is not great (playing with sticks, rebound helps when playing snare rolls etc). Some say this is because the force sensor pushes against the bottom side of the drum head. I think it should be possible to replace the mechanical sensor with a reflective optical sensor like the CNY70. This would not be in touch with the drum head at all, hence no impact on rebound. The sensitivity of the head pickup might be improved too. Regarding the Wavedrum's internal sounds, it might become tricky to get the same response as with the old sensor, but for the MIDI extension any desired response can be realized in software. It's sometimes mentioned that the rebound of the Wavedrum is not great (playing with sticks, rebound helps when playing snare rolls etc). Some say this is because the force sensor pushes against the bottom side of the drum head. I think it should be possible to replace the mechanical sensor with a reflective optical sensor like the CNY70. This would not be in touch with the drum head at all, hence no impact on rebound. The sensitivity of the head pickup might be improved too. Regarding the Wavedrum's internal sounds, it might become tricky to get the same response as with the old sensor, but for the MIDI extension any desired response can be realized in software.
  
-==Separating the two rim sensors==+===Separating the two rim sensors===
 As mentioned, there are two sensors attached to the rim, but these are just wired in series. Interpreting the two sensors' signals seperately, probably the position where the rim was hit could be detected. Of course the sum of the two signals still needs to be available for the Wavedrum's original electronics. As mentioned, there are two sensors attached to the rim, but these are just wired in series. Interpreting the two sensors' signals seperately, probably the position where the rim was hit could be detected. Of course the sum of the two signals still needs to be available for the Wavedrum's original electronics.
  
-==User interface==+===User interface===
 At least a text display and a few buttons. Unfortunately there isn't much room for this in the Wavedrum. At least a text display and a few buttons. Unfortunately there isn't much room for this in the Wavedrum.
  
-==Improving the Wavedrum's own user interface==+===Improving the Wavedrum's own user interface===
 At the moment everything is coded into three digits or letters (letters that can reasonably be displayed in a seven-segment digit, that is). It's impossible to edit the Wavedrum's patches without looking at the user's manual all the time.  At the moment everything is coded into three digits or letters (letters that can reasonably be displayed in a seven-segment digit, that is). It's impossible to edit the Wavedrum's patches without looking at the user's manual all the time. 
 With a text display the Wavedrum's user interface would vastly be improved. Software had to monitor the Wavedrum's own six pushbuttons and its rotary encoder to keep track which parameter is edited.\\ With a text display the Wavedrum's user interface would vastly be improved. Software had to monitor the Wavedrum's own six pushbuttons and its rotary encoder to keep track which parameter is edited.\\
 Yes, I'm aware that this is a huge programming task.:-o Yes, I'm aware that this is a huge programming task.:-o
  
-==Position sensing==+===Position sensing===
 Unlike the Roland HPD, the Wavedrum cannot sense //where// the drum head is hit. There are application notes from NXP on capacitive touch sensing with the LPC processors (AN11023, AN11095). I have no idea if this is feasible, but maybe regions of the drumhead can be covered with some conductive paint (from the bottom side perhaps), and, with hand playing, the region that was hit can be detected. Unlike the Roland HPD, the Wavedrum cannot sense //where// the drum head is hit. There are application notes from NXP on capacitive touch sensing with the LPC processors (AN11023, AN11095). I have no idea if this is feasible, but maybe regions of the drumhead can be covered with some conductive paint (from the bottom side perhaps), and, with hand playing, the region that was hit can be detected.
  
korg_wavedrum_midification.1370777906.txt.gz · Last modified: 2013/06/09 11:38 by midisaron