Adjustment Apparatus and Storage Medium

This application is a continuation of International Patent Application No. PCT/JP2024/022127 filed on Jun. 18, 2024, which claims priority to and the benefit of Japanese Patent Application No. 2023-129498 filed on Aug. 8, 2023, the entire disclosures of which are incorporated herein by reference.

The present invention relates to an adjustment apparatus and a storage medium.

The dynamic range of an audio signal may be wider than that of an output device such as a loudspeaker. In this case, the user cannot hear a part of an audio signal where the signal level is low, and a part of the audio signal where the signal level is high may be clipped. Therefore, it is necessary to appropriately compress the dynamic range of the audio signal. Processing of compressing the dynamic range is called dynamic range compression (or simply compression), and an adjustment apparatus that performs compression is called a compressor.

PTL 1 discloses a technique of automatically adjusting the signal level using the average power level and the maximum power level of the signal level of an audio signal.

PTL 1: Japanese Patent Laid-Open No. 2001-103593

Presently, automatic adjustment of the signal level is uniformly performed on a track basis, and is not performed on a waveform basis. Therefore, the result of automatic adjustment of the signal level is not always satisfactory, and the user finally needs to perform manual adjustment on a waveform basis, which requires much labor for manual adjustment. It is desired to improve automatic adjustment of the signal level.

The present invention provides a technique for automatic adjustment of the signal level advantageous in reducing the labor of the user for manual adjustment.

The present invention in one aspect provides an adjustment apparatus for adjusting a signal level of an audio signal formed from a plurality of frames recorded in a file at discrete adjustment points corresponding to an envelope of the audio signal, the apparatus including a processor, and a memory, wherein the processor is configured to function as an acquisition unit configured to acquire the envelope of the audio signal, and an adjustment unit configured to adjust the envelope, wherein the adjustment unit is configured to detect a peak value of the envelope for each frame, calculate a first average value as an average value of the detected peak values in the plurality of frames, calculate a second average value as an average value of peak values higher than the first average value, and adjust the envelope so as to suppress at least some of peak values higher than the second average value.

Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings. Note that the same reference numerals denote the same or like components throughout the accompanying drawings.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. Note, the following embodiments are not intended to limit the scope of the claimed invention, and limitation is not made to an invention that requires a combination of all features described in the embodiments. Two or more of the multiple features described in the embodiments may be combined as appropriate. Furthermore, the same reference numerals are given to the same or similar configurations, and redundant description thereof is omitted.

1 FIG. is a block diagram showing the configuration of an adjustment apparatus C according to an embodiment. The adjustment apparatus C is an apparatus that adjusts the signal level of an audio signal formed from a plurality of frames recorded in a file at discrete adjustment points corresponding to the envelope of the audio signal.

101 102 101 103 104 104 110 105 110 110 106 The adjustment apparatus C can be a computer apparatus such as a personal computer or a workstation. The adjustment apparatus C includes a central processing unit (CPU)that controls the entire apparatus, a RAMthat functions as a main storage device and provides a work area of the CPU, and a ROMthat stores permanent data and programs. The adjustment apparatus C also includes an audio interface (I/F). A microphone M and a loudspeaker S can be connected to the audio interface. An external storage deviceis connected to the adjustment apparatus C via an interface (I/F). The external storage devicecan be, for example, a hard disk drive (HDD), a solid-state drive (SSD), or a combination thereof. Note that the external storage devicemay be formed as a secondary storage device in the adjustment apparatus C. A network interfaceis connected to a network N to perform communication. The adjustment apparatus C can communicably be connected to a server A via, for example, the network N.

107 108 109 109 An input device such as a keyboard and a mouse can be connected to the adjustment apparatus C via an interface. An external media device F such as a CD-ROM drive or a DVD drive can be connected to the adjustment apparatus C via an interface. Furthermore, the adjustment apparatus C includes a video controller. The video controllercontrols image display on a display device D.

103 111 112 113 110 113 113 1 FIG. A boot program for activating the adjustment apparatus C is stored in the ROM. As shown in, an operating system (OS)as well as a signal processing programfor performing audio signal processing and one or more audio filescan be installed in the external storage device. The audio filemay be supplied from an external apparatus such as the server A via the network N, or supplied from a medium accommodated in the external media device F. Alternatively, the audio filemay be created from sound collected by the microphone M.

113 113 113 In an example, the file format of the audio filecan be a WAVE file format generally used in a personal computer. A WAVE file can include a header including information such as a monaural/stereo type, a sampling frequency, and the number of quantization bits, and audio signal data. Note that the file format of the audio fileis not limited to the WAVE file format. The file format of the audio filemay be a format other than the WAVE file format, such as the AIFF, MP3, or AAC formats.

2 FIG. 101 112 113 shows an example of a waveform W of the whole section of the audio signal displayed on the display device D when the CPUexecutes the signal processing programto load the audio fileas a processing target. The displayed waveform W is a time domain waveform, the abscissa represents the time, and the ordinate represents the signal level.

In an example, to compress the audio signal, an envelope indicating the outline of the waveform W of the audio signal can be acquired. The adjustment apparatus C serving as an adjustment apparatus can set adjustment points at a plurality of discrete positions corresponding to the envelope.

3 FIG. 3 FIG. 32 33 32 33 shows examples of the waveform W and the adjustment points P corresponding to the envelope. When the user clicks an envelope buttonwith the mouse, envelope generation processing for the waveform W is executed. An envelope indicates the outline of the waveform, and is obtained by connecting the respective peaks of the waveform. The audio signal may undergo full-wave rectification, thereby obtaining the envelope of the audio signal having undergone full-wave rectification. After that, an envelope curve representing the envelope generated by the envelope generation processing is displayed. The user can adjust the envelope curve by adding or moving the adjustment points P corresponding to the envelope curve. For example, the user can drag an arbitrary adjustment point P with the mouse, thereby adjusting the signal level at this position. The waveform W may be re-rendered in accordance with the adjusted signal level. When the user clicks an auto compression button, automatic adjustment (auto compression) of the signal level is performed (automatic adjustment mode). Note that in the example shown in, a GUI including the envelope buttonand the auto compression buttonis provided. However, instead of this, a GUI in which a pull-down menu is provided and an envelope or auto compression function can be selected from the pull-down menu may be provided.

4 FIG. 112 101 is a flowchart of adjustment processing of adjusting the signal level of the audio signal by the adjustment apparatus C. A program corresponding to this flowchart is included in the signal processing program, and is executed by the CPU.

100 101 33 32 In step S, the CPUacquires the entire envelope (the envelope of the whole section) of the audio signal formed from the plurality of frames included in the audio file loaded as a processing target. This processing may automatically be performed when the auto compression buttonis clicked, or may be performed when the envelope buttonis clicked. In this embodiment, subsequent processing is performed for the acquired envelope.

200 101 101 101 In step S, the CPUdetects the peak value of the envelope for each frame. The frame is a waveform unit obtained by dividing the waveform of the audio signal (envelope) into segments of a predetermined time length. The time length of one frame can be, for example, 10 ms. After that, the CPUcalculates the average value (first average value) of the peak values detected in the entire audio signal (that is, all frames). Next, the CPUcalculates the average value (second average value) of the peak values higher than the first average value.

300 101 In step S, the CPUadjusts the envelope so as to suppress at least some of the peak values higher than the second average value.

200 300 5 6 FIGS.and The detailed procedure of steps Sand Swill be described with reference to.

200 201 203 201 101 Step Sincludes steps Sto Sbelow. In step S, the CPUdetects the peak value of the envelope for each frame. As described above, the frame is a waveform unit obtained by dividing the waveform of the audio signal (envelope) into segments of the predetermined time length, and the length of one frame can be, for example, 10 ms. In an example, one frame may further be divided into sub-frames of a predetermined time length (for example, 1 ms), the peak value may be detected for each sub-frame, and the maximum value of the peak values in one frame may be obtained, thereby detecting the peak value of the frame.

202 101 203 101 In step S, the CPUcalculates the average value (first average value) of the peak values detected in the entire audio signal (envelope) (that is, all frames). The first average value can represent a dominant volume in the audio signal. The peaks exceeding the first average value act in a direction of widening the dynamic range. The peaks exceeding the first average value may include a sudden peak that unnecessarily widens the dynamic range. In the following processing, such a sudden peak is detected to suppress its signal level. In step S, the CPUdetects the peak values higher than the first average value, and calculates the average value (second average value) of the detected peak values.

300 204 205 204 101 205 101 101 101 101 Step Sincludes steps Sand Sbelow. In step S, the CPUdetects the peak values higher than the second average value and calculates the average value (third average value) of the detected peak values. The peak exceeding the third average value is determined as a sudden peak that excessively widens the dynamic range. To cope with this, in step S, the CPUadjusts the peak value higher than the third average value to be closer to the third average value. In an example, the CPUadjusts the peak value higher than the third average value to the third average value. In another example, the CPUcan adjust the peak value higher than the third average value to an adjustment value preset by the user. For example, the CPUdetects the peak values higher than the third average value, and calculates the average value (fourth average value) of the detected peak values. Then, the adjustment value may be set to a value between the third average value and the fourth average value. In this case, the adjustment value preset by the user may be indicated by, for example, a percentage by setting the third average value to 0% and the fourth average value to 100%.

206 101 101 207 Processing of allowing the user to easily hear a part with a low signal level is performed. In particular, in a section immediately after the start of the audio signal, an audible sound tends to be small. To cope with this, in step S, the CPUsearches for the presence of the peak value of the envelope that is lower than the first average value and higher than the first threshold during the first period (for example, 0.1 sec) from the start of the audio signal. The first threshold is, for example, a predetermined value corresponding to a noise level. If there is such a peak value, the CPUincreases, in step S, the signal level of the peak value up to the first adjustment amount (for example, 7 dB). Note that the first threshold and the first adjustment amount can arbitrarily be preset by the user.

208 101 101 209 Next, in step S, the CPUsearches for the presence of the peak value of the envelope that is lower than the first average value and higher than the second threshold higher than the first threshold during the second period (for example, 0.2 sec), longer than the first period, from the start of the audio signal. If there is such a peak value, the CPUincreases, in step S, the signal level of the peak value up to the second adjustment amount (for example, 4 dB) smaller than the first adjustment amount. Note that the second threshold and the second adjustment amount can arbitrarily be preset by the user.

210 101 101 211 Next, in step S, the CPUsearches for the presence of the peak value of the envelope that is lower than the first average value and higher than the third threshold higher than the second threshold after the second period. If there is such a peak value, the CPUincreases, in step S, the signal level of the peak value up to the third adjustment amount (for example, 2 dB) smaller than the second adjustment amount. Note that the third threshold and the third adjustment amount can arbitrarily be preset by the user.

With the above processing, appropriate dynamic range compression with excellent audibility is implemented.

101 101 212 101 With the above processing, the CPUcan adjust the signal level of the audio signal. The CPUre-renders the waveform of the audio signal in accordance with the adjusted signal level. In step S, the CPUsets a volume curve corresponding to the envelope of the audio signal whose signal level has been adjusted, and sets, as an adjustment point, a predetermined position of each frame in the volume curve. The predetermined position of the frame can be set at, for example, the center of the frame. Alternatively, the predetermined position of the frame may be set at the start or end of the frame.

213 101 101 214 The adjustment point is a position where the user can arbitrarily perform manual adjustment by dragging with the mouse. There is no point in presenting adjacent adjustment points with almost no level difference. When the user performs fine adjustment for the output sound after automatic adjustment by hearing and confirming it, if the number of adjustment points is too large, it becomes difficult to perform fine adjustment. To cope with this, in step S, the CPUsearches for a pair of adjacent adjustment points with a signal level difference equal to or smaller than a predetermined threshold (for example, 0.5 dB) among the plurality of adjustment points set in the volume curve of the audio signal after the signal level is adjusted based on a generated parameter. If there is such a pair, the CPUdeletes one adjustment point of the pair in step S.

7 FIG. shows examples of the waveform W and the adjustment points P after performing automatic adjustment of the signal level. By appropriate automatic adjustment of the signal level according to this embodiment, the labor of the user for manual adjustment is reduced.

3 7 FIGS.and 8 FIG. 1 2 3 1 2 3 Note that in the examples of, the audio signal recorded in one file loaded as a processing target is displayed, but a plurality of files may be loaded as processing targets in advance.shows examples of the waveforms and the adjustment points of audio signals T, T, and Tof a plurality of files loaded in advance. The user can cause the adjustment apparatus C to execute the above-described adjustment processing of the signal level by designating one of the audio signals T, T, and T.

The present invention can also be implemented by causing the computer to execute a program for implementing the function of the adjustment apparatus described in the above embodiment.

According to the present invention, it is possible to provide a technique for automatic adjustment of the signal level advantageous in reducing the labor of the user for manual adjustment.

The invention is not limited to the foregoing embodiments, and various variations/changes are possible within the spirit of the invention.