ffmpeg/libavcodec/x86
Michael Niedermayer 96fe37a339 avcodec/x86/mpegvideodsp: Fix signedness bug in need_emu
Fixes: out of array read
Fixes: 3516/attachment-311488.dat

Found-by: Insu Yun, Georgia Tech.
Tested-by: wuninsu@gmail.com
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 58cf31cee7)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
2017-12-30 21:11:31 +01:00
..
aacencdsp.asm aacenc: add SIMD optimizations for abs_pow34 and quantization 2016-10-18 21:41:18 +01:00
aacencdsp_init.c aacenc: add SIMD optimizations for abs_pow34 and quantization 2016-10-18 21:41:18 +01:00
aacpsdsp.asm x86/aacpsdsp: optimize add_squares loop 2016-06-14 12:41:23 -03:00
aacpsdsp_init.c x86/aacpsdsp: add SSE and SSE3 optimized functions 2015-07-30 19:01:15 -03:00
ac3dsp.asm x86: lavc: share more constants 2015-02-06 23:35:02 +01:00
ac3dsp_downmix.asm Merge commit 'b57e38f52c' 2017-03-22 12:49:29 +01:00
ac3dsp_init.c Merge commit 'b57e38f52c' 2017-03-22 12:49:29 +01:00
alacdsp.asm x86/alacdsp: add simd optimized functions 2015-10-06 20:22:00 -03:00
alacdsp_init.c x86/alacdsp: add simd optimized functions 2015-10-06 20:22:00 -03:00
audiodsp.asm Merge commit '6be7944ee2' 2017-03-23 18:05:27 -03:00
audiodsp_init.c Merge commit '12004a9a7f' 2017-03-20 22:35:07 +01:00
blockdsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
blockdsp_init.c blockdsp: reindent after parameter removal 2015-10-03 23:34:56 +02:00
bswapdsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-11 11:12:01 +02:00
bswapdsp_init.c Merge commit 'c67b449beb' 2014-06-23 13:31:26 +02:00
cabac.h asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
cavsdsp.c Merge commit 'f81be06cf6' 2017-03-19 15:23:52 -03:00
constants.c vp9mc/x86: add AVX and AVX2 MC 2016-08-03 11:00:08 +02:00
constants.h Merge commit '3c504bc359' 2017-03-15 22:07:28 -03:00
dcadsp.asm x86: Add missing colons after assembly labels 2016-10-17 16:31:26 +02:00
dcadsp_init.c x86/dcadec: add ff_lfe_fir1_float_{sse3,avx} 2016-02-22 21:21:34 -03:00
dct32.asm x86inc: Drop SECTION_TEXT macro 2015-08-11 11:12:01 +02:00
dct_init.c Merge commit 'ebaf571aca' 2015-08-02 12:31:39 +02:00
dirac_dwt.asm dirac_dwt: Make x86 files/functions names consistent 2016-02-05 19:30:23 -08:00
dirac_dwt_init.c dirac_dwt: Make x86 files/functions names consistent 2016-02-05 19:30:23 -08:00
diracdsp.asm x86/diracdsp: make ff_put_signed_rect_clamped_10_sse4 work on x86_32 2016-07-20 13:43:38 -03:00
diracdsp_init.c x86/diracdsp: make ff_put_signed_rect_clamped_10_sse4 work on x86_32 2016-07-20 13:43:38 -03:00
dnxhdenc.asm DNxHD: convert inline asm to yasm 2014-04-11 12:09:09 +02:00
dnxhdenc_init.c Merge commit '9e0b29911f' 2014-07-18 22:33:24 +02:00
fdct.c Merge commit '85cabb8d00' 2014-07-19 13:45:59 +02:00
fdct.h Merge commit '85cabb8d00' 2014-07-19 13:45:59 +02:00
fdctdsp_init.c Merge commit '85cabb8d00' 2014-07-19 13:45:59 +02:00
fft.asm avcodec: Extend fft to size 2^17 2016-03-04 13:51:42 +01:00
fft.h fft: Split MDCT bits off from FFT 2016-03-01 10:18:28 +01:00
fft_init.c Merge commit '73ff983e8d' 2016-04-12 15:42:21 +01:00
flac_dsp_gpl.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
flacdsp.asm x86: move XOP emulation code back to x86inc 2015-08-03 17:11:13 -03:00
flacdsp_init.c lavc/flac: Fix encoding and decoding with high lpc. 2015-05-17 02:08:58 +02:00
fmtconvert.asm avcodec/x86/fmtconvert: Add emms to int32_to_float_fmul_array8_sse() 2016-01-15 17:08:37 +01:00
fmtconvert_init.c Merge commit 'dc40a70c57' 2016-06-26 15:53:00 +02:00
fpel.asm Merge commit '009adfd4fb' 2017-03-21 15:02:31 +01:00
fpel.h x86: fpel: Remove erroneous ff_put_pixels8_mmxext prototype 2015-10-19 16:52:37 -07:00
g722dsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
g722dsp_init.c x86/g722dsp: add ff_g722_apply_qmf_sse2 2015-02-16 00:41:21 -03:00
h263_loopfilter.asm x86inc: Drop SECTION_TEXT macro 2015-08-11 11:12:01 +02:00
h263dsp_init.c
h264_chromamc.asm Merge commit 'e4a94d8b36' 2017-03-21 15:20:45 -03:00
h264_chromamc_10bit.asm Merge commit 'e4a94d8b36' 2017-03-21 15:20:45 -03:00
h264_deblock.asm avcodec/h264: enable sse2 chroma deblock/loop filter functions 2017-02-27 13:22:06 +01:00
h264_deblock_10bit.asm avcodec/x86: deduplicate PASS8ROWS macro 2017-02-18 20:26:49 +01:00
h264_i386.h asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
h264_idct.asm avcodec/h264: mmx 4:2:2 idct add8 function 2016-11-30 22:58:27 +01:00
h264_idct_10bit.asm avcodec/h264: sse2 and avx 4:2:2 idct add8 10-bit functions 2016-11-30 22:58:28 +01:00
h264_intrapred.asm Merge commit '5801f9ed24' 2017-03-23 11:58:01 +01:00
h264_intrapred_10bit.asm Merge commit '5801f9ed24' 2017-03-23 11:58:01 +01:00
h264_intrapred_init.c h264pred: added AVX2 implementation for tm_vp8 16x16. 2017-03-20 09:45:42 -04:00
h264_qpel.c Merge commit '0361e4dcb4' 2017-03-31 09:44:04 +02:00
h264_qpel_8bit.asm
h264_qpel_10bit.asm x86: Add missing colons after assembly labels 2016-10-17 16:31:26 +02:00
h264_weight.asm x86: Add missing colons after assembly labels 2016-10-17 16:31:26 +02:00
h264_weight_10bit.asm x86: lavc: share more constant through defines 2015-02-07 17:48:14 +01:00
h264chroma_init.c Merge commit 'e4a94d8b36' 2017-03-21 15:20:45 -03:00
h264dsp_init.c avcodec/h264: enable sse2 chroma deblock/loop filter functions 2017-02-27 13:22:06 +01:00
hevc_add_res.asm x86/hevc_add_res: merge last remaining changes from 3d65359832 2017-03-31 20:49:45 -03:00
hevc_deblock.asm avcodec/x86: deduplicate PASS8ROWS macro 2017-02-18 20:26:49 +01:00
hevc_idct.asm Merge commit '112cee0241' 2017-03-23 15:58:46 +01:00
hevc_mc.asm x86: Add missing colons after assembly labels 2016-10-17 16:31:26 +02:00
hevc_sao.asm x86/hevc_sao: move 10/12bit functions into a separate file 2015-09-30 02:59:55 -03:00
hevc_sao_10bit.asm x86/hevc_sao: add ff_hevc_sao_edge_filter_{8,16}_{10,12} 2015-12-20 17:01:15 -03:00
hevcdsp.h Merge commit '6d5636ad9a' 2017-03-24 12:33:25 +01:00
hevcdsp_init.c Merge commit '6d5636ad9a' 2017-03-24 12:33:25 +01:00
hpeldsp.asm Merge commit '1dfc3cf89d' 2017-01-31 14:49:29 -03:00
hpeldsp.h Revert "Merge commit '0a39c9ac0b'" 2017-02-01 02:01:07 +01:00
hpeldsp_init.c Revert "Merge commit '0a39c9ac0b'" 2017-02-01 02:01:07 +01:00
hpeldsp_rnd_template.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
hpeldsp_vp3.asm Merge commit '1dfc3cf89d' 2017-01-31 14:49:29 -03:00
hpeldsp_vp3_init.c Revert "Merge commit '0a39c9ac0b'" 2017-02-01 02:01:07 +01:00
huffyuvdsp.asm huffyuvdsp: move functions only used by huffyuv from lossless_videodsp 2017-01-12 22:53:05 -03:00
huffyuvdsp_init.c lavc/huffyuvdsp: only transmit the pix_fmt instead of the whole avctx 2017-03-22 16:22:20 +01:00
huffyuvencdsp.asm huffyuvencdsp: move shared functions to a new lossless_videoencdsp context 2017-01-12 22:53:04 -03:00
huffyuvencdsp_init.c huffyuvencdsp: move shared functions to a new lossless_videoencdsp context 2017-01-12 22:53:04 -03:00
idctdsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
idctdsp.h avcodec/x86/idctdsp: Remove duplicate include 2017-03-26 19:17:30 +02:00
idctdsp_init.c x86: simple_idct: 12bits versions 2015-10-13 15:34:32 +02:00
imdct36.asm avcodec/x86/imdct36: fix building with nasm 2.11.05 2017-01-02 20:44:16 +01:00
inline_asm.h Merge commit '41ed7ab45f' 2016-06-21 21:55:34 +02:00
jpeg2000dsp.asm avcodec/x86: add missing colon to labels 2015-07-26 02:50:14 -03:00
jpeg2000dsp_init.c x86: use the new helper macros where useful 2016-02-14 20:00:21 -03:00
lossless_audiodsp.asm x86: lossless audio: SSE4 madd 32bits 2016-05-07 23:28:48 +02:00
lossless_audiodsp_init.c x86: lossless audio: SSE4 madd 32bits 2016-05-07 23:28:48 +02:00
lossless_videodsp.asm Merge commit 'd06dfaa5cb' 2017-01-31 15:36:49 -03:00
lossless_videodsp_init.c avcodec/lossless_videodsp: use ptrdiff_t for length parameters 2017-03-22 18:38:35 -03:00
lossless_videoencdsp.asm avcodec/x86/lossless_videoencdsp: Fix warning: signed dword value exceeds bounds 2017-10-26 17:34:42 +02:00
lossless_videoencdsp_init.c huffyuvencdsp: move shared functions to a new lossless_videoencdsp context 2017-01-12 22:53:04 -03:00
lpc.c Merge commit '4efab89332' 2017-01-31 15:08:19 -03:00
Makefile lavc/x86/hevc: rename hevc_res_add to hevc_add_res 2017-03-24 11:45:23 +01:00
mathops.h Merge commit '48aef27f52' 2015-03-17 20:25:47 +01:00
me_cmp.asm avcodec/x86: add missing colon to labels 2015-07-26 02:50:14 -03:00
me_cmp_init.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
mlpdsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
mlpdsp_init.c x86: use the new helper macros where useful 2016-02-14 20:00:21 -03:00
mpegaudiodsp.c Merge commit '2caa93b813' 2017-03-21 16:04:22 -03:00
mpegvideo.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
mpegvideodsp.c avcodec/x86/mpegvideodsp: Fix signedness bug in need_emu 2017-12-30 21:11:31 +01:00
mpegvideoenc.c avcodec/x86/mpegvideoenc: silence -Wunused-function on --disable-mmx 2015-09-19 23:26:57 +02:00
mpegvideoenc_qns_template.c Merge commit '8d686ca59d' 2014-07-07 15:08:55 +02:00
mpegvideoenc_template.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
mpegvideoencdsp.asm x86/mpegvideoencdsp: improve ff_pix_sum16_sse2 2014-10-01 13:07:22 -03:00
mpegvideoencdsp_init.c Merge commit '7c6eb0a1b7' 2015-07-27 22:10:35 +02:00
pixblockdsp.asm Merge commit 'de452e5037' 2017-03-20 15:58:32 +01:00
pixblockdsp_init.c avcodec/me_cmp: Fix crashes on ARM due to misalignment 2017-09-10 01:33:28 +02:00
pngdsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-11 11:12:01 +02:00
pngdsp_init.c
proresdsp.asm prores: Change type of stride parameters to ptrdiff_t 2016-08-26 11:50:21 +02:00
proresdsp_init.c Merge commit '3fd22538bc' 2017-03-19 15:30:13 -03:00
qpel.asm
qpeldsp.asm x86inc: Drop SECTION_TEXT macro 2015-08-11 11:12:01 +02:00
qpeldsp_init.c Merge commit '7fb993d338' 2014-07-25 13:05:08 +02:00
rnd_template.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
rv34dsp.asm x86/rv34dsp: add ff_rv34_idct_dc_add_sse2 2017-02-02 17:51:21 -03:00
rv34dsp_init.c x86/rv34dsp: add ff_rv34_idct_dc_add_sse2 2017-02-02 17:51:21 -03:00
rv40dsp.asm Merge commit '41ed7ab45f' 2016-06-21 21:55:34 +02:00
rv40dsp_init.c Merge commit 'e4a94d8b36' 2017-03-21 15:20:45 -03:00
sbrdsp.asm x86/aacdec: use HADDPS macro 2016-06-08 14:18:18 -03:00
sbrdsp_init.c x86/sbrdsp: add ff_sbr_autocorrelate_{sse,sse3} 2015-01-25 18:20:39 -03:00
simple_idct.c Merge commit '2ec9fa5ec6' 2017-03-21 14:29:52 -03:00
simple_idct.h Merge commit '2ec9fa5ec6' 2017-03-21 14:29:52 -03:00
simple_idct10.asm x86inc: Add debug symbols indicating sizes of compiled functions 2016-01-21 23:19:46 +01:00
simple_idct10_template.asm Merge commit '3fd22538bc' 2017-03-19 15:30:13 -03:00
snowdsp.c asm: FF_-prefix internal macros used in inline assembly 2016-06-27 17:21:18 +02:00
svq1enc.asm x86inc: Drop SECTION_TEXT macro 2015-08-04 20:13:09 +02:00
svq1enc_init.c x86/svq1enc: port ssd_int8_vs_int16 to yasm 2014-07-05 21:43:40 +02:00
synth_filter.asm avcodec/synth_filter: split off remaining code from dcadec files 2016-01-25 14:57:38 -03:00
synth_filter_init.c x86: use the new helper macros where useful 2016-02-14 20:00:21 -03:00
takdsp.asm x86/takdsp: use arithmetic shift instructions 2015-10-09 23:52:39 -03:00
takdsp_init.c avcodec/takdec: add x86 SIMD for rest of decorrelation modes 2015-10-09 21:38:15 +02:00
ttadsp.asm avcodec/ttadsp: cosmetics 2016-08-06 18:27:01 -03:00
ttadsp_init.c avcodec/ttadsp: cosmetics 2016-08-06 18:27:01 -03:00
ttaencdsp.asm x86/ttaenc: add ff_ttaenc_filter_process_{ssse3,sse4} 2016-08-02 15:48:04 -03:00
ttaencdsp_init.c x86/ttaenc: add ff_ttaenc_filter_process_{ssse3,sse4} 2016-08-02 15:48:04 -03:00
v210-init.c avcodec/x86/v210-init: fix unused variable warning 2015-08-21 17:06:27 +02:00
v210.asm avcodec/x86: add missing colon to labels 2015-07-26 02:50:14 -03:00
v210enc.asm x86: Add missing colons after assembly labels 2016-10-17 16:31:26 +02:00
v210enc_init.c Merge commit 'e280fe1329' 2016-02-16 17:23:32 +00:00
vc1dsp.h
vc1dsp_init.c avcodec/x86/vc1dsp_init: Fix build failure with --disable-optimizations and clang 2017-05-14 00:21:49 +02:00
vc1dsp_loopfilter.asm x86/vc1dsp: Split the file into MC and loopfilter 2016-02-29 08:46:53 -08:00
vc1dsp_mc.asm Merge commit '2ec9fa5ec6' 2017-03-21 14:29:52 -03:00
vc1dsp_mmx.c idct: Change type of array stride parameters to ptrdiff_t 2016-09-29 14:48:03 +02:00
videodsp.asm Merge commit 'b89804da9b' 2017-03-23 18:35:49 -03:00
videodsp_init.c videodsp: assert that linesize is larger than width 2015-07-08 01:32:04 +02:00
vorbisdsp.asm
vorbisdsp_init.c Merge commit '01c5779f56' 2014-04-05 19:16:39 +02:00
vp3dsp.asm Merge commit '6892df9294' 2017-03-19 18:41:26 +01:00
vp3dsp_init.c Merge commit '6892df9294' 2017-03-19 18:41:26 +01:00
vp6dsp.asm Merge commit 'd9d26a3674' 2017-03-19 14:54:25 -03:00
vp6dsp_init.c Merge commit '721d57e608' 2017-03-19 17:15:24 -03:00
vp8dsp.asm Merge commit '802727b538' 2017-03-19 15:18:31 -03:00
vp8dsp_init.c x86/vp8dsp: add ff_vp8_idct_dc_add_sse2 2017-02-02 17:18:58 -03:00
vp8dsp_loopfilter.asm Merge commit '802727b538' 2017-03-19 15:18:31 -03:00
vp9dsp_init.c vp9: re-split the decoder/format/dsp interface header files. 2017-03-28 18:04:26 -04:00
vp9dsp_init.h vp9: re-split the decoder/format/dsp interface header files. 2017-03-28 18:04:26 -04:00
vp9dsp_init_10bpp.c vp9: add subpel MC SIMD for 10/12bpp. 2015-09-16 21:11:34 -04:00
vp9dsp_init_12bpp.c vp9: add subpel MC SIMD for 10/12bpp. 2015-09-16 21:11:34 -04:00
vp9dsp_init_16bpp.c vp9: re-split the decoder/format/dsp interface header files. 2017-03-28 18:04:26 -04:00
vp9dsp_init_16bpp_template.c vp9: re-split the decoder/format/dsp interface header files. 2017-03-28 18:04:26 -04:00
vp9intrapred.asm x86: lavc: share more constants 2015-02-06 23:35:02 +01:00
vp9intrapred_16bpp.asm avcodec/vp9: avx2 implementation of ipred_dl_16x16_16 2017-03-20 09:47:43 -04:00
vp9itxfm.asm x86/vp9itxfm: add missing AVX2 guards 2016-11-18 17:01:11 -03:00
vp9itxfm_16bpp.asm x86/vp9itxfm: fix register clobbering in ff_vp9_idct_idct_4x4_add_12_sse2 2015-10-13 20:21:33 -03:00
vp9itxfm_template.asm vp9: add x86 simd (sse2/ssse3) for iadst4 10bpp functions. 2015-10-13 11:05:58 -04:00
vp9lpf.asm vp9lpf/x86: make filter_16_h work on 32-bit. 2016-10-04 10:54:09 +02:00
vp9lpf_16bpp.asm doc: fix spelling errors 2016-10-21 23:58:47 +02:00
vp9mc.asm Merge commit 'e99ecda550' 2017-03-16 20:25:39 +01:00
vp9mc_16bpp.asm vp9: sse2/ssse3/avx 16bpp loopfilter x86 simd. 2015-10-03 14:42:39 -04:00
vp56_arith.h Fix compilation with !HAVE_6REGS. 2014-04-19 09:56:01 +02:00
w64xmmtest.c Merge commit 'de2ae3c1fa' 2017-03-21 14:43:53 +01:00
xvididct.asm x86: xvid_idct: SSE2 merged add version 2015-03-14 13:36:47 +01:00
xvididct.h Merge commit '2ec9fa5ec6' 2017-03-21 14:29:52 -03:00
xvididct_init.c Merge commit '2ec9fa5ec6' 2017-03-21 14:29:52 -03:00