
	Compression project (most info is in Russian) >> About In English: Video >> Public filters \| Com. filters \| Video Codecs Comparisons \| Our Video Codecs \| Video Quality Metrics \|\| New: Compression Catalog! Personal (English) >> V.Yoockin \| A.Ratushnyak In Russian: "Compression Methods" book \| Arctest \| Download \| FIDO \| Forum \| Links

Hot news:
* 4-th H.264 codecs test!
* Million filters downloads!
* Video Quality Metric 1.5!

If you find a spelling error, please select an incorrect text and press Ctrl+Enter. Thank you!

Compression project >> Video Area Home

Call for MPEG4-AVC/H.264 codecs

Third Annual H.264 video codec comparison
For people, who make real research in field of high-end video compression

MSU Graphics & Media Lab (Video Group) See CALL FOR CODECS of Fourth Annual MPEG-4 AVC/H.264 comparison!

Important Dates

August, 1 – deadline for receipt of a H.264 codec with required presets

August, 15 – deadline for settling technical problems with codec’s functioning

Task of the Comparison

To perform comparative unbiased analysis of the current software implementations of H.264/MPEG-4 AVC video coding standard using objective metrics

Scope of test

Summary report topics:

Encoding and decoding time

Objective measurements (PSNR, SSIM, VQM, Average Advantage and etc)

Analysis of averaged objective results

Leaders in different areas

Cross-compatibility test

See previous comparison for details.

Comparison Rules

There will be three types of testing sequences and for every type there will be specific set of presets, bitrates, and profiles:

HDTV streams

resolutions: 1920x1080, 1280x720

bitrates 1-10 Mbps

2-pass encoding (1-pass is possible if 2-pass mode doesn't implemented)

speed requirements (at 3 Mbps, 1920x1080 sequences): minimum 0.4 fps.

Movie streams

different types of content (movie, animation)

resolutions: PAL, NTSC, 4CIF

bitrates 500-2000 Kbps

3 presets: "1-pass High Speed", "1-pass High Quality" and "2-pass High Quality"

speed requirements (at 750 Kbps, 4CIF sequence):

Minimum 10 fps for "1-pass High Speed" preset

Minimum 4 fps for "1-pass High Quality" prest

Minimum 1 fps for "2-pass High Quality" preset

Videoconference streams

birates 30-300 Kbps

resolutions: QCIF, CIF, 4CIF

"High Speed" and "High Quality" presets

speed requirements (at 200 Kbps, CIF sequences):

Minimum 70 fps for "fast" preset

Minimum 30 fps for "best" preset

All codec’s options and presets should be provided by codec’s authors

An important restriction on a preset is encoding time for it. A few iterations of compliance testing and preset optimization are possible to meet the requirements set above

All speed measurements will be performed using our testing hardware (detailed description see below).

There will be two types of decoding:

All encoded sequences are decoding with reference JM decoder (for encoders testing)

All encoded sequences are decoding with its own decoder (for decoders testing, for example, decoders’ post-processing). The results of this type of decoding will be in comparison's appendix.

There will be cross-compatibility test (all possible encoder-decoder pairs)

All measurements will be performed using MSU Video Quality Measurement Tool (Pro Version)

Before results' publishing each developer will receive the results of its codec and competitive free codecs. Authors of each codec can write a comment (one paragraph) about the comparison results. That comment will be included in the report.

We are willing to completely or partially delete information about some codec in the public version of comparison report due to codec's developers request only in exceptional cases (e.g. critical errors in a codec).

If your company want to receive results of your codec testing without publication and information disclosure, you should pay for measurements and report preparing before comparison's beginning. You can join to comparison for free if you agree that your codec's results will be published.

Testing Hardware Characteristics

Processor: AMD64 3000+

OS Name: Microsoft Windows XP Professional

System Manufacturer: NVIDIA

System Type: X86-based PC

Total Physical Memory: 1 024.00 MB

Total Virtual Memory: 2.00 GB

Codec Requirements

You should point implemented H.264/AVC profile for each preset

Presets for different types of video sequences should be provided by the developers

Codec should allow to set arbitrary bitrate of resulting stream

3 variants of codec interface are possible:

Console codec version (with batch processing support — bitrate and file names must be possible to assign from the command line). This variant is most preferable.

Video for Windows Codec with correct state saving (batch processing support)

Direct Show filter. In this case software for batch processing should be provided by the developers.

Codec should open and save *.yuv or *.avi (YV12 colorspace) files

Encoder should be compatible with JM 9.8 reference decoder

Developers Deliverables

Following deliverables should be provided by each developer:

Codec files (CLI executable file is preferable)

Short description of codec parameters

Codec's presets with pointing of used H.264/AVC profile.

The Facts about the Previous H.264 Video Codecs Comparison

There were more than 50.000 downloads of previous H.264 video codec comparison results

Many codec's bugs were found and reported to developers

Here you can see Selected comments for MPEG-4 AVC/H.264 video codecs comparison

Sequences

HDTV sequences:

Concert

Movie sequences

Battle

rancho

Matrix

Futurama

Videoconference sequences:

Foreman

Akiyo

Carphone

Useful Links

Second Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison

MPEG-2 Video Decoders "Crash-Test" Comparison

MSU MPEG-4 SP/ASP Codecs Comparison

MSU Lossless Video Codecs Comparison

Contact Information

See all MSU Video Codec Comparisons

New comparisons versions:

Second Annual MPEG-4 AVC/H.264 Video Codec Comparison (December 2005)

FAQ of Second Annual MPEG-4 AVC/H.264 Video Codec Comparison

Other materials

Video resources:

Public MSU video filters
Here are available VirtualDub and AviSynth filters. Commonly we develop a whole family of some kind of a filter. Generally there are also versions optimized for PC and hardware implementations (ASIC/FPGA/DSP). These optimized versions can be licensed to companies. Please contact us for details via video(at)graphics.cs.msu_ru.

MSU Cartoon Restore (New!)
MSU Cartoon Restore (New!)
MSU Noise Estimation (New!)
MSU Frame Rate Conversion (New!)
MSU Image Restoration (New!)
MSU Denoising (Top!)
MSU Old Cinema
MSU Deblocking (Top!)
MSU Smart Brightness and Contrast (Top!)
MSU Smart Sharpen (Top!)
MSU Noise generation
MSU Noise estimation
MSU Motion Estimation Information
MSU Subtitles removal
MSU Logo removal (Top!)
MSU Deflicker (Top!)
MSU Field Shift Fixer AviSynth plug-in
MSU StegoVideo
MSU Cartoonizer (Top!)
MSU SmartDeblocking (Top!)
MSU Color Enhancement
MSU Old Color Restoration
MSU filters FAQ (Read me!)
MSU filters statistics
MSU filters for companies
We are working with Intel, Samsung, RealNetworks and other companies on adapting our filters other video processing algorithms for specific video streams, applications and hardware like TV-sets, graphics cards, etc. Some of such projects are non-exclusive. Also we have internal researches. Please let us know via video(at)graphics.cs.msu_ru if you are interested in acquiring a license for such filters or making a custom R&D project on video processing, compression, computer vision.

Automatic Objects Segmentation (New!)
Semiautomatic Objects Segmentation
New Frame Rate Conversion (New!)
New Deinterlacer (New!)
MSU-Samsung Deinterlacing Project
Digital TV Signal Enhancement
Old Film Recovery
Tuner TV Restore
Panorama
Video2Photo
SuperResolution
SuperPrecision
MSU-Samsung image and video resampling
MSU-Samsung Frame Rate Conversion
Motion Phase filter
Deshaker (video stabilization)
Film Grain/Degrain filter
Deblurring filter
Video Content Search

Codecs comparisons
Objective and subjective quality evaluation
tests for video and image codecs

4-th MPEG4-AVC/H.264 Comparison (New!)
Lossless Video Codecs Comparison 2007 (New!)
3-rd MPEG4-AVC/H.264 Comparison
HD Photo and JPEG 2000 Comparison
MPEG-2 Decoders Crash Test (Top!)
Subjective Compar. of 4 Modern Codecs (Top!)
2-nd MPEG-4 AVC/H.264 Comparison (Top!)

FAQ of 2-nd H.264 Comparison

1-st MPEG-4 AVC/H.264 Codecs Comparison

FAQ of 1-st H.264 Comparison

JPEG 2000 Image Codecs Comparison (Top!)
Lossless Video Codecs Comparison 2004
MPEG-4 SP/ASP Codecs Comparison (Top!)
Video codecs comparison (old)

Ext. link: x264 parameters efficiency comparison
Video quality metrics
Programs with different objective and subjective video quality metrics implementation

MSU Video Quality Metric - objective metrics for codecs and filters comparison (Top!)

Implemented metrics short info: PSNR, Delta, MSAD, MSE, SSIM, VQM, MSU Blurring, MSU Blocking
MSU Brightness Flicking Metric
MSU Brightness Independent PSNR
MSU Drop Frame Metric
MSU Noise Estimation Metric
MSU VQM Metric Tool FAQ

MSU Human Perceptual Quality Metric - several metrics for exact visual tests (Top!)

Implemented metrics short info: ITU-R BT.500-11: DSIS, DSCQS I & II, SCACJ; EBU: SAMVIQ; MSUCQE
MSU PVQ Metric Tool FAQ

Video codecs projects
Different research and development
projects on video codecs

MSU Lossless Video Codec (Top!)
MSU Screen Capture Lossless Codec (Top!)
MSU MPEG-2 Video Codec
x264 Codec Improvement
Other
Other information

Crazy gallery (filters screams :)
License for commercial usage of MSU VideoGroup Public Software (please be careful: some soft like metrics has another license!)

Bookmark this page:

Add to Del.icio.us Digg It

Digg It

Last updated: 12-October-2007

Server size: 7489 files, 921Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab

	Send your comments to compression_##_graphicon.ru © Dr. D.Vatolin, Dr. M.Smirnov, A.Ratushnyak, V.Yoockin, content, 2001-2008 © A.Andreev, pictures, 2002