Add muxer for JPEG 2000 over MPEG TS

added Component::Stream output: Muxers label

J2K video descriptor can be found on page 104 of this document.

Many of the descriptor's fields are straightforward, but there are a few that are not:

profile_and_level (RSIZ parameter from J2K main header):

broadcast profile and level values:

A) J2K supports the following profiles:

#define PROFILE_NONE 0x0000 /** no profile, conform to 15444-1 */

#define PROFILE_0 0x0001 /** Profile 0 as described in 15444-1,Table A.45 */

#define PROFILE_1 0x0002 /** Profile 1 as described in 15444-1,Table A.45 */

#define PROFILE_PART2 0x8000 /** At least 1 extension defined in 15444-2 (Part-2) */

#define PROFILE_CINEMA_2K 0x0003 /** 2K cinema profile defined in 15444-1 AMD1 */

#define PROFILE_CINEMA_4K 0x0004 /** 4K cinema profile defined in 15444-1 AMD1 */

#define PROFILE_CINEMA_S2K 0x0005 /** Scalable 2K cinema profile defined in 15444-1 AMD2 */

#define PROFILE_CINEMA_S4K 0x0006 /** Scalable 4K cinema profile defined in 15444-1 AMD2 */

#define PROFILE_CINEMA_LTS 0x0007 /** Long term storage cinema profile defined in 15444-1 AMD2 */

#define PROFILE_BC_SINGLE 0x0100 /** Single Tile Broadcast profile defined in 15444-1 AMD3 */

#define PROFILE_BC_MULTI 0x0200 /** Multi Tile Broadcast profile defined in 15444-1 AMD3 */

#define PROFILE_BC_MULTI_R 0x0300 /** Multi Tile Reversible Broadcast profile defined in 15444-1 AMD3 */

#define PROFILE_IMF_2K 0x0400 /** 2K Single Tile Lossy IMF profile defined in 15444-1 AMD 8 */

#define PROFILE_IMF_4K 0x0401 /** 4K Single Tile Lossy IMF profile defined in 15444-1 AMD 8 */

#define PROFILE_IMF_8K 0x0402 /** 8K Single Tile Lossy IMF profile defined in 15444-1 AMD 8 */

#define PROFILE_IMF_2K_R 0x0403 /** 2K Single/Multi Tile Reversible IMF profile defined in 15444-1 AMD 8 */

#define PROFILE_IMF_4K_R 0x0800 /** 4K Single/Multi Tile Reversible IMF profile defined in 15444-1 AMD 8 */

#define PROFILE_IMF_8K_R 0x0801 /** 8K Single/Multi Tile Reversible IMF profile defined in 15444-1 AMD 8 */

For broadcast profiles, the PROFILE_XXX value has to be bitwise OR'd with the targeted main level (3-0 LSB, value between 0 and 11), as described below :

B) Main level is a number between 0 and 11, and indicates max bit rate and sample rate, where bit rate is measured in Mega bits per second (Mbps), and sample rate is measured in Mega samples per second (Msps)

0: no maximum

1: 200 Mbps; 65 Msps

2: 200 Mbps; 130 Msps

3: 200 Mbps; 195 Msps

4: 400 Mbps; 260 Msps

5: 800 Mbps; 520 Msps

For level >= 6, we have

[2 to the power (level-6)] * 1600 Mbps;

[2 to the power (level-6)] * 1200 Msps

Another field that needs more details: color_specification

This field takes the following values:

sRGB 0x01

Rec-601 0x02

Rec-709 0x03

CIE-LUV 0x04

CIE-XYZ 0x05

Rec-2020 0x06

SMPTE-2084 0x07

Note: 1 Mbps == 10 to the 6th power bits per second

Mandatory:

Encoder BROADCAST Profile support 0x0100

avcodec has none.

and as for now, it doesn't seem any support for this one in openjpeg

Thanks. I don't think it will be hard to add support for this profile. Except, we are at the mercy of OpenJPEG maintainers merging this in.

Will work on this.

FYI: support for MPEG TS mux and demux is currently being added to gstreamer:

https://bugzilla.gnome.org/show_bug.cgi?id=753323

Could you provide a sample file that allows to test the demuxer?

Here is a recipe for creating a sample broadcast stream :

(tools used: Ffmpeg, Graphics Magick and kdu_v_compress from Kakadu J2K toolkit)

(Kakadu has free demo apps for windows, Linux, here: http://kakadusoftware.com/downloads/ )

// 1. start with a folder of TIFF images

// 2. rename all files in directory to foo followed by an increasing sequence of consecutive numbers $ c=0; ls -rt | while read -r file; do ((++c)); mv "

{file}" "

(printf 'foo_%04d.%s' "

c" "

{file#*.}")"; done

// 3. force resize of all images in directory into 2K resolution $ c=0; ls -rt | while read -r file; do ((++c)); gm convert -size 1920x1080! "

{file}" -resize 1920x1080! "

{file}"; done

// 4. batch convert tiff to 8 bit (FFmpeg didn't like 12 bit TIFF) $ c=0; ls -rt | while read -r file; do ((++c)); gm convert "

{file}" -define tiff:bits-per-sample=8 "

{file}"; done

// 5. create YUV video file from tiff sequence $ ffmpeg -i foo_%04d.tif -vf format=yuv444p12le 1920x1080x5x444.yuv

// 6. convert to broadcast format with elementary stream headers $ kdu_v_compress -i 1920x1080x5x444.yuv -o test.jpb -jpb_data 1,200

GStreamer project now has a working muxer/demuxer for J2K over MPEG TS.

https://bugzilla.gnome.org/show_bug.cgi?id=753323

This code is checked into gstreamer master - not yet released. Sample pipelines are listed in the gstreamer bugzilla ticket.

This should allow VLC to test this feature with GStreamer, if anyone is interested.

I still don't see the purpose if you don't have access to a decoder/encoder which can produce the required broadcast profile.

If you have access to a working pipeline, please feed a sample somewhere

Well, when muxing, you create a PES header plus raw J2K codestream. And codestream knows nothing about profiles. So, the muxer can simply set profile and main level to whatever it wants, or based on user settings.

This is what we are doing in the GStreamer muxer at the moment: we are being lenient, so if profile is not broadcast profile, we set it to broadcast.

Someone could make a feature request to openjpeg to allow setting the profile and main level ?

Gstreamer bug mentioned above lists a number of working pipelines, so it is easy to get a stream running.

e89ca614

added Status::fixed label

changed milestone to %3.0 FF

closed

Thanks, where may I find the commit that closed this feature ? Couldn't locate it in the vlc repo on github.

Replying to [comment:16 boxerab]:

Thanks, where may I find the commit that closed this feature ? Couldn't locate it in the vlc repo on github.

We don't use github. Github is evil.

https://git.videolan.org/?p=vlc.git;a=summary

?que?

https://github.com/videolan

:) Thanks, that was incredibly fast to implement this. Hats off to fcartegnie !

I will let the gstreamer guys know : we can do interop testing between projects.

So, I got my hands on a real TR1 sample capture file.

http://s3.amazonaws.com/fox_misc/aperi_tr01_1s_pkts-C.cap.gz

If Francois wants to test demux on this file, get it while you can - not sure how long it will be up on Amazon.

After really annoying work to convert back to binary

https://streams.videolan.org/streams/ts/JP2K_aperi_tr01_1s.ts

Add muxer for JPEG 2000 over MPEG TS

Child items 0

Activity