Hi, At the piksel07 festival in Bergen, cehteh, hermanr, raffa and I met and we did a little brainstorming about Linux Video Editing stuff, and the following is a list of the stuff we found.
Have fun, -Richard -------8<---------- Linux Video Editing: Open Problems Problem #1: Detect Interlacing in Videofiles/streams, through Image Analysis Subproblems: * Detect 3x2 Pulldown, vs. Video. * Topfield first vs. Bottomfield first. Relevant Links: * http://silicontrip.net/~mark/lavtools/ Possible Problems: * Later Editing could introduce sudden changes in pulldown sequence Possible Approches: * Compare fields, to detect duplicates, which is common in pulleddown material. * Look at deinterlacers in MPlayer etc. Unsolvable: Put a 60i Overlay, (Titles) on a 3x2 Pulldown source. Problem #2: Develop Algorithms and Processing code, for not-upsampled YUV 4:2:0 or 4:1:1 Source Footage. Common Filters and Operations. Chroma-Keyers, etc. Problem #3: Interaction between Cinelerra/Linux Video Editing, and Scientific Community, Research on Image-Processing, Algorithms, etc. Have someone that reviews scientific Papers for their relevance for Video Editing. Problem #4: General Purpose Image Processing Library, accellerated using OpenGL Graphics Hardware. Ideas: Processing Graph, Automating Parameters, Different Colorspaces, Packed vs. Unpacked, Software Fallbacks for unavailable Hardware features, Scaling, Aspect-Ratios, Interlacing, take model of OpenGL Shaders into account. Problem #5: Simple Control Protocol, most likely OSC, because it is widely used in the Audio Community. Jack-Transport for Playback Syncronization. Subproblems: * Jog-Dial Support/Daemon over OSC? * Hardware-Support, Slider-Decks, Knobs, etc. * MIDI to OSC? Problem #6: Temporally compressed Video processing, MPEG, GOPs Subproblem 1#: „Give me Frame 10"! No matter whether B, P or I Frame. No consideration of Performance. * Consider Memory Mapping Compressed Files, reusing kernel file cache * Fast-Forward, Seeking, Scrubbing, Sustained, illusion of instant access * Sparse fetching of compressed GOPs. * Detect and reproduce bitrates and stream restrictions (think: export to devices) * „clever" reencoding around cuts, collapse GOPs if necessary? * (Keyframe marker in UI) * Index Building (File index, endianess neutral) Problem #7: Detect scene changes in footage, with image processing Problem #8: Multiprocessing: Multicore, Distributed. Research? * Distributing footage (e.g. NFS) vs. homebrow protocol * Review Scientific Papers to multiprocessing * Is abstraction between Multicore vs. Distribution possible. * Compression on Render nodes, means Network capacitiy is no bottleneck. * One GOP per Node? * Lossless Codec? * Failure Tolerance? Crashing Nodes? Failover? * Adding Node? Network Autodetection Avahi, Zeroconf? * Endianess, Different Operating Systems, Distributions. Simple Tasks: * Make Youtube simple uploader program in C with libcurl Problems that still need Discussion: * Intermediate Formats * Plugin generation _______________________________________________ Cinelerra mailing list Cinelerra@skolelinux.no https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra
