\n
![](\"https:\/\/blogger.googleusercontent.com\/img\/b\/R29vZ2xl\/AVvXsEifgV_wUMIzInKtKXR9FyNh7h00qDygaA6fRVDMqMxht68oPNmrAJfZtM_Vf6-3VD8FVGKoSoljaILjtn7ygMwCdBcXPJAvH3fUWiw2LfZBHh4qFSrMvOZLqlDiPVILmiBBo8jKZb0izoq0jxA1tFR9MKf5tDr112svVgsIhdxNnQTK8xf1n7GyduQYT9Q\/s1600\/Jetpack-Media3-Processing.png\")
<\/p>\nPosted by Nevin Mital \u2013 Developer Relations Engineer, and Kristina Simakova \u2013 Engineering Manager<\/em><\/p>\n Android users have demonstrated an increasing desire to create, personalize, and share video content online, whether to preserve their memories or to make people laugh. As such, media editing is a cornerstone of many engaging Android apps, and historically developers have often relied on external libraries to handle operations such as Trimming and Resizing. While these solutions are powerful, integrating and managing external library dependencies can introduce complexity and lead to challenges with managing performance and quality.<\/p>\n The Jetpack Media3 Transformer APIs offer a native Android solution that streamline media editing with fast performance, extensive customizability, and broad device compatibility. In this blog post, we\u2019ll walk through some of the most common editing operations with Transformer and discuss its performance.<\/p>\n To get started with Transformer, check out our Getting Started<\/a> documentation for details on how to add the dependency to your project and a basic understanding of the workflow when using Transformer. In a nutshell, you\u2019ll:<\/p>\n Aside:<\/b> You can also use a CompositionPlayer<\/a><\/span> to preview your edits before exporting, but this is out of scope for this blog post, as this API is still a work in progress. Please stay tuned for a future post!<\/p><\/blockquote>\n Here\u2019s what this looks like in code:<\/p>\n <\/p>\n Let\u2019s now take a look at four of the most common single-asset media editing operations, starting with Transcoding<\/i>.<\/p>\n Transcoding<\/b> is the process of re-encoding an input file into a specified output format. For this example, we\u2019ll request the output to have video in HEVC (H265) and audio in AAC. Starting with the code above, here are the lines that change:<\/p>\n <\/p>\n Many of you may already be familiar with FFmpeg<\/a>, a popular open-source library for processing media files, so we\u2019ll also include FFmpeg commands for each example to serve as a helpful reference. Here\u2019s how you can perform the same transcoding with FFmpeg:<\/p>\n <\/p>\n The next operation we\u2019ll try is Trimming<\/b>.<\/p>\n Specifically, we\u2019ll set Transformer up to trim the input video from the 3 second mark to the 8 second mark, resulting in a 5 second output video. Starting again from the code in the \u201cGetting set up\u201d section above, here are the lines that change:<\/p>\n <\/p>\n With FFmpeg:<\/p>\n <\/p>\n Next, we can mute<\/b> the audio in the exported video file.<\/p>\n <\/p>\n The corresponding FFmpeg command:<\/p>\n <\/p>\n And for our final example, we\u2019ll try resizing<\/b> the input video by scaling it down to half its original height and width.<\/p>\n <\/p>\n An FFmpeg command could look like this:<\/p>\n <\/p>\n Of course, you can also combine these operations to apply multiple edits on the same video, but hopefully these examples serve to demonstrate that the Transformer APIs make configuring these edits simple.<\/p>\n Here are some benchmarking measurements for each of the 4 operations taken with the Stopwatch API, running on a Pixel 9 Pro XL device:<\/p>\n (Note that performance for operations like these can depend on a variety of reasons, such as the current load the device is under, so the numbers below should be taken as rough estimates.)<\/i><\/p>\n Input video format:<\/b> 10s 720p H264 video with AAC audio<\/a><\/p>\n Input video format:<\/b> 25s 360p VP8 video with Vorbis audio<\/a><\/p>\n Input video format:<\/b> 4s 8k H265 video with AAC audio<\/a><\/p>\n One technique Transformer uses to speed up editing operations is by prioritizing transmuxing<\/i> for basic video edits where possible. Transmuxing<\/b> refers to the process of repackaging video streams without re-encoding, which ensures high-quality output and significantly faster processing times.<\/p>\n When not possible, Transformer falls back to transcoding, a process that involves first decoding video samples into raw data, then re-encoding them for storage in a new container. Here are some of these differences:<\/p>\n <\/image><\/p>\n <\/image><\/p>\n We are continuously implementing further optimizations, such as the recently introduced experimentalSetTrimOptimizationEnabled<\/a><\/span> setting that we used in the Trimming example above.<\/p>\n A trim is usually performed by re-encoding all the samples in the file, but since encoded media samples are stored chronologically in their container, we can improve efficiency by only re-encoding the group of pictures<\/i> (GOP) between the start point of the trim and the first keyframes at\/after the start point, then stream-copying the rest.<\/p>\n Since we only decode and encode a fixed portion of any file, the encoding latency is roughly constant, regardless of what the input video duration is. For long videos, this improved latency is dramatic. The optimization relies on being able to stitch part of the input file with newly-encoded output, which means that the encoder’s output format and the input format must be compatible.<\/p>\n If the optimization fails, Transformer automatically falls back to normal export.<\/p>\n As part of Media3, Transformer is a native solution with low integration complexity, is tested on and ensures compatibility with a wide variety of devices, and is customizable to fit your specific needs.<\/p>\n To dive deeper, you can explore Media3 Transformer documentation<\/a>, run our sample apps<\/a>, or learn how to complement your media editing pipeline with Jetpack Media3<\/a>. We\u2019ve already seen app developers benefit greatly from adopting Transformer<\/a>, so we encourage you to try them out yourself to streamline your media editing workflows and enhance your app\u2019s performance!<\/p>\n<\/div>\n![](\"https:\/\/blogger.googleusercontent.com\/img\/b\/R29vZ2xl\/AVvXsEiiJNdGSk1eFCtZbcQJl7Tj-8Adto42Rn6bHT2EOkkRFVKklpyoZmZHtUkACfnbIbSotZv2oyJwSiMCrM2KJ5e_OyqwWMbXyTxuWoht755j540OGyWthdBM2PQBsFs12X9cVk9OiASFgfRgDCfRn6R-hTrB7st-V5wUqlmUi15THdsRXAtUWtWAY1vonyI\/s1600\/Jetpack-Media3-Processing%20%281%29.png\")
<\/a><\/p>\nGetting set up with Transformer<\/span><\/h2>\n
\n
\n
\n
\n
\n
val<\/span> mediaItem = MediaItem.Builder().setUri(mediaItemUri).build()\nval<\/span> editedMediaItem = EditedMediaItem.Builder(mediaItem).build()\nval<\/span> transformer = \n Transformer.Builder(context)\n .addListener(\/* Add a Transformer.Listener instance here for completion events *\/<\/span>)\n .build()\ntransformer.start(editedMediaItem, outputFilePath)\n<\/pre>\n<\/div>\nTranscoding, Trimming, Muting, and Resizing with the Transformer API<\/span><\/h2>\n
val<\/span> transformer = \n Transformer.Builder(context)\n .addListener(...)\n .setVideoMimeType(MimeTypes.VIDEO_H265)\n .setAudioMimeType(MimeTypes.AUDIO_AAC)<\/b>\n .build()\n<\/pre>\n<\/div>\n$ ffmpeg -<\/span>i $inputVideoPath<\/span> -<\/span>c:<\/span>v libx265 -<\/span>c:<\/span>a aac<\/b> $outputFilePath<\/span>\n<\/pre>\n<\/div>\n\/\/ Configure the trim operation by adding a ClippingConfiguration to<\/span>\n\/\/ the media item<\/span>\nval<\/span> clippingConfiguration =\n MediaItem.ClippingConfiguration.Builder()\n .setStartPositionMs(3000<\/span>)\n .setEndPositionMs(8000<\/span>)\n .build()<\/b>\nval<\/span> mediaItem =\n MediaItem.Builder()\n .setUri(mediaItemUri)\n .setClippingConfiguration(clippingConfiguration)<\/b>\n .build()\n\n\/\/ Transformer also has a trim optimization feature we can enable.<\/span>\n\/\/ This will prioritize Transmuxing over Transcoding where possible.<\/span>\n\/\/ See more about Transmuxing further down in this post.<\/span>\nval<\/span> transformer = \n Transformer.Builder(context)\n .addListener(...)\n .experimentalSetTrimOptimizationEnabled(true<\/span>)<\/b>\n .build()\n<\/pre>\n<\/div>\n$ ffmpeg -<\/span>ss 00:00:03<\/span><\/b> -<\/span>i $inputVideoPath<\/span> -<\/span>t 00:00:05<\/span><\/b> $outputFilePath<\/span>\n<\/pre>\n<\/div>\nval<\/span> editedMediaItem = \n EditedMediaItem.Builder(mediaItem)\n .setRemoveAudio(true<\/span>)<\/b>\n .build()\n<\/pre>\n<\/div>\n$ ffmpeg -<\/span>i $inputVideoPath<\/span> -<\/span>c copy -<\/span>an<\/b> $outputFilePath<\/span>\n<\/pre>\n<\/div>\nval<\/span> scaleEffect = \n ScaleAndRotateTransformation.Builder()\n .setScale(0.5f<\/span>, 0.5f<\/span>)\n .build()<\/b>\nval<\/span> editedMediaItem =\n EditedMediaItem.Builder(mediaItem)\n .setEffects(\n \/* audio *\/<\/span> Effects(emptyList(), \n \/* video *\/<\/span> listOf(scaleEffect))<\/b>\n )\n .build()\n<\/pre>\n<\/div>\n$ ffmpeg -<\/span>i $inputVideoPath<\/span> -<\/span>filter:<\/span>v scale=<\/span>w=<\/span>trunc(iw\/4<\/span>)*2:<\/span>h=<\/span>trunc(ih\/4<\/span>)*2<\/span><\/b> $outputFilePath<\/span>\n<\/pre>\n<\/div>\nTransformer API Performance results<\/span><\/h2>\n
\n
\n
\n
\n
Transmuxing<\/span><\/h3>\n
\n
\n
<\/div>\nTranscoding<\/span><\/h3>\n
\n
\n
<\/div>\nWhat\u2019s next?<\/h3>\n