Home Blog

Freebeat Evaluation: The Best Option to Make Viral Music Movies


Do you know that a big a part of human communication (55%) is nonverbal? This contains what we see in physique language and facial expressions.

Which means if you share a publish, a music, or a message on-line, these watching are connecting extra to what they see than what they hear. However right here’s the factor: not everybody has the time, instruments, or data to flip their concepts into scroll-stopping movies.

That’s the place Freebeat is available in.

Freebeat is your shortcut to reworking any music or textual content into dynamic, beat-matching movies. The most effective half? No modifying expertise is required.

On this Freebeat evaluate, I will focus on the professionals and cons, what it’s, who it is best for, and its key options. Then, I will present you the way I used Freebeat to generate clips for the music “Flowers” by Miley Cyrus.

I will end the article by evaluating Freebeat with my high three alternate options (Riffusion, Udio, and Soundraw). By the tip, you will know if Freebeat is best for you!

Verdict

Freebeat is a enjoyable and simple instrument for turning music or textual content into beat-matching movies. It is excellent for all talent ranges. Nonetheless, gradual free-plan speeds, extra clip prices, and restricted customization might frustrate these needing extra management.

Execs and Cons

  • Works for all talent ranges with a easy interface.
  • The AI mechanically turns music, textual content, or photographs into movies.
  • Simply use music from Spotify, YouTube, TikTok, and extra.
  • Visuals mechanically match the music beat completely.
  • Edit particular person clip prompts and regenerate.
  • Utilizing Freebeat on smartphones or tablets will be troublesome.
  • Restricted customization might make superior customers really feel restricted.
  • There’s no sandbox to check earlier than publishing.
  • Video era takes a very long time on the free plan.
  • Regenerating particular person clips prices extra credit.
  • You may inform the clips are generated with AI.

What’s Freebeat?

The Freebeat homepage.

Freebeat is an AI instrument that turns music into visuals, together with lyric movies, dance movies, and extra. It mechanically syncs music with animations and scenes to create partaking social media or streaming content material.

With Freebeat’s newest improve (Freebeat.ai 3.0), the AI instrument has expanded past simply music-to-video instruments. It now gives textual content, picture, and effects-driven video era. This implies you may simply flip absolutely anything (scripts, images, and music tracks) into partaking movies.

The platform helps music from just about all over the place: Spotify, SoundCloud, YouTube, Suno, TikTok, you title it. In any other case, you may add your individual information.

In the event you’re a content material creator making an attempt to construct a social media presence, you may create every little thing from TikToks to YouTube movies. However I am not saying Freebeat is ideal. The clips it generates can look distorted, so that you would possibly have to regenerate if the primary consequence is not fairly proper.

Who’s Freebeat Finest For?

Here is who Freebeat AI is greatest for:

  • Musicians and music producers can use Freebeat to rapidly and simply generate lyric movies, dance movies, or music movies completely synced to their tracks.
  • Content material creators and influencers can use Freebeat to make partaking movies for TikTok, YouTube, Instagram, and different platforms in seconds.
  • Social media managers and digital entrepreneurs can use Freebeat to supply branded video content material for campaigns.
  • Storytellers and entrepreneurs can use Freebeat to show their scripts, images, and concepts into dynamic movies with minimal effort.
  • Rookies in video modifying can use Freebeat’s intuitive workflow to create skilled movies with none prior modifying expertise.

Freebeat Key Options

Listed here are Freebeat’s key options:

  • One-Click on AI Video Creation: Immediately flip music into partaking movies.
  • A number of Video Sorts: Generate dance movies, lyric movies, and music movies.
  • Computerized Beat Synchronization: The AI syncs clips completely to the rhythm of your music.
  • Help for Main Music Platforms: Appropriate with Spotify, YouTube, TikTok, SoundCloud, Suno, Udio, Steady Audio, Riffusion, and native information.
  • Music to Dance Video: Auto-generate dance movies with AI-choreographed avatars and dance types.
  • Music to Lyrics Video: Immediately create animated lyric movies synced to music rhythm.
  • AI Video Generator: Produce movies from textual content or photographs with results and transitions.
  • AI Video Impact: Add numerous AI results (humorous, pageant, inventive, and so on.)
  • Free Inventory Footage: Entry 10,000+ free HD video clips for backgrounds and B-roll.
  • Auto Caption: Robotically generate captions in your uploaded movies.
  • Caption Translation: Translate captions into 31+ languages for international attain.
  • Library: An organized repository for all of your generated movies.

Use Freebeat

Here is how I used Freebeat to generate a music video:

  1. Begin Making Free Movies
  2. Drop a Music Hyperlink
  3. Select a Part of the Music
  4. Select What You Wish to Create
  5. Add a Background Thought & Generate
  6. View the Music Video
  7. Regenerate Clips & Obtain the Video

Step 1: Begin Making Free Movies

Selecting "Make Free Videos" on the Freebeat homepage.

I began by going to freebeat.ai and choosing “Make Free Movies” on the highest proper.

Step 2: Drop a Music Hyperlink

pasting a music link into Freebeat.

Step one was pasting a music hyperlink. The hyperlink may very well be from any of the next platforms:

  • YouTube
  • Spotify
  • Udio
  • TikTok
  • SoundCloud
  • Steady Audio
  • Riffusion
  • Suno

Step 3: Select a Part of the Music

Selecting a part of the song uploaded to Freebeat and sampling it.

I pasted a YouTube hyperlink of “Flowers” by Miley Cyrus. From there, I dragged my choice to the a part of the music I needed (between 15 and 30 seconds), and I sampled it by hitting the play button. I chosen the primary a part of the refrain.

Step 4: Select What You Wish to Create

Creating a music video with Freebeat.

Subsequent, I had to decide on what I needed to create subsequent:

  • Music Video: Flip my music into artwork
  • Dance Video: Dancify my music with characters
  • Lyric Video: Convey music lyrics to life

I made a decision to decide on the “Music Video” possibility.

Step 5: Add a Background Thought & Generate

Adding a background idea and generating a video with Freebeat.

Choosing “Music Video” opened a brand new window, the place I might:

  • Select my mannequin (quick or customized)
  • Describe what I needed to see within the background
  • Select the side ratio (16:9, 4:3, 1:1, 9:16)
  • Choose the decision (720p)
  • Take away the watermark (solely on paid plans)

I saved every little thing on default and added a background concept that I felt match with the theme of my music. I hit “Generate,” which consumed 30 credit.

Using Freebeat to generate a video.

Instantly, Freebeat started producing my video. However I will be trustworthy, the era took longer than anticipated.

Freebeat put me consistent with 12 initiatives forward of me. The one technique to get sooner generations was by upgrading my account.

Step 6: View the Music Video

A while later, I obtained an e-mail from Freebeat telling me my video had been efficiently generated! I chosen it from my music movies.

Step 7: Regenerate Clips & Obtain the Video

Regenerating a clip on Freebeat.

After choosing the video, I went by way of every of the clips. I had two choices:

  1. If I used to be proud of the video, I might obtain it.
  2. If I used to be sad with sure clips, I might regenerate them. Regenerating a person clip consumed three credit.

Waiting in line to regenerate a clip with Freebeat.

One of many clips in my video was inappropriate, so I hit “Regenerate.” I used to be disenchanted to see that regenerating my clip put me again in line for era, which took some time.

Here is how my music video generated with Freebeat turned out:

Freebeat did a terrific job producing clips that aligned with the music’s essence and synchronized nicely with the music’s beat.

Nonetheless, the clips are considerably distorted and clearly AI-generated. In the event you’re sad with how particular person clips turned out, you may at all times edit the immediate and regenerate the clip.

General, Freebeat made it enjoyable and simple to show a music right into a customized music video. Nonetheless, the lengthy era wait and occasional want to repair clips made the method slower than anticipated.

High 3 Freebeat Alternate options

Listed here are the very best Freebeat alternate options I would suggest.

Riffusion

Riffusion homepage.

The primary Freebeat various I’d suggest is Riffusion. Riffusion is an AI music generator that permits you to create full songs immediately from textual content prompts. Simply describe the sound, temper, or style you need, and Riffusion generates unique music in actual time. You may even customise the devices.

On the one hand, Riffusion stands out with its real-time text-to-music era, superior customization, and the power to remix or modify outputs on the fly. It is AI learns your musical preferences over time, and it even options stem separation for isolating devices in skilled workflows.

In the meantime, Freebeat makes a speciality of turning your music, scripts, or textual content prompts into beat-synced music movies, lyric visuals, and dance clips. You may even create branded video content material for social media and advertising.

For customizable AI music era and experimentation, select Riffusion. For quick, professional-quality music video creation and branded content material, select Freebeat!

Learn my Riffusion evaluate or go to Riffusion!

Udio

The subsequent Freebeat various I’d suggest is Udio. Udio is an AI music generator that creates customized studio-quality songs from easy textual content prompts. It covers every little thing from instrumentals to full tracks with vocals and even customized cowl artwork.

Udio stands out with its modifying options. You may lengthen, remix, and inpaint tracks. Which means you may tweak particular sections of a music with out altering the remainder. Udio additionally permits you to export particular person stems to be used in skilled DAWs, and its AI can generate matching cowl artwork in your music.

In the meantime, Freebeat focuses on turning music into partaking visible, lyric, and dance movies with branded content material.

For exact management over music era, superior modifying, {and professional} audio exports, select Udio. For quick video content material synced to music, select Freebeat!

Learn my Udio evaluate or go to Udio!

Soundraw

The ultimate Freebeat various I’d suggest is Soundraw. Soundraw is an AI music generator that creates distinctive, royalty-free tracks by selecting the temper, style, and size you need. Its user-friendly interface permits even newcomers to generate music rapidly. You may additional customise your tracks by adjusting music construction, depth, and instrumentation.

Soundraw stands out with its customization options and wide selection of genres and moods. You may fine-tune components like tempo and instrumentation, rearrange music sections, and personalize the music to suit your venture completely. Soundraw additionally ensures all tracks are royalty-free and unique, addressing copyright considerations for business use.

In the meantime, Freebeat is valued for its means to effectively generate partaking branded music movies.

For producing customizable royalty-free music tracks, select Soundraw. For rapidly producing music and synchronized video content material for social media or advertising, select Freebeat!

Freebeat Evaluation: The Proper Device For You?

Freebeat shocked me with how enjoyable and simple it was to show songs into dynamic, beat-synced movies. It dealt with every little thing mechanically, from producing clips that match with the theme to syncing them as much as the beat of the music.

Nonetheless, the lengthy wait occasions on the free plan and the necessity to spend further credit to repair dangerous clips slowed me down. Additionally, the clips that have been generated have been typically distorted, and you might inform they have been made with AI.

Whereas the outcomes general have been spectacular, they generally felt tough across the edges. This makes Freebeat greatest for quick, mild initiatives versus polished, high-end productions.

For a easy, beginner-friendly technique to carry your music or scripts to life visually, Freebeat is value making an attempt. However when you want deep customization, sooner speeds, or skilled controls, you would possibly really feel a bit boxed in.

In the event you’re interested in the very best Freebeat alternate options, this is what I would suggest:

  • Riffusion is greatest for musicians and creators who need prompt, customizable AI-generated music with remixing and stem separation.
  • Udio is greatest for these wanting exact music modifying, high quality exports, and AI-generated cowl artwork.
  • Soundraw is greatest for creators needing royalty-free music with management over temper, depth, and instrumentation.

Thanks for studying my Freebeat evaluate! I hope you discovered it useful.

Freebeat gives 50 credit without spending a dime to strive their instruments simply by signing up. Strive Freebeat for your self and see the way you prefer it!

Pulumi IDP gives builders with sooner entry to self-service cloud infrastructure provisioning


Pulumi, a supplier of infrastructure as code (IaC) options, introduced a brand new inner developer platform (IDP) for delivering cloud infrastructure for builders. 

Pulumi IDP permits platform groups to publish constructing blocks within the type of Parts, Templates, and Insurance policies. These constructing blocks incorporate greatest practices with normal configurations and enforcement of safety, compliance, price, and operational guidelines.

Builders can then entry these constructing blocks to provision and handle cloud functions and infrastructure. Pulumi meets builders the place they’re by enabling them to entry the IDP by way of a no-code interface, low-code YAML-based CI/CI pipelines, IaC of their most popular language, or a REST API. 

Builders can set up tasks into Providers, which Pulumi describes as logical containers of cloud infrastructure, configuration, secrets and techniques, documentation, and observability dashboards, equivalent to an online utility, microservice, Jupyter pocket book, or information pipeline. 

Pulumi IDP additionally options safeguards for day 2 operations and past, equivalent to drift and coverage detection and remediation, auditing of outdated elements and templates, and alter administration throughout updates. 

Different capabilities of the IDP embody approval workflows, a visible import software for bringing unmanaged cloud infrastructure into Pulumi, and a sophisticated IAM system.

The brand new providing is on the market as a managed SaaS resolution or it may be self-hosted. It’s presently out there as a public preview, free for Pulumi prospects, and might be usually out there later this yr. 

“CTOs, CIOs, and engineering leaders inform us that the tempo of innovation is quicker than ever,” stated Joe Duffy, co-founder and CEO of Pulumi. “To succeed, builders should transfer quick – with out breaking issues. Pulumi IDP is the cloud infrastructure platform trendy groups have been asking for: infrastructure-first, multi-cloud, immensely highly effective and versatile, with built-in safety and full visibility and controls. It turns the cloud right into a aggressive benefit.”

Constructing pleasant Android digicam and media experiences



Constructing pleasant Android digicam and media experiences

Posted by Donovan McMurray, Mayuri Khinvasara Khabya, Mozart Louis, and Nevin Mital – Developer Relations Engineers

Hiya Android Builders!

We’re the Android Developer Relations Digital camera & Media group, and we’re excited to carry you one thing just a little completely different at this time. Over the previous a number of months, we’ve been exhausting at work writing pattern code and constructing demos that showcase methods to benefit from all the good potential Android affords for constructing pleasant person experiences.

A few of these efforts can be found so that you can discover now, and a few you’ll see later all year long, however for this weblog publish we thought we’d share among the learnings we gathered whereas going by this train.

Seize your favourite Android plush or rubber duck, and browse on to see what we’ve been as much as!

Future-proof your app with Jetpack

Nevin Mital

Certainly one of our focuses for the previous a number of years has been bettering the developer instruments accessible for video enhancing on Android. This led to the creation of the Jetpack Media3 Transformer APIs, which supply options for each single-asset and multi-asset video enhancing preview and export. As we speak, I’d wish to give attention to the Composition demo app, a pattern app that showcases among the multi-asset enhancing experiences that Transformer permits.

I began by including a customized video compositor to display how one can organize enter video sequences into completely different layouts to your remaining composition, comparable to a 2×2 grid or a picture-in-picture overlay. You may customise this by implementing a VideoCompositorSettings and overriding the getOverlaySettings technique. This object can then be set when constructing your Composition with setVideoCompositorSettings.

Right here is an instance for the 2×2 grid structure:

object : VideoCompositorSettings {
  ...

  override enjoyable getOverlaySettings(inputId: Int, presentationTimeUs: Lengthy): OverlaySettings {
    return when (inputId) {
      0 -> { // First sequence is positioned within the high left
        StaticOverlaySettings.Builder()
          .setScale(0.5f, 0.5f)
          .setOverlayFrameAnchor(0f, 0f) // Center of overlay
          .setBackgroundFrameAnchor(-0.5f, 0.5f) // High-left part of background
          .construct()
      }

      1 -> { // Second sequence is positioned within the high proper
        StaticOverlaySettings.Builder()
          .setScale(0.5f, 0.5f)
          .setOverlayFrameAnchor(0f, 0f) // Center of overlay
          .setBackgroundFrameAnchor(0.5f, 0.5f) // High-right part of background
          .construct()
      }

      2 -> { // Third sequence is positioned within the backside left
        StaticOverlaySettings.Builder()
          .setScale(0.5f, 0.5f)
          .setOverlayFrameAnchor(0f, 0f) // Center of overlay
          .setBackgroundFrameAnchor(-0.5f, -0.5f) // Backside-left part of background
          .construct()
      }

      3 -> { // Fourth sequence is positioned within the backside proper
        StaticOverlaySettings.Builder()
          .setScale(0.5f, 0.5f)
          .setOverlayFrameAnchor(0f, 0f) // Center of overlay
          .setBackgroundFrameAnchor(0.5f, -0.5f) // Backside-right part of background
          .construct()
      }

      else -> {
        StaticOverlaySettings.Builder().construct()
      }
    }
  }
}

Since getOverlaySettings additionally supplies a presentation time, we will even animate the structure, comparable to on this picture-in-picture instance:

moving image of picture in picture on a mobile device

Subsequent, I spent a while migrating the Composition demo app to make use of Jetpack Compose. With difficult enhancing flows, it may assist to benefit from as a lot display house as is obtainable, so I made a decision to make use of the supporting pane adaptive structure. This fashion, the person can fine-tune their video creation on the preview display, and export choices are solely proven on the identical time on a bigger show. Under, you may see how the UI dynamically adapts to the display measurement on a foldable machine, when switching from the outer display to the interior display and vice versa.

What’s nice is that by utilizing Jetpack Media3 and Jetpack Compose, these options additionally carry over seamlessly to different units and kind components, comparable to the brand new Android XR platform. Proper out-of-the-box, I used to be in a position to run the demo app in House House with the 2D UI I already had. And with some small updates, I used to be even in a position to adapt the UI particularly for XR with options comparable to a number of panels, and to take additional benefit of the additional house, an Orbiter with playback controls for the enhancing preview.

moving image of suportive pane adaptive layout

What’s nice is that by utilizing Jetpack Media3 and Jetpack Compose, these options additionally carry over seamlessly to different units and kind components, comparable to the brand new Android XR platform. Proper out-of-the-box, I used to be in a position to run the demo app in House House with the 2D UI I already had. And with some small updates, I used to be even in a position to adapt the UI particularly for XR with options comparable to a number of panels, and to take additional benefit of the additional house, an Orbiter with playback controls for the enhancing preview.

moving image of sequential composition preview in Android XR

Orbiter(
  place = OrbiterEdge.Backside,
  offset = EdgeOffset.interior(offset = MaterialTheme.spacing.normal),
  alignment = Alignment.CenterHorizontally,
  form = SpatialRoundedCornerShape(CornerSize(28.dp))
) {
  Row (horizontalArrangement = Association.spacedBy(MaterialTheme.spacing.mini)) {
    // Playback management for rewinding by 10 seconds
    FilledTonalIconButton({ viewModel.seekBack(10_000L) }) {
      Icon(
        painter = painterResource(id = R.drawable.rewind_10),
        contentDescription = "Rewind by 10 seconds"
      )
    }
    // Playback management for play/pause
    FilledTonalIconButton({ viewModel.togglePlay() }) {
      Icon(
        painter = painterResource(id = R.drawable.rounded_play_pause_24),
        contentDescription = 
            if(viewModel.compositionPlayer.isPlaying) {
                "Pause preview playback"
            } else {
                "Resume preview playback"
            }
      )
    }
    // Playback management for forwarding by 10 seconds
    FilledTonalIconButton({ viewModel.seekForward(10_000L) }) {
      Icon(
        painter = painterResource(id = R.drawable.forward_10),
        contentDescription = "Ahead by 10 seconds"
      )
    }
  }
}

Jetpack libraries unlock premium performance incrementally

Donovan McMurray

Not solely do our Jetpack libraries have you ever lined by working persistently throughout present and future units, however additionally they open the doorways to superior performance and customized behaviors to assist all sorts of app experiences. In a nutshell, our Jetpack libraries intention to make the widespread case very accessible and simple, and it has hooks for including extra customized options later.

We’ve labored with many apps who’ve switched to a Jetpack library, constructed the fundamentals, added their vital customized options, and truly saved developer time over their estimates. Let’s check out CameraX and the way this incremental growth can supercharge your course of.

// Arrange CameraX app with preview and picture seize.
// Notice: setting the decision selector is elective, and if not set,
// then a default 4:3 ratio will likely be used.
val aspectRatioStrategy = AspectRatioStrategy(
  AspectRatio.RATIO_16_9, AspectRatioStrategy.FALLBACK_RULE_NONE)
var resolutionSelector = ResolutionSelector.Builder()
  .setAspectRatioStrategy(aspectRatioStrategy)
  .construct()

personal val previewUseCase = Preview.Builder()
  .setResolutionSelector(resolutionSelector)
  .construct()
personal val imageCaptureUseCase = ImageCapture.Builder()
  .setResolutionSelector(resolutionSelector)
  .setCaptureMode(ImageCapture.CAPTURE_MODE_MINIMIZE_LATENCY)
  .construct()

val useCaseGroupBuilder = UseCaseGroup.Builder()
  .addUseCase(previewUseCase)
  .addUseCase(imageCaptureUseCase)

cameraProvider.unbindAll()

digicam = cameraProvider.bindToLifecycle(
  this,  // lifecycleOwner
  CameraSelector.DEFAULT_BACK_CAMERA,
  useCaseGroupBuilder.construct(),
)

After organising the essential construction for CameraX, you may arrange a easy UI with a digicam preview and a shutter button. You need to use the CameraX Viewfinder composable which shows a Preview stream from a CameraX SurfaceRequest.

// Create preview
Field(
  Modifier
    .background(Coloration.Black)
    .fillMaxSize(),
  contentAlignment = Alignment.Heart,
) {
  surfaceRequest?.let {
    CameraXViewfinder(
      modifier = Modifier.fillMaxSize(),
      implementationMode = ImplementationMode.EXTERNAL,
      surfaceRequest = surfaceRequest,
     )
  }
  Button(
    onClick = onPhotoCapture,
    form = CircleShape,
    colours = ButtonDefaults.buttonColors(containerColor = Coloration.White),
    modifier = Modifier
      .peak(75.dp)
      .width(75.dp),
  )
}

enjoyable onPhotoCapture() {
  // Not proven: defining the ImageCapture.OutputFileOptions for
  // your saved photographs
  imageCaptureUseCase.takePicture(
    outputOptions,
    ContextCompat.getMainExecutor(context),
    object : ImageCapture.OnImageSavedCallback {
      override enjoyable onError(exc: ImageCaptureException) {
        val msg = "Photograph seize failed."
        Toast.makeText(context, msg, Toast.LENGTH_SHORT).present()
      }

      override enjoyable onImageSaved(output: ImageCapture.OutputFileResults) {
        val savedUri = output.savedUri
        if (savedUri != null) {
          // Do one thing with the savedUri if wanted
        } else {
          val msg = "Photograph seize failed."
          Toast.makeText(context, msg, Toast.LENGTH_SHORT).present()
        }
      }
    },
  )
}

You’re already on monitor for a strong digicam expertise, however what for those who needed so as to add some additional options to your customers? Including filters and results are simple with CameraX’s Media3 impact integration, which is one of many new options launched in CameraX 1.4.0.

Right here’s how easy it’s so as to add a black and white filter from Media3’s built-in results.

val media3Effect = Media3Effect(
  utility,
  PREVIEW or IMAGE_CAPTURE,
  ContextCompat.getMainExecutor(utility),
  {},
)
media3Effect.setEffects(listOf(RgbFilter.createGrayscaleFilter()))
useCaseGroupBuilder.addEffect(media3Effect)

The Media3Effect object takes a Context, a bitwise illustration of the use case constants for focused UseCases, an Executor, and an error listener. You then set the checklist of results you need to apply. Lastly, you add the impact to the useCaseGroupBuilder we outlined earlier.

moving image of sequential composition preview in Android XR

(Left) Our digicam app with no filter utilized. 
 (Proper) Our digicam app after the createGrayscaleFilter was added.

There are lots of different built-in results you may add, too! See the Media3 Impact documentation for extra choices, like brightness, colour lookup tables (LUTs), distinction, blur, and lots of different results.

To take your results to yet one more stage, it’s additionally attainable to outline your individual results by implementing the GlEffect interface, which acts as a manufacturing unit of GlShaderPrograms. You may implement a BaseGlShaderProgram’s drawFrame() technique to implement a customized impact of your individual. A minimal implementation ought to inform your graphics library to make use of its shader program, bind the shader program’s vertex attributes and uniforms, and situation a drawing command.

Jetpack libraries meet you the place you might be and your app’s wants. Whether or not that be a easy, fast-to-implement, and dependable implementation, or customized performance that helps the vital person journeys in your app stand out from the remaining, Jetpack has you lined!

Jetpack affords a basis for revolutionary AI Options

Mayuri Khinvasara Khabya

Simply as Donovan demonstrated with CameraX for seize, Jetpack Media3 supplies a dependable, customizable, and feature-rich resolution for playback with ExoPlayer. The AI Samples app builds on this basis to please customers with useful and enriching AI-driven additions.

In at this time’s quickly evolving digital panorama, customers count on extra from their media purposes. Merely enjoying movies is now not sufficient. Builders are consistently looking for methods to boost person experiences and supply deeper engagement. Leveraging the ability of Synthetic Intelligence (AI), notably when constructed upon sturdy media frameworks like Media3, affords thrilling alternatives. Let’s check out among the methods we will remodel the best way customers work together with video content material:

    • Empowering Video Understanding: The core concept is to make use of AI, particularly multimodal fashions just like the Gemini Flash and Professional fashions, to research video content material and extract significant info. This goes past merely enjoying a video; it is about understanding what’s within the video and making that info readily accessible to the person.
    • Actionable Insights: The aim is to remodel uncooked video into summaries, insights, and interactive experiences. This permits customers to shortly grasp the content material of a video and discover particular info they want or be taught one thing new!
    • Accessibility and Engagement: AI helps make movies extra accessible by offering options like summaries, translations, and descriptions. It additionally goals to extend person engagement by interactive options.

A Glimpse into AI-Powered Video Journeys

The next instance demonstrates potential video journies enhanced by synthetic intelligence. This pattern integrates a number of parts, comparable to ExoPlayer and Transformer from Media3; the Firebase SDK (leveraging Vertex AI on Android); and Jetpack Compose, ViewModel, and StateFlow. The code will likely be accessible quickly on Github.

moving images of examples of AI-powered video journeys

(Left) Video summarization  
 (Proper) Thumbnails timestamps and HDR body extraction

There are two experiences specifically that I’d like to spotlight:

    • HDR Thumbnails: AI might help establish key moments within the video that would make for good thumbnails. With these timestamps, you need to use the brand new ExperimentalFrameExtractor API from Media3 to extract HDR thumbnails from movies, offering richer visible previews.
    • Textual content-to-Speech: AI can be utilized to transform textual info derived from the video into spoken audio, enhancing accessibility. On Android you can even select to play audio in several languages and dialects thus enhancing personalization for a wider viewers.

Utilizing the best AI resolution

At present, solely cloud fashions assist video inputs, so we went forward with a cloud-based resolution.Iintegrating Firebase in our pattern empowers the app to:

    • Generate real-time, concise video summaries routinely.
    • Produce complete content material metadata, together with chapter markers and related hashtags.
    • Facilitate seamless multilingual content material translation.

So how do you truly work together with a video and work with Gemini to course of it? First, ship your video as an enter parameter to your immediate:

val promptData =
"Summarize this video within the type of high 3-4 takeaways solely. Write within the type of bullet factors. Do not assume if you do not know"

val generativeModel = Firebase.vertexAI.generativeModel("gemini-2.0-flash")
_outputText.worth = OutputTextState.Loading

viewModelScope.launch(Dispatchers.IO) {
    strive {
        val requestContent = content material {
            fileData(videoSource.toString(), "video/mp4")
            textual content(immediate)
        }
        val outputStringBuilder = StringBuilder()

        generativeModel.generateContentStream(requestContent).gather { response ->
            outputStringBuilder.append(response.textual content)
            _outputText.worth = OutputTextState.Success(outputStringBuilder.toString())
        }

        _outputText.worth = OutputTextState.Success(outputStringBuilder.toString())

    } catch (error: Exception) {
        _outputText.worth = error.localizedMessage?.let { OutputTextState.Error(it) }
    }
}

Discover there are two key parts right here:

    • FileData: This element integrates a video into the question.
    • Immediate: This asks the person what particular help they want from AI in relation to the offered video.

In fact, you may finetune your immediate as per your necessities and get the responses accordingly.

In conclusion, by harnessing the capabilities of Jetpack Media3 and integrating AI options like Gemini by Firebase, you may considerably elevate video experiences on Android. This mix permits superior options like video summaries, enriched metadata, and seamless multilingual translations, in the end enhancing accessibility and engagement for customers. As these applied sciences proceed to evolve, the potential for creating much more dynamic and clever video purposes is huge.

Go above-and-beyond with specialised APIs

Mozart Louis

Android 16 introduces the brand new audio PCM Offload mode which might scale back the ability consumption of audio playback in your app, resulting in longer playback time and elevated person engagement. Eliminating the ability nervousness enormously enhances the person expertise.

Oboe is Android’s premiere audio api that builders are in a position to make use of to create excessive efficiency, low latency audio apps. A brand new function is being added to the Android NDK and Android 16 known as Native PCM Offload playback.

Offload playback helps save battery life when enjoying audio. It really works by sending a big chunk of audio to a particular a part of the machine’s {hardware} (a DSP). This permits the CPU of the machine to enter a low-power state whereas the DSP handles enjoying the sound. This works with uncompressed audio (like PCM) and compressed audio (like MP3 or AAC), the place the DSP additionally takes care of decoding.

This may end up in vital energy saving whereas enjoying again audio and is ideal for purposes that play audio within the background or whereas the display is off (suppose audiobooks, podcasts, music and so on).

We created the pattern app PowerPlay to display methods to implement these options utilizing the most recent NDK model, C++ and Jetpack Compose.

Listed here are crucial components!

First order of enterprise is to guarantee the machine helps audio offload of the file attributes you want. Within the instance beneath, we’re checking if the machine assist audio offload of stereo, float PCM file with a pattern price of 48000Hz.

       val format = AudioFormat.Builder()
            .setEncoding(AudioFormat.ENCODING_PCM_FLOAT)
            .setSampleRate(48000)
            .setChannelMask(AudioFormat.CHANNEL_OUT_STEREO)
            .construct()

        val attributes =
            AudioAttributes.Builder()
                .setContentType(AudioAttributes.CONTENT_TYPE_MUSIC)
                .setUsage(AudioAttributes.USAGE_MEDIA)
                .construct()
       
        val isOffloadSupported = 
            if (Construct.VERSION.SDK_INT >= Construct.VERSION_CODES.Q) {
                AudioManager.isOffloadedPlaybackSupported(format, attributes)
            } else {
                false
            }

        if (isOffloadSupported) {
            participant.initializeAudio(PerformanceMode::POWER_SAVING_OFFLOADED)
        }

As soon as we all know the machine helps audio offload, we will confidently set the Oboe audio streams’ efficiency mode to the brand new efficiency mode possibility, PerformanceMode::POWER_SAVING_OFFLOADED.

// Create an audio stream
        AudioStreamBuilder builder;
        builder.setChannelCount(mChannelCount);
        builder.setDataCallback(mDataCallback);
        builder.setFormat(AudioFormat::Float);
        builder.setSampleRate(48000);

        builder.setErrorCallback(mErrorCallback);
        builder.setPresentationCallback(mPresentationCallback);
        builder.setPerformanceMode(PerformanceMode::POWER_SAVING_OFFLOADED);
        builder.setFramesPerDataCallback(128);
        builder.setSharingMode(SharingMode::Unique);
           builder.setSampleRateConversionQuality(SampleRateConversionQuality::Medium);
        End result consequence = builder.openStream(mAudioStream);

Now when audio is performed again, it is going to be offloading audio to the DSP, serving to save energy when enjoying again audio.

There’s extra to this function that will likely be lined in a future weblog publish, absolutely detailing out the entire new accessible APIs that may assist you to optimize your audio playback expertise!

What’s subsequent

In fact, we had been solely in a position to share the tip of the iceberg with you right here, so to dive deeper into the samples, take a look at the next hyperlinks:

Hopefully these examples have impressed you to discover what new and interesting experiences you may construct on Android. Tune in to our session at Google I/O in a pair weeks to be taught much more about use-cases supported by options like Jetpack CameraX and Jetpack Media3!

WisdomAI Launches with $23M to Remodel Enterprise Intelligence Utilizing Reasoning Brokers and Data Cloth


WisdomAI, a brand new drive in enterprise AI, has formally emerged from stealth with $23 million in funding, led by Coatue Ventures alongside Madrona, GTM Capital, and The Anthology Fund. Designed to beat the constraints of legacy enterprise intelligence instruments, WisdomAI introduces a first-of-its-kind Agentic Knowledge Insights Platform—a system that empowers organizations to realize proactive, contextual, and quick insights from throughout their fragmented knowledge ecosystems.

Fortune 100 firms like Cisco and ConocoPhillips are already utilizing WisdomAI to unlock insights that have been beforehand buried beneath knowledge silos, delayed by dashboards, or caught in outdated reporting methods.

Transferring Past Dashboards with Agentic Intelligence

Fashionable organizations make investments closely in knowledge infrastructure—knowledge warehouses, visualization instruments, CRMs—however nonetheless face a core bottleneck: changing that knowledge into well timed, actionable selections. Conventional dashboards and experiences are restricted to pre-configured insights and require analysts to translate enterprise questions into queries.

WisdomAI replaces static dashboards with clever, reasoning brokers that perceive enterprise semantics and ship insights by pure language interfaces. These AI brokers don’t simply retrieve knowledge—they interpret, join, and motive throughout disparate sources to supply clear, actionable steerage.

The Core of WisdomAI: Data Cloth + Specialised AI Brokers

On the coronary heart of WisdomAI is the Data Cloth, an evolving layer that learns the relationships, terminology, and KPIs distinctive to every enterprise. In contrast to generic LLMs, this material is enriched by human area experience and repeatedly up to date with real-time knowledge throughout each structured and unstructured sources.

Sitting on high of this clever context engine are three AI-powered brokers:

  • Data Curation Agent: Quickly assimilates your small business’s knowledge vocabulary, mapping key ideas and metrics into the Data Cloth. This layer captures institutional information that generic AI fashions miss.

  • Prompt Solutions Agent: Allows anybody—from executives to frontline staff—to ask enterprise questions in plain English and obtain quick, correct solutions in the most effective format (tables, charts, or textual content).

  • Proactive Insights Agent: Constantly displays your knowledge, alerting you to alternatives or threats—like churn dangers or price range anomalies—earlier than they escalate.

Personalised, Safe, and Able to Combine

WisdomAI connects on to your present stack: databases, spreadsheets, CRMs, ERPs, advertising and marketing instruments, and productiveness platforms like Slack and Microsoft Groups. There’s no want to tear and exchange infrastructure—WisdomAI capabilities as an clever overlay.

Safety is paramount. WisdomAI doesn’t prepare or fine-tune LLMs in your proprietary knowledge. The Data Cloth stays non-public and organization-specific. Enterprises also can convey their very own LLMs to fulfill distinctive compliance and governance necessities.

Furthermore, responses are role-aware and tailor-made. A salesman, for instance, may obtain insights on pipeline well being, whereas a CMO might entry blended advertising and marketing efficiency throughout channels. Groups additionally profit from shared studying, as WisdomAI recommends insights based mostly on what colleagues are discovering.

Use Instances Throughout the Enterprise Spectrum

WisdomAI is designed to help a number of enterprise capabilities:

  • Gross sales & RevOps: Alert groups to at-risk offers and enhance conversion charges by analyzing pipeline well being in actual time.

  • Advertising: Mix marketing campaign knowledge, channel efficiency, and viewers insights to spice up ROI.

  • Buyer Success: Establish churn indicators, upsell alternatives, and put together QBRs routinely.

  • Manufacturing & Provide Chain: Forecast demand, optimize assets, and spot operational inefficiencies by AI-powered analytics.

In all instances, WisdomAI permits a shift from reactive reporting to real-time, proactive decision-making.

The Quick-Monitor Improvement Behind WisdomAI

A key a part of WisdomAI’s capacity to innovate quickly lies in its embrace of AI-assisted software program improvement, sometimes called vibe coding. This method flips conventional product improvement on its head—beginning with code first, then iterating on design. By utilizing AI to generate purposeful software program based mostly on pure language prompts or high-level targets, builders at WisdomAI can shortly prototype key options and get real-time suggestions from precise utilization.

This execute-first methodology permits WisdomAI’s designers to refine UX and visible layers based mostly on actual behaviors, not static wireframes. As a substitute of lengthy design cycles earlier than a single line of code is written, groups vibe with the product because it evolves—designing straight on high of dwell AI-generated performance.

The consequence? A system that feels intuitive from day one and repeatedly improves by real-world interplay.

Closing Ideas: The Way forward for Knowledge-Pushed Choices

WisdomAI isn’t simply fixing a tech downside—it’s addressing a strategic hole in how enterprises function. As Sri Viswanath of Coatue Ventures put it, “Actual-time insights essentially change how companies function… With out accessible intelligence, these early warning indicators stay buried within the knowledge.”

Karan Mehandru, Managing Director at Madrona, echoed the sentiment: “WisdomAI solves [decision-making bottlenecks] with an clever platform that connects disparate knowledge sources and transforms them into proactive insights that present a decisive aggressive benefit.”

In an period of AI overload, WisdomAI stands out by providing not simply intelligence—however company. The platform doesn’t wait so that you can analyze your knowledge. It meets you the place you’re, understands your objectives, and works beside you—anticipating, analyzing, and advising.

With WisdomAI, the way forward for enterprise intelligence is now not passive. It’s agentic, personalised, safe, and proactive.

The Community Impression of Cloud Safety and Operations


I not too long ago visited a small firm with 20 staff. Its IT group was within the means of shifting everybody to digital desktops and different expertise it might doubtlessly “cloudify.”

My preliminary response was shock. The identical firm had invested closely in an inside community with a small knowledge middle solely two years earlier, however now it was becoming a member of the 96% of corporations that use a public cloud.

The IT workers welcomed the transfer to cloud as a result of they may outsource extra day-to-day IT and maintain their inside workers lean. Customers additionally welcomed the transfer as a result of the corporate might scale sources, reminiscent of networks, rapidly and deftly.

As soon as IT shifted to the cloud, the subsequent step was to revise community documentation. This was when the community workers skilled its “aha” second, as everybody acknowledged that the topology of the community was now so totally different that the community had been reinvented. It was a community that also had bodily contact factors throughout the knowledge middle, however it largely directed site visitors inside and between clouds.

The community workers found they, too, needed to change — in how they carried out day by day operations, monitored actions and efficiency, enforced safety, provisioned new sources and deliberate for load balancing and failover.

Associated:NVIDIA Beefs up its AI Safety Capabilities with DOCA Argus

Modifications Introduced on by a Community Transfer to Cloud

When a community extends to the cloud, day by day community operations change. It is a truism not just for small corporations, however for bigger ones as properly. Accordingly, listed here are a number of the adjustments and challenges that community teams face when networks transfer to the cloud:

  • Safety vulnerabilities and lack of management.

  • Community help for a cloud-enabled firm.

1. Safety Vulnerabilities and Lack of Management

Earlier than corporations began extending networks into the cloud, they primarily administered safety enforcement on inside networks. Community workers used applied sciences reminiscent of id entry administration (IAM) to trace person actions internally and at a primary degree within the cloud. They used safety monitoring software program for the interior community, they usually secured community endpoints and gadgets. In addition they had methods to quickly concern safety updates to programs and gadgets.

With the transfer of extra networking to the cloud, nonetheless, IT loses a lot of the visibility it had into safety and person actions. IAM cannot give community workers granular seems into person entry and actions throughout clouds, so groups have to contemplate new id administration choices.

One such possibility is cloud id entitlement administration (CIEM), which may present the identical degree of granular visibility within the cloud that the community workers has on premises with IAM. Moreover, corporations face a future want for an overarching id administration package deal, reminiscent of id governance administration, that may combine each CIEM and IAM in a single pane of glass.

Associated:Edge Computing and the Burgeoning IoT Safety Menace

Community safety and monitoring additionally change. With cloud-based networks, the community workers now not has all its administration software program below its direct management. It now should work with its varied cloud suppliers on safety.

On this atmosphere, some small firm community workers choose to outsource safety and community administration to their cloud suppliers. Bigger corporations that need extra direct management may favor to upskill their community workers on the totally different safety and configuration toolsets that every cloud supplier makes accessible.

2. Community Help for a Cloud-Enabled Firm

The transfer of functions and programs to extra cloud companies is partially fueled by the expansion of citizen IT. That is when finish customers in departments have mini IT budgets and subscribe to new IT cloud companies, of which IT and community teams aren’t at all times conscious.

This creates potential safety vulnerabilities, and it forces extra community teams to phase networks into smaller items for larger management. They need to additionally implement zero-trust networks that may instantly detect any IT useful resource, reminiscent of a cloud service, {that a} person provides, subtracts or adjustments on the community.

Associated:IAM and CIEM Enhance Community Safety and 360-Diploma Visibility

3. Catastrophe Restoration

Community managers are additionally discovering that they should rewrite their catastrophe restoration plans for cloud. The methods and operations that had been developed for the interior community are nonetheless related. However as soon as the community extends into the cloud, community workers needs to be ready for an interruption of service that would happen anyplace, whether or not it is within the bodily or digital community world.

It may be advanced to work out a brand new community catastrophe restoration plan that encompasses each cloud and on-premises networks. Groups should coordinate with exterior cloud suppliers that host enterprise community companies. The discussions can rapidly contain administrative and contractual points in addition to community restoration points.

Last Ideas

Corporations can profit from utilizing cloud-based sources to broaden the attain of company networks, which is why nearly each firm’s community workers is pushing a transfer to the cloud. Nevertheless, with an prolonged community attain that depends on outsourced sources, the safety vulnerability floor additionally broadens. This requires extra complete approaches to safety and governance, in addition to a plethora of recent toolsets that community workers should grasp to maintain up with the change.

Failover, catastrophe restoration, uptime and community service commitments additionally come into focus. With cloud-based networks, community groups perceive that they cannot deal with this stuff alone. They need to work with cloud distributors, each technically and contractually.