Page 1 of 2 12 LastLast
Results 1 to 20 of 38

Thread: Topaz Video Enhance AI - Artificial Intelligence Software for Video

  1. #1
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default Topaz Video Enhance AI - Artificial Intelligence Software for Video

    Some may know that I collect music videos from the 70's, 80's and 90's. I try and hunt out the best possible copies I can find and if the audio is a bit shitty, I replace it with a quality track that is not compressed ie, I avoid mp3's and try to only use lossless audio, such as a .wav file ripped from a CD or a lossless track that is encoded as a Flac file......basically, it's similar to mp3 but where mp3 loses quality, flac does not.

    There are many songs that I wish I had a better quality copy of. The ABC's Rage is a great source, but boy, what a mess they are. The degraded quality of a lot of their clips is a disgrace for an organization that has an annual budget of over a billion dollars. Unfortunately, Rage is the only place it is possible to get hold of a lot of Australian videos.

    Over the last year, there has been a marked improvement in the quality of some videos mainly all on official channels on Youtube. By official channels, I mean for example, the official ACDC channel. Music Videos in general have not been filmed in a great way on videotape. Prior to current times, there has only been a certain level to improve them. There have been a couple of exceptions - as an example I will use 2 Pink Floyd concert videos.

    1. Delicate Sound Of Thunder - This came out on VHS and was mind blowing at the time. One interesting thing they did was to record the concert on 35 mm film and not video tape......basically the same as if you were making a movie. For the VHS release, they simply cut the sides off so it fitted our then 4:3 screen televisions.

    2. PULSE - Also a brilliant concert, they made a huge blunder (as acknowledged by David Gilmour) and recorded it on 4:3 videotape for release straight to VHS.

    Nearly 30 odd years later, we have a stark difference on improving them. Film is high quality, and Pink Floyd a couple of years ago re- released Delicate Sound Of Thunder on 16:9 bluray. Wow, what a difference. As an example, from my channel below is a link to "Comfortably Numb" from the Delicate Sound Of Thunder concert. I have downscaled it to 1920x1080, and Youtube also compress it, but it still shows what high quality it is.



    Pulse on the other hand, cannot be replicated to that high standard mainly because it was recorded on video tape. Pink Floyd have re-released it, but it's disappointing compared to DSOT. See the same song, but from the Pulse concert below



    But as I mentioned, there has recently been a major move in that record companies are releasing remastered copies of old videos is what can only be described as amazing quality. New Artificial Intelligence software has changed the game in a big way, even some very average videos can be transformed. I will give you a couple of examples, personal examples as I am responsible for the videos. The video is "April Sun In Cuba" by Dragon. I would expect most would know it, and have seen the video at some stage of their life. The video itself has always been of average quality and suffered from a number of problems, particularly with horizontal lines running through it. Here is the original below, I posted it on Youtube 5 years ago :



    As you can see, average. Poor detail, occasional horizontal lines if you look closely. I had a play with some AI software and this difference was very noticeable. Although they are not the exact same clip (above one was from rage), they were similar quality, if anything this one was worst as it had a lot of "noise" on it, like a sheet of rain. See it below after the AI software improved it :



    Although you can certainly see the difference, it doesn't work brilliantly on all clips - some have slight improvement, some are mind blowing. A couple of years ago I uploaded a remastered copy of "Split Enz - Dirty Creature" to Youtube. I state it as remastered as I made slight video improvements as well as straightening a few lines and replaced the absolute crap audio on it with a lossless version. It was the best I could do with an average clip, I can't remember where I sourced it but you just couldn't get it anywhere. See below :



    Not long after I posted it, Rage actually played it so I recorded it from there HD channel. It was a little better in video quality, but the audio sounded like a tin can. I didn't upload it, as I had already uploaded the above copy. But as mentioned, the video was slightly better and the audio was terrible. This is that clip after I had a play :



    The software requires some reasonably powerful hardware. I bought a new PC earlier this year after getting sick of bordering on minimum requirements for a lot of stuff. my current one is an i9, with 32 gb ram and a Nvidea Gforce RTX 2080 Super 8 gb graphics card. Depending on what profile you use in the software, and more importantly how many FPS there are in the video, it can take up to 90 minutes to encode just one. As an example, Dirty Creature above came in at 3.46 gb in size. I would need a data centre to house my collection I cant keep files that big, so I am going to have to either cut the bitrate or downsize to 1080.

    While photo technology has kept going forward in leaps and bounds, being able to improve video has been limited. Until now.

    NOTE - IF YOU CLICK ON A VIDEO, MAKE SURE IT'S ON 4K. I clicked on it and got 360 ?

  2. The Following 6 Users Say Thank You to admin For This Useful Post:

    efab (17-11-21),fred49au (14-11-21),mtv (13-11-21),shred (13-11-21),Uncle Fester (14-11-21),william10 (14-11-21)



Look Here ->
  • #2
    Administrator
    mtv's Avatar
    Join Date
    Jan 2008
    Posts
    19,893
    Thanks
    7,508
    Thanked 15,066 Times in 6,761 Posts
    Rep Power
    5647
    Reputation
    239305

    Default

    Nice work!

    What software is it that you are using?

  • The Following User Says Thank You to mtv For This Useful Post:

    Uncle Fester (14-11-21)

  • #3
    Senior Member
    Uncle Fester's Avatar
    Join Date
    Jan 2008
    Location
    Commonly found in a pantry or the bottom of a fridge, searching for grains, fermented or distilled
    Posts
    6,405
    Thanks
    2,289
    Thanked 4,414 Times in 2,517 Posts
    Rep Power
    2046
    Reputation
    81778

    Default

    Why re-encode to 4K when the original is 480p or less?
    For the filters to work 1080p would be sufficient to extrapolate the pixels but you are not adding any content.
    Faster encoding and smaller systems could do the same job.

    However digitising 35mm film to 4K is a different story, although you would be basically digitising grain but for authenticity still desirable and also for filters to remove said grain without losing much content.
    But that is something only the studios have access to.
    Last edited by Uncle Fester; 14-11-21 at 11:11 AM.
    Update: A deletion of features that work well and ain't broke but are deemed outdated in order to add things that are up to date and broken.
    Compatibility: A word soon to be deleted from our dictionaries as it is outdated.
    Humans: Entities that are not only outdated but broken... AI-self-learning-update-error...terminate...terminate...

  • #4
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Quote Originally Posted by mtv View Post
    Nice work!

    What software is it that you are using?
    It's called Topaz Video Enhancer AI


    There is a free trial, but it's pretty much useless as it has a giant watermark through the image which is lighter than the rest of the picture. I didn't really get much out the trial, so took a gamble as I know a large number on Youtube are now using it.

  • The Following User Says Thank You to admin For This Useful Post:

    mtv (14-11-21)

  • #5
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Quote Originally Posted by Uncle Fester View Post
    Why re-encode to 4K when the original is 480p or less?
    For the filters to work 1080p would be sufficient to extrapolate the pixels but you are not adding any content.
    Faster encoding and smaller systems could do the same job.
    I'll make it easier for us both by just directing you to the site's FAQ. Artificial Intelligence is obviously a step away from traditional methods.

    This the FAQ section for this particular product (they have a few products)


    At the end of the day, people want their video to look it's best.
    480 sailed away a long time ago unless you are a traditionalist. I cant even find 720 on my phones video camera.

    I wont be keeping giant sized files myself, but am happy to send giant ones to Youtube as I know what they do to them I just downloaded "Dirty Creature" from Youtube, they compressed 3.5 gb to 468.3 mb, very impressive.

  • The Following 2 Users Say Thank You to admin For This Useful Post:

    mtv (14-11-21),Uncle Fester (15-11-21)

  • #6
    Administrator
    mtv's Avatar
    Join Date
    Jan 2008
    Posts
    19,893
    Thanks
    7,508
    Thanked 15,066 Times in 6,761 Posts
    Rep Power
    5647
    Reputation
    239305

    Default

    Quote Originally Posted by admin View Post
    It's called Topaz Video Enhancer AI
    I'll give it a go, as it sounds ideal for my needs.
    From the specs, it should run fine on my system.

  • #7
    Senior Member
    Uncle Fester's Avatar
    Join Date
    Jan 2008
    Location
    Commonly found in a pantry or the bottom of a fridge, searching for grains, fermented or distilled
    Posts
    6,405
    Thanks
    2,289
    Thanked 4,414 Times in 2,517 Posts
    Rep Power
    2046
    Reputation
    81778

    Default

    Quote Originally Posted by admin View Post
    I'll make it easier for us both by just directing you to the site's FAQ. Artificial Intelligence is obviously a step away from traditional methods.

    This the FAQ section for this particular product (they have a few products)

    Nice
    Full M1 native support for all M1 machines in version 2.5 and higher.
    Finally a proper use for the 16 core neural engine !
    Apple decided that Machine learning will be coming to the consumer and this would be the first application for me to try it, that goes beyond just data mining user behaviour.

    Update: A deletion of features that work well and ain't broke but are deemed outdated in order to add things that are up to date and broken.
    Compatibility: A word soon to be deleted from our dictionaries as it is outdated.
    Humans: Entities that are not only outdated but broken... AI-self-learning-update-error...terminate...terminate...

  • #8
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Just a heads up that the presets are exactly that......there is only one single one that I have found that allows manual settings.
    It's called Proteus Fine Tune.

    As a rough starting guide, load your video and my suggestion is to use the suggested models to start. If you click "compare", it will load up 4 windows at once, with the original video in the top left. It will encode a small piece of video using each of the 3 different presets it recommends, so you can choose which one you want to use. It's worth doing......there is nothing worse than waiting 90 minutes for a video that turns out shit

    The software is moving forward at at a fair pace from what I have read, and about 6 days ago when I bought it it was version 2.4. I got an update the next day to 2.6 and it contained about a 30% speed increase which was very noticeable.
    From a time perspective, a video with 50 fps will take twice as long to encode as one with 25 fps. It's worth considering when you are doing some testing as 40 minutes is better than 80 minutes

    Edit : Edited the title to reflect the software name for Google search.

  • The Following User Says Thank You to admin For This Useful Post:

    mtv (15-11-21)

  • #9
    Junior Member Bobby Slogger's Avatar
    Join Date
    Jan 2008
    Posts
    231
    Thanks
    17
    Thanked 47 Times in 32 Posts
    Rep Power
    216
    Reputation
    610

    Default

    Unfortunately, most music videos from the 70s and 80s are stored on video tape and have probably been dubbed down from the original records which were either 1" (or even 2" if in the 70s). The tapes are probably also shedding oxide if that old. The digitisation process will add to the noise when they are re-ingested for TX. Headend compression adds more shit. What you basically get on digital tv (if the source was analogue) is not the best. The best transfers are those by the NFSA - but the process is very time consuming.

  • #10
    Senior Member
    Uncle Fester's Avatar
    Join Date
    Jan 2008
    Location
    Commonly found in a pantry or the bottom of a fridge, searching for grains, fermented or distilled
    Posts
    6,405
    Thanks
    2,289
    Thanked 4,414 Times in 2,517 Posts
    Rep Power
    2046
    Reputation
    81778

    Default

    Quote Originally Posted by Bobby Slogger View Post
    Unfortunately, most music videos from the 70s and 80s are stored on video tape and have probably been dubbed down from the original records which were either 1" (or even 2" if in the 70s). The tapes are probably also shedding oxide if that old. The digitisation process will add to the noise when they are re-ingested for TX. Headend compression adds more shit. What you basically get on digital tv (if the source was analogue) is not the best. The best transfers are those by the NFSA - but the process is very time consuming.
    This tape is from 1971 and looks darn good for that time to me:



    I didn't do this but it will be a test subject when I get around to try out Topaz.
    I will also run it through my trusty AviDemux and compare if Topaz is really that much better.
    Getting good results with all the AViDemux filters can be very time consuming, so I assume Topaz will be figuring that out for me.

    This link seems to be the least messed around with that I could find.
    Main issue are the interlacing errors. I also wonder if the over swing on the trailing edges(from left to right) can be removed without softening.
    There are other attempts to fix this on Youtube, one has unbelievable 4million hits, way too softened out to enjoy and sounds terrible unlike this one.
    Last edited by Uncle Fester; 16-11-21 at 09:17 PM.
    Update: A deletion of features that work well and ain't broke but are deemed outdated in order to add things that are up to date and broken.
    Compatibility: A word soon to be deleted from our dictionaries as it is outdated.
    Humans: Entities that are not only outdated but broken... AI-self-learning-update-error...terminate...terminate...

  • #11
    Junior Member Bobby Slogger's Avatar
    Join Date
    Jan 2008
    Posts
    231
    Thanks
    17
    Thanked 47 Times in 32 Posts
    Rep Power
    216
    Reputation
    610

    Default

    I'd day most probably 2 inch tape and probably dubbed down once before being digitised but definitely not recorded off air - less noise being induced.

  • #12
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    I had to bite when Topaz offered some of their other software dirt cheap on the recent black Friday sale.
    I have extensively researched my family tree and have a fair collection of historic photos or copies of them, and also have my great great grandparents photo album that they got as a wedding present in 1882 full of photos.

    I had a play around with an image of a relative, taken from a portrait circa 1900. As you will see when you click on the link below, it was in pretty rough shape. I don't even have the actual portrait, I cant remember if it's a scan or I used my mobile phone but I visited a distant cousin in Tasmania in 2017 and got it then. It's only 663.3 KB in size.

    I think the results speak for themselves, I am very happy. I will add that Topaz didn't produce all the results. I went over it first with good old freebie Snapseed and manually removed most of the marks with the "Healing" wand before cropping it and then using Topaz Gigapixel AI followed by Topaz Adjust AI.

    663kb Original





    After using Snapseed, Topaz Gigapixel AI and Topaz Adjust AI


  • The Following 2 Users Say Thank You to admin For This Useful Post:

    gulliver (29-03-22),mtv (08-12-21)

  • #13
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    I have also had a play around with some color photos, also with some really good results particularly with reasonable photos on cheap film.
    By that I mean they have been processed fine, but the colors are very dull. Topaz has given them a new life.

  • #14
    Administrator
    mtv's Avatar
    Join Date
    Jan 2008
    Posts
    19,893
    Thanks
    7,508
    Thanked 15,066 Times in 6,761 Posts
    Rep Power
    5647
    Reputation
    239305

    Default

    Can't complain about that result... nice!!!

    I also ended up buying the whole video/image package from Topaz.
    Please consider Premium Membership. Without Premium Member contributions Austech cannot operate.

  • #15
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    To me its worth the money, I will no doubt get my moneys worth over and over. It's also good that they marketed it at a reasonable price, unlike arsehole companies like Adobe etc. who you have to offer your first child to.

    Topaz DeNoise has also been interesting in that I came across a heap of photos that were taken on an old Nokia phone when phone cameras first came out. They were terrible, you can barely even make out who they are. But strip the noise back and they are actually viewable.

    All up, lots of fun, results vary, but I have no doubt their products are just going to get better and better as time goes on.

  • #16
    Senior Member
    Uncle Fester's Avatar
    Join Date
    Jan 2008
    Location
    Commonly found in a pantry or the bottom of a fridge, searching for grains, fermented or distilled
    Posts
    6,405
    Thanks
    2,289
    Thanked 4,414 Times in 2,517 Posts
    Rep Power
    2046
    Reputation
    81778

    Default

    Only playing around with the demos here, I find the only one really worth buying is Gigapixel and I mean REALLY because I have not seen something like it elsewhere, yet.
    Load photo, simply view the amazing result on the before/after screen, save, that's it!
    It sharpens and increases detail all in one. You will find denoise plugins in any reasonable photo editor but I would try Gigapixel without any other editing first. It may or may not suppress the noise, depends on what the AI 'thinks' about that.

    Where Gigapixel failed for me are images that were scanned with a too high resolution setting. I am NOT talking about the resolution multiplier you select with Gigapixel.
    The resolution of the physical image and scanner DPI setting should match to get the best results, so there is a bit of trial and error here.

    With old phone camera images this is always the perfect match and the results are then often mind blowing.
    Last edited by Uncle Fester; 15-12-21 at 07:12 PM.
    Update: A deletion of features that work well and ain't broke but are deemed outdated in order to add things that are up to date and broken.
    Compatibility: A word soon to be deleted from our dictionaries as it is outdated.
    Humans: Entities that are not only outdated but broken... AI-self-learning-update-error...terminate...terminate...

  • #17
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Yes, old phone images are amazing. I found some from an old Sony Erickson that were terrible, you could hardly make out what was in them and the end result was amazing. That's using the whole suite - to me it's worth the money as it's reasonably priced and if you keep an eye open for things like Black Friday sales, you can get the lot at a bargain price. They all work great, denoise is great, sharpen is amazing at times and adjust has turned some great work in to wow work. And of course as you said, Gigapixel sometimes blows your mind as to how it did something.

    All up, I have found Topaz's products the most interesting software I have come across in a long time and I have no doubt that its only going to get better as time goes on.

  • #18
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Well I have certainly been getting a lot of use out of this software remastering videos. And I am still astounded at what it can do. I recently decided to" remaster the remastered" - Pink Floyd - Delicate Sound Of Thunder Blu-Ray.
    This was able to be remastered to a very high standard due to it being recorded on film and not videotape, when it came out on VHS they just cut the ends off for our then 4: 3 televisions. So when they released the remastered version in 2019, everyone was very happy and amazed at the astounding quality.

    I have remastered it from 1920 x 1080 @24fps to 3840 x 2160 @60fps. Boy, what a job. It was encoding for over 2 full days. The end result was just under 50gb. But what a result I got. Here are 7 examples from the concert.


    Blu-Ray Release 1920 x 1080 @24fps




    My remastered version at 3840 x 2160 @60fps


  • #19
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Blu-Ray Release 1920 x 1080 @24fps





    My remastered version at 3840 x 2160 @60fps


  • #20
    Administrator
    admin's Avatar
    Join Date
    Jan 2008
    Location
    Victoria
    Age
    56
    Posts
    31,150
    Thanks
    2,238
    Thanked 13,731 Times in 5,823 Posts
    Rep Power
    4552
    Reputation
    165805

    Default

    Blu-Ray Release 1920 x 1080 @24fps




    My remastered version at 3840 x 2160 @60fps


  • Page 1 of 2 12 LastLast

    Bookmarks

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •