The very best educational and news content for Stable Diffusion, AI, LLMs, SDXL, LoRA, DreamBooth AI Lectures, Voice Cloning, DeepFake, Tech, Tips
Testing Stable Diffusion Inference Performance with Latest NVIDIA Driver including TensorRT ONNX
1-Click fresh Automatic1111 SD Web UI Installer Script with TensorRT and more ⤵️
https://www.patreon.com/posts/86307255
🚀 UNLOCK INSANE SPEED BOOSTS with NVIDIA's Latest Driver Update or not? 🚀 Are you ready to turbocharge your AI performance? Watch me compare the brand-new NVIDIA 555 driver against the older 552 driver on an RTX 3090 TI for #StableDiffusion. Discover how TensorRT and ONNX models can skyrocket your speed! Don't miss out on these game-changing results!
0:00 Introduction to the NVIDIA newest driver update performance boost claims
0:25 What I am going to test and compare in this video
1:11 How to install latest version of Automatic1111 Web UI
1:40 The very best sampler of Automatic1111 for Stable Diffusion image generation / inference
1:57 Automatic1111 SD Web UI default installation versions
2:12 RTX 3090 TI image generation / inference speed for SDXL model with default Automatic1111 SD Web UI installation
2:22 How to see your NVIDIA driver version and many more info with nvitop library
2:40 Default installation speed for NVIDIA 551.23 driver
2:53 How to update Automatic1111 SD Web UI to the latest Torch and xFormers
3:05 Which CPU and RAM used to conduct these speed tests CPU-Z results
3:54 nvitop status while generating an image with Stable Diffusion XL - SDLX on Automatic1111 Web UI
4:10 The new generation speed after updating Torch (2.3.0) and xFormers (0.0.26) to the latest version
4:20 How to install TensorRT extension on Automatic1111 SD Web UI
5:28 How to generate a TensorRT ONNX model for huge speed up during image generation / inference
6:39 How to enable SD Unet selection to be able to use TensorRT generated model
7:13 TensorRT pros and cons
7:38 TensorRT image generation / inference speed results
8:09 How to download and install the latest NVIDIA driver properly and cleanly on Windows
9:03 Repeating all the testing again on the newest NVIDIA driver (555.85)
10:06 Comparison of other optimizations such as SDP attention or doggettx
10.:35 Conclusion of the tutorial
NVIDIA's Latest Driver: Does It Really Deliver?
In this video, we dive deep into NVIDIA's newest driver update, comparing the performance of driver versions 552 and 555 on an RTX 3090 TI running Windows 10. We'll explore the claims of speed improvements, particularly with #ONNX runtime and TensorRT integration, using the popular Automatic1111 Web UI.
What You'll Learn:
Driver Comparison: Direct performance comparison between NVIDIA drivers 552 and 555.
Setup and Installation: Step-by-step guide on setting up a fresh #Automatic1111 Web UI installation, including the latest versions of Torch and xFormers.
ONNX and TensorRT Models: Detailed testing of default and TensorRT-generated models to measure speed differences.
Hardware Specifications: Insights into the hardware used for testing, including CPU and memory configurations.
Testing Procedure:
Initial Setup:
Fresh installation using a custom installer script which includes necessary models and styles.
Initial speed test with default settings and configurations.
Driver 552 Performance:
Speed testing on driver 552 with default models and configurations.
Detailed performance metrics and image generation speed analysis.
Upgrading to Latest Torch and xFormers:
Updating to the latest versions of Torch (2.3.0) and xFormers (0.0.26).
Performance testing after updates and comparison with initial setup.
TensorRT Installation and Testing:
Installing TensorRT extension and generating TensorRT models.
Overcoming common installation errors and optimizations.
Speed testing with TensorRT models and analysis of performance improvements.
Upgrading to Driver 555:
Step-by-step guide on downloading and installing NVIDIA driver 555.
Performance comparison between driver 552 and 555.
Analyzing the impact on speed and efficiency.
Results and Conclusions:
Performance Metrics: Detailed analysis of speed improvements (or lack thereof) with the newest NVIDIA driver.
TensorRT Benefits: How TensorRT models significantly boost performance.
Driver Update Impact: Understanding the real-world impact of updating to the latest NVIDIA driver.
2
views
1
comment
How Good is RTX 3060 for ML AI Deep Learning Tasks and Comparison With GTX 1050 Ti and i7 10700F CPU
If you are wondering which Graphic to purchase to run recent Artificial Intelligence (#AI), Machine Learning (#ML), and Deep Learning models on your GPU with CUDA, then this is the right video for you.
I have purchased the cheapest and yet largest VRAM having GPU #RTX3060.
In this video I am going to compare the performance of Gainward RTX 3060 Ghost 12 GB GPU with MSI GTX 1050 Ti OC 4 GB GPU model and with my CPU which is Core i7 10700F running at 4.59 GHz.
For performance tests, I will use OpenAI’s very newest AI model release Whisper.
So this is a video of GTX 1050 Ti vs Core i7 10700F vs RTX 3060 in terms of Machine Learning applications performance.
Whisper is used for transcribing speech into text in 99 languages.
You can check out my tutorial educational video regarding Whisper here: https://youtu.be/msj3wuYf3d8
Also, in this video, I am doing a box opening of Gainward RTX 3060 Ghost. Moreover, I do a physical comparison of RTX 3060 with GTX 1050 Ti.
Furthermore, I use an AC power meter plug (digital wattmeter - watt energy meter) to calculate GTX 1050 Ti, RTX 3060, and Core i7 10700F power consumption.
I am very satisfied with the performance of RTX 3060. Moreover, it is even able to run the large model of the Whisper which is the best-released model.
Please join Our Discord server for asking questions and discussions: https://discord.gg/rfttctFewW
Please follow us on Twitter: https://twitter.com/SECourses
Please follow us on Facebook: https://www.facebook.com/OfficialSECourses
If you are interested in programming our playlists will teach you how to program and code from scratch: https://www.youtube.com/c/SECourses/playlists
[1] Introduction to Programming Full Course with C# playlist
[2] Advanced Programming with C# Full Course Playlist
[3] Object Oriented Programming Full Course with C# playlist
[4] Asp.NET Core V5 - MVC Pattern - Bootstrap V5 - Responsive Web Programming with C# Full Course Playlist
[5] Artificial Intelligence (AI) and Machine Learning (ML) Full Course with C# Examples playlist
[6] Software Engineering Full Course playlist
[7] Security of Information Systems Full Course playlist
Thumbnail source : https://www.freepik.com/free-vector/isometric-computer-hardware-parts-set-with-monitor-system-unit-electronic-components-details-isolated_9647137.htm
8
views
1
comment
How to do Free Speech-to-Text Transcription Better Than Google Premium API with OpenAI Whisper Model
If you want to transcribe your videos and audio into text for free but with high quality, you have come to the correct video.
In this tutorial video, I will guide you on how to use #OpenAI #Whisper model. I will show you how to install and run Open AI's Whisper from scratch. I will demonstrate to you how to convert audio/speech into text.
Whisper is a general-purpose speech recognition model released for free by Open AI. I claim that Whisper is the best available Speech-to-Text model (Natural Language Processing - #NLP) released to public usage including premium paid ones such as Amazon Web Services, Microsoft Azure Cloud Platform, or Google Cloud API. And Whisper is free to use.
I will show you how to install the necessary Python code and the dependent libraries. I will show you how to download a video from YouTube with YT-DLP, how to cut certain parts of the video with LosslessCut, and how to extract the audio of a video with FFMPEG. I will show you how to do a transcription of a video or a sound. I will show you how to generate subtitles for any video. Finally, I will show you how to generate translated transcription and subtitles of any language video.
With the translation feature of the Whisper model, you can watch any language (Whisper supports 99 languages) with English subtitles. Let's say you can find English subtitles for your favorite video in German or Japanese or Arabic. It is not a problem. Just follow my tutorial and generated English translated subtitles.
Actually, to be precise, Whisper is able to transcribe speech to text in all the following languages, and therefore, translation of these following languages into English:
{af,am,ar,as,az,ba,be,bg,bn,bo,br,bs,ca,cs,cy,da,de,el,en,es,et,eu,fa,fi,fo,fr,gl,gu,ha,haw,hi,hr,ht,hu,hy,id,is,it,iw,ja,jw,ka,kk,km,kn,ko,la,lb,ln,lo,lt,lv,mg,mi,mk,ml,mn,mr,ms,mt,my,ne,nl,nn,no,oc,pa,pl,ps,pt,ro,ru,sa,sd,si,sk,sl,sn,so,sq,sr,su,sv,sw,ta,te,tg,th,tk,tl,tr,tt,uk,ur,uz,vi,yi,yo,zh,Afrikaans,Albanian,Amharic,Arabic,Armenian,Assamese,Azerbaijani,Bashkir,Basque,Belarusian,Bengali,Bosnian,Breton,Bulgarian,Burmese,Castilian,Catalan,Chinese,Croatian,Czech,Danish,Dutch,English,Estonian,Faroese,Finnish,Flemish,French,Galician,Georgian,German,Greek,Gujarati,Haitian,Haitian Creole,Hausa,Hawaiian,Hebrew,Hindi,Hungarian,Icelandic,Indonesian,Italian,Japanese,Javanese,Kannada,Kazakh,Khmer,Korean,Lao,Latin,Latvian,Letzeburgesch,Lingala,Lithuanian,Luxembourgish,Macedonian,Malagasy,Malay,Malayalam,Maltese,Maori,Marathi,Moldavian,Moldovan,Mongolian,Myanmar,Nepali,Norwegian,Nynorsk,Occitan,Panjabi,Pashto,Persian,Polish,Portuguese,Punjabi,Pushto,Romanian,Russian,Sanskrit,Serbian,Shona,Sindhi,Sinhala,Sinhalese,Slovak,Slovenian,Somali,Spanish,Sundanese,Swahili,Swedish,Tagalog,Tajik,Tamil,Tatar,Telugu,Thai,Tibetan,Turkish,Turkmen,Ukrainian,Urdu,Uzbek,Valencian,Vietnamese,Welsh,Yiddish,Yoruba}
The links and the commands I have shown in the video below:
Open AI Whisper : https://openai.com/blog/whisper/
Whisper Code : https://github.com/openai/whisper
Python : https://www.python.org/downloads/release/python-399/
Whisper install : pip install git+https://github.com/openai/whisper.git
How to install CUDA support for using GPU when doing transcription of audio :
First, delete existing Pytorch : pip3 uninstall torch
Then install Pytorch with CUDA support : pip3 install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu116
FFMPEG : https://github.com/BtbN/FFmpeg-Builds/releases
LosslessCut : https://github.com/mifi/lossless-cut/releases
How to extract sound of any video with FFMPEG : ffmpeg -i "test_video.webm" -q:a 0 -map a test_video.mp3
How to transcribe an English video : whisper "C:\speech to text\test_video.mp3" --language en --model base.en --device cpu --task transcribe
How to transcribe an English video with CUDA support : whisper "C:\speech to text\test_video.mp3" --language en --model base.en --device cuda --task transcribe
How to transcribe a Turkish video : whisper "C:\speech to text\test_video.mp3" --language tr --model base.en --device cpu --task transcribe
How to transcribe a Turkish video with translation : whisper "C:\speech to text\test.mp3" --language tr --model small --device cuda -o "C:\speech to text" --task translate
Our Discord for SECourses : https://discord.gg/rfttctFewW
If you are interested in programming but you lack experience and skills I suggest you watch our playlists: https://www.youtube.com/c/SECourses/playlists
[1] Introduction to Programming Full Course with C# playlist
[2] Advanced Programming with C# Full Course Playlist
[3] Object Oriented Programming Full Course with C# playlist
[4] Asp.NET Core V5 - MVC Pattern - Bootstrap V5 - Responsive Web Programming with C# Full Course Playlist
[5] Artificial Intelligence (AI) and Machine Learning (ML) Full Course with C# Examples playlist
[6] Software Engineering Full Course playlist
[7] Security of Information Systems Full Course playlist
18
views
1
comment
How to Setup Private IKEv2 / IPSec MSCHAPv2 VPN on Windows Server to Connect From Android 12+ Phone
✔️ If you are frustrated since #L2TP/PPTP is gone after MIUI 13 Update, or after your phone's / tablet's / device's Android Version update, then this full guide tutorial is for you. If your phone, tablet, or mobile device's Android version is above 11 and you can't find the #PPTP VPN protocol to connect your private #VPN, then don't worry. Because I am explaining the easiest way to set up our VPN to connect from your device in this tutorial guide.
✔️ Point-to-Point Tunneling Protocol (PPTP) was so easy to set up on Windows Server and you were able to connect your private VPN easily through your phone. But this is not possible anymore since PPTP is removed from the majority of phones and mobile devices.
✔️ So instead of setting up our private VPN through features of Windows Server, we are going to use open source #SoftEther VPN Project.
✔️ In this video I will show you thoroughly from scratch:
1: Generate a new virtual server on Hyper-V and install Windows Server 2019 evaluation version.
2: Install SoftEther VPN Project on Windows Server 2019.
3: Make the necessary configuration of SoftEther.
4: Generate and export the #OpenVPN configuration file.
5: Modify the OpenVPN configuration file which ends with the .ovpn extension.
6: Install the OpenVPN app through Google Play Market and import the .ovpn configuration.
7: Connect to your VPN from your phone. I demonstrate this with my Xiaomi Poco X3 Pro - Android 12
8: With this methodology, we don't have to deal with complex and very hard-to-set-up IKEv2 / #IPSec #MSCHAPv2, #IKEv2 / IPSec #PSK, and IKEv2 / IPSec #RSA VPN protocols. These are the only available protocols on my mobile device.
0:00 Introduction
1:17 New Virtual Machine
3:28 Setting up Windows Server 2019
7:20 SoftEther Download & Installation
11:56 How to Setup OpenVPN on the Phone and Use VPN
✔️ The reason why I made this video is, it was so hard and there wasn't any up-to-date guide/tutorial for setting up your private VPN and connecting from your mobile phone.
✔️ The subtitle of the video is manually corrected so please watch with subtitles.
✔️ Please join Our Discord server for asking questions and have discussions: 🔗 https://discord.gg/rfttctFewW
✔️ Please follow us on Twitter: 🔗 https://twitter.com/SECourses
✔️ Please follow us on Facebook: 🔗 https://www.facebook.com/OfficialSECourses
✔️ If you are interested in programming our playlists will teach you how to program and code from scratch: 🔗 https://www.youtube.com/c/SECourses/playlists
1️⃣ Introduction to Programming Full Course with C# playlist ⭐⭐⭐⭐⭐
2️⃣ Advanced Programming with C# Full Course Playlist ⭐⭐⭐⭐⭐
3️⃣ Object Oriented Programming Full Course with C# playlist ⭐⭐⭐⭐⭐
4️⃣ Asp NETCore V5 - MVC Pattern - Bootstrap V5 - Responsive Web Programming with C# Full Course Playlist ⭐⭐⭐⭐⭐
5️⃣ Artificial Intelligence (AI) and Machine Learning (ML) Full Course with C# Examples playlist ⭐⭐⭐⭐⭐
6️⃣ Software Engineering Full Course playlist ⭐⭐⭐⭐⭐
7️⃣ Security of Information Systems Full Course playlist ⭐⭐⭐⭐⭐
Thumbnail : freepik : Gradient vpn illustration
23
views
1
comment