mescrappy - Python + Selenium Youtube scraper

Overview

mescrappy - Python + Selenium Youtube scraper


image

Youtube Sraping With Python (Selenium)

Table of Contents

  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Test
  6. License
  7. Contact
  8. Acknowledgements

About The Project

Built With

Getting Started

Installation

  1. To use this package first install it: package

pip install mescrappy

  1. import sraper to your project

from mescrappy.srappy import scrapper scrapper.youtube_video_data_scrapper(url='', driver='')

You can also run it directly using terminal:

python mescrappy "https://www.youtube.com/watch?v=rMO7APyBiMI" "C:\Users\ME\projects\for_github\chromedriver_win32\chromedriver.exe"

1'st argument is video url and 2'nd argument is browser driver location

Usage

You can use this package to scrap youtube video's:

  1. title
  2. view count
  3. description
  4. like
  5. dislike
  6. post date
  7. owner

EX:

` python mescrappy "https://www.youtube.com/watch?v=rMO7APyBiMI" "C:\Users\ME\projects\for_github\chromedriver_win32\chromedriver.exe"

{

'title': 'Şeker (Cover)',

'description': 'Aýdymyň sazy : Soprano - Скорее забудь (ft. Ka-Re)\n\nLyrics:\n\nÖňler diýýärdim Aşgabat\nGerek däl başga zat\nIndi bolsa maşgalam\nGerek däl Aşgabat\n\nYanyñda oýanmak iñ uly keýp\nBaşymyz aýlanýar gerek däl meý,\nSeret! günem eýýäm günorta\nOýanmaly hiç, bulambujar otag\nBize name?! bolsun bulambujar dünýä,\nSamsyk pikirlem, şonda-da gülyäñ\n\nÝüregiñ aşagynda ýürejik urýar\nKime meñzeýärkä?, pikirlenip durýan,\nBilýäňmi näme?!, dakjak adyna Emin,\nMeñzesin ejesine, bolmasyn kemi\n\nGowy hasiyetleñ hemmesi geçmez belki,\nGeçse bolýa ejesiniñ göz reñki,\nYaşyl, öñem diýýärdim men yaşyla aşyk,\nMillet pula diýýärmikam diýýärdi, daşda...\n\nÇalyşman sizi hiç kime, \nGaraşyañ maňa giç gelsem\nUgradýañ meni ir gitsem,\nÝeke söýgimiñ biri sen,\nSöýülýänçämem diri men.\n\nDiñle! Sen meni söýýärdiñ hiçkimkäm,\nDurmuşyma geleliñ bäri men hiçkim däl.\nIşlisyraýanmy ýa çyndanam işim kän\nJaň edeýin, ýa söýýan diýmäne giçmikä?\n\nGaty seýrek hem söýmek hem söýülmek\nYüregiñ ýarysy garaşyp duranda öýüňde,\nGaýdasyñ gelýär oturan ýeriñden\nAýdasyñ gelýär oglanlara, gelenok diliñden,\nÝaýdanyp durýan, çykañok pikirden\nAýlanyp durýaň sen bedenimiñ içinde\nSaýlanyp durýar, gözelligiñ maña aýan,\nBerildi sadalyk, berildi haýa\n\nBu dünýäň oýnuny oýnasam\nMenemä ölmerin sen söýmäni goýmasañ\nGark bolman men söýgimiz meni boýlasa,\nPikire batýan sen barada oýlansam\n\nNädip saýladyñ meni hemem näme üçin,\nErbet hasiýetlem köp kemçiliklem näçe,\nBilyän, söygi şeýlerak bolaýýar nätjek\nÝüregiñ päkje özüne gatyrak çek meni\n\nJemi dört ýyldan gowrak bile eýýäm\nÖzümden gaçsamam ýene öýümize gelýän,\nHawa söýan sözi ýönekey söz däl\nSeniň ýaly tapylmaz başlasamam gözläp\n\nDaşymyzda göz kän\nÖzümede dözmän, seni bermen özgä\nYnan, muny ýazamda-da tolgunýan,\nAýlanýan ýaly depesinde tolkunlañ\n \nGerek däl bize hiçkim,\nÝyldyzlary sanamana äkideýin giçlik\nBolaly biraz işsiz\nUklap galaly asmany ýapynyp üstümize\nBir zat bor galany\n\nArzuw etmegem gowy zat\nDuýýan özümi sana zar, ýöne men azat\nGoşulmasyn duýgularymyza gazap\nAýyrmasyn biribar, degmesin nazar..\n\nDiñle! Sen meni söýýardiñ hiçkimkäm,\nDurmuşyma geleliñ bäri men hiçkim dal.\nMenema ölmerin bu söýgimiz dirika,\nDañama atdy söýýän diýmäne irmika\n\nSen men söýgülim, joram, hakyky dostum\nSen maňa hossar ýekelikden dolsam\nMeni ýumşadyañ aladalar üstüme gonsa\nSöýýän sözi ýaly gerek ýene on söz\n\nHarplar ýerini alýar, setirler dolýar\nPikirlerimi saña ýetiren bolsam bolýar,\nBar iki göz - diňe seni görýän\nBar diýjegim iki söz - Seni söýýän.\n\nBar diýjek bolanym - Seni söýýän!\nDiňe sen hakyky meni görýäň...',

'owner': 'Dali Dade',

'date': 'Premiered Jul 1, 2021',

'views': '29,392',

'like': '888',

'dislike': '5'

}`

Roadmap

See the open issues for a list of proposed features (and known issues).

Test

for testing :

python mescrappy\test.py

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Merdan Chariyarov - @merlinemris96 - [email protected]

Project Link: https://github.com/MerlinEmris/youtube_srapping_with_python

Acknowledgements

You might also like...
DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key

Ditch YouTubeAPI (BETA) DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key Detai

Youtube Downloader is a Graphic User Interface(GUI) that lets users download a Youtube Video or Audio through a URL
Youtube Downloader is a Graphic User Interface(GUI) that lets users download a Youtube Video or Audio through a URL

Youtube Downloader This Python and Tkinter based GUI allows users to directly download the Best Resolution Videos and Audios from Youtube. Pa-fy Insta

Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio.

YouTube-Downloader Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio. G

YouTube-Video-Downloader - Download Youtube Videos for free.

YouTube-Video-Downloader Download Youtube Videos for free. Installing Dependencies:- Windows pip install pytube Mac/Linux pip3 install pytube Clonin

PyQt5 simple files , youtube videos and youtube playlist downloader

PyQt5 simple files , youtube videos and youtube playlist downloader

YouTube Video publisher using youtube-dl & ROS2🐢
YouTube Video publisher using youtube-dl & ROS2🐢

YouTube-publisher-ROS2 Publish sensor_msgs/Image by "YouTube" 🤗 🤗 🤗 ! You don't have to use webcamera or your video to check demos. Purpose Quick d

Youtube list to mp3 - Youtube list to mp3 downloader

Youtube list to mp3 downloader Tiny script to convert a list of youtube videos t

Python/Selenium script to scrape data about university courses

university-courses Python/Selenium script to scrape data about university courses. Script first extracts URLs of each courses homepage, then trawls ea

 Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/.
Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/.

Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/. Features Scrapes 10 pages Scrapes each thread Downloads all the images

Comments
  • Test is not working

    Test is not working

    when running test raise expectation

    ` ERROR: test_scrap (main.TestScrapper)

    Traceback (most recent call last): File "mescrappy\test.py", line 10, in test_scrap youtube_video_data_scrapper(url=url, driver=driver), {}) File "c:\users\me\appdata\local\programs\python\python37\lib\unittest\case.py", line 883, in assertAlmostEqual diff = abs(first - second) TypeError: unsupported operand type(s) for -: 'dict' and 'dict' `

    opened by MerlinEmris 0
Releases(1.0.0)
Owner
Merdan Chariyarov
WEB Developer
Merdan Chariyarov
A scriptable music downloader for Qobuz, Tidal, and Deezer

streamrip A scriptable stream downloader for Qobuz, Tidal, and Deezer. Features Downloads tracks, albums, playlists, discographies, and labels from Qo

967 Jan 03, 2023
A cross platform front-end GUI of the popular youtube-dl written in wxPython.

youtube-dlG A cross platform front-end GUI of the popular youtube-dl media downloader written in wxPython. Supported sites Screenshots Requirements Py

8.7k Dec 31, 2022
the best video downloader for terminals (currently only compatible with Linux and Windows)

the best video downloader for terminals (currently only compatible with Linux and Windows)

Amaral 2 Oct 14, 2021
Noto fonts go universal! Download Noto fonts combined to suit your region (South Asia, SE Asia, Africa-MiddleEast, Europe-Americas).

Go Noto Universal Noto fonts go universal! Download Noto fonts combined to suit your region (South Asia, SE Asia, East Asia, Africa-MiddleEast, Europe

Satish B 67 Jan 06, 2023
A Simple YouTube Video Downloader With Python

Simple YouTube Video Downloader Simple YouTube Video Downloader is an open source project with a very simple UI that tries to speed up the process of

Brian Han 2 Jan 03, 2022
Command-line program to download videos from YouTube.com and other video sites

youtube-dl - download videos from youtube.com or other video platforms

youtube-dl 116.4k Jan 07, 2023
PyDownloader - Downloads files and folders at high speed (based on your interent speed).

PyDownloader - Downloads files and folders at high speed (based on your interent speed).

Armen._.G 4 Feb 24, 2022
Parallels Desktop dmg downloader

parallelsdesktop-dl Parallels Desktop dmg file downloader Usage usage: pd-dl [-h] [--dlv [DLV]] [-v] Parallels Desktop downloader optional arguments

2 Sep 13, 2022
Fully Automated YouTube Channel ▶️with Added Extra Features.

Fully Automated Youtube Channel ▒█▀▀█ █▀▀█ ▀▀█▀▀ ▀▀█▀▀ █░░█ █▀▀▄ █▀▀ █▀▀█ ▒█▀▀▄ █░░█ ░░█░░ ░▒█░░ █░░█ █▀▀▄ █▀▀ █▄▄▀ ▒█▄▄█ ▀▀▀▀ ░░▀░░ ░▒█░░ ░▀▀▀ ▀▀▀░

sam-sepiol 249 Jan 02, 2023
A simple python script to fetch Bing daily images and set them randomly using hsetroot

Daily bing walls A script to set the daily bing image as the wallpaper. It can also set from a random set of previously fetched wallpapers. usage: dai

Harinarayanan K S 5 Nov 23, 2022
Python script to download entire campaign images and navigation.

Squidle campaign downloader Python script to download entire campaign images and navigation. usage: squidle_campaign_downloader.py [-h] [--api-token A

Miquel Massot 2 Nov 17, 2021
Downloads data from OSM API and uploads it to the mapping sandbox.

OpenStreetMap To Sandbox This is a script to download data from OSM API and upload it to the mapping sandbox. Note that it clears all data in the sand

Ilya Zverev 5 Nov 27, 2022
ComicDownloader - Downloads Comics from readcomiconline.li

ComicDownloader Downloads Comics from readcomiconline.li To use this script from

2 Nov 08, 2022
A user-friendly GUI for the ZSpotify music downloader.

ZSpotifyGUI A user-friendly desktop app for ZSpotify music downloader for Windows, MacOs, and Linux Discord Server - Matrix Server - Gitea Mirror - Ma

94 Dec 17, 2022
This simple Python script allows you to download songs on Telegram🌸❤️😁

SongsDownloaderTgBot 📺 YouTube Song Downloader Bot For Telegram 🔮 3X Fast Telethon Based Bot ⚜ Open Source Bot 👨🏻‍💻 Demo : 𝗔𝗻𝗻𝗶𝗲 - 𝗘𝗹𝗶𝘇?

Sehath Perera 23 Dec 03, 2022
Simple Python script to download images and videos from public subreddits without using Reddit's API 😎

Subreddit Media Downloader Download images and videos from any public subreddit without using Reddit's API Made with ❤ by Nico 💬 About: This script a

Nico 106 Jan 07, 2023
Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio.

YouTube-Downloader Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio. G

Manav Grover 2 Dec 27, 2021
squid-dl is a massively parallel yt-dlp-based YouTube downloader.

squid-dl squid-dl is a massively parallel yt-dlp-based YouTube downloader. Installation Run the setup.py, which will install squid-dl and its two depe

tuxlovesyou 51 Jan 05, 2023
⚙️ A CLI tool that can download songs from youtube.

⚙️ Music Downloader Music Downloader is a tool that can download songs from Youtube. Installation Base requirements: Python 3.7+ If you have Python 3.

matjs 4 Nov 03, 2021
Aline file downloader automator!

AlineDorker Aline is used for donwloading files with google dorking , dowloading specified links such as dorks. Dependences: python3 installed pip ins

27 Nov 16, 2022