This is an advanced tutorial showing how to scrape JavaScript rendered content using the Crawlomatic plugin and HeadlessBrowserAPI.
š RESOURCES MENTIONED š
Crawlomatic āŗ https://1.envato.market/crawlomatic
HeadlessBrowserAPI āŗ https://headlessbrowserapi.com/
š¤ Settings I used in the Crawlomatic plugin for correct scraping š
FOR SINGLE SCRAPING:
Scraper Start (Seed) URL: https://brightside.me/inspiration-health/10-daily-habits-that-can-make-deodorant-less-effective-802066/
Content Scraping Method To Use: Puppeteer (HeadlessBrowserAPI)
Headless Browser Wait Before Rendering Pages (ms): 5000
Strip HTML Elements by Tag Name: svg
Content Query Type: XPath/CSS Selector
Content Query String: //*[@data-test-id=’article-content’]
Strip HTML Elements by XPATH/CSS Selector: //*[@data-adunit-started=’true’]
FOR SERIAL SCRAPING:
Scraper Start (Seed) URL: https://brightside.me/
Do Not Scrape Seed URL: checked
Seed Page Crawling Query Type: XPath/CSS Selector
Seed Page Crawling Query String: //*[@data-test-id=’title-link’]
Content Scraping Method To Use: Puppeteer (HeadlessBrowserAPI)
Headless Browser Wait Before Rendering Pages (ms): 5000
Strip HTML Elements by Tag Name: svg
Content Query Type: XPath/CSS Selector
Content Query String: //*[@data-test-id=’article-content’]
Reverse Crawling Order: checked
Skip Scraping Post If Below Content Query Is Not Found: Checked
Strip HTML Elements by XPATH/CSS Selector: //*[@data-adunit-started=’true’]
š„ Join this channel to get access to member only videos and PERKS š
https://www.youtube.com/channel/UCVLIksvzyk-D_oEdHab2Lgg/join
š„ Join my FREE newsletter to discover my insights (and also to get the YouTube Caption Scraper plugin for FREE) š
https://coderevolution.mailchimpsites.com/
š» MY WORDPRESS PLUGINS š
https://1.envato.market/coderevolutionplugins
ā¶[SPECIAL OFFER] GET ALL MY PLUGINS AT ONCE! – https://1.envato.market/bundle
š» MY COURSES š
https://coderevolution.teachable.com/
šš¼ Please help & give the video a like if you enjoyed it!
ā¤ļø Not Yet Subscribed? https://www.youtube.com/channel/UCVLIksvzyk-D_oEdHab2Lgg?sub_confirmation=1
š Hit the notification bell to ensure you get notified!
ā
CAN I HELP YOU OR YOUR BUSINESS ā
š Become a member of my website today, to enjoy premium tutorials: https://coderevolution.ro/join-the-site/
ā
EITHER WAY, CAN WE KEEP IN TOUCH ā
š Join the CodeRevolution VIP List here šš¼ https://coderevolution.mailchimpsites.com/
š£ļø TALK TO ME AND FOLLOW CODEREVOLUTION š„ ON SOCIAL MEDIA š
Instagram āŗ https://www.instagram.com/coderevolution_envato/
Facebook āŗ https://www.facebook.com/CodeRevolution.envato/
Twitter āŗ https://twitter.com/code2revolution
LinkedIn āŗ https://www.linkedin.com/company/18002194
Pinterest āŗ https://pinterest.com/caddy_lagaristu/coderevolution/
š¤ ABOUT CODEREVOLUTION TV š
Hello, Iām Szabi, a 32 years old guy living with my wife and our beautiful 4 year old daughter Maya. I started my journey in WordPress plugin development back in 2017, when I quit my programmer job and became a full time stay at home WordPress plugin developer, entrepreneur, blogger and also daddy. Since then, I implemented over 100 WordPress plugins, earning my full time income from them.
I started this YouTube channel to share tutorials for my plugins with people who are using them, however, since then, the channel has evolved into a daily VLOG, besides of tutorials for my plugins, I am sharing here also my insights about how to be a successful entrepreneur in our current times.
On this YouTube channel, I publish new videos regularly (each time I have to tell you about something new)! If you don’t want to miss my videos, subscribe and hit the bell notification also!
š RECOMMENDED RESOURCES š
See what services I use to power my business online and help me earn as an affiliate
https://coderevolution.ro/recommendations/
Do you want to start autoblogging? Check my recommended resources below š
https://coderevolution.ro/more-automation/
ā¶ GEAR I USE IN MY VIDEOS š
Microphone: Trust GXT 252+ Emita Plus Streaming Microphone:
https://amzn.to/2LB79sv
Web Cam: Logitech Brio 4K Stream Edition: https://amzn.to/2N5CNid
To your success,
Szabi – CodeRevolution.
DISCLAIMER: The information contained on this YouTube Channel and the resources available for download/viewing through this YouTube Channel are for educational and informational purposes only.ā
This description may contain affiliate links. If you purchase a product through one of them, I will receive a commission (at no additional cost to you). I only ever endorse products that I have personally used and benefited from personally. Thank you for your support!
#CRAWLOMATIC #HEADLESSBROWSERAPI #SCRAPING #CRAWLING