Open An URL On A New Browser Tab

We need to import the module web browser to open a browser tab to read the HTML page.

import webbrowser

if __name__ == "__main__":
    webbrowser.open( 'https://www.weiy.city' )

Download Web Page As Text


We can download the web page and write the content into a local file by multiple text chunks, it will help us to avoid too much memory occupying.
The function raise_for_status can throw an exception if there is any problem in our project.

import requests

if __name__ == "__main__":
    res = requests.get("https://www.weiy.city/2019/08/vtk-measurement-widgets/")
    res.raise_for_status()
    pageFile = open('page.txt', 'wb')
    for chunk in res.iter_content( 10000 ):
        pageFile.write( chunk )
    pageFile.close()

Open Multiple URLs With Browser

I fetch HTML content from my site and open five URLs in it with multiple browser tabs. It is absolutely faster than operating manually.

import requests, sys, webbrowser, bs4

if __name__ == "__main__":
    res = requests.get( "https://www.weiy.city" )
    res.raise_for_status()
    soup = bs4.BeautifulSoup( res.text, features='html.parser' )
    elements = soup.select( 'a' )
    elements = list(set(elements))
    count = min( 5,  len( elements ) )
    for i in range(count):
        urlStr = elements[i].get('href')
        if urlStr[:6] == "https:" :
            print( "open: " + urlStr )
            webbrowser.open( urlStr )

 

Categories: Python

0 Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

You cannot copy content of this page