User Tools
docu:csheet:sysadm:script:python:html_scraping
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | |||
| docu:csheet:sysadm:script:python:html_scraping [2022/01/16 02:11] – better examples admin | docu:csheet:sysadm:script:python:html_scraping [2022/01/16 02:13] (current) – clearer examples on attributes admin | ||
|---|---|---|---|
| Line 21: | Line 21: | ||
| response = requests.get(' | response = requests.get(' | ||
| html = BeautifulSoup(response.text, | html = BeautifulSoup(response.text, | ||
| + | |||
| + | # get page title | ||
| + | print(html.title) | ||
| # select using DOM selector (list of elements) | # select using DOM selector (list of elements) | ||
| Line 27: | Line 30: | ||
| # examples on findings | # examples on findings | ||
| if len(elements) > 0: | if len(elements) > 0: | ||
| - | # get " | ||
| - | print(elements[0].get(' | ||
| # get " | # get " | ||
| print(elements[0].get(' | print(elements[0].get(' | ||
| + | print(elements[0].get(' | ||
| - | # get class | + | # or get using dictionary: |
| print(elements[0][' | print(elements[0][' | ||
| + | print(elements[0][' | ||
| # get text of DOM | # get text of DOM | ||
docu/csheet/sysadm/script/python/html_scraping.1642299083.txt.gz · Last modified: 2022/01/16 02:11 by admin
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: GNU Free Documentation License 1.3
