Python and Web Crawler Project - Alibaba Cloud Academy - Alibaba Cloud Academy

Training

Trainer-led Classroom

In-person Classes
Let our expert trainers enable you and your team to build the cloud skills required to innovate and drive innovation through our professional, in-person classes.

Free Online Live Classroom
Alibaba Cloud Academy's Free Virtual Training uses a combination of trainer-led presentations and hands-on labs to introduce you to basic cloud skills and best practices.

E-learning Courses

Virtual Classes
Join a classroom from virtually anywhere around the world! Learn basic cloud skills and best practices through a combination of presentations and hands-on labs.

Professional Exam Preparation Courses
Professional online training courses delivered by certified Alibaba Cloud experts.

Hands-on Training

Bootcamps
Go all in with our dedicated trainers in our intensive bootcamps that focus on real, hands-on scenarios to gain real-world experience and gain applicable skills.

Hands-on Labs
Test out your skills with the help of our guided tutorials on LabEx.
Certifications

Certification

Professional Certification
Showcase your comprehensive knowledge and skills in building and delivering solutions on Alibaba Cloud as an Alibaba Cloud professional with our industry-recognized Professional Certifications.

Specialty Certification
Demonstrate your capabilities in key roles and expertise in working with Alibaba Cloud products with an industry-recognized Specialty certification.

Clouder Certification
Validate your knowledge of basic cloud concepts and Alibaba Cloud products with our Clouder certifications.

Certificate Management

Certification Verification
Verify your own certification status or the status of others in a quick, one-step process.
Education

Student Central

Register Now
Claim your free student benefits, and start your cloud journey today.

Online Classes
Explore ever-evolving courses at Student Central.

Exam Schedule
This exam schedule is only available for the students in Alibaba Cloud Student Central.

University Program

AAEP
Alibaba Cloud Academic Empowerment Program (AAEP) brings digital intelligence to academic institutions worldwide.

Campus Campaign

Web 3.0 Festival
See the playback of our Web3.0 sessions

HKIIT Cloud Week
Join us for an immersive learning experience where students can participate in career sharing, ACA and AI training sessions, as well as exciting company visits.

AI Festival
Coming Soon
Partnership

Team Up With Us

Training Partner Program
Distinguish yourself as a trusted, reliable organization that offers, delivers, and/or resells Alibaba Cloud training courses.

Partner Enablement Portal
Manage and upskill your teams on our one-stop, dedicated learning platform for Alibaba Cloud partners.
About Us

e-Magazine

Training & Certification Catalog

2024 Spring/Summer Course Catalog

2023 Course Catalog

Membership

Blog

FAQ & Help

Python and Web Crawler Project

Python and Web Crawler Project Scan QR to continue learning QR codes are valid for 30 minutes

(0comments)

price free

119 learner

join the course

1 Section ：
lesson1：Basics of Web Crawler and HTML Parsing - Videos 53:01
lesson2：Basics of Web Crawler and HTML Parsing - Scripts
2 Section ：
lesson3：Web crawler real-world Project - Videos 34:05
lesson4：Web crawler real-world Project - Scripts

instructor

Alibaba Cloud Academy Trainer

Solution Architect

{"moduleinfo":{"paymentLogos_count":[{"count_phone":6,"count":6}],"followUsLinks_count":[{"count_phone":3,"count":3}],"searchContenet_count":[{"count_phone":4,"count":4}],"languages_count":[{"count_phone":2,"count":2}],"version":"0.0.9homon:page_57074_9135018350_Uscv9dq6oXpK","showTruste":true,"i18n":{"followUs":"A comprehensive suite of global cloud computing services to power your business","copyRight":"© 2009-2024 Copyright by Alibaba Cloud All rights reserved"},"footerLogo":{"allow":false,"target":"_self"},"opentarget":true,"search":true,"linkArray_count":[{"count_phone":10,"count":10}],"items_count":[{"count_phone":5,"count":5}],"helperLinks_count":[{"count_phone":17,"count":17}],"hideNavigations":false,"hideFooterLogo":false,"links_count":[{"count_phone":6,"count":6}],"paymentText":"Payment Methods We Support"},"paymentLogos":[{"logo":"https://img.alicdn.com/tfs/TB1_z9xtqL7gK0jSZFBXXXZZpXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1oPiCtET1gK0jSZFhXXaAtVXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1HcqCtxn1gK0jSZKPXXXvUXXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1CIiBtuL2gK0jSZPhXXahvXXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1FHWcB7P2gK0jSZPxXXacQpXa-130-36.png","alt":"rupay"},{"logo":"https://img.alicdn.com/tfs/TB1AveGtAT2gK0jSZFkXXcIQFXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1oIeDtAL0gK0jSZFAXXcA9pXa-80-80.png"},{"logo":"https://img.alicdn.com/tfs/TB1XZCiBYj1gK0jSZFuXXcrHpXa-114-32.png","alt":"upi"}],"searchContenet":[{"right15px":"false","searchlabel":"Products & Solutions","confs":[{"searchLink":"https://www.alibabacloud.com/product/ecs","tce_rule_count":"1","searchItems":"Elastic Compute Service"},{"searchLink":"https://www.alibabacloud.com/product/cdn","tce_rule_count":"1","searchItems":"CDN"},{"searchLink":"https://www.alibabacloud.com/product/ddos","tce_rule_count":"1","searchItems":"Anti-DDoS"},{"searchLink":"https://www.alibabacloud.com/product/oss","tce_rule_count":"1","searchItems":"Object Storage Service"},{"searchLink":"https://www.alibabacloud.com/solutions/e-commerce","tce_rule_count":"1","searchItems":"eCommerce"},{"searchLink":"https://www.alibabacloud.com/solutions/hosting","tce_rule_count":"1","searchItems":"Web Hosting"},{"searchLink":"https://www.alibabacloud.com/solutions/security","tce_rule_count":"1","searchItems":"Security"}]},{"right15px":"false","searchlabel":"Hot Content","confs":[{"searchLink":"https://www.alibabacloud.com/ja","tce_rule_count":"1","searchItems":"Japan Site"},{"searchLink":"https://www.alibabacloud.com/help/product/25365.htm","tce_rule_count":"1","searchItems":"ECS Documentation"},{"searchLink":"https://www.alibabacloud.com/domain","tce_rule_count":"1","searchItems":"How to get Domains"},{"searchLink":"https://marketplace.alibabacloud.com/products/56682004","tce_rule_count":"1","searchItems":"Software Infrastructure"},{"searchLink":"https://www.alibabacloud.com/getting-started/learningpath","tce_rule_count":"1","searchItems":"Learning Path"},{"searchLink":"https://www.alibabacloud.com/getting-started/projects","tce_rule_count":"1","searchItems":"New Users"}]},{"right15px":"false","searchlabel":"Recommended","confs":[{"searchLink":"https://topic.alibabacloud.com","tce_rule_count":"1","searchItems":"Topic Center"},{"searchLink":"https://topic.alibabacloud.com/c/cloud-computing_3","tce_rule_count":"1","searchItems":"Cloud Computing"},{"searchLink":"https://topic.alibabacloud.com/c/industries_2","tce_rule_count":"1","searchItems":"Industries"},{"searchLink":"https://topic.alibabacloud.com/c/developer_1","tce_rule_count":"1","searchItems":"Developers"},{"searchLink":"https://topic.alibabacloud.com/c/web-develop_1_11_1","tce_rule_count":"1","searchItems":"Web Developing"},{"searchLink":"https://topic.alibabacloud.com/c/tutorials_4","tce_rule_count":"1","searchItems":"Tutorials"},{"searchLink":"https://topic.alibabacloud.com/c/php-tutorials_4_86_1","tce_rule_count":"1","searchItems":"PHP Tutorials"}]},{"right15px":"true","searchlabel":"Browse by Letter","confs":[{"searchLink":"https://topic.alibabacloud.com/zqpop/a","tce_rule_count":"1","searchItems":"A"},{"searchLink":"https://topic.alibabacloud.com/zqpop/b","tce_rule_count":"1","searchItems":"B"},{"searchLink":"https://topic.alibabacloud.com/zqpop/c","tce_rule_count":"1","searchItems":"C"},{"searchLink":"https://topic.alibabacloud.com/zqpop/d","tce_rule_count":"1","searchItems":"D"},{"searchLink":"https://topic.alibabacloud.com/zqpop/e","tce_rule_count":"1","searchItems":"E"},{"searchLink":"https://topic.alibabacloud.com/zqpop/f","tce_rule_count":"1","searchItems":"F"},{"searchLink":"https://topic.alibabacloud.com/zqpop/g","tce_rule_count":"1","searchItems":"G"},{"searchLink":"https://topic.alibabacloud.com/zqpop/h","tce_rule_count":"1","searchItems":"H"},{"searchLink":"https://topic.alibabacloud.com/zqpop/i","tce_rule_count":"1","searchItems":"I"},{"searchLink":"https://topic.alibabacloud.com/zqpop/j","tce_rule_count":"1","searchItems":"J"},{"searchLink":"https://topic.alibabacloud.com/zqpop/k","tce_rule_count":"1","searchItems":"K"},{"searchLink":"https://topic.alibabacloud.com/zqpop/l","tce_rule_count":"1","searchItems":"L"},{"searchLink":"https://topic.alibabacloud.com/zqpop/m","tce_rule_count":"1","searchItems":"M"},{"searchLink":"https://topic.alibabacloud.com/zqpop/n","tce_rule_count":"1","searchItems":"N"},{"searchLink":"https://topic.alibabacloud.com/zqpop/o","tce_rule_count":"1","searchItems":"O"},{"searchLink":"https://topic.alibabacloud.com/zqpop/p","tce_rule_count":"1","searchItems":"P"},{"searchLink":"https://topic.alibabacloud.com/zqpop/q","tce_rule_count":"1","searchItems":"Q"},{"searchLink":"https://topic.alibabacloud.com/zqpop/r","tce_rule_count":"1","searchItems":"R"},{"searchLink":"https://topic.alibabacloud.com/zqpop/s","tce_rule_count":"1","searchItems":"S"},{"searchLink":"https://topic.alibabacloud.com/zqpop/t","tce_rule_count":"1","searchItems":"T"},{"searchLink":"https://topic.alibabacloud.com/zqpop/u","tce_rule_count":"1","searchItems":"U"},{"searchLink":"https://topic.alibabacloud.com/zqpop/v","tce_rule_count":"1","searchItems":"V"},{"searchLink":"https://topic.alibabacloud.com/zqpop/w","tce_rule_count":"1","searchItems":"W"},{"searchLink":"https://topic.alibabacloud.com/zqpop/x","tce_rule_count":"1","searchItems":"X"},{"searchLink":"https://topic.alibabacloud.com/zqpop/y","tce_rule_count":"1","searchItems":"Y"},{"searchLink":"https://topic.alibabacloud.com/zqpop/z","tce_rule_count":"1","searchItems":"Z"},{"searchLink":"https://topic.alibabacloud.com/zqpop/0-9","tce_rule_count":"1","searchItems":"0-9"}]}],"items":[{"title":"About","items":[{"tce_rule_count":"1","rel":"follow","text":"About Alibaba Cloud","url":"https://www.alibabacloud.com/about","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Pricing Models","url":"https://www.alibabacloud.com/pricing","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Products","url":"https://www.alibabacloud.com/product","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Customers","url":"https://www.alibabacloud.com/customers","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Partners","url":"https://www.alibabacloud.com/partner","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Startups","url":"https://www.alibabacloud.com/startup","target":"_self"},{"text":"Apsara Conference","url":"https://www.alibabacloud.com/apsara-conference-2022/livestreaming","rel":"follow","target":"_self"},{"text":"Alibaba Cloud Summit","url":"https://www.alibabacloud.com/events/alibaba-cloud-global-summit-2023","rel":"follow","target":"_self"}]},{"title":"Promotions","items":[{"tce_rule_count":"1","rel":"follow","text":"Free Trial","url":"https://www.alibabacloud.com/free","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Simple Application Server","url":"https://www.alibabacloud.com/product/swas","target":"_self"}]},{"title":"Explore","items":[{"tce_rule_count":"1","rel":"follow","text":"China Gateway","url":"https://www.alibabacloud.com/china-gateway","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"ICP License Support","url":"https://www.alibabacloud.com/icp","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Getting Started","url":"https://www.alibabacloud.com/getting-started","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Blog","url":"https://www.alibabacloud.com/blog","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Marketplace","url":"https://marketplace.alibabacloud.com","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Training & Certification","url":"https://edu.alibabacloud.com/","target":"_self"}]},{"title":"Support","items":[{"tce_rule_count":"1","rel":"follow","text":"Contact Sales","url":"https://www.alibabacloud.com/contact-sales","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Submit a Ticket","url":"https://workorder-intl.console.aliyun.com/console.htm?lang=#/ticket/list","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"After-Sales Support","url":"https://www.alibabacloud.com/support/after-sales","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Report Abuse","url":"https://www.alibabacloud.com/report","target":"_self"},{"rel":"follow","text":"Report IPR infringement","url":"https://ipp.alibabacloud.com/global/aliyun/complaint.htm?lang=en_US#/complaintPage/aliyun","target":"_self"},{"text":"Feedback","url":"https://connect.alibabacloud.com","rel":"follow","target":"_self"},{"text":"Forum","url":"https://www.alibabacloud.com/forum","rel":"follow","target":"_self"},{"text":"Pricing Calculator","url":"https://www.alibabacloud.com/pricing-calculator","rel":"follow","target":"_self"}]},{"title":"Resources","items":[{"tce_rule_count":"1","rel":"follow","text":"Documentation Center","url":"https://www.alibabacloud.com/help","target":"_self"},{"text":"Alibaba Cloud MVP","url":"https://mvp.alibabacloud.com/","rel":"follow","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Security & Compliance","url":"https://www.alibabacloud.com/trust-center","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Press Room","url":"https://www.alibabacloud.com/press-room","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"WHOIS","url":"https://www.alibabacloud.com/whois/home","target":"_self"},{"text":"Site Map","url":"https://www.alibabacloud.com/sitemap.html","rel":"follow","target":"_self"},{"rel":"follow","text":"Status","url":"https://status.alibabacloud.com/","target":"_self"}]}],"links":[{"text":"Careers","url":"https://careers.aliyun.com/en/home","target":"_self","rel":"follow"},{"text":" About Us","url":"https://www.alibabacloud.com/about","target":"_self","rel":"follow"},{"rel":"nofollow","text":" Privacy Policy","url":"https://www.alibabacloud.com/help/faq-detail/42425.htm","target":"_self"},{"rel":"nofollow","text":"Legal","url":"https://www.alibabacloud.com/help/en/legal","target":"_self"},{"text":"Notice List","url":"https://www.alibabacloud.com/notice","target":"_self","rel":"nofollow"},{"text":"Links","url":"https://www.alibabacloud.com/links.html","target":"_self","rel":"nofollow"}],"helperLinks":[{"text":"Alibaba Group","url":"http://www.alibabagroup.com/en/global/home","target":"_blank"},{"text":"Taobao Marketplace","url":"https://www.taobao.com","target":"_blank"},{"text":"Tmall","url":"https://www.tmall.com","target":"_blank"},{"text":"Juhuasuan","url":"https://ju.taobao.com","target":"_blank"},{"text":"AliExpress","url":"http://www.aliexpress.com","target":"_blank"},{"text":"Alibaba.com","url":"http://www.alibaba.com","target":"_blank"},{"text":"1688","url":"http://www.1688.com","target":"_blank"},{"text":"Alimama","url":"http://www.alimama.com/index.htm","target":"_blank"},{"text":"Fliggy","url":"https://www.fliggy.com","target":"_blank"},{"text":"YunOS","url":"http://www.yunos.com","target":"_blank"},{"text":"Amap","url":"http://www.autonavi.com","target":"_blank"},{"text":"UCWeb","url":"http://www.ucweb.com","target":"_blank"},{"text":"Umeng","url":"http://www.umeng.com","target":"_blank"},{"text":"Xiami","url":"http://www.xiami.com","target":"_blank"},{"text":"DingTalk","url":"https://www.dingtalk.com","target":"_blank"},{"text":"Alipay","url":"https://www.alipay.com","target":"_blank"}],"languages":[{"text":"English","key":"en"},{"text":"简体中文","key":"zh"}],"followUsLinks":[{"icon":"icon-Facebook","text":"Facebook","url":"https://www.facebook.com/alibabacloud/","target":"_self"},{"icon":"icon-LinkedIn","text":"Linkedin","url":"https://www.linkedin.com/company/alibabacloudtech","target":"_self"},{"icon":"icon-X_twitter","text":"Twitter","url":"//www.twitter.com/alibaba_cloud","target":"_self"},{"text":"YouTube","url":"https://www.youtube.com/channel/UCipPA-ZHX6UYGH_Iyti1-Jw","icon":"icon-Youtube","target":"_self"},{"text":"TikTok","url":"https://www.tiktok.com/@alibaba__cloud?lang=zh-Hant-TW","icon":"icon-Tiktok","target":"_self"},{"icon":"icon-mailbox","target":"_self","text":"contact.us@alibabacloud.com","url":"https://www.alibabacloud.com/contact-sales"},{"icon":"icon-phone1","target":"_self","url":"https://www.alibabacloud.com/contact-sales","text":"Call Us Now"}],"linkArray":[{"url":"//intl.aliyun.com"},{"url":"//intl.aliyun.com/why-alibaba-cloud"},{"url":"//intl.aliyun.com/product"},{"url":"//intl.aliyun.com/solution"},{"url":"//intl.aliyun.com/chinaconnect"},{"url":"//intl.aliyun.com/icp"},{"url":"//intl.aliyun.com/pricing"},{"url":"//intl.aliyun.com/trust-center"},{"url":"//intl.aliyun.com/free-trial/enterprise"},{"url":"//intl.aliyun.com/startup"},{"url":"//intl.aliyun.com/partner"}],"public":[{"publicText":"","publicCode":""}],"optioninfo":{"dynamic":"true","static":"true"}}
        pc