How to Use Spark on Cloud Series 2 - Spark Python - Alibaba Cloud Academy - Alibaba Cloud Academy

Training

Trainer-led Classroom

Classroom Training Courses
Let our expert trainers enable you and your team to build the cloud skills required to innovate and drive innovation through our professional, in-person classes.

Free Online Live Classroom
Alibaba Cloud Academy's Free Virtual Training uses a combination of trainer-led presentations and hands-on labs to introduce you to basic cloud skills and best practices.

E-learning Courses

Virtual Classes
Join a classroom from virtually anywhere around the world! Learn basic cloud skills and best practices through a combination of presentations and hands-on labs.

Professional Exam Preparation Courses
Professional online training courses delivered by certified Alibaba Cloud experts.

Hands-on Training

Hands-on Labs
Test out your skills with the help of our guided tutorials on LabEx.
Certifications

Certification

Professional Certification
Showcase your comprehensive knowledge and skills in building and delivering solutions on Alibaba Cloud as an Alibaba Cloud professional with our industry-recognized Professional Certifications.

Capability & Competency Certifications
Showcase your expertise in Alibaba Cloud products and solutions with our Capability & Competency Certifications.

Clouder Certification
Validate your knowledge of basic cloud concepts and Alibaba Cloud products with our Clouder certifications.

Certificate Management

Certification Verification
Verify your own certification status or the status of others in a quick, one-step process.
Education

Student Central

Register Now
Claim your free student benefits, and start your cloud journey today.

Online Classes
Explore ever-evolving courses at Student Central.

Exam Schedule
This exam schedule is only available for the students in Alibaba Cloud Student Central.

University Program

AAEP
Alibaba Cloud Academic Empowerment Program (AAEP) brings digital intelligence to academic institutions worldwide.

Campus Campaign

AI Festival
Coming Soon
Partnership

Team Up With Us

Training Partner Program
Distinguish yourself as a trusted, reliable organization that offers, delivers, and/or resells Alibaba Cloud training courses.

Partner Enablement Portal
Manage and upskill your teams on our one-stop, dedicated learning platform for Alibaba Cloud partners.
About Us

Training & Certification Catalog

2024 Spring/Summer Course Catalog

Membership

Blog

FAQ & Help

How to Use Spark on Cloud Series 2 - Spark Python

How to Use Spark on Cloud Series 2 - Spark Python Scan QR to continue learning QR codes are valid for 30 minutes

How to program with Python on Spark

(0Comments)

Tip: This course is associated with How to Use Spark on Cloud Series 2 - Spark Python. You must purchase the certification package before you are able to complete all lessons for a certificate.

Purchase View Details Learn for Free (Membership)

421 learner

Purchase

Course Introduction

In this course we will show you how to write basic data analysis programs on Spark in Python. Through these programs we will introduce some concepts like Spark RDD, Dataframe, Streaming, etc.

Course Goals

Through this course, you will know how to use spark python to perform data analysis project.

Intended Audience

Spark beginners, cloud computing beginners, Python beginners

Instructor

Alibaba Cloud Academy Trainer

Solution Architect

{"moduleinfo":{"paymentLogos_count":[{"count_phone":6,"count":6}],"followUsLinks_count":[{"count_phone":3,"count":3}],"searchContenet_count":[{"count_phone":4,"count":4}],"languages_count":[{"count_phone":2,"count":2}],"version":"0.0.9homon:page_57074_9135018350_Uscv9dq6oXpK","showTruste":true,"i18n":{"followUs":"A comprehensive suite of global cloud computing services to power your business","copyRight":"© 2009-<span class='current-year'></span> Copyright by Alibaba Cloud All rights reserved","paymentText":"Payment Methods We Support","findUsText":"Find Us"},"footerLogo":{"allow":false,"target":"_self","img":"https://img.alicdn.com/imgextra/i4/O1CN01cMRNZN1Q3rqeuFGkP_!!6000000001921-55-tps-296-37.svg"},"opentarget":true,"search":true,"linkArray_count":[{"count_phone":10,"count":10}],"items_count":[{"count_phone":5,"count":5}],"helperLinks_count":[{"count_phone":17,"count":17}],"hideNavigations":false,"hideFooterLogo":false,"links_count":[{"count_phone":6,"count":6}],"paymentText":"Payment Methods We Support","colorStyle":"whiteBase"},"paymentLogos":[{"logo":"https://img.alicdn.com/imgextra/i4/O1CN01chC8yr1bmG2LUYqkC_!!6000000003507-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i3/O1CN01uRgIPS1zPrRqILrOX_!!6000000006707-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i1/O1CN01dnxClx1aFuRooqQcV_!!6000000003301-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i1/O1CN01bVFfu324eaG5tyVLi_!!6000000007416-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i3/O1CN01FfnfuU1VPScvSlR2Q_!!6000000002645-2-tps-96-48.png","alt":"rupay"},{"logo":"https://img.alicdn.com/imgextra/i3/O1CN01EOPbOe26ClQtTQcx8_!!6000000007626-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i4/O1CN01qZcmom1rFlnMQxCGu_!!6000000005602-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i2/O1CN01JIX5rU22y9xIKJfo4_!!6000000007188-2-tps-96-48.png","alt":"upi"}],"searchContenet":[{"right15px":"false","searchlabel":"Products & Solutions","confs":[{"searchLink":"https://www.alibabacloud.com/product/ecs","tce_rule_count":"1","searchItems":"Elastic Compute Service"},{"searchLink":"https://www.alibabacloud.com/product/cdn","tce_rule_count":"1","searchItems":"CDN"},{"searchLink":"https://www.alibabacloud.com/product/ddos","tce_rule_count":"1","searchItems":"Anti-DDoS"},{"searchLink":"https://www.alibabacloud.com/product/oss","tce_rule_count":"1","searchItems":"Object Storage Service"},{"searchLink":"https://www.alibabacloud.com/solutions/e-commerce","tce_rule_count":"1","searchItems":"eCommerce"},{"searchLink":"https://www.alibabacloud.com/solutions/hosting","tce_rule_count":"1","searchItems":"Web Hosting"},{"searchLink":"https://www.alibabacloud.com/solutions/security","tce_rule_count":"1","searchItems":"Security"}]},{"right15px":"false","searchlabel":"Hot Content","confs":[{"searchLink":"https://www.alibabacloud.com/ja","tce_rule_count":"1","searchItems":"Japan Site"},{"searchLink":"https://www.alibabacloud.com/help/product/25365.htm","tce_rule_count":"1","searchItems":"ECS Documentation"},{"searchLink":"https://www.alibabacloud.com/domain","tce_rule_count":"1","searchItems":"How to get Domains"},{"searchLink":"https://marketplace.alibabacloud.com/products/56682004","tce_rule_count":"1","searchItems":"Software Infrastructure"},{"searchLink":"https://www.alibabacloud.com/getting-started/learningpath","tce_rule_count":"1","searchItems":"Learning Path"},{"searchLink":"https://www.alibabacloud.com/getting-started/projects","tce_rule_count":"1","searchItems":"New Users"}]},{"right15px":"false","searchlabel":"Recommended","confs":[{"searchLink":"https://topic.alibabacloud.com","tce_rule_count":"1","searchItems":"Topic Center"},{"searchLink":"https://topic.alibabacloud.com/c/cloud-computing_3","tce_rule_count":"1","searchItems":"Cloud Computing"},{"searchLink":"https://topic.alibabacloud.com/c/industries_2","tce_rule_count":"1","searchItems":"Industries"},{"searchLink":"https://topic.alibabacloud.com/c/developer_1","tce_rule_count":"1","searchItems":"Developers"},{"searchLink":"https://topic.alibabacloud.com/c/web-develop_1_11_1","tce_rule_count":"1","searchItems":"Web Developing"},{"searchLink":"https://topic.alibabacloud.com/c/tutorials_4","tce_rule_count":"1","searchItems":"Tutorials"},{"searchLink":"https://topic.alibabacloud.com/c/php-tutorials_4_86_1","tce_rule_count":"1","searchItems":"PHP Tutorials"}]}],"items":[{"title":"About","items":[{"tce_rule_count":"1","rel":"follow","text":"About Alibaba Cloud","url":"https://www.alibabacloud.com/about","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Pricing Models","url":"https://www.alibabacloud.com/pricing","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Products","url":"https://www.alibabacloud.com/product","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Customers","url":"https://www.alibabacloud.com/customers","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Partners","url":"https://www.alibabacloud.com/partner","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Startups","url":"https://www.alibabacloud.com/startup","target":"_self"},{"text":"Apsara Conference","url":"https://www.alibabacloud.com/apsara-conference-2022/livestreaming","rel":"follow","target":"_self"},{"text":"Alibaba Cloud Summit","url":"https://www.alibabacloud.com/events/alibaba-cloud-global-summit-2023","rel":"follow","target":"_self"}]},{"title":"Promotions","items":[{"tce_rule_count":"1","rel":"follow","text":"Free Trial","url":"https://www.alibabacloud.com/free","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Simple Application Server","url":"https://www.alibabacloud.com/product/swas","target":"_self"}]},{"title":"Explore","items":[{"tce_rule_count":"1","rel":"follow","text":"China Gateway","url":"https://www.alibabacloud.com/china-gateway","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"ICP License Support","url":"https://www.alibabacloud.com/icp","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Getting Started","url":"https://www.alibabacloud.com/getting-started","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Blog","url":"https://www.alibabacloud.com/blog","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Marketplace","url":"https://marketplace.alibabacloud.com","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Training & Certification","url":"https://edu.alibabacloud.com/","target":"_self"}]},{"title":"Support","items":[{"tce_rule_count":"1","rel":"follow","text":"Contact Sales","url":"https://www.alibabacloud.com/contact-sales","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Submit a Ticket","url":"https://workorder-intl.console.aliyun.com/console.htm?lang=#/ticket/list","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"After-Sales Support","url":"https://www.alibabacloud.com/support/after-sales","target":"_self"},{"rel":"follow","text":"Security Report","url":"https://report.alibabacloud.com/#/reportCenter/home","target":"_self"},{"text":"Feedback","url":"https://connect.alibabacloud.com","rel":"follow","target":"_self"},{"text":"Pricing Calculator","url":"https://www.alibabacloud.com/pricing-calculator","rel":"follow","target":"_self"}]},{"title":"Resources","items":[{"tce_rule_count":"1","rel":"follow","text":"Documentation Center","url":"https://www.alibabacloud.com/help","target":"_self"},{"text":"Alibaba Cloud MVP","url":"https://mvp.alibabacloud.com/","rel":"follow","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Security & Compliance","url":"https://www.alibabacloud.com/trust-center","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"Press Room","url":"https://www.alibabacloud.com/press-room","target":"_self"},{"tce_rule_count":"1","rel":"follow","text":"WHOIS","url":"https://www.alibabacloud.com/whois/home","target":"_self"},{"text":"Site Map","url":"https://www.alibabacloud.com/sitemap.html","rel":"follow","target":"_self"},{"rel":"follow","text":"Status","url":"https://status.alibabacloud.com/","target":"_self"}]}],"links":[{"text":"Careers","url":"https://careers.aliyun.com/en/home","target":"_self","rel":"follow"},{"text":" About Us","url":"https://www.alibabacloud.com/about","target":"_self","rel":"follow"},{"rel":"nofollow","text":" Privacy Policy","url":"https://www.alibabacloud.com/help/faq-detail/42425.htm","target":"_self"},{"rel":"nofollow","text":"Legal","url":"https://www.alibabacloud.com/help/en/legal","target":"_self"},{"text":"Notice List","url":"https://www.alibabacloud.com/notice","target":"_self","rel":"nofollow"},{"text":"Links","url":"https://www.alibabacloud.com/links.html","target":"_self","rel":"nofollow"}],"helperLinks":[{"text":"Alibaba Group","url":"http://www.alibabagroup.com/en/global/home","target":"_blank"},{"text":"Taobao Marketplace","url":"https://www.taobao.com","target":"_blank"},{"text":"Tmall","url":"https://www.tmall.com","target":"_blank"},{"text":"Juhuasuan","url":"https://ju.taobao.com","target":"_blank"},{"text":"AliExpress","url":"http://www.aliexpress.com","target":"_blank"},{"text":"Alibaba.com","url":"http://www.alibaba.com","target":"_blank"},{"text":"1688","url":"http://www.1688.com","target":"_blank"},{"text":"Alimama","url":"http://www.alimama.com/index.htm","target":"_blank"},{"text":"Fliggy","url":"https://www.fliggy.com","target":"_blank"},{"text":"YunOS","url":"http://www.yunos.com","target":"_blank"},{"text":"Amap","url":"http://www.autonavi.com","target":"_blank"},{"text":"UCWeb","url":"http://www.ucweb.com","target":"_blank"},{"text":"Umeng","url":"http://www.umeng.com","target":"_blank"},{"text":"Xiami","url":"http://www.xiami.com","target":"_blank"},{"text":"DingTalk","url":"https://www.dingtalk.com","target":"_blank"},{"text":"Alipay","url":"https://www.alipay.com","target":"_blank"}],"languages":[{"text":"English","key":"en"},{"text":"简体中文","key":"zh"}],"followUsLinks":[{"icon":"icon-Facebook1","text":"Facebook","url":"https://www.alibabacloud.com/security-notice-kfxbqr?forward=https://www.facebook.com/alibabacloud/","target":"_self"},{"icon":"icon-Linkedin","text":"Linkedin","url":"https://www.alibabacloud.com/security-notice-kfxbqr?forward=https://www.linkedin.com/company/alibabacloudtech","target":"_self"},{"icon":"icon-x","text":"Twitter","url":"https://www.alibabacloud.com/security-notice-kfxbqr?forward=https://www.twitter.com/alibaba_cloud","target":"_self"},{"text":"YouTube","url":"https://www.alibabacloud.com/security-notice-kfxbqr?forward=https://www.youtube.com/channel/UCipPA-ZHX6UYGH_Iyti1-Jw","icon":"icon-Youtube1","target":"_self"},{"text":"TikTok","url":"https://www.alibabacloud.com/security-notice-kfxbqr?forward=https://www.tiktok.com/@alibaba__cloud?lang=zh-Hant-TW","icon":"icon-Tiktok1","target":"_self"},{"icon":"icon-Email","target":"_self","text":"contact.us@alibabacloud.com","url":"https://www.alibabacloud.com/contact-sales"},{"icon":"icon-Telphone","target":"_self","url":"https://www.alibabacloud.com/contact-sales","text":"Call Us Now"},{"text":"Discord","url":"https://discord.com/invite/xEuwmj6qaA","icon":"icon-Discord","target":"_self"}],"linkArray":[{"url":"//intl.aliyun.com"},{"url":"//intl.aliyun.com/why-alibaba-cloud"},{"url":"//intl.aliyun.com/product"},{"url":"//intl.aliyun.com/solution"},{"url":"//intl.aliyun.com/chinaconnect"},{"url":"//intl.aliyun.com/icp"},{"url":"//intl.aliyun.com/pricing"},{"url":"//intl.aliyun.com/trust-center"},{"url":"//intl.aliyun.com/free-trial/enterprise"},{"url":"//intl.aliyun.com/startup"},{"url":"//intl.aliyun.com/partner"}],"public":[{"publicText":"","publicCode":""}],"optioninfo":{"dynamic":"true","static":"true"},"configGrayDatas":[{"rel":"follow","text":"价格计算器","target":"_blank"}],"isConfigGrayOpen":"false","whitePaymentLogos":[{"logo":"https://img.alicdn.com/imgextra/i2/O1CN016idpxh1fyP0EcQovD_!!6000000004075-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i4/O1CN01Y5zsNG1YUuBStyzr1_!!6000000003063-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i1/O1CN01iyQxY31jMAOtrq2hw_!!6000000004533-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i2/O1CN018Rxao91HAtPRiPbFH_!!6000000000718-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i1/O1CN01nK1cV41TuwchFwyYF_!!6000000002443-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i4/O1CN015JjBRl1NGHleda64q_!!6000000001542-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i2/O1CN01WH2Qvw1GDoJkT2Tka_!!6000000000589-2-tps-96-48.png"},{"logo":"https://img.alicdn.com/imgextra/i2/O1CN01qRlqso1lwvQ5TVSVI_!!6000000004884-2-tps-96-48.png"}],"navigations":[[{"title":"About","items":[{"rel":"follow","text":"About Alibaba Cloud","url":"https://www.alibabacloud.com/about","target":"_self"},{"rel":"follow","text":"Pricing Models","url":"https://www.alibabacloud.com/pricing","target":"_self"},{"rel":"follow","text":"Products","url":"https://www.alibabacloud.com/product","target":"_self"},{"rel":"follow","text":"Customers","url":"https://www.alibabacloud.com/customers","target":"_self"},{"rel":"follow","text":"Partners","url":"https://www.alibabacloud.com/partner","target":"_self"},{"rel":"follow","text":"Startups","url":"https://www.alibabacloud.com/startup","target":"_self"},{"rel":"follow","url":"https://www.alibabacloud.com/apsara-conference-2022/livestreaming","text":"Apsara Conference","target":"_self"},{"rel":"follow","url":"https://www.alibabacloud.com/apsara-conference-2022/livestreaming","text":"Alibaba Cloud Summit","target":"_self"}]},{"title":"Promotions","items":[{"rel":"follow","text":"Free Trial","url":"https://www.alibabacloud.com/free","target":"_self"},{"rel":"follow","text":"Simple Application Server","url":"https://www.alibabacloud.com/product/swas","target":"_self"}]}],[{"title":"Explore","items":[{"rel":"follow","text":"China Gateway","url":"https://www.alibabacloud.com/china-gateway","target":"_self"},{"rel":"follow","text":"ICP License Support","url":"https://www.alibabacloud.com/icp","target":"_self"},{"rel":"follow","text":"Getting Started","url":"https://www.alibabacloud.com/getting-started","target":"_self"},{"rel":"follow","text":"Blog","url":"https://www.alibabacloud.com/blog","target":"_self"},{"rel":"follow","text":"Marketplace","url":"https://marketplace.alibabacloud.com","target":"_self"},{"rel":"follow","text":"Training & Certification","url":"https://edu.alibabacloud.com/","target":"_self"}]},{"title":"Support","items":[{"rel":"follow","text":"Contact Sales","url":"https://www.alibabacloud.com/contact-sales","target":"_self"},{"rel":"follow","text":"Submit a Ticket","url":"https://workorder-intl.console.aliyun.com/console.htm?lang=#/ticket/list","target":"_self"},{"rel":"follow","text":"After-Sales Support","url":"https://www.alibabacloud.com/support/after-sales","target":"_self"},{"rel":"follow","text":"Security Report","url":"https://report.alibabacloud.com/#/reportCenter/home","target":"_self"},{"rel":"follow","text":"Feedback","url":"https://connect.alibabacloud.com","target":"_self"},{"rel":"follow","text":"Pricing Calculator","url":"https://www.alibabacloud.com/pricing-calculator","target":"_self"}]}],[{"title":"Resources","items":[{"rel":"follow","text":"Documentation Center","url":"https://www.alibabacloud.com/help","target":"_self"},{"rel":"follow","text":"Alibaba Cloud MVP","url":"https://mvp.alibabacloud.com/","target":"_self"},{"rel":"follow","text":"Security & Compliance","url":"https://www.alibabacloud.com/trust-center","target":"_self"},{"rel":"follow","text":"Press Room","url":"https://www.alibabacloud.com/press-room","target":"_self"},{"rel":"follow","text":"WHOIS","url":"https://www.alibabacloud.com/whois/home","target":"_self"},{"rel":"follow","text":"Status","url":"https://status.alibabacloud.com/","target":"_self"}]},{"title":"Products & Solutions","items":[{"rel":"","text":"Elastic Compute Service","url":"https://www.alibabacloud.com/product/ecs","target":"_blank"},{"rel":"","text":"CDN","url":"https://www.alibabacloud.com/product/cdn","target":"_blank"},{"rel":"","text":"Anti-DDoS","url":"https://www.alibabacloud.com/product/ddos","target":"_blank"},{"rel":"","text":"Object Storage Service","url":"https://www.alibabacloud.com/product/oss","target":"_blank"},{"rel":"","text":"eCommerce","url":"https://www.alibabacloud.com/solutions/e-commerce","target":"_blank"},{"rel":"","text":"Web Hosting","url":"https://www.alibabacloud.com/solutions/hosting","target":"_blank"},{"rel":"","text":"Security","url":"https://www.alibabacloud.com/solutions/security","target":"_blank"}]}],[{"title":"Hot Content","items":[{"rel":"","text":"ECS Documentation","url":"https://www.alibabacloud.com/help/product/25365.htm","target":"_blank"},{"rel":"","text":"How to get Domains","url":"https://www.alibabacloud.com/domain","target":"_blank"},{"rel":"","text":"Software Infrastructure","url":"https://marketplace.alibabacloud.com/products/56682004","target":"_blank"},{"rel":"","text":"New Users","url":"https://www.alibabacloud.com/getting-started/projects","target":"_blank"}]},{"title":"Recommended","items":[{"rel":"","text":"Topic Center","url":"https://topic.alibabacloud.com","target":"_blank"},{"rel":"","text":"Cloud Computing","url":"https://topic.alibabacloud.com/c/cloud-computing_3","target":"_blank"},{"rel":"","text":"Industries","url":"https://topic.alibabacloud.com/c/industries_2","target":"_blank"},{"rel":"","text":"Developers","url":"https://topic.alibabacloud.com/c/developer_1","target":"_blank"},{"rel":"","text":"Web Developing","url":"https://topic.alibabacloud.com/c/web-develop_1_11_1","target":"_blank"},{"rel":"","text":"Tutorials","url":"https://topic.alibabacloud.com/c/tutorials_4","target":"_blank"},{"rel":"","text":"PHP Tutorials","url":"https://topic.alibabacloud.com/c/php-tutorials_4_86_1","target":"_blank"}]}]]}
        pc