AWS MapReduce yog dab tsi?
AWS MapReduce yog dab tsi?

Video: AWS MapReduce yog dab tsi?

Video: AWS MapReduce yog dab tsi?
Video: Top 50+ AWS Services Explained in 10 Minutes 2024, Tej zaum
Anonim

Amazon Elastic MapRub (EMR) yog Amazon Web Services ( AWS ) cov cuab yeej rau kev ua cov ntaub ntawv loj thiab kev tshuaj xyuas. Amazon EMR ua cov ntaub ntawv loj thoob plaws Hadoop pawg ntawm virtual servers ntawm Amazon Elastic Compute Cloud (EC2) thiab Amazon Simple Storage Service (S3).

Hauv qhov no, AWS EMR ua haujlwm li cas?

Cov kev pabcuam pib tus neeg siv khoom tshwj xeeb ntawm Amazon EC2 piv txwv, suav nrog ib tus tswv thiab ntau lwm cov nodes. Amazon EMR khiav Hadoop software ntawm cov piv txwv no. Tus tswv node faib cov ntaub ntawv nkag mus rau hauv cov blocks, thiab faib cov txheej txheem ntawm cov blocks mus rau lwm cov nodes.

Ib sab saum toj no, qhov txawv ntawm ec2 thiab EMR yog dab tsi? Tsis zoo li EMR , EC 2 tsis categorize tus qhev nodes rau hauv core thiab cov haujlwm nodes. Qhov no ua rau muaj kev pheej hmoo ntawm kev poob HDFS cov ntaub ntawv nyob rau hauv rooj plaub node raug tshem tawm / ploj. EC 2 siv Apache cov tsev qiv ntawv (s3a) kom nkag tau cov ntaub ntawv ntawm s3. Ntawm qhov tod tes, EMR siv AWS proprietary code kom muaj kev nkag tau sai rau s3.

Tsis tas li ntawd, puas yog AWS EMR tswj hwm tag nrho?

Amazon Elastic MapReduce ( EMR ) yog a tswj tag nrho Hadoop thiab Spark platform los ntawm Amazon Web Service ( AWS ). Nrog EMR , AWS Cov neeg siv khoom tuaj yeem nrawm nrawm rau ntau qhov ntawm Hadoop pawg los ua cov ntaub ntawv loj ua haujlwm.

AWS puas siv Hadoop?

Amazon Web Services siv qhib qhov chaw Apache Hadoop faib cov tshuab xam zauv los ua kom yooj yim rau kev nkag mus rau cov lej loj ntawm lub zog los khiav cov ntaub ntawv siv ntau yam haujlwm. Hadoop , qhov qhib version ntawm Google's MapReduce, twb tau siv los ntawm cov tuam txhab xws li Yahoo thiab Facebook.

Pom zoo: