Dab tsi yog mapper thiab reducer hauv Hadoop?
Dab tsi yog mapper thiab reducer hauv Hadoop?

Video: Dab tsi yog mapper thiab reducer hauv Hadoop?

Video: Dab tsi yog mapper thiab reducer hauv Hadoop?
Video: yog hmoov dab tsi tub huas xyooj 2024, Tej zaum
Anonim

Qhov loj kom zoo dua ntawm MapQhia yog tias nws yog ib qho yooj yim rau scale cov ntaub ntawv ua dua ntau lub computer nodes. Hauv qab MapQhia qauv, cov ntaub ntawv ua primitives hu ua mappers thiab reducers . Decomposing cov ntaub ntawv ua daim ntawv thov rau hauv mappers thiab reducers yog qee zaum tsis tseem ceeb.

Ua raws li qhov pom, mapper thiab reducer yog dab tsi?

MapReduce muaj ob lub luag haujlwm tseem ceeb: Mapper thiab Reducer . Daim ntawv qhia yog ib txoj haujlwm uas ua cov ntaub ntawv nkag. Cov daim ntawv qhia ua cov ntaub ntawv thiab tsim ntau yam me me ntawm cov ntaub ntawv.

mapper yog dab tsi? A daim ntawv qhia tuaj yeem piav qhia cov ntaub ntawv daim ntawv qhia nrog rau tus neeg uas tsim cov duab qhia chaw. Lub luag haujlwm ntawm thaj chaw daim ntawv qhia los yog tus kws tshaj lij kos duab suav nrog kev sib sau thiab ua cov ntaub ntawv thaj chaw los tsim ib daim duab qhia chaw.

Nyob rau hauv txoj kev no, dab tsi yog siv mapper thiab reducer hauv Hadoop?

Raws li Apache Software Foundation, lub hom phiaj tseem ceeb ntawm Daim ntawv qhia / Txo yog cais cov ntaub ntawv nkag mus rau hauv cov chunks ywj pheej uas tau ua tiav hauv ib qho kev sib luag. Cov Hadoop MapReduce lub moj khaum sorts cov outputs ntawm cov maps, uas yog ces input rau lub txo hauj lwm.

Dab tsi yog kev siv mapper hauv Hadoop?

Hauv kev khiav Hadoop txoj haujlwm, cov ntawv thov feem ntau siv cov Daim ntawv qhia thiab Reducer interfaces los muab daim ntawv qhia (ib tus neeg ua haujlwm hloov cov ntaub ntawv nkag mus rau hauv cov ntaub ntawv nruab nrab) thiab txo txoj hauv kev los txo cov txheej txheem nruab nrab uas qhia tus yuam sij rau cov nqi me me.

Pom zoo: