Puas yog lub teeb siv zookeeper?
Puas yog lub teeb siv zookeeper?

Video: Puas yog lub teeb siv zookeeper?

Video: Puas yog lub teeb siv zookeeper?
Video: Puas yog luag dag koj xwb | Kawm muas 2024, Hlis ntuj nqeg
Anonim

Pib lub Teeb Master ntawm ntau lub nodes thiab xyuas kom meej tias cov nodes muaj tib yam Zookeeper configuration rau ZooKeeper URL thiab directory.

Cov ntaub ntawv.

Cov cuab yeej cuab tam Lub ntsiab lus
spark . xa mus. zookeeper .dir Cov directory hauv ZooKeeper los khaws lub xeev rov qab (default: / spark ). Qhov no tuaj yeem xaiv tau

Li ntawd, koj puas tuaj yeem khiav taws hauv zos?

Spark tau ua khiav siv lub built-in standalone pawg teem sij hawm nyob rau hauv lub hauv zos hom. Qhov no txhais tau tias tag nrho cov Teeb txheej txheem yog khiav nyob rau hauv tib JVM-zoo, ib zaug, multithreaded piv txwv ntawm Teeb.

Qhov thib ob, Spark tuaj yeem siv yam tsis muaj Hadoop? Raws li ib Teeb cov ntaub ntawv, Spark tau khiav tsis muaj Hadoop . Koj tuaj yeem khiav nws ua hom Standalone tsis muaj txhua tus neeg saib xyuas kev pabcuam. Tab sis yog tias koj xav khiav hauv ntau qhov teeb tsa, koj xav tau tus neeg saib xyuas kev pab zoo li YARN lossis Mesos thiab cov ntaub ntawv faib tawm zoo li HDFS , S3 etc. Yog, taws tau khiav tsis muaj hwj chim.

Kuj paub yog, vim li cas ZooKeeper siv hauv Hadoop?

Zookeeper hauv Hadoop tuaj yeem saib raws li qhov chaw khaws cia hauv nruab nrab qhov twg cov ntawv thov faib tuaj yeem tso cov ntaub ntawv thiab tau txais cov ntaub ntawv tawm ntawm nws. Nws yog siv ua kom cov txheej txheem faib ua haujlwm ua ke ua ib chav tsev, siv nws cov synchronization, serialization thiab kev sib koom ua ke cov hom phiaj.

Lub spark standalone ua haujlwm li cas?

Standalone hom yog ib tug yooj yim pawg thawj tswj koom nrog Teeb . Nws ua rau nws yooj yim rau teeb ib pawg uas Teeb nws tus kheej tswj thiab tuaj yeem khiav ntawm Linux, Windows, lossis Mac OSX. Feem ntau nws yog qhov yooj yim tshaj plaws los khiav Teeb daim ntawv thov nyob rau hauv ib puag ncig pawg. Kawm, yuav ua li cas rau nruab Apache Spark Ntawm Standalone Hom.

Pom zoo: