DataNode thiab NameNode hauv Hadoop yog dab tsi?
DataNode thiab NameNode hauv Hadoop yog dab tsi?

Video: DataNode thiab NameNode hauv Hadoop yog dab tsi?

Video: DataNode thiab NameNode hauv Hadoop yog dab tsi?
Video: TWed Discussion: Xiaohui Lu on "A Hands-on Introduction to Big Data Analysis using Hadoop" 2024, Kaum ib hlis
Anonim

DataNodes yog cov qhev nodes hauv HDFS . Tsis zoo li Lub npeNode , DataNode yog cov khoom siv kho vajtse, uas yog, cov khoom siv tsis kim uas tsis yog cov khoom zoo lossis cov khoom siv siab. Cov DataNode yog ib lub server thaiv uas khaws cov ntaub ntawv hauv zos cov ntaub ntawv ext3 lossis ext4.

Ib qho ntxiv, NameNode ua haujlwm li cas hauv Hadoop?

Lub npeNode tsuas khaws cov metadata ntawm HDFS - cov ntoo directory ntawm tag nrho cov ntaub ntawv nyob rau hauv cov ntaub ntawv system, thiab taug qab cov ntaub ntawv nyob rau hauv pawg. NameNode tsis khaws cov ntaub ntawv tiag tiag lossis dataset. Cov ntaub ntawv nws tus kheej tau khaws cia hauv DataNodes. NameNode yog ib lub ntsiab lus ntawm kev ua tsis tiav hauv Hadoop pawg.

Ib tug kuj yuav nug, NameNode RPC yog dab tsi? Hauv Hadoop, lub Lub npeNode yog ib lub tshuab uas tswj hwm HDFS cov haujlwm hauv nws lub npe. Cov haujlwm no suav nrog tau txais qhov chaw thaiv, sau npe, thiab tsim cov ntaub ntawv. Cov NameNode tau txais kev ua haujlwm HDFS raws li RPC hu thiab muab tso rau hauv FIFO hu queue rau kev ua tiav los ntawm kev nyeem xov.

Hais txog qhov no, cov nodes hauv Hadoop yog dab tsi?

A node hauv hadoop tsuas yog txhais tau tias lub computer uas siv tau rau kev ua thiab khaws cia. Muaj ob hom nodes hauv hadoop Lub npe node thiab Data node . Nws yog hu ua a node raws li tag nrho cov computers no yog interconnected. NameNode tseem hu ua tus Xib Hwb node.

Qhov thib ob NameNode hauv Hadoop yog dab tsi?

Secondary NameNode hauv hadoop yog ib qho tshwj xeeb ntawm node nyob rau hauv HDFS pawg uas nws lub luag haujlwm tseem ceeb yog los saib xyuas cov ntaub ntawv kaw lus metadata tam sim no npe . Nws tsis yog thaub qab npe . Nws tsuas yog checkpoints cov npe file system namespace.

Pom zoo: