Dab tsi yog lub pas dej data hauv Hadoop?
Dab tsi yog lub pas dej data hauv Hadoop?

Video: Dab tsi yog lub pas dej data hauv Hadoop?

Video: Dab tsi yog lub pas dej data hauv Hadoop?
Video: Koj Hais Dab Tsi?/Suabci Kwm & Ab Meej Ham/Official MV 2023 2024, Kaum ib hlis
Anonim

A Hadoop data lake yog a cov ntaub ntawv kev tswj hwm platform suav nrog ib lossis ntau dua Hadoop pawg. Nws yog siv los ua cov txheej txheem thiab khaws cov khoom tsis sib xws cov ntaub ntawv , xws li cov ntaub ntawv cav, internet clickstream cov ntaub ntawv, sensor cov ntaub ntawv , JSON cov khoom, dluab thiab social media posts.

Hauv qhov no, qhov txawv ntawm lub tsev khaws ntaub ntawv thiab lub pas dej cov ntaub ntawv yog dab tsi?

Cov pas dej thiab cov ntaub ntawv warehouses yog ob qho tib si dav siv rau khaws cia loj cov ntaub ntawv , tab sis lawv tsis yog interchangeable lus. A data pas dej yog lub pas dej loj loj cov ntaub ntawv , lub hom phiaj uas tseem tsis tau txhais. A cov ntaub ntawv warehouse yog ib lub repository rau structured, lim cov ntaub ntawv uas twb tau ua tiav rau lub hom phiaj tshwj xeeb.

Tsis tas li ntawd, dab tsi yog data Lake architecture? A Data Lake yog ib qho chaw cia khoom uas tuaj yeem khaws ntau cov qauv tsim, semi-structured, thiab unstructured cov ntaub ntawv . Tsis zoo li lub tsev hierarchal Dataware qhov twg cov ntaub ntawv yog khaws cia rau hauv Files thiab Folder, Data pas dej muaj ib lub tiaj architecture.

Hais txog qhov no, dab tsi yog txhais los ntawm cov ntaub ntawv pas dej?

A data pas dej yog ib lub chaw cia khoom uas tuav tau ib tug loj npaum li cas ntawm raw cov ntaub ntawv nyob rau hauv nws haiv neeg hom kom txog rau thaum nws yuav tsum tau. Thaum ib tug hierarchical cov ntaub ntawv cov khw muag khoom cov ntaub ntawv nyob rau hauv cov ntaub ntawv los yog folders, a data pas dej siv lub tiaj tiaj architecture los khaws cia cov ntaub ntawv . Lub sij hawm data pas dej feem ntau cuam tshuam nrog Hadoop-oriented khoom cia.

Puas yog Elasticsearch lub pas dej cov ntaub ntawv?

A data pas dej tsuas yog qhov chaw nres tsheb rau koj cov ntaub ntawv kom txog thaum koj xav tau, thiab nws tuaj yeem suav nrog HDFS (feem ntau), cov khoom khaws cia, NAS lub thawv, lossis lwm yam. Hauv paus, Elasticsearch yog ib qho cuab yeej rau indexing cov ntaub ntawv , tsis yog rau kev khaws cia cov ntaub ntawv nws tus kheej.

Pom zoo: