Parquet data format yog dab tsi?

2024 Tus sau: Lynn Donovan | [email protected]. Kawg hloov kho: 2023-12-15 23:47

Apache Parquet yog ib qho dawb thiab qhib-qhov kab ke-oriented cov ntaub ntawv khaws cia hom ntawv ntawm Apache Hadoop ecosystem. Nws yog sib xws nrog feem ntau ntawm cov cov ntaub ntawv ua cov txheej txheem hauv Hadoop ib puag ncig. Nws muab tau zoo cov ntaub ntawv compression thiab encoding schemes nrog txhim kho kev ua tau zoo los daws qhov nyuaj cov ntaub ntawv nyob rau hauv tej.

Tsuas yog li ntawd, hom ntawv parquet yog dab tsi?

Parquet , qhov chaw qhib hom ntaub ntawv rau Hadoop. Parquet khaws cov ntaub ntawv nested nyob rau hauv ib tug ca columnar hom ntawv . Piv nrog rau txoj hauv kev ib txwm muaj uas cov ntaub ntawv khaws cia hauv kab-oriented mus kom ze, parquet yog ntau npaum li cas ntawm kev cia thiab kev ua haujlwm.

Tsis tas li ntawd, parquet siv rau dab tsi? Parquet yog qhov qhib cov ntaub ntawv hom muaj rau txhua qhov project hauv Hadoop ecosystem. Apache Parquet yog tsim los kom muaj txiaj ntsig zoo li kev ua tau zoo ntawm cov ntaub ntawv ca columnar khaws cov ntaub ntawv piv rau kab raws li cov ntaub ntawv xws li CSV lossis TSV cov ntaub ntawv.

Tsis tas li ntawd, parquet format khaws cov ntaub ntawv li cas?

DATA BLOCK Txhua qhov thaiv hauv qhov parquet file yog khaws cia nyob rau hauv daim ntawv ntawm kab pawg. Yog li ntawd, cov ntaub ntawv hauv a parquet cov ntaub ntawv tau muab faib ua ntau pawg kab. Cov kab no nyob rau hauv lem muaj ib los yog ntau kem chunks uas sib haum mus rau ib kem nyob rau hauv lub cov ntaub ntawv teeb. Cov cov ntaub ntawv rau txhua kab chunk uas sau nyob rau hauv daim ntawv ntawm nplooj ntawv.

Puas yog parquet tib neeg nyeem tau?

ORC, Parquet , thiab Avro kuj yog tshuab- nyeem tau binary hom ntawv, uas yog hais tias cov ntaub ntawv zoo li gibberish rau tib neeg . Yog koj xav tau ib tug neeg - nyeem tau hom ntawv zoo li JSON lossis XML, ces koj yuav tsum tau rov xav txog vim li cas koj thiaj siv Hadoop thawj qhov chaw.