Txoj haujlwm ua kua nplaum yog dab tsi?
Txoj haujlwm ua kua nplaum yog dab tsi?

Video: Txoj haujlwm ua kua nplaum yog dab tsi?

Video: Txoj haujlwm ua kua nplaum yog dab tsi?
Video: Tshuaj theem vim li cas thiaj tau nqi ?/ Siv kho mob dab tsi?/paris polyphylla use for? 2024, Kaum ib hlis
Anonim

A txoj hauj lwm yog lub lag luam logic uas ua cov extract, transform, thiab load (ETL) ua hauj lwm hauv AWS Kua nplaum . Thaum koj pib a txoj hauj lwm , AWS Kua nplaum khiav ib tsab ntawv uas rho tawm cov ntaub ntawv los ntawm qhov chaw, hloov cov ntaub ntawv, thiab thauj nws mus rau hauv lub hom phiaj. Koj tuaj yeem tsim hauj lwm ETL section of AWS Kua nplaum lub console.

Kuj nug, tuaj yeem teeb tsa hauv AWS kua nplaum?

AWS Glue yog serverless, yog li tsis muaj infrastructure rau teeb nce los yog tswj. Koj ua tau kuj siv cov AWS Glue API ua haujlwm rau kev sib txuas nrog AWS Glue kev pabcuam. Kho kom raug, debug, thiab sim koj tus Python lossis Scala Apache Spark ETL code siv qhov chaw paub txog kev txhim kho.

Kuj Paub, dab tsi yog AWS kua nplaum? AWS Glue yog ib qho kev pabcuam huab uas npaj cov ntaub ntawv rau kev tshuaj xyuas los ntawm kev rho tawm, hloov pauv thiab thauj khoom (ETL) cov txheej txheem. Kua nplaum kuj txhawb MySQL, Oracle, Microsoft SQL Server thiab PostgreSQL databases uas khiav ntawm Amazon Elastic Compute Cloud (EC2) piv txwv hauv Amazon Virtual Private Cloud.

Hais txog qhov no, AWS kua nplaum ua haujlwm li cas?

AWS Glue cia li nrhiav pom thiab profiles koj cov ntaub ntawv ntawm lub Kua nplaum Cov ntaub ntawv Catalog, pom zoo thiab tsim ETL code los hloov koj cov ntaub ntawv los rau hauv cov phiaj xwm phiaj xwm, thiab khiav ETL cov haujlwm ntawm kev tswj hwm tag nrho, ntsuas-tawm Apache Spark ib puag ncig kom thauj koj cov ntaub ntawv mus rau hauv nws qhov chaw.

Puas yog AWS nplaum txhawb pandas?

AWS Glue supports ob hom haujlwm: Apache Spark thiab Python plhaub. Nco tseg: Cov tsev qiv ntawv thiab txuas ntxiv modules rau Spark txoj haujlwm yuav tsum tau sau rau hauv Python . Cov tsev qiv ntawv xws li pandas , qho yog sau hauv C, tsis yog txhawb.

Pom zoo: