Cov txheej txheem:

Kuv yuav teem sijhawm ua haujlwm Hive hauv oozie li cas?
Kuv yuav teem sijhawm ua haujlwm Hive hauv oozie li cas?

Video: Kuv yuav teem sijhawm ua haujlwm Hive hauv oozie li cas?

Video: Kuv yuav teem sijhawm ua haujlwm Hive hauv oozie li cas?
Video: Yuav tawm ntawm txoj kev txom nyem tau li cas? 2024, Hlis ntuj nqeg
Anonim

Rau teem caij ua haujlwm Hive siv Oozie , koj yuav tsum sau ib Hive - kev ua.

hql) hauv.

  1. Tsim ib daim ntawv teev npe hauv HDFS los ntawm kev tua cov lus txib hauv qab no.
  2. hadoop fs -mkdir -p /user/ ua oozi /workflows/
  3. Muab kev ua haujlwm. xml, Hive tsab ntawv (create_table. hql) thiab Hniav - chaw. xml nyob rau hauv cov directory tsim nyob rau hauv kauj ruam 2. Koj siv tau cov lus txib hauv qab no.

Ib yam li ntawd, kuv yuav ua li cas khiav Hive tsab ntawv hauv oozie?

Khiav Hive Txoj Haujlwm nrog Oozie

  1. Qhia qhov chaw Hive-site. xml nyob rau hauv txoj hauj lwm-xml parameter.
  2. Qhia meej lub npe ntawm tsab ntawv (piv txwv li, tsab ntawv. q) uas muaj cov lus nug hauv Hive nyob rau hauv tsab ntawv parameter.
  3. Optionally, ntxiv cov khoom siv los ntawm txoj haujlwm Oozie launcher. Ntxiv lub prefix oozie. launcher rau cov khoom npe.

Tsis tas li ntawd, kuv yuav khiav oozie workflow li cas? Khiav Oozie Workflow Los ntawm Kab hais kom ua

  1. Nkag mus rau Web Console.
  2. Luam oozie piv txwv rau koj lub tsev directory hauv web console: cp /usr/hdp/current/oozie-client/doc/oozie-examples. tar. gz kev.
  3. Extract cov ntaub ntawv los ntawm tar tar -zxvf oozie-examples.tar.gz.
  4. Luam cov piv txwv directory rau HDFS hadoop fs -copyFromLocal piv txwv.

Hauv qhov no, kuv yuav teem sijhawm ua haujlwm Hadoop li cas?

Yuav ua li cas teem caij ua hauj lwm hauv haoop ua - Quora. Txoj kev yooj yim tshaj plaws yog qhwv koj cov cai hauv daim ntawv plhaub thiab teem caij nws zoo li cron txoj hauj lwm ntawm ntug node (qhov node qhov twg koj feem ntau xa koj hauj lwm ). Tab sis feem ntau ntim cov cai hauv ib tsab ntawv thiab khiav nws li a txoj hauj lwm yog ib qho nyuaj rau debug. kuaj thiab tswj.

Oozie workflow yog dab tsi?

Oozie yog a kev ua haujlwm teem sijhawm rau kev tswj hwm Apache Hadoop cov haujlwm. Oozie Workflow cov hauj lwm yog Directed Acyclical Graphs (DAGs) ntawm kev ua. Oozie Cov hauj lwm coordinator rov muaj dua Oozie Workflow cov hauj lwm tshwm sim los ntawm lub sij hawm (frequency) thiab cov ntaub ntawv muaj. Oozie yog ib tug scalable, txhim khu kev qha thiab extensible system.

Pom zoo: