docs: clarify pre-installed duckdb/pyiceberg and target injected packages in walkthrough
This commit is contained in:
@@ -237,17 +237,17 @@ docker ps --filter "name=airflow" --format "table {{.Names}}\t{{.Image}}\t{{.Sta
|
|||||||
*Catat nama kontainer scheduler dan dag processor serta port host webserver (misal: `0.0.0.0:12082->8080/tcp`).*
|
*Catat nama kontainer scheduler dan dag processor serta port host webserver (misal: `0.0.0.0:12082->8080/tcp`).*
|
||||||
|
|
||||||
#### 2. Injeksi Pustaka Engine ke Kontainer Berjalan (Tanpa Restart)
|
#### 2. Injeksi Pustaka Engine ke Kontainer Berjalan (Tanpa Restart)
|
||||||
Gunakan `docker exec` untuk memasang dependensi engine (`astronomer-cosmos`, `dbt-postgres`, `duckdb`, `pyiceberg`) langsung ke worker/scheduler tanpa mematikan layanan:
|
Gunakan `docker exec` untuk memasang dependensi engine (`astronomer-cosmos`, `dbt-postgres`, `apache-airflow-providers-git`, dan `dlt`) langsung ke worker/scheduler tanpa mematikan layanan. *(Catatan: Pustaka `duckdb` dan `pyiceberg` sudah tersedia bawaan image)*:
|
||||||
```bash
|
```bash
|
||||||
# Injeksi ke Scheduler
|
# Injeksi ke Scheduler
|
||||||
docker exec -u airflow <nama_kontainer_scheduler> pip install --no-cache-dir \
|
docker exec -u airflow <nama_kontainer_scheduler> pip install --no-cache-dir \
|
||||||
astronomer-cosmos==1.15.1 dbt-postgres==1.11.0 apache-airflow-providers-git==1.0.0 \
|
astronomer-cosmos==1.15.1 dbt-postgres==1.11.0 apache-airflow-providers-git==1.0.0 \
|
||||||
duckdb==1.1.3 pyiceberg[s3fs,pyarrow]==0.8.0 dlt[duckdb,filesystem]==1.6.1
|
dlt[duckdb,filesystem]==1.6.1
|
||||||
|
|
||||||
# Injeksi ke DAG Processor
|
# Injeksi ke DAG Processor
|
||||||
docker exec -u airflow <nama_kontainer_dag_processor> pip install --no-cache-dir \
|
docker exec -u airflow <nama_kontainer_dag_processor> pip install --no-cache-dir \
|
||||||
astronomer-cosmos==1.15.1 dbt-postgres==1.11.0 apache-airflow-providers-git==1.0.0 \
|
astronomer-cosmos==1.15.1 dbt-postgres==1.11.0 apache-airflow-providers-git==1.0.0 \
|
||||||
duckdb==1.1.3 pyiceberg[s3fs,pyarrow]==0.8.0 dlt[duckdb,filesystem]==1.6.1
|
dlt[duckdb,filesystem]==1.6.1
|
||||||
|
|
||||||
# Verifikasi instalasi berhasil
|
# Verifikasi instalasi berhasil
|
||||||
docker exec <nama_kontainer_scheduler> python -c "import cosmos, duckdb, pyiceberg; print('✅ Airflow Engine Ready!')"
|
docker exec <nama_kontainer_scheduler> python -c "import cosmos, duckdb, pyiceberg; print('✅ Airflow Engine Ready!')"
|
||||||
|
|||||||
Reference in New Issue
Block a user