profile
v K_Y v
๐Ÿ“Œ ๊ธฐ์–ตํ•˜๊ธฐ ์œ„ํ•ด ๋‚จ๊ธฐ๋Š” ๊ธฐ๋ก๋“ค
๊ธ€์‹œ๋ฆฌ์ฆˆ์†Œ๊ฐœ
ํƒœ๊ทธ ๋ชฉ๋ก
์ „์ฒด๋ณด๊ธฐ (18)airflow(4)spark(3)elasticsearch(3)ELK(1)k8s(1)Index(1)python(1)docker(1)sparksql(1)rdb(1)kafka(1)Grafana(1)

[Airflow] custom operator(DAG run time check)

DAG ์–ผ๋งˆ๋‚˜ ๊ฑธ๋ฆฌ๋Š”์ง€ ์ง€์ผœ๋ณด๊ฒ ์–ด๐Ÿ‘€

airflow
2023๋…„ 11์›” 28์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

PEP 8

๊ทœ์น™์„ ์ž˜ ์ง€ํ‚ค์ž

python
2023๋…„ 8์›” 31์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Grafana] slack alert ์ ์šฉ

influxDB + Grafana ํ™˜๊ฒฝ์—์„œ slack alert ์„ค์ •ํ•˜๊ธฐ

Grafana
2023๋…„ 6์›” 21์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Filebeat] 7.10.2 ์„ค์น˜

on-premise์—์„œ filebeat ๊ตฌ์ถ•ํ•˜๊ธฐ

ELK
2023๋…„ 6์›” 16์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Airflow] log ์ตœ์ ํ™”

๋ฏธ์—ญ๋ณด๋‹ค ๋ฌด์„œ์šด log ๐Ÿ‘ฟ

airflow
2023๋…„ 6์›” 15์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

k8s๋ž€?

k8s ๋‹ˆ๊ฐ€ ๋ชฌ๋ฐใ… ใ… 

k8s
2023๋…„ 4์›” 14์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Airflow] date ๋ฐ ์Šค์ผ€์ค„ ๊ฐœ๋…

Airflow์˜ ์‹œ๊ฐ„์€ ๊ฑฐ๊พธ๋กœ ๊ฐ„๋‹ค๐Ÿ˜ฑ

airflow
2023๋…„ 2์›” 7์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Airflow] dag ์‹คํ–‰์‹œ argument๋ฅผ ์ „๋‹ฌํ•˜์—ฌ ์‹คํ–‰ํ•˜๋Š” ๋ฐฉ๋ฒ•

argument๋กœ ์œ ์—ฐํ•˜๊ฒŒ dag ์‹คํ–‰ํ•˜๋Š” ๋ฒ•

airflow
2023๋…„ 2์›” 7์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Docker] ๊ฐœ๋… ๋ฐ Dockerfile ๋ช…๋ น์–ด

๋„์ปค ๋‹ˆ๊ฐ€ ๋ชฌ๋ฐ?

docker
2023๋…„ 1์›” 17์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Pandas] loop ์†๋„ ๋น„๊ต

Pandas ํ”„๋ ˆ์ž„์„ loop์—์„œ ๊ฐ€์žฅ ๋นจ๋ฆฌ ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•!

2023๋…„ 1์›” 10์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Elasticsearch] score ๊ณ„์‚ฐ(BM25)

Elasticsearch์˜ score ๊ณ„์‚ฐ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ธ BM25 ์ •๋ฆฌ

elasticsearch
2022๋…„ 9์›” 22์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Kafka] Docker๋กœ kafka ํด๋Ÿฌ์Šคํ„ฐ ๊ตฌ์ถ•ํ•˜๊ธฐ

Docker๋กœ kafka ํด๋Ÿฌ์Šคํ„ฐ ๊ตฌ์ถ•ํ•˜๊ธฐ

kafka
2022๋…„ 8์›” 29์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Spark] Catalyst & Tungsten

SparkSQL ๋ฐฑ์—”๋“œ์˜ ํ•ต์‹ฌ์ธ Catalyst & Tungsten

sparksparksql
2022๋…„ 8์›” 5์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท

[Spark] Cache & Persist

RDD๋ฅผ ์žฌ์‚ฌ์šฉํ•˜๊ธฐ ์œ„ํ•œ cache ๋ฐ persist

spark
2022๋…„ 7์›” 28์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท

[RDB] Index ํšจ๊ณผ์ ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๋ฒ•

DB Index ํšจ๊ณผ์ ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๋ฐฉ๋ฒ•

Indexrdb
2022๋…„ 7์›” 4์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท

[Spark] Apache Spark๋ž€?

Apache Spark ๊ฐœ๋…

spark
2022๋…„ 7์›” 1์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท

[Elasticsearch] heap memory ์„ค์ •

heap memory ์„ค์ •

elasticsearch
2022๋…„ 5์›” 10์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท

[Elasticsearch] ์šฉ๋Ÿ‰ ํฐ ์ธ๋ฑ์Šค reindex ํ•˜๋Š” ๋ฒ•

์šฉ๋Ÿ‰ ํฐ ์ธ๋ฑ์Šค ์•ˆ์ •์ ์œผ๋กœ reindex ํ•˜๋Š” ๋ฒ•

elasticsearch
2022๋…„ 5์›” 10์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท