Hive Server run Error

LΒ·2022λ…„ 7μ›” 26일
0
post-thumbnail

λ…μž λŒ€μƒπŸ“£

πŸ‘‰ Hadoop eco system ꡬ좕쀑이신 λΆ„
πŸ‘‰ 데이터 적재 및 처리λ₯Ό μœ„ν•΄ Hiveλ₯Ό μ‚¬μš©ν•˜μ‹œλŠ” λΆ„


μΆœκ°„ μ΄μœ β“

tez engine 기반의 Hive ꡬ동 μ‹œ, μ—λŸ¬ λ°œμƒ 확인


문제 νŒŒμ•…πŸ”

Exception in thread "main" java.lang.RuntimeException:java.io.IOException: Previous writer likely failed to write hdfs://mycluster/user/root/.hiveJars/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar. Failing because I am unlikely to write too.
~
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://mycluster/user/root/.hiveJars/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar. Failing because I am unlikely to write too.
~
Q: Hive ꡬ동 μ‹œ, 상기 였λ₯˜κ°€ λ°œμƒν•΄μš”πŸ’¦πŸ’¦

문제 ν•΄κ²°πŸŽŠ

A: λ¨Όμ € hive-site.xmlμ—μ„œ hive.exec.scratchdir의 값을 ν™•μΈν•˜μ„Έμš”.
   ν•΄λ‹Ή κ°’μ˜ μ΅œμƒλ‹¨(루트) 디렉터리λ₯Ό ν™•μΈν•œ ν›„, 
   Hadoop NN(active)의 ν„°λ―Έλ„λ‘œ μ΄λ™ν•©λ‹ˆλ‹€πŸ’¨
   
   ν•΄λ‹Ή ν„°λ―Έλ„μ—μ„œ 
   hdfs dfs -chmod -R 777 /[μƒκΈ°μ—μ„œ ν™•μΈν•œ 디렉터리λͺ…]
   을 μž…λ ₯ν•˜μ—¬ κΆŒν•œμ„ λ³€κ²½ν•΄μ€λ‹ˆλ‹€.
   
   λ‹€μ‹œ hive μ„œλ²„ ꡬ동을 ν•˜λ©΄ μ •μƒμ μœΌλ‘œ κ΅¬λ™λ˜λŠ” 것을 확인할 수 μžˆμŠ΅λ‹ˆλ‹€.
profile
데이터 μš”λ¦¬μ‚¬

0개의 λŒ“κΈ€