2021년 3월 21일 일요일

[ Hive ] Phoenix에 연동하는 External Hive Table 생성시 오류 (NoSuchColumnFamilyException)


[ 에러메세지 ]

  • Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family table does not exist in region hbase:meta,,1.1588230740 in table 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', REGION_REPLICATION => '1', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', BLOOMFILTER => 'NONE', VERSIONS => '3', IN_MEMORY => 'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at org.apache.hadoop.hbase.regionserver.HRegion.checkFamily(HRegion.java:8420) at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:7398) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2269) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:36800) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2399) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:311) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:291) )



[ 원인 ]

CDH Hbase와 EMR Hbase 버전이 맞지 않아 생긴 오류

CDH Hbase-2.1, EMR-Hbase.1.4 



[ 해결 ]

1. Hbase버전 싱크를 맞춘다.

2. Hive to Phoenix를 다른 어플리케이션을 이용한다.



댓글 없음:

댓글 쓰기