Discussion:
NativeException: java.io.IOException: Unable to enable table
(too old to reply)
陈加俊
2011-02-25 03:20:21 UTC
Permalink
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE

Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS =>
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'

NativeException: java.io.IOException: Unable to enable table cjjHTML


and the master's log :

2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:41,662 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.metaScanner scanning meta region {server: 192.168.5.154:60020,
regionname: .META.,,1, startKey: <>}
2011-02-25 11:11:59,872 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.metaScanner scan of 9958 row(s) of meta region {server:
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
2011-02-25 11:11:59,873 INFO org.apache.hadoop.hbase.master.BaseScanner: All
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved regions
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747',
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm',
ENDKEY => 'http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390', STARTKEY =>
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164, OFFLINE =>
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629',
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm',
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm',
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm', ENDKEY
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME => 'cjjHTML',
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1',
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
Stack
2011-02-25 04:27:07 UTC
Permalink
If you enable debug in the shell, I think it'll give you full stack
trace. Try that.

hbase(main):003:0> debug
Debug mode is ON

St.Ack
Post by 陈加俊
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE
Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS =>
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'
NativeException: java.io.IOException: Unable to enable table cjjHTML
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
RegionManager.metaScanner scanning meta region {server: 192.168.5.154:60020,
regionname: .META.,,1, startKey: <>}
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
2011-02-25 11:11:59,873 INFO org.apache.hadoop.hbase.master.BaseScanner: All
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved regions
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747',
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm',
ENDKEY => 'http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390', STARTKEY =>
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164, OFFLINE =>
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629',
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm',
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm',
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION =>
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm', ENDKEY
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME => 'cjjHTML',
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1',
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
陈加俊
2011-02-25 06:51:47 UTC
Permalink
hbase(main):004:0> debug
NameError: undefined local variable or method `debug' for
#<Object:0x1b72290f>
Post by Stack
If you enable debug in the shell, I think it'll give you full stack
trace. Try that.
hbase(main):003:0> debug
Debug mode is ON
St.Ack
Post by 陈加俊
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE
Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS
=>
Post by 陈加俊
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'
NativeException: java.io.IOException: Unable to enable table cjjHTML
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
192.168.5.154:60020,
Post by 陈加俊
regionname: .META.,,1, startKey: <>}
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
All
Post by 陈加俊
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved
regions
Post by 陈加俊
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747
',
Post by 陈加俊
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm
',
Post by 陈加俊
ENDKEY => '
http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
Post by 陈加俊
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390', STARTKEY
=>
Post by 陈加俊
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164,
OFFLINE =>
Post by 陈加俊
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
=>
Post by 陈加俊
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629
',
Post by 陈加俊
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm
',
Post by 陈加俊
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm',
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm',
ENDKEY
Post by 陈加俊
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME => 'cjjHTML',
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3', TTL
=>
Post by 陈加俊
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS =>
'1',
Post by 陈加俊
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE
Post by 陈加俊
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
陈加俊
2011-02-25 06:57:02 UTC
Permalink
hbase(main):006:0> enable_region 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390'
0 row(s) in 0.1260 seconds
hbase(main):007:0> enable_region 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863'
0 row(s) in 0.0980 seconds

master's logs :

2011-02-25 14:53:02,037 WARN org.apache.hadoop.hbase.master.BaseScanner:
Region is split but not offline: cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863

2011-02-25 14:54:06,635 WARN org.apache.hadoop.hbase.master.BaseScanner:
Region is split but not offline: cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863

My question is : Is there any problem ?
Post by 陈加俊
hbase(main):004:0> debug
NameError: undefined local variable or method `debug' for
#<Object:0x1b72290f>
Post by Stack
If you enable debug in the shell, I think it'll give you full stack
trace. Try that.
hbase(main):003:0> debug
Debug mode is ON
St.Ack
Post by 陈加俊
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE
Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS
=>
Post by 陈加俊
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'
NativeException: java.io.IOException: Unable to enable table cjjHTML
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
192.168.5.154:60020,
Post by 陈加俊
regionname: .META.,,1, startKey: <>}
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
All
Post by 陈加俊
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved
regions
Post by 陈加俊
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747
',
Post by 陈加俊
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm
',
Post by 陈加俊
ENDKEY => '
http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
Post by 陈加俊
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390',
STARTKEY =>
Post by 陈加俊
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164,
OFFLINE =>
Post by 陈加俊
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
=>
Post by 陈加俊
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629
',
Post by 陈加俊
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm
',
Post by 陈加俊
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm
',
Post by 陈加俊
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm',
ENDKEY
Post by 陈加俊
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML',
Post by 陈加俊
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3',
TTL =>
Post by 陈加俊
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS =>
'1',
Post by 陈加俊
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE
Post by 陈加俊
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
陈加俊
2011-02-25 07:11:46 UTC
Permalink
Fisrt

enable_region 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390'
enable_region 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863'
disable_region 'cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834'
enable_region 'cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834'

Then

hbase(main):016:0> enable 'cjjHTML'
0 row(s) in 6.8580 seconds

But

logs in master:
2011-02-25 15:09:58,575 WARN org.apache.hadoop.hbase.master.BaseScanner:
Region is split but not offline: cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390
2011-02-25 15:10:01,991 WARN org.apache.hadoop.hbase.master.BaseScanner:
Region is split but not offline: cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863
2011-02-25 15:10:03,391 WARN org.apache.hadoop.hbase.master.BaseScanner:
Region is split but not offline: cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834
Post by 陈加俊
hbase(main):004:0> debug
NameError: undefined local variable or method `debug' for
#<Object:0x1b72290f>
Post by Stack
If you enable debug in the shell, I think it'll give you full stack
trace. Try that.
hbase(main):003:0> debug
Debug mode is ON
St.Ack
Post by 陈加俊
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE
Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS
=>
Post by 陈加俊
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'
NativeException: java.io.IOException: Unable to enable table cjjHTML
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
192.168.5.154:60020,
Post by 陈加俊
regionname: .META.,,1, startKey: <>}
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
All
Post by 陈加俊
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved
regions
Post by 陈加俊
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747
',
Post by 陈加俊
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm
',
Post by 陈加俊
ENDKEY => '
http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
Post by 陈加俊
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390',
STARTKEY =>
Post by 陈加俊
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164,
OFFLINE =>
Post by 陈加俊
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
=>
Post by 陈加俊
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629
',
Post by 陈加俊
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm
',
Post by 陈加俊
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm
',
Post by 陈加俊
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm',
ENDKEY
Post by 陈加俊
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML',
Post by 陈加俊
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3',
TTL =>
Post by 陈加俊
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS =>
'1',
Post by 陈加俊
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE
Post by 陈加俊
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
Jean-Daniel Cryans
2011-02-25 17:51:45 UTC
Permalink
I that's the bug where disabling a table that was just split and still
has the parent entries in .META. puts it into a weird state. We can do
some deeper debugging to help you getting that table back but I
strongly suggest that you upgrade to 0.90.1 where the issue is fixed.
There's no backport possible to 0.20 btw.

J-D
Post by 陈加俊
Fisrt
enable_region 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390'
enable_region 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863'
disable_region 'cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834'
enable_region 'cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834'
Then
hbase(main):016:0> enable 'cjjHTML'
0 row(s) in 6.8580 seconds
But
Region is split but not offline: cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390
Region is split but not offline: cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863
Region is split but not offline: cjjHTML,
http://www.feelcars.com/20101217/c200607508.shtml,1292862148834
Post by 陈加俊
hbase(main):004:0> debug
NameError: undefined local variable or method `debug' for
#<Object:0x1b72290f>
Post by Stack
If you enable debug in the shell, I think it'll give you full stack
trace.  Try that.
hbase(main):003:0> debug
Debug mode is ON
St.Ack
Post by 陈加俊
I want to alter table 'cjjHTML' ,and do ti as follows,but throw IOE
Version: 0.20.6, r965666, Mon Jul 19 16:54:48 PDT 2010
hbase(main):001:0> disable 'cjjHTML'
0 row(s) in 210.5140 seconds
hbase(main):002:0> alter 'cjjHTML', {NAME => 'responseHeader' , VERSIONS
=>
Post by 陈加俊
1 , METHOD => 'add'}
0 row(s) in 38.8540 seconds
hbase(main):003:0> enable 'cjjHTML'
NativeException: java.io.IOException: Unable to enable table cjjHTML
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing regions
currently being served
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
2011-02-25 11:11:39,861 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Already online
192.168.5.154:60020,
Post by 陈加俊
regionname: .META.,,1, startKey: <>}
192.168.5.154:60020, regionname: .META.,,1, startKey: <>} complete
All
Post by 陈加俊
1 .META. region(s) scanned
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Processing unserved
regions
Post by 陈加俊
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm,1296258983747
',
Post by 陈加俊
STARTKEY => '
http://epaper.usqiaobao.com:81/qiaobao/html/2011-01/15/content_398858.htm
',
Post by 陈加俊
ENDKEY => '
http://epaper.voc.com.cn/hnrb/html/2010-11/30/content_278268.htm',
Post by 陈加俊
ENCODED => 1336943365, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://news.hexun.com/2010-11-24/125798014.html,1291022808390',
STARTKEY =>
Post by 陈加俊
'http://news.hexun.com/2010-11-24/125798014.html', ENDKEY => '
http://news.hexun.com/index-scroll-2.html', ENCODED => 489854164,
OFFLINE =>
Post by 陈加俊
true, SPLIT => true, TABLE => {{NAME => 'cjjHTML', FAMILIES => [{NAME =>
'page', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
=>
Post by 陈加俊
'responseHeader', COMPRESSION => 'NONE', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://szsb.sznews.com/html/2011-01/31/content_1431920.htm,1297882835629
',
Post by 陈加俊
STARTKEY => 'http://szsb.sznews.com/html/2011-01/31/content_1431920.htm
',
Post by 陈加俊
ENDKEY => 'http://sztqb.sznews.com/html/2010-11/04/content_1295151.htm
',
Post by 陈加俊
ENCODED => 1607157459, OFFLINE => true, SPLIT => true, TABLE => {{NAME
=>
Post by 陈加俊
'cjjHTML', FAMILIES => [{NAME => 'page', VERSIONS => '3', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE',
VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} because it is offline and split
2011-02-25 11:12:05,010 DEBUG
org.apache.hadoop.hbase.master.ChangeTableState: Skipping region REGION
=>
Post by 陈加俊
{NAME => 'cjjHTML,
http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm,1291148553863',
STARTKEY => 'http://wfwb.wfnews.com.cn/html/2010-11/26/node_62.htm',
ENDKEY
Post by 陈加俊
=> 'http://whb.eastday.com/w/20091015/u1a642090.html', ENCODED =>
1864097884, OFFLINE => true, SPLIT => true, TABLE => {{NAME =>
'cjjHTML',
Post by 陈加俊
FAMILIES => [{NAME => 'page', COMPRESSION => 'NONE', VERSIONS => '3',
TTL =>
Post by 陈加俊
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'responseHeader', COMPRESSION => 'NONE', VERSIONS =>
'1',
Post by 陈加俊
TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE
Post by 陈加俊
=> 'true'}]}} because it is offline and split
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
--
Thanks & Best regards
jiajun
Loading...