Hadoop使用过程中常见的错误

导读:本篇文章讲解 Hadoop使用过程中常见的错误,希望对大家有帮助,欢迎收藏,转发!站点地址:www.bmabk.com

1、异常:“java.io.IOException: Got error, status message , ack with firstBadLink as 192.168.1.10:50010”

[root@node01 servers]# ./hadoop-2.7.5/bin/hdfs dfs -put test.txt /input
20/08/10 22:28:42 INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.io.IOException: Got error, status message , ack with firstBadLink as 192.168.1.9:50010
at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:140)
at org.apache.hadoop.hdfs.DFSOutputStream

D

a

t

a

S

t

r

e

a

m

e

r

.

c

r

e

a

t

e

B

l

o

c

k

O

u

t

p

u

t

S

t

r

e

a

m

(

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

.

j

a

v

a

:

1482

)

a

t

o

r

g

.

a

p

a

c

h

e

.

h

a

d

o

o

p

.

h

d

f

s

.

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

DataStreamer.createBlockOutputStream(DFSOutputStream.java:1482) at org.apache.hadoop.hdfs.DFSOutputStream

DataStreamer.createBlockOutputStream(DFSOutputStream.java:1482)atorg.apache.hadoop.hdfs.DFSOutputStreamDataStreamer.nextBlockOutputStream(DFSOutputStream.java:1385)
at org.apache.hadoop.hdfs.DFSOutputStream

D

a

t

a

S

t

r

e

a

m

e

r

.

r

u

n

(

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

.

j

a

v

a

:

554

)

20

/

08

/

1022

:

28

:

42

I

N

F

O

h

d

f

s

.

D

F

S

C

l

i

e

n

t

:

A

b

a

n

d

o

n

i

n

g

B

P

180482463

192.168.1.8

1588893747062

:

b

l

k

1

07374183

1

1

00720

/

08

/

1022

:

28

:

42

I

N

F

O

h

d

f

s

.

D

F

S

C

l

i

e

n

t

:

E

x

c

l

u

d

i

n

g

d

a

t

a

n

o

d

e

D

a

t

a

n

o

d

e

I

n

f

o

W

i

t

h

S

t

o

r

a

g

e

[

192.168.1.9

:

50010

,

D

S

b

84

e

f

1

d

c

6

e

a

c

49

b

0

b

b

c

7

822

e

5809

f

69

a

,

D

I

S

K

]

20

/

08

/

1022

:

28

:

42

I

N

F

O

h

d

f

s

.

D

F

S

C

l

i

e

n

t

:

E

x

c

e

p

t

i

o

n

i

n

c

r

e

a

t

e

B

l

o

c

k

O

u

t

p

u

t

S

t

r

e

a

m

j

a

v

a

.

i

o

.

I

O

E

x

c

e

p

t

i

o

n

:

G

o

t

e

r

r

o

r

,

s

t

a

t

u

s

m

e

s

s

a

g

e

,

a

c

k

w

i

t

h

f

i

r

s

t

B

a

d

L

i

n

k

a

s

192.168.1.10

:

50010

a

t

o

r

g

.

a

p

a

c

h

e

.

h

a

d

o

o

p

.

h

d

f

s

.

p

r

o

t

o

c

o

l

.

d

a

t

a

t

r

a

n

s

f

e

r

.

D

a

t

a

T

r

a

n

s

f

e

r

P

r

o

t

o

U

t

i

l

.

c

h

e

c

k

B

l

o

c

k

O

p

S

t

a

t

u

s

(

D

a

t

a

T

r

a

n

s

f

e

r

P

r

o

t

o

U

t

i

l

.

j

a

v

a

:

140

)

a

t

o

r

g

.

a

p

a

c

h

e

.

h

a

d

o

o

p

.

h

d

f

s

.

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

DataStreamer.run(DFSOutputStream.java:554) 20/08/10 22:28:42 INFO hdfs.DFSClient: Abandoning BP-180482463-192.168.1.8-1588893747062:blk_1073741831_1007 20/08/10 22:28:42 INFO hdfs.DFSClient: Excluding datanode DatanodeInfoWithStorage[192.168.1.9:50010,DS-b84ef1dc-6eac-49b0-bbc7-822e5809f69a,DISK] 20/08/10 22:28:42 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.io.IOException: Got error, status message , ack with firstBadLink as 192.168.1.10:50010 at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:140) at org.apache.hadoop.hdfs.DFSOutputStream

DataStreamer.run(DFSOutputStream.java:554)20/08/1022:28:42INFOhdfs.DFSClient:AbandoningBP180482463192.168.1.81588893747062:blk1073741831100720/08/1022:28:42INFOhdfs.DFSClient:ExcludingdatanodeDatanodeInfoWithStorage[192.168.1.9:50010,DSb84ef1dc6eac49b0bbc7822e5809f69a,DISK]20/08/1022:28:42INFOhdfs.DFSClient:ExceptionincreateBlockOutputStreamjava.io.IOException:Goterror,statusmessage,ackwithfirstBadLinkas192.168.1.10:50010atorg.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:140)atorg.apache.hadoop.hdfs.DFSOutputStreamDataStreamer.createBlockOutputStream(DFSOutputStream.java:1482)
at org.apache.hadoop.hdfs.DFSOutputStream

D

a

t

a

S

t

r

e

a

m

e

r

.

n

e

x

t

B

l

o

c

k

O

u

t

p

u

t

S

t

r

e

a

m

(

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

.

j

a

v

a

:

1385

)

a

t

o

r

g

.

a

p

a

c

h

e

.

h

a

d

o

o

p

.

h

d

f

s

.

D

F

S

O

u

t

p

u

t

S

t

r

e

a

m

DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1385) at org.apache.hadoop.hdfs.DFSOutputStream

DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1385)atorg.apache.hadoop.hdfs.DFSOutputStreamDataStreamer.run(DFSOutputStream.java:554)
20/08/10 22:28:42 INFO hdfs.DFSClient: Abandoning BP-180482463-192.168.1.8-1588893747062:blk_1073741832_1008
20/08/10 22:28:42 INFO hdfs.DFSClient: Excluding datanode DatanodeInfoWithStorage[192.168.1.10:50010,DS-8bfe69be-dc25-4a35-b2bf-c435847af4ba,DISK]

出现上述情况,一般都是没有关闭防火墙或者没有开通对应端口造成的。

#查看防火墙状态
systemctl status firewalld.service
#关闭防火墙
systemctl stop firewalld.service
#禁止开机启动
systemctl disable firewalld.service

版权声明:本文内容由互联网用户自发贡献,该文观点仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 举报,一经查实,本站将立刻删除。

文章由极客之音整理,本文链接:https://www.bmabk.com/index.php/post/68807.html

(0)
小半的头像小半

相关推荐

极客之音——专业性很强的中文编程技术网站,欢迎收藏到浏览器,订阅我们!