首页 文章 精选 留言 我的

ELK日志分析平台

2017-11-21 688
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
我的博客已迁移到xdoujiang.com请去那边和我交流
ELKstack是Elasticsearch、Logstash、Kibana三个开源软件的组合。目前都在Elastic.co公司名下。
ELK是一套常用的开源日志监控和分析系统，包括一个分布式索引与搜索服务Elasticsearch，
一个管理日志和事件的工具logstash，和一个数据可视化服务Kibana
logstash_1.5.3                 负责日志的收集，处理和储存
elasticsearch-1.7.2            负责日志检索和分析
kibana-4.1.2-linux-x64. tar .gz  负责日志的可视化
jdk-1.7.0_03                   java环境
redis-2.4.14                   DB
 
一、基础环境
1、角色、ip、版本、内核
serverA 10.1.10.185 3.2.0-4-amd64 7.8 java elasticsearch redis kibana logstash(agent indexer)
clientB 10.1.10.117 3.2.0-4-amd64 7.8 java logstash(agent)
 
2、安装基础包
apt-get -y  install  curl wget lrzsz axel
 
二、安装redis server
1、安装包
apt-get -y  install  redis-server
 
2、创建redis存储目录
mkdir  /opt/redis  -p
 
3、权限
chown  redis  /opt/redis/  -R
 
4、配置
1)备份配置
cp  /etc/redis/redis .conf  /etc/redis/redis .conf.bak
2)修改配置
sed  -i  's!^bind.*!bind 10.1.10.185!g'  /etc/redis/redis .conf
sed  -i  's!^dir.*!dir /opt/redis!g'  /etc/redis/redis .conf
 
5、重启服务
/etc/init .d /redis-server  restart
 
6、查看进程和端口
1)查看进程
ps  -ef | grep  redis
redis     23193      1  0 16:41 ?        00:00:00  /usr/bin/redis-server  /etc/redis/redis .conf
2)查看端口
netstat  -tupnl | grep  redis
tcp        0      0 10.1.10.185:6379        0.0.0.0:*               LISTEN      25188 /redis-server
 
7、检查开机启动(默认设置开机启动了)
ll  /etc/rc2 .d/ | grep  redis
lrwxrwxrwx 1 root root  22 Sep 20 16:41 S02redis-server -> .. /init .d /redis-server
 
三、安装java环境
1、安装包
apt-get -y  install  openjdk-7-jdk
 
2、查看版本
java -version
java version  "1.7.0_03"
OpenJDK Runtime Environment (IcedTea7 2.1.7) (7u3-2.1.7-1)
OpenJDK 64-Bit Server VM (build 22.0-b10, mixed mode)
 
四、安装elasticsearch
1、下载elasticsearch
wget https: //download .elastic.co /elasticsearch/elasticsearch/elasticsearch-1 .7.2.deb
 
2、安装elasticsearch
dpkg -i elasticsearch-1.7.2.deb
Selecting previously unselected package elasticsearch.
(Reading database ... 30240 files and directories currently installed.)
Unpacking elasticsearch (from elasticsearch-1.7.2.deb) ...
Creating elasticsearch group... OK
Creating elasticsearch user... OK
Setting up elasticsearch (1.7.2) ...
 
3、配置
1)备份配置
cp  /etc/elasticsearch/elasticsearch .yml  /etc/elasticsearch/elasticsearch .yml.bak
2)修改配置
echo  "network.bind_host: 10.1.10.185"  >>  /etc/elasticsearch/elasticsearch .yml
 
4、启动elasticsearch服务
/etc/init .d /elasticsearch  start
 
5、查看进程和端口
1)查看进程
ps  -ef | grep  java
106       22835      1 63 15:14 ?        00:00:03  /usr/lib/jvm/java-7-openjdk-amd64//bin/java  -Xms256m -Xmx1g -Djava.awt.headless= true  -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -XX:+DisableExplicitGC -Dfile.encoding=UTF-8 -Delasticsearch -Des.pidfile= /var/run/elasticsearch/elasticsearch .pid -Des.path.home= /usr/share/elasticsearch  - cp  : /usr/share/elasticsearch/lib/elasticsearch-1 .7.2.jar: /usr/share/elasticsearch/lib/ *: /usr/share/elasticsearch/lib/sigar/ * -Des.default.config= /etc/elasticsearch/elasticsearch .yml -Des.default.path.home= /usr/share/elasticsearch  -Des.default.path.logs= /var/log/elasticsearch  -Des.default.path.data= /var/lib/elasticsearch  -Des.default.path.work= /tmp/elasticsearch  -Des.default.path.conf= /etc/elasticsearch  org.elasticsearch.bootstrap.Elasticsearch
2)查看端口
netstat  -tupnl | grep  java
tcp6       0      0 10.1.10.185:9200        :::*                    LISTEN      22835 /java      
tcp6       0      0 10.1.10.185:9300        :::*                    LISTEN      22835 /java      
udp6       0      0 :::54328                :::*                                22835 /java     
 
6、测试
curl -X GET http: //10 .1.10.185:9200
{
   "status"  : 200,
   "name"  :  "Ned Leeds" ,
   "cluster_name"  :  "elasticsearch" ,
   "version"  : {
     "number"  :  "1.7.2" ,
     "build_hash"  :  "e43676b1385b8125d647f593f7202acbd816e8ec" ,
     "build_timestamp"  :  "2015-09-14T09:49:53Z" ,
     "build_snapshot"  :  false ,
     "lucene_version"  :  "4.10.4"
   },
   "tagline"  :  "You Know, for Search"
}
 
7、添加到开机启动
update-rc.d elasticsearch defaults
update-rc.d: using dependency based boot sequencing
 
五、安装logstash
1、下载logstash
wget https: //download .elastic.co /logstash/logstash/packages/debian/logstash_1 .5.3-1_all.deb
 
2、安装logstash
dpkg -i logstash_1.5.3-1_all.deb
(Reading database ... 30338 files and directories currently installed.)
Unpacking logstash (from logstash_1.5.3-1_all.deb) ...
Setting up logstash (1:1.5.3-1) ...
 
3、配置(默认没有这个配置文件)
1)配置logstash_agent
cat  /etc/logstash/conf .d /logstash_agent .conf
input {
         file  {
                 type  =>  "messages"
                 path => [ "/var/log/messages" ]
         }
         file  {
                 type  =>  "elasticsearch"
                 path => [ '/var/log/elasticsearch/elasticsearch.log*' ]
         }
}
output {
         redis {
                 host =>  "10.1.10.185"
                 data_type =>  "list"
                 key =>  "logstash:redis"
         }
}
2)配置logstash_indexer
cat  /etc/logstash/conf .d /logstash_indexer .conf
input {
         redis {
                 host =>  "10.1.10.185"
                 data_type =>  "list"
                 key =>  "logstash:redis"
                 type  =>  "redis-input"
         port =>  "6379"
         }
}
output {
         elasticsearch {
                 host =>  "10.1.10.185"
         }
}
 
4、启动服务
/etc/init .d /logstash  start
logstash started.
 
5、使用jps -mlv或 ps  -ef来查看下进程
ps  -ef| grep  logst
logstash  22932      1 16 15:19 pts /0     00:00:01  /usr/bin/java  -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless= true  -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Djava.io.tmpdir= /var/lib/logstash  -Xmx500m -Xss2048k -Djffi.boot.library.path= /opt/logstash/vendor/jruby/lib/jni  -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless= true  -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Djava.io.tmpdir= /var/lib/logstash  -Xbootclasspath /a : /opt/logstash/vendor/jruby/lib/jruby .jar -classpath : -Djruby.home= /opt/logstash/vendor/jruby  -Djruby.lib= /opt/logstash/vendor/jruby/lib  -Djruby.script=jruby -Djruby.shell= /bin/sh  org.jruby.Main --1.9  /opt/logstash/lib/bootstrap/environment .rb logstash /runner .rb agent -f  /etc/logstash/conf .d -l  /var/log/logstash/logstash .log
 
6、设置开机启动
update-rc.d logstash defaults
update-rc.d: using dependency based boot sequencing
 
六、安装kibana(前端web)
1、下载
axel -n 10 https: //download .elastic.co /kibana/kibana/kibana-4 .1.2-linux-x64. tar .gz
 
2、解压到指定目录
tar  zxvf kibana-4.1.2-linux-x64. tar .gz -C  /opt
 
3、创建日志目录
mkdir  -p  /opt/kibanalog
 
4、配置
1)备份配置
cp  /opt/kibana-4 .1.2-linux-x64 /config/kibana .yml  /opt/kibana-4 .1.2-linux-x64 /config/kibana .yml.bak
2)修改配置
sed  -i  's!^elasticsearch_url: .*!elasticsearch_url: "http://10.1.10.185:9200"!g'  /opt/kibana-4 .1.2-linux-x64 /config/kibana .yml
sed  -i  's!^host: .*!host: "10.1.10.185"!g'  /opt/kibana-4 .1.2-linux-x64 /config/kibana .yml
 
5、启动服务
cd  /opt/kibanalog  &&  nohup  /opt/kibana-4 .1.2-linux-x64 /bin/kibana  &
 
6、查看进程和端口
1)查看进程
ps  aux | grep  kibana
root      22982  5.4 20.1 612576 47716 pts /0     Sl   15:22   0:01  /opt/kibana-4 .1.2-linux-x64 /bin/ .. /node/bin/node  /opt/kibana-4 .1.2-linux-x64 /bin/ .. /src/bin/kibana .js
2)查看端口
netstat  -tupnl| grep  5601
tcp        0      0 10.1.10.185:5601        0.0.0.0:*               LISTEN      22982 /node  
 
7、在windows上访问http: //10 .1.10.185:5601

wKiom1YB9GrwvtzrAANcUZu8rDw596.jpg

wKioL1YB9GyzXKWkAAbO4sll4MI251.jpg

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
8、设置开机启动
echo  "cd /opt/kibanalog && nohup /opt/kibana-4.1.2-linux-x64/bin/kibana &"  >>  /etc/rc . local
 
七、查看全部服务日志
1、查看redis日志
cat  /var/log/redis/redis-server .log
[5903] 22 Sep 09:53:47 * Server started, Redis version 2.4.14
[5903] 22 Sep 09:53:47  # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[5903] 22 Sep 09:53:47 * The server is now ready to accept connections on port 6379
[5903] 22 Sep 10:08:42  # Received SIGTERM, scheduling shutdown...
[5903] 22 Sep 10:08:42  # User requested shutdown...
[5903] 22 Sep 10:08:42 * Saving the final RDB snapshot before exiting.
[5903] 22 Sep 10:08:42 * DB saved on disk
[5903] 22 Sep 10:08:42 * Removing the pid  file .
[5903] 22 Sep 10:08:42  # Redis is now ready to exit, bye bye...
[22674] 22 Sep 10:08:43 * Server started, Redis version 2.4.14
[22674] 22 Sep 10:08:43  # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
[22674] 22 Sep 10:08:43 * The server is now ready to accept connections on port 6379
[22674] 22 Sep 10:49:56 * 1 changes  in  900 seconds. Saving...
[22674] 22 Sep 10:49:56 * Background saving started by pid 23186
[23186] 22 Sep 10:49:56 * DB saved on disk
[22674] 22 Sep 10:49:57 * Background saving terminated with success
[22674] 22 Sep 10:50:58 * 10000 changes  in  60 seconds. Saving...
[22674] 22 Sep 10:50:58 * Background saving started by pid 23205
[23205] 22 Sep 10:50:58 * DB saved on disk
[22674] 22 Sep 10:50:58 * Background saving terminated with success
[22674] 22 Sep 10:51:59 * 10000 changes  in  60 seconds. Saving...
[22674] 22 Sep 10:51:59 * Background saving started by pid 23214
[23214] 22 Sep 10:51:59 * DB saved on disk
[22674] 22 Sep 10:51:59 * Background saving terminated with success
 
2、查看elasticsearch日志
cat  /var/log/elasticsearch/elasticsearch .log
[2015-09-22 10:09:42,361][INFO ][node                     ] [Karma] version[1.7.2], pid[22751], build[e43676b /2015-09-14T09 :49:53Z]
[2015-09-22 10:09:42,362][INFO ][node                     ] [Karma] initializing ...
[2015-09-22 10:09:42,536][INFO ][plugins                  ] [Karma] loaded [], sites []
[2015-09-22 10:09:42,595][INFO ][ env                       ] [Karma] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [7.3gb], net total_space [9.1gb], types [rootfs]
[2015-09-22 10:09:45,669][INFO ][node                     ] [Karma] initialized
[2015-09-22 10:09:45,669][INFO ][node                     ] [Karma] starting ...
[2015-09-22 10:09:45,776][INFO ][transport                ] [Karma] bound_address {inet[ /10 .1.10.185:9300]}, publish_address {inet[ /10 .1.10.185:9300]}
[2015-09-22 10:09:45,794][INFO ][discovery                ] [Karma] elasticsearch /mB1_wQprTAWGam7X1LzCxQ
[2015-09-22 10:09:49,582][INFO ][cluster.service          ] [Karma] new_master [Karma][mB1_wQprTAWGam7X1LzCxQ][debian][inet[ /10 .1.10.185:9300]], reason: zen-disco- join  (elected_as_master)
[2015-09-22 10:09:49,620][INFO ][http                     ] [Karma] bound_address {inet[ /10 .1.10.185:9200]}, publish_address {inet[ /10 .1.10.185:9200]}
[2015-09-22 10:09:49,620][INFO ][node                     ] [Karma] started
[2015-09-22 10:09:49,642][INFO ][gateway                  ] [Karma] recovered [0] indices into cluster_state
[2015-09-22 10:49:56,101][INFO ][cluster.service          ] [Karma] added {[logstash-debian-23118-13460][Bt8LxnD9R4amhOypJbgxww][debian][inet[ /10 .1.10.185:9301]]{client= true , data= false },}, reason: zen-disco-receive( join  from node[[logstash-debian-23118-13460][Bt8LxnD9R4amhOypJbgxww][debian][inet[ /10 .1.10.185:9301]]{client= true , data= false }])
[2015-09-22 10:49:58,511][INFO ][cluster.metadata         ] [Karma] [logstash-2015.09.22] creating index, cause [auto(bulk api)], templates [logstash], shards [5]/[1], mappings [_default_, elasticsearch]
[2015-09-22 10:49:59,645][INFO ][cluster.metadata         ] [Karma] [logstash-2015.09.22] update_mapping [elasticsearch] (dynamic)
[2015-09-22 10:53:28,474][DEBUG][action.admin.cluster.health] [Karma] observer: timeout notification from cluster service. timeout setting [5s],  time  since start [5s]
[2015-09-22 10:53:51,251][INFO ][cluster.metadata         ] [Karma] [.kibana] creating index, cause [api], templates [], shards [1]/[1], mappings []
[2015-09-22 10:53:52,902][INFO ][cluster.metadata         ] [Karma] [.kibana] update_mapping [config] (dynamic)
 
3、查看logstash日志
cat  /var/log/logstash/logstash .err
!!! Please upgrade your java version, the current version  '1.7.0_03-b21'  may cause problems. We recommend a minimum version of 1.7.0_51
'[DEPRECATED] use `require concurrent` instead of `require concurrent_ruby'
[2015-09-22 10:49:48.459]  WARN -- Concurrent: [DEPRECATED] Java 7 is deprecated, please use Java 8.
Java 7 support is only best effort, it may not work. It will be removed  in  next release (1.0).
Sep 22, 2015 10:49:49 AM org.elasticsearch.node.internal.InternalNode <init>
INFO: [logstash-debian-23118-13460] version[1.7.0], pid[23118], build[929b973 /2015-07-16T14 :31:07Z]
Sep 22, 2015 10:49:49 AM org.elasticsearch.node.internal.InternalNode <init>
INFO: [logstash-debian-23118-13460] initializing ...
Sep 22, 2015 10:49:49 AM org.elasticsearch.plugins.PluginsService <init>
INFO: [logstash-debian-23118-13460] loaded [], sites []
Sep 22, 2015 10:49:51 AM org.elasticsearch.bootstrap.Natives <clinit>
WARNING: JNA not found. native methods will be disabled.
Sep 22, 2015 10:49:52 AM org.elasticsearch.node.internal.InternalNode <init>
INFO: [logstash-debian-23118-13460] initialized
Sep 22, 2015 10:49:52 AM org.elasticsearch.node.internal.InternalNode start
INFO: [logstash-debian-23118-13460] starting ...
Sep 22, 2015 10:49:52 AM org.elasticsearch.transport.TransportService doStart
INFO: [logstash-debian-23118-13460] bound_address {inet[ /0 :0:0:0:0:0:0:0:9301]}, publish_address {inet[ /10 .1.10.185:9301]}
Sep 22, 2015 10:49:53 AM org.elasticsearch.discovery.DiscoveryService doStart
INFO: [logstash-debian-23118-13460] elasticsearch /Bt8LxnD9R4amhOypJbgxww
Sep 22, 2015 10:49:56 AM org.elasticsearch.cluster.service.InternalClusterService$UpdateTask run
INFO: [logstash-debian-23118-13460] detected_master [Karma][mB1_wQprTAWGam7X1LzCxQ][debian][inet[ /10 .1.10.185:9300]], added {[Karma][mB1_wQprTAWGam7X1LzCxQ][debian][inet[ /10 .1.10.185:9300]],}, reason: zen-disco-receive(from master [[Karma][mB1_wQprTAWGam7X1LzCxQ][debian][inet[ /10 .1.10.185:9300]]])
Sep 22, 2015 10:49:56 AM org.elasticsearch.node.internal.InternalNode start
INFO: [logstash-debian-23118-13460] started
Sep 22, 2015 10:55:23 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
WARNING: [logstash-debian-23118-13460] [gc][young][325][5441] duration [1s], collections [1]/[1.2s], total [1s]/[31.5s], memory [156.5mb]->[157.1mb]/[491.6mb], all_pools {[young] [3.8mb]->[2.4mb]/[66.5mb]}{[survivor] [365.5kb]->[512kb]/[8.3mb]}{[old] [152.3mb]->[154.2mb]/[416.8mb]}
Sep 22, 2015 10:56:08 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
INFO: [logstash-debian-23118-13460] [gc][young][369][6284] duration [1.8s], collections [2]/[2.3s], total [1.8s]/[37.9s], memory [113.8mb]->[116.2mb]/[491.6mb], all_pools {[young] [3.6mb]->[2.1mb]/[66.5mb]}{[survivor] [361.1kb]->[508kb]/[8.3mb]}{[old] [109.8mb]->[113.6mb]/[416.8mb]}
Sep 22, 2015 10:57:39 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
INFO: [logstash-debian-23118-13460] [gc][young][457][7938] duration [941ms], collections [1]/[1s], total [941ms]/[48.7s], memory [110.9mb]->[114.2mb]/[491.6mb], all_pools {[young] [894.6kb]->[4.1mb]/[66.5mb]}{[survivor] [512kb]->[512kb]/[8.3mb]}{[old] [109.5mb]->[109.5mb]/[416.8mb]}
Sep 22, 2015 11:00:42 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
INFO: [logstash-debian-23118-13460] [gc][young][635][11214] duration [703ms], collections [1]/[2.7s], total [703ms]/[1.1m], memory [158.2mb]->[160.1mb]/[491.6mb], all_pools {[young] [3.7mb]->[2mb]/[66.5mb]}{[survivor] [512kb]->[509.4kb]/[8.3mb]}{[old] [153.9mb]->[157.5mb]/[416.8mb]}
Sep 22, 2015 11:01:33 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
WARNING: [logstash-debian-23118-13460] [gc][young][684][12144] duration [1s], collections [1]/[2.4s], total [1s]/[1.2m], memory [201.6mb]->[200mb]/[491.6mb], all_pools {[young] [4.1mb]->[50.1kb]/[66.5mb]}{[survivor] [512kb]->[512kb]/[8.3mb]}{[old] [197mb]->[199.5mb]/[416.8mb]}
Sep 22, 2015 11:02:17 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
WARNING: [logstash-debian-23118-13460] [gc][young][727][12972] duration [1.3s], collections [1]/[1s], total [1.3s]/[1.3m], memory [186.5mb]->[188mb]/[491.6mb], all_pools {[young] [2.2mb]->[4.1mb]/[66.5mb]}{[survivor] [512kb]->[512kb]/[8.3mb]}{[old] [183.7mb]->[183.4mb]/[416.8mb]}
Sep 22, 2015 11:04:40 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
WARNING: [logstash-debian-23118-13460] [gc][young][864][15273] duration [1.3s], collections [1]/[2.9s], total [1.3s]/[1.6m], memory [122.9mb]->[125.8mb]/[491.6mb], all_pools {[young] [2.6mb]->[1.9mb]/[66.5mb]}{[survivor] [512kb]->[511.9kb]/[8.3mb]}{[old] [119.7mb]->[123.3mb]/[416.8mb]}
Sep 22, 2015 11:05:30 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
WARNING: [logstash-debian-23118-13460] [gc][young][912][16079] duration [1.3s], collections [1]/[2.5s], total [1.3s]/[1.7m], memory [183.9mb]->[181.4mb]/[491.6mb], all_pools {[young] [4.1mb]->[101.1kb]/[66.5mb]}{[survivor] [510.1kb]->[499.7kb]/[8.3mb]}{[old] [179.3mb]->[180.8mb]/[416.8mb]}
Sep 22, 2015 11:06:16 AM org.elasticsearch.monitor.jvm.JvmMonitorService$JvmMonitor monitorLongGc
INFO: [logstash-debian-23118-13460] [gc][young][956][16816] duration [915ms], collections [1]/[2s], total [915ms]/[1.8m], memory [175.2mb]->[144.9mb]/[491.6mb], all_pools {[young] [3.7mb]->[12.5kb]/[66.5mb]}{[survivor] [357.1kb]->[259.6kb]/[8.3mb]}{[old] [171.2mb]->[144.6mb]/[416.8mb]}
 
4、查看kibana日志
cat  /opt/kibanalog/nohup .out 
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "msg" : "No existing kibana index found" , "time" : "2015-09-22T02:53:28.503Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "msg" : "Listening on 10.1.10.185:5601" , "time" : "2015-09-22T02:53:28.538Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"6f9-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :6, "contentLength" :0}, "msg" : "GET / 304 - 6ms" , "time" : "2015-09-22T02:53:49.894Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/main.css?_b=7562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/css,*/*;q=0.1" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"335dc-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :18, "contentLength" :0}, "msg" : "GET /styles/main.css?_b=7562 304 - 18ms" , "time" : "2015-09-22T02:53:49.964Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/images/initial_load.gif" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "image/png,image/*;q=0.8,*/*;q=0.5" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"2e9e-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :2, "contentLength" :0}, "msg" : "GET /images/initial_load.gif 304 - 2ms" , "time" : "2015-09-22T02:53:49.968Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/bower_components/requirejs/require.js?_b=7562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "*/*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"14703-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57469}, "res" :{ "statusCode" :304, "responseTime" :1, "contentLength" :0}, "msg" : "GET /bower_components/requirejs/require.js?_b=7562 304 - 1ms" , "time" : "2015-09-22T02:53:49.969Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/require.config.js?_b=7562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "*/*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"a66-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :304, "responseTime" :2, "contentLength" :0}, "msg" : "GET /require.config.js?_b=7562 304 - 2ms" , "time" : "2015-09-22T02:53:49.970Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57471}, "res" :{ "statusCode" :304, "responseTime" :3, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 3ms" , "time" : "2015-09-22T02:53:49.970Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/index.js?_b=7562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "*/*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"5489a7-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57472}, "res" :{ "statusCode" :304, "responseTime" :1, "contentLength" :0}, "msg" : "GET /index.js?_b=7562 304 - 1ms" , "time" : "2015-09-22T02:53:50.037Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :0, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 0ms" , "time" : "2015-09-22T02:53:50.203Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/config?_b=7562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" , "if-none-match" : "W/\"151-5c053bf3\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57469}, "res" :{ "statusCode" :304, "responseTime" :3, "contentLength" :0}, "msg" : "GET /config?_b=7562 304 - 3ms" , "time" : "2015-09-22T02:53:50.492Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/elasticsearch/?_=1442890430562" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :12, "contentLength" :333}, "msg" : "GET /?_=1442890430562 200 - 12ms" , "time" : "2015-09-22T02:53:50.883Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57471}, "res" :{ "statusCode" :304, "responseTime" :0, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 0ms" , "time" : "2015-09-22T02:53:50.923Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57472}, "res" :{ "statusCode" :304, "responseTime" :0, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 0ms" , "time" : "2015-09-22T02:53:50.926Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :1, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 1ms" , "time" : "2015-09-22T02:53:50.929Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/elasticsearch/_nodes?_=1442890430791" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :63, "contentLength" :5943}, "msg" : "GET /_nodes?_=1442890430791 200 - 63ms" , "time" : "2015-09-22T02:53:51.153Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "HEAD" , "url" : "/elasticsearch/.kibana" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :404, "responseTime" :6, "contentLength" :0}, "msg" : "HEAD /.kibana 404 - 6ms" , "time" : "2015-09-22T02:53:51.171Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "POST" , "url" : "/elasticsearch/.kibana" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "content-type" : "application/json;charset=utf-8" , "referer" : "http://10.1.10.185:5601/" , "content-length" : "35" , "connection" : "keep-alive" , "pragma" : "no-cache" , "cache-control" : "no-cache" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :546, "contentLength" :21}, "msg" : "POST /.kibana 200 - 546ms" , "time" : "2015-09-22T02:53:51.726Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/elasticsearch/_cluster/health/.kibana?wait_for_status=yellow&_=1442890431632" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :467, "contentLength" :313}, "msg" : "GET /_cluster/health/.kibana?wait_for_status=yellow&_=1442890431632 200 - 467ms" , "time" : "2015-09-22T02:53:52.398Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "POST" , "url" : "/elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1442890430199" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "content-type" : "application/json;charset=utf-8" , "referer" : "http://10.1.10.185:5601/" , "content-length" : "62" , "connection" : "keep-alive" , "pragma" : "no-cache" , "cache-control" : "no-cache" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :60, "contentLength" :76}, "msg" : "POST /_mget?timeout=0&ignore_unavailable=true&preference=1442890430199 200 - 60ms" , "time" : "2015-09-22T02:53:52.665Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "POST" , "url" : "/elasticsearch/.kibana/config/4.1.2" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "content-type" : "application/json;charset=utf-8" , "referer" : "http://10.1.10.185:5601/" , "content-length" : "17" , "connection" : "keep-alive" , "pragma" : "no-cache" , "cache-control" : "no-cache" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :201, "responseTime" :33, "contentLength" :79}, "msg" : "POST /.kibana/config/4.1.2 201 - 33ms" , "time" : "2015-09-22T02:53:52.908Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "POST" , "url" : "/elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1442890430199" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "content-type" : "application/json;charset=utf-8" , "referer" : "http://10.1.10.185:5601/" , "content-length" : "62" , "connection" : "keep-alive" , "pragma" : "no-cache" , "cache-control" : "no-cache" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :6, "contentLength" :116}, "msg" : "POST /_mget?timeout=0&ignore_unavailable=true&preference=1442890430199 200 - 6ms" , "time" : "2015-09-22T02:53:53.126Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "POST" , "url" : "/elasticsearch/.kibana/index-pattern/_search?fields=" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "content-type" : "application/json;charset=utf-8" , "referer" : "http://10.1.10.185:5601/" , "content-length" : "44" , "connection" : "keep-alive" , "pragma" : "no-cache" , "cache-control" : "no-cache" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :152, "contentLength" :124}, "msg" : "POST /.kibana/index-pattern/_search?fields= 200 - 152ms" , "time" : "2015-09-22T02:53:53.529Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57469}, "res" :{ "statusCode" :304, "responseTime" :1, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 1ms" , "time" : "2015-09-22T02:53:54.035Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57471}, "res" :{ "statusCode" :304, "responseTime" :0, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 0ms" , "time" : "2015-09-22T02:53:54.036Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/styles/theme/elk.ico" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:30 GMT" , "if-none-match" : "W/\"47e-873763449\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57472}, "res" :{ "statusCode" :304, "responseTime" :9, "contentLength" :0}, "msg" : "GET /styles/theme/elk.ico 304 - 9ms" , "time" : "2015-09-22T02:53:54.051Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/elasticsearch/logstash-*/_mapping/field/*?ignore_unavailable=false&allow_no_indices=false&include_defaults=true&_=1442890433545" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/json, text/plain, */*" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/" , "connection" : "keep-alive" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :200, "responseTime" :235, "contentLength" :11412}, "msg" : "GET /logstash-*/_mapping/field/*?ignore_unavailable=false&allow_no_indices=false&include_defaults=true&_=1442890433545 200 - 235ms" , "time" : "2015-09-22T02:53:54.096Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/images/no_border.png" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "image/png,image/*;q=0.8,*/*;q=0.5" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "gzip, deflate" , "referer" : "http://10.1.10.185:5601/styles/main.css?_b=7562" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"10ab-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57470}, "res" :{ "statusCode" :304, "responseTime" :2, "contentLength" :0}, "msg" : "GET /images/no_border.png 304 - 2ms" , "time" : "2015-09-22T02:53:54.377Z" , "v" :0}
{ "name" : "Kibana" , "hostname" : "debian" , "pid" :23238, "level" :30, "req" :{ "method" : "GET" , "url" : "/bower_components/font-awesome/fonts/fontawesome-webfont.woff?v=4.2.0" , "headers" :{ "host" : "10.1.10.185:5601" , "user-agent" : "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0" , "accept" : "application/font-woff2;q=1.0,application/font-woff;q=0.9,*/*;q=0.8" , "accept-language" : "zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3" , "accept-encoding" : "identity" , "referer" : "http://10.1.10.185:5601/styles/main.css?_b=7562" , "connection" : "keep-alive" , "if-modified-since" : "Tue, 08 Sep 2015 20:12:29 GMT" , "if-none-match" : "W/\"ffac-3043805189\"" }, "remoteAddress" : "10.1.10.131" , "remotePort" :57468}, "res" :{ "statusCode" :304, "responseTime" :1, "contentLength" :0}, "msg" : "GET /bower_components/font-awesome/fonts/fontawesome-webfont.woff?v=4.2.0 304 - 1ms" , "time" : "2015-09-22T02:53:54.378Z" , "v" :0}
 
八、clientB安装配置logstash(agent)
1、安装java环境
apt-get -y  install  openjdk-7-jdk
 
2、下载logstash
wget https: //download .elastic.co /logstash/logstash/packages/debian/logstash_1 .5.3-1_all.deb
 
3、安装logstash
dpkg -i logstash_1.5.3-1_all.deb
(Reading database ... 30338 files and directories currently installed.)
Unpacking logstash (from logstash_1.5.3-1_all.deb) ...
Setting up logstash (1:1.5.3-1) ...
 
4、配置(默认没有这个配置文件)
1)配置logstash_agent
cat  /etc/logstash/conf .d /logstash_agent .conf
input {
         file  {
                 type  =>  "message"
                 path => [ "/var/log/message'" ]
         }
}
output {
上一篇 下一篇
优秀的个人博客,低调大师

微信关注我们

原文链接：https://yq.aliyun.com/articles/474433

转载内容版权归作者及来源网站所有！

低调大师中文资讯倾力打造互联网数据资讯、行业资源、电子商务、移动互联网、网络营销平台。持续更新报道IT业界、互联网、市场资讯、驱动更新,是最及时权威的产业资讯及硬件资讯报道平台。

hadoop 测试第一个mapreduce程序

说明：测试hadoop自带的实例 wordcount程序（此程序统计每个单词在文件中出现的次数） 2.6.0版本jar程序的路径是 /usr/local/hadoop-2.6.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar 一、在本地创建目录和文件 创建目录： mkdir /home/hadoop/input cd/home/hadoop/input 创建文件： touch wordcount1.txt touch wordcount2.txt 二、添加内容 echo "Hello World" >wordcount1.txt echo "Hello Hadoop" >wordcount2.txt 三、在hdfs上创建input目录 hadoop fs -mkdir /input 四、拷贝文件到/input目录 hadoop fs -put/home/hadoop/input/* /input 五、执行程序 hadoop jar /usr/local/hadoop-2.6.0/share/hadoop...
2017-11-22
571
上一篇

linux配置服务器间无密钥双向登录

服务器： 192.168.152.140 hd_nn_140 192.168.152.141 hd_dn_141 192.168.152.142 hd_dn_142 二、三台服务器分别 创建hadoop用户 groupadd hadoop useradd -g hadoop hadoop 三、设置密码 passwd hadoop 切换到hadoop用户登录su hadoop 四、生成无密码访问的公钥/私钥对 ssh-keygen -t rsa 什么都不输入 回车两次 查看：id_rsa 私钥 id_rsa.pub 公钥 五、在hd_nn_140上将id_rsa.pub的内容输出追加到authorized_keys： cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys 六、添加权限 chmod 700 .sshchmod 600 authorized_keys 七、拷贝hd_dn_141和hd_dn_142中id_rsa.pub内容到hd_nn_140的authorized_keys文件中 八、通过scp命令拷贝authorized...
2017-11-22
564
下一篇

相关文章

发表评论

资源下载

更多资源
优质分享App

优质分享App

近一个月的开发和优化，本站点的第一个app全新上线。该app采用极致压缩，本体才4.36MB。系统里面做了大量数据访问、缓存优化。方便用户在手机上查看文章。后续会推出HarmonyOS的适配版本。

时间: 2025-12-03 大小: 4.36MB 下载: 23次
Mario

Mario

马里奥是站在游戏界顶峰的超人气多面角色。马里奥靠吃蘑菇成长，特征是大鼻子、头戴帽子、身穿背带裤，还留着胡子。与他的双胞胎兄弟路易基一起，长年担任任天堂的招牌角色。

时间: 2025-12-12 大小: 211.28KB 下载: 54次
Nacos

Nacos

Nacos /nɑ:kəʊs/ 是 Dynamic Naming and Configuration Service 的首字母简称，一个易于构建 AI Agent 应用的动态服务发现、配置管理和AI智能体管理平台。Nacos 致力于帮助您发现、配置和管理微服务及AI智能体应用。Nacos 提供了一组简单易用的特性集，帮助您快速实现动态服务发现、服务配置、服务元数据、流量管理。Nacos 帮助您更敏捷和容易地构建、交付和管理微服务平台。

时间: 2025-12-21 大小: 189MB 下载: 2次
Spring

Spring

Spring框架（Spring Framework）是由Rod Johnson于2002年提出的开源Java企业级应用框架，旨在通过使用JavaBean替代传统EJB实现方式降低企业级编程开发的复杂性。该框架基于简单性、可测试性和松耦合性设计理念，提供核心容器、应用上下文、数据访问集成等模块，支持整合Hibernate、Struts等第三方框架，其适用范围不仅限于服务器端开发，绝大多数Java应用均可从中受益。

时间: 2025-12-17 大小: 5MB 下载: 1次
手机查看

扫码在手机上查看文章

扫描二维码，手机阅读更方便

热门标签
Redis Service Mesh SpringCloud Kubernetes HarmonyOS6 Jdk25 Gemini3 DeepSeek Rocky Nacos3 OpenAi SpringBoot4 Docker

欢迎您来访！

登录后，您将获得更多功能！
热门文章
联系我们

有任何问题或合作意向欢迎联系我们

Email: 99873273@qq.com

QQ: 99873273

用户登录
用户注册