-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathlogstash_with_rails.html
225 lines (179 loc) · 8.64 KB
/
logstash_with_rails.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="author" content="">
<meta name="keywords" content="logstash, kibana, elk with rails, logstash integration with rails">
<meta name="description" content="having used new relic monitoring for sometime, I tried out logstash which is pretty much interesting and straight forward, clear documentation and actively updated and open-souce.">
<title>Logstash with Rails application.</title>
<!-- Bootstrap Core CSS -->
<link href="css/bootstrap.min.css" rel="stylesheet">
<!-- Custom CSS -->
<link href="css/clean-blog.min.css" rel="stylesheet">
<!-- Custom Fonts -->
<link href="http://maxcdn.bootstrapcdn.com/font-awesome/4.1.0/css/font-awesome.min.css" rel="stylesheet" type="text/css">
<link href='http://fonts.googleapis.com/css?family=Lora:400,700,400italic,700italic' rel='stylesheet' type='text/css'>
<link href='http://fonts.googleapis.com/css?family=Open+Sans:300italic,400italic,600italic,700italic,800italic,400,300,600,700,800' rel='stylesheet' type='text/css'>
<!-- HTML5 Shim and Respond.js IE8 support of HTML5 elements and media queries -->
<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
<script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
<![endif]-->
</head>
<body>
<!-- Navigation -->
<nav class="navbar navbar-default navbar-custom navbar-fixed-top">
<div class="container-fluid">
<!-- Brand and toggle get grouped for better mobile display -->
<div class="navbar-header page-scroll">
<button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
<span class="sr-only">Toggle navigation</span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
<a class="navbar-brand" href="index.html">Start Coding</a>
</div>
<!-- Collect the nav links, forms, and other content for toggling -->
<div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
<ul class="nav navbar-nav navbar-right">
<li>
<a href="index.html">Home</a>
</li>
<li>
<a href="about.html">About</a>
</li>
<!-- <li>
<a href="post.html">Sample Post</a>
</li> -->
<li>
<a href="contact.html">Contact</a>
</li>
</ul>
</div>
<!-- /.navbar-collapse -->
</div>
<!-- /.container -->
</nav>
<!-- Page Header -->
<!-- Set your background image for this header on the line below. -->
<header class="intro-header" style="background-image: url('img/post-bg.jpg')">
<div class="container">
<div class="row">
<div class="col-lg-8 col-lg-offset-2 col-md-10 col-md-offset-1">
<div class="post-heading">
<h1>Logstash and Kibana quick set-up.</h1>
<h2 class="subheading">Monitoring your awesome application..</h2>
<!-- <span class="meta">Posted by <a href="#">Start Bootstrap</a> on August 24, 2014</span> -->
</div>
</div>
</div>
</div>
</header>
<!-- Post Content -->
<article>
<div class="container">
<div class="row">
<div class="col-lg-8 col-lg-offset-2 col-md-10 col-md-offset-1">
<h2 class="section-heading">Prerequisite</h2>
<p>Elasticsearch - FullText search engine.</p>
<p>Logstash - Store log data and indexing.</p>
<p>Get insights of input, filters and output: -</p>
<iframe width="500" height="345"src="http://www.youtube.com/embed/RuUFnog29M4"></iframe>
<p>Kibana - Awesome visual dashboard.</p>
<p><h2 class="section-heading">Download ELK</h2></p>
<p>Checkout <a href="https://www.elastic.co/products">Products of Elastic</a> </p>
<p>Step1: Install Elasticsearch and automatically start during bootup. </p>
<p>Step2: Install Logstash and follow installation steps for all plugins.</p>
<p>Step3: Download Kibana files follow installation steps.</p>
<p>Complete information <a href="https://www.elastic.co/downloads">https://www.elastic.co/downloads</a></p>
<p><h2 class="section-heading">Ruby Gem</h2></p>
<p><a href="https://github.com/shadabahmed/logstasher"> gem 'logstasher'</a></p>
<p>Configure the Rails <a href="https://github.com/shadabahmed/logstasher#configure-your-environmentrb-eg-developmentrb"> environment</a> to be monitored accordingly.</p>
<p>It provides an additional logger for your application in JSON format, which will be feed as input to logstash and visualised from Kibana interface.</p>
<p><h2 class="section-heading">Configure Logstash</h2></p>
<p>Create a file inside Logstash directory(all plugins) which was downloaded in previous step,<p>
quickstart.conf - set the log path of your application to be monitored.
<pre>
input {
file {
type => "rails logs"
<b>path => "/home/Nithin/rails/project_name/log/logstasher.log"</b>
codec => json {
charset => "UTF-8"
}
}
}
output {
# Print each event to stdout.
stdout {
codec => rubydebug
}
elasticsearch {
# Setting 'embedded' will run a real elasticsearch server inside logstash.
# This option below saves you from having to run a separate process just
# for ElasticSearch, so you can get started quicker!
}
}
</pre>
<p>logstasher.log will be your new log file created by logstasher gem.</p>
<p><h2 class="section-heading">Start Logstash and Kibana</h2></p>
Make sure logstash is up and running with
<p><b>sudo service logstash status/start</b></p>
Start the configured logstash agent.
<p><b>bin/logstash agent -f quickstart.conf</b></p>
<p>Start Kibana for Inferface and visit <a href="http://0.0.0.0:5601"> 0.0.0.0:5601</a></p>
<p><b>bin/kibana</b></p>
<img src="img/kibana_ui.png" height="300" width="800">
</div>
</div>
</div>
</article>
<hr>
<!-- Footer -->
<footer>
<div class="container">
<div class="row">
<div class="col-lg-8 col-lg-offset-2 col-md-10 col-md-offset-1">
<ul class="list-inline text-center">
<li>
<a href="https://twitter.com/imnithink">
<span class="fa-stack fa-lg">
<i class="fa fa-circle fa-stack-2x"></i>
<i class="fa fa-twitter fa-stack-1x fa-inverse"></i>
</span>
</a>
</li>
<li>
<a href="https://www.facebook.com/imnithink/">
<span class="fa-stack fa-lg">
<i class="fa fa-circle fa-stack-2x"></i>
<i class="fa fa-facebook fa-stack-1x fa-inverse"></i>
</span>
</a>
</li>
<li>
<a href="https://github.com/imnithin">
<span class="fa-stack fa-lg">
<i class="fa fa-circle fa-stack-2x"></i>
<i class="fa fa-github fa-stack-1x fa-inverse"></i>
</span>
</a>
</li>
</ul>
<!-- <p class="copyright text-muted">Copyright © Your Website 2014</p> -->
</div>
</div>
</div>
</footer>
<!-- jQuery -->
<script src="js/jquery.js"></script>
<!-- Bootstrap Core JavaScript -->
<script src="js/bootstrap.min.js"></script>
<!-- Custom Theme JavaScript -->
<script src="js/clean-blog.min.js"></script>
</body>
</html>