Sending from one logstash to another using TCP -


i'm trying forward events logstash server another. last logstash server should write received logs file

in source logstash i've added:

output {     tcp {         host => "host"         port => port     } }

and destination logstash has:

input {   tcp {     port => port   } }  output {   file {     path => "/var/log/project/log"   } }

this boot log:

{:timestamp=>"2016-01-15t23:12:30.884000+0100", :message=>"reading config file", :file=>"logstash/agent.rb", :level=>:debug, :line=>"309", :method=>"local_config"} {:timestamp=>"2016-01-15t23:12:31.011000+0100", :message=>"compiled pipeline code:\n        @inputs = []\n        @filters = []\n        @outputs = []\n        @periodic_flushers = []\n        @shutdown_flushers = []\n\n          @input_tcp_1 = plugin(\"input\", \"tcp\", logstash::util.hash_merge_many({ \"port\" => port }))\n\n          @inputs << @input_tcp_1\n\n          @output_file_2 = plugin(\"output\", \"file\", logstash::util.hash_merge_many({ \"path\" => (\"/var/log/project/log\") }))\n\n          @outputs << @output_file_2\n\n  def filter_func(event)\n    events = [event]\n    @logger.debug? && @logger.debug(\"filter received\", :event => event.to_hash)\n    events\n  end\n  def output_func(event)\n    @logger.debug? && @logger.debug(\"output received\", :event => event.to_hash)\n    @output_file_2.handle(event)\n    \n  end", :level=>:debug, :file=>"logstash/pipeline.rb", :line=>"29", :method=>"initialize"} {:timestamp=>"2016-01-15t23:12:31.027000+0100", :message=>"plugin not defined in namespace, checking plugin file", :type=>"input", :name=>"tcp", :path=>"logstash/inputs/tcp", :level=>:debug, :file=>"logstash/plugin.rb", :line=>"133", :method=>"lookup"} {:timestamp=>"2016-01-15t23:12:31.070000+0100", :message=>"plugin not defined in namespace, checking plugin file", :type=>"codec", :name=>"line", :path=>"logstash/codecs/line", :level=>:debug, :file=>"logstash/plugin.rb", :line=>"133", :method=>"lookup"} {:timestamp=>"2016-01-15t23:12:31.101000+0100", :message=>"config logstash::codecs::line/@charset = \"utf-8\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.120000+0100", :message=>"config logstash::inputs::tcp/@port = 35364", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.127000+0100", :message=>"config logstash::inputs::tcp/@debug = false", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.135000+0100", :message=>"config logstash::inputs::tcp/@codec = <logstash::codecs::line charset=>\"utf-8\">", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.138000+0100", :message=>"config logstash::inputs::tcp/@add_field = {}", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.146000+0100", :message=>"config logstash::inputs::tcp/@host = \"0.0.0.0\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.154000+0100", :message=>"config logstash::inputs::tcp/@data_timeout = -1", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.162000+0100", :message=>"config logstash::inputs::tcp/@mode = \"server\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.169000+0100", :message=>"config logstash::inputs::tcp/@ssl_enable = false", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.172000+0100", :message=>"config logstash::inputs::tcp/@ssl_verify = false", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.175000+0100", :message=>"config logstash::inputs::tcp/@ssl_key_passphrase = <password>", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.179000+0100", :message=>"plugin not defined in namespace, checking plugin file", :type=>"output", :name=>"file", :path=>"logstash/outputs/file", :level=>:debug, :file=>"logstash/plugin.rb", :line=>"133", :method=>"lookup"} {:timestamp=>"2016-01-15t23:12:31.219000+0100", :message=>"plugin not defined in namespace, checking plugin file", :type=>"codec", :name=>"plain", :path=>"logstash/codecs/plain", :level=>:debug, :file=>"logstash/plugin.rb", :line=>"133", :method=>"lookup"} {:timestamp=>"2016-01-15t23:12:31.246000+0100", :message=>"config logstash::codecs::plain/@charset = \"utf-8\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.263000+0100", :message=>"config logstash::outputs::file/@path = \"/var/log/project/log\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.269000+0100", :message=>"config logstash::outputs::file/@type = \"\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.281000+0100", :message=>"config logstash::outputs::file/@tags = []", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.284000+0100", :message=>"config logstash::outputs::file/@exclude_tags = []", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.297000+0100", :message=>"config logstash::outputs::file/@codec = <logstash::codecs::plain charset=>\"utf-8\">", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.309000+0100", :message=>"config logstash::outputs::file/@workers = 1", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.312000+0100", :message=>"config logstash::outputs::file/@flush_interval = 2", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.331000+0100", :message=>"config logstash::outputs::file/@gzip = false", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.334000+0100", :message=>"config logstash::outputs::file/@filename_failure = \"_filepath_failures\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"} {:timestamp=>"2016-01-15t23:12:31.364000+0100", :message=>"starting tcp input listener", :address=>"0.0.0.0:35364", :level=>:info, :file=>"logstash/inputs/tcp.rb", :line=>"92", :method=>"register"} {:timestamp=>"2016-01-15t23:12:31.425000+0100", :message=>"pipeline started", :level=>:info, :file=>"logstash/pipeline.rb", :line=>"87", :method=>"run"} {:timestamp=>"2016-01-15t23:13:53.014000+0100", :message=>"accepted connection", :client=>"xx.xx.xx.xx:51272", :server=>"0.0.0.0:port", :level=>:debug, :file=>"logstash/inputs/tcp.rb", :line=>"146", :method=>"client_thread"} {:timestamp=>"2016-01-15t23:13:53.025000+0100", :message=>"config logstash::codecs::line/@charset = \"utf-8\"", :level=>:debug, :file=>"logstash/config/mixin.rb", :line=>"111", :method=>"config_init"}

i can see connection between client , server using netstat , packets containing events tcpdump. /var/log/project owned logstash user.

however, no file created, no file written, no log that

i'm not sure if issue tcp or else switching tcp lumberjack input , output worked perfectly


Comments

Post a Comment

Popular posts from this blog

get url and add instance to a model with prefilled foreign key :django admin -

Image
i have page in each contest shown in row. each row contains contest id , link other model names have foreign key contest. news model: class news(models.model): title = models.charfield(max_length=50, null=true) description = models.textfield() time = models.timefield( default= datetime.datetime.now().time()) contest = models.foreignkey(contest) i want use admin adding , changing these models. want when user clicks on 'news' has foreign key contest id=1, shows list of news value foreign key. use {% instance in instances %} <tr class="{% cycle 'row1' 'row2' %}"> <td>{{ instance.title }}</td> <td>{{ instance.starttime }}</td> <td>{{ instance.timespan }}</td> <td>{{ instance.date }}</td> <td><a href="/adm...
Read more

css - Make div keyboard-scrollable in jQuery Mobile? -

from can tell, although jquery-mobile-powered pages can contain divs overflow set scroll or auto, , these divs can scrolled one-screen bar or mouse wheel, cannot scrolled using arrow keys, page-up/page-down, or home/end. instead, official "page" div (with data-role="page") absorbs input. perhaps other divs can't acquire focus, i'm not sure. is there way around this? edit: jsfiddle of simple example: https://jsfiddle.net/qogz0shx/ <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script> <script src="https://ajax.googleapis.com/ajax/libs/jquerymobile/1.4.5/jquery.mobile.min.js"> </script> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"/> <style> #outer { overflow:scroll; height: 50vh; width: 50vw; } #inner { height: 500vh; width: 500vw; } ...
Read more

android - Keyboard hides my half of edit-text and button below it even in scroll view -

i having trouble keyboard covers edit-text , half of button in scroll view. here's layout , please tell me how should resolve problem. many questions on topic none of them s working me. <?xml version="1.0" encoding="utf-8"?> <linearlayout xmlns:android="http://schemas.android.com/apk/res/android" android:layout_width="match_parent" android:background="@drawable/bg" android:layout_height="match_parent"> <scrollview android:layout_width="match_parent" android:fillviewport="true" android:layout_height="match_parent"> <relativelayout android:layout_width="match_parent" android:layout_height="wrap_content" android:orientation="vertical"> <linearlayout android:layout_width="match_parent" android:layout_height="w...
Read more