M
M
Max2015-12-14 11:28:02
Amazon Web Services
Max, 2015-12-14 11:28:02

Logstash can't see data in S3 bucket on AWS?

Colleagues, something of my Google-fu is stalling.
we have an instance on AWS in which Logstash is installed. It perfectly parses local files. The task is to feed it with the logs that are in the basket on S3.

input {
  s3 {
   bucket =>  "[имя_корзины]"
   delete => false
    interval => 60 # seconds
    prefix => "/"
    region => "us-west-2"
#    type => "cloudfront"
    codec => "cloudfront"
    secret_access_key => "ключ"
    access_key_id => "ID_ключ"
    sincedb_path => "/opt/logstash_input/s3/cloudfront/sincedb_cloudfront"
    use_ssl => true
  }
}
output{
         stdout { 
           }
}

this bastard does not swear at anything, stupidly silent. there are definitely files in the bucket, they lie at the root. CHADNT?
Upd.
s3cmd ls s3://имя_корзины/
2015-12-14 08:59       665   s3://имя_корзины/EFU10WYEZ98VX.2015-09-17-11.e2e0ab2c.gz

those. the instance bucket sees, there is a file in the root.

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question