logstash - output single event into multiple line output file
up vote
0
down vote
favorite
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1
, c2
, c3
. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
add a comment |
up vote
0
down vote
favorite
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1
, c2
, c3
. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1
, c2
, c3
. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1
, c2
, c3
. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
logstash
asked Nov 22 at 9:27
Mr T.
1,71562341
1,71562341
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
-1
down vote
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:v1nv2nv3
. I couldn't add the line break.
– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
-1
down vote
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:v1nv2nv3
. I couldn't add the line break.
– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
add a comment |
up vote
-1
down vote
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:v1nv2nv3
. I couldn't add the line break.
– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
add a comment |
up vote
-1
down vote
up vote
-1
down vote
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 at 12:07
Faulander
835
835
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:v1nv2nv3
. I couldn't add the line break.
– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
add a comment |
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:v1nv2nv3
. I couldn't add the line break.
– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 at 12:55
what output do you get?
– Faulander
Nov 26 at 10:18
what output do you get?
– Faulander
Nov 26 at 10:18
I'm getting the same thing as in the question:
v1nv2nv3
. I couldn't add the line break.– baudsp
Nov 26 at 12:53
I'm getting the same thing as in the question:
v1nv2nv3
. I couldn't add the line break.– baudsp
Nov 26 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 at 17:11
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53427649%2flogstash-output-single-event-into-multiple-line-output-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown