Python - pandas Avoid splitting string columns when writing to csv file
This is the sample of my code
when I write the dataframe into csv, 9 October 1937 and 81 years ago (1937-10-09) are coming in different columns.
import pandas as pd
df = pd.DataFrame({'established':['9 October 1937, 81 years ago (1937-10-09)','1996'],'location':['hyd','Delhi']})
df.to_csv('some_file.csv')
How to make 9 October 1937, 81 years ago (1937-10-09) should be coming in same column??
Thanks
python python-3.x pandas
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
add a comment |
This is the sample of my code
when I write the dataframe into csv, 9 October 1937 and 81 years ago (1937-10-09) are coming in different columns.
import pandas as pd
df = pd.DataFrame({'established':['9 October 1937, 81 years ago (1937-10-09)','1996'],'location':['hyd','Delhi']})
df.to_csv('some_file.csv')
How to make 9 October 1937, 81 years ago (1937-10-09) should be coming in same column??
Thanks
python python-3.x pandas
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33
add a comment |
This is the sample of my code
when I write the dataframe into csv, 9 October 1937 and 81 years ago (1937-10-09) are coming in different columns.
import pandas as pd
df = pd.DataFrame({'established':['9 October 1937, 81 years ago (1937-10-09)','1996'],'location':['hyd','Delhi']})
df.to_csv('some_file.csv')
How to make 9 October 1937, 81 years ago (1937-10-09) should be coming in same column??
Thanks
python python-3.x pandas
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
This is the sample of my code
when I write the dataframe into csv, 9 October 1937 and 81 years ago (1937-10-09) are coming in different columns.
import pandas as pd
df = pd.DataFrame({'established':['9 October 1937, 81 years ago (1937-10-09)','1996'],'location':['hyd','Delhi']})
df.to_csv('some_file.csv')
How to make 9 October 1937, 81 years ago (1937-10-09) should be coming in same column??
Thanks
python python-3.x pandas
python python-3.x pandas
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
edited Nov 28 '18 at 12:05
Rupesh Goud
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
asked Nov 28 '18 at 11:58
Rupesh GoudRupesh Goud
7117
7117
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33
add a comment |
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33
add a comment |
1 Answer
1
active
oldest
votes
This works as it should, if you open the file in a plain text reader:
,established,location
0,"9 October 1937, 81 years ago (1937-10-09)",hyd
1,1996,Delhi
You may run into trouble when reading the .csv file afterwards, depending on how your reader handles the "," after 1937. It may understand it either as a field separator and cut right after, or understand that the encompassing quotes " ... " suggest that it is a single field.
To avoid any trouble you may want to use a semi-colon separator when writing the file: df.to_csv("some_file.csv", sep=";")
answered Nov 28 '18 at 13:31
seisemanseiseman
263
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53518972%2fpython-pandas-avoid-splitting-string-columns-when-writing-to-csv-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
This works as it should, if you open the file in a plain text reader:
,established,location
0,"9 October 1937, 81 years ago (1937-10-09)",hyd
1,1996,Delhi
You may run into trouble when reading the .csv file afterwards, depending on how your reader handles the "," after 1937. It may understand it either as a field separator and cut right after, or understand that the encompassing quotes " ... " suggest that it is a single field.
To avoid any trouble you may want to use a semi-colon separator when writing the file: df.to_csv("some_file.csv", sep=";")
answered Nov 28 '18 at 13:31
seisemanseiseman
263
add a comment |
This works as it should, if you open the file in a plain text reader:
,established,location
0,"9 October 1937, 81 years ago (1937-10-09)",hyd
1,1996,Delhi
You may run into trouble when reading the .csv file afterwards, depending on how your reader handles the "," after 1937. It may understand it either as a field separator and cut right after, or understand that the encompassing quotes " ... " suggest that it is a single field.
To avoid any trouble you may want to use a semi-colon separator when writing the file: df.to_csv("some_file.csv", sep=";")
answered Nov 28 '18 at 13:31
seisemanseiseman
263
add a comment |
This works as it should, if you open the file in a plain text reader:
,established,location
0,"9 October 1937, 81 years ago (1937-10-09)",hyd
1,1996,Delhi
You may run into trouble when reading the .csv file afterwards, depending on how your reader handles the "," after 1937. It may understand it either as a field separator and cut right after, or understand that the encompassing quotes " ... " suggest that it is a single field.
To avoid any trouble you may want to use a semi-colon separator when writing the file: df.to_csv("some_file.csv", sep=";")
answered Nov 28 '18 at 13:31
seisemanseiseman
263
This works as it should, if you open the file in a plain text reader:
,established,location
0,"9 October 1937, 81 years ago (1937-10-09)",hyd
1,1996,Delhi
You may run into trouble when reading the .csv file afterwards, depending on how your reader handles the "," after 1937. It may understand it either as a field separator and cut right after, or understand that the encompassing quotes " ... " suggest that it is a single field.
To avoid any trouble you may want to use a semi-colon separator when writing the file: df.to_csv("some_file.csv", sep=";")
answered Nov 28 '18 at 13:31
seisemanseiseman
263
answered Nov 28 '18 at 13:31
seisemanseiseman
263
answered Nov 28 '18 at 13:31
seisemanseiseman
263
answered Nov 28 '18 at 13:31
seisemanseiseman
263
263
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53518972%2fpython-pandas-avoid-splitting-string-columns-when-writing-to-csv-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Your code works as intended without any changes for me (Windows 7, Python 3.6.4, Pandas 0.22.0).
– thesilkworm
Nov 28 '18 at 12:05
It works fine on my system
– Mohit Motwani
Nov 28 '18 at 12:05
You need to look into which csv dialect you want to target - one way or another you need to escape, or quote-surround that embedded comma, or some readers will interpret it as a delimiter. Another option would be to force some alternative delimiter - but this is normally considered bad form - it's a faster alternative (if you can control the config of the downstream reader) but generally better to solve using the former mechanism.
– Thomas Kimber
Nov 28 '18 at 12:07
Thanks @ThomasKimber, it was because some configuration in my csv reader. Its working fine now.
– Rupesh Goud
Nov 28 '18 at 12:33