Delete multiple columns using awk or sed












1















I have a database with 6037 space-separated columns and 450 rows like the one below:



1807 1452 1598 1 6.655713  A B A B ... 0 

1808 1452 1763 1 9.362033  0 0 A B ... A 

1809 1452 1527 2 6.728534  A B A A ... B 

1810 1452 1367 2 9.4055  A B A A B ... A 

... ... ... ... ... ... ... ... ... ...

1812 1452 1258 1 6.363032  0 0 A B ... B


I want to get a new database with only the first 676 columns.



Preferably, some form that uses awk or sed command.






text-processing sed awk







share|improve this question









New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





















  • The delimiter is the space.

    – andrec
    4 hours ago
















1















I have a database with 6037 space-separated columns and 450 rows like the one below:



1807 1452 1598 1 6.655713  A B A B ... 0 

1808 1452 1763 1 9.362033  0 0 A B ... A 

1809 1452 1527 2 6.728534  A B A A ... B 

1810 1452 1367 2 9.4055  A B A A B ... A 

... ... ... ... ... ... ... ... ... ...

1812 1452 1258 1 6.363032  0 0 A B ... B


I want to get a new database with only the first 676 columns.



Preferably, some form that uses awk or sed command.






text-processing sed awk







share|improve this question









New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





















  • The delimiter is the space.

    – andrec
    4 hours ago














1












1








1








I have a database with 6037 space-separated columns and 450 rows like the one below:



1807 1452 1598 1 6.655713  A B A B ... 0 

1808 1452 1763 1 9.362033  0 0 A B ... A 

1809 1452 1527 2 6.728534  A B A A ... B 

1810 1452 1367 2 9.4055  A B A A B ... A 

... ... ... ... ... ... ... ... ... ...

1812 1452 1258 1 6.363032  0 0 A B ... B


I want to get a new database with only the first 676 columns.



Preferably, some form that uses awk or sed command.






text-processing sed awk







share|improve this question









New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.












I have a database with 6037 space-separated columns and 450 rows like the one below:



1807 1452 1598 1 6.655713  A B A B ... 0 

1808 1452 1763 1 9.362033  0 0 A B ... A 

1809 1452 1527 2 6.728534  A B A A ... B 

1810 1452 1367 2 9.4055  A B A A B ... A 

... ... ... ... ... ... ... ... ... ...

1812 1452 1258 1 6.363032  0 0 A B ... B


I want to get a new database with only the first 676 columns.



Preferably, some form that uses awk or sed command.






text-processing sed awk




text-processing sed awk






share|improve this question









New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question









New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question








edited 3 hours ago









dessert

24.7k672105




24.7k672105






New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 5 hours ago









andrecandrec

61




61




New contributor




andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






andrec is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.













  • The delimiter is the space.

    – andrec
    4 hours ago



















  • The delimiter is the space.

    – andrec
    4 hours ago

















The delimiter is the space.

– andrec
4 hours ago





The delimiter is the space.

– andrec
4 hours ago










2 Answers
2






active

oldest

votes


















4
















If the column delimiter in your file is a single character, e.g. a space, cut can do that easily:



cut -d' ' -f-676 <in >out


This prints only the space-separated columns from the first to the 676th.



If you need e.g. every whitespace character to count as a delimiter, a sed solution is:



sed -r 's/s+S+//677g' <in >out


This replaces every column (= at least one whitespace character followed by at least one non-whitespace character) beginning with the 677th with nothing. Using character groups you can specify any set of delimiters you need, e.g. for “4”, “#” and “K”:



sed -r 's/[4#K]+[^4#K]+//677g' <in >out


For a reasonable awk approach kindly refer to steeldriver’s answer, but here is another one looping over the columns and only printing them (separated by FS) if their number is <= 676:



awk '{for (i=1;i<=676;i++) {printf (i==1?"":FS)$i}; print ""}' <in >out


For a character group you have to specify the output field separator for the output, e.g. for [4#K] and "sep":




awk -F'[4#K]' '{for (i=1;i<=676;i++) {printf (i==1?"":"sep")$i}; print ""}' <in >out





share|improve this answer

































    1














    For a single-character delimiter (such as space or comma) I would recommend using the cut command over either awk or sed.



    However since you asked about awk specifically, I think a reasonable way to do it would be to decrement the field count:



    awk -v last=676 '{while(NF>last) NF--} 1' datafile


    Tested in GNU Awk (gawk) and mawk.






    share|improve this answer

























      Your Answer








      StackExchange.ready(function() {
      var channelOptions = {
      tags: "".split(" "),
      id: "89"
      };
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function() {
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled) {
      StackExchange.using("snippets", function() {
      createEditor();
      });
      }
      else {
      createEditor();
      }
      });

      function createEditor() {
      StackExchange.prepareEditor({
      heartbeatType: 'answer',
      autoActivateHeartbeat: false,
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader: {
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      },
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      });


      }
      });






      andrec is a new contributor. Be nice, and check out our Code of Conduct.










      draft saved

      draft discarded


















      StackExchange.ready(
      function () {
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1127670%2fdelete-multiple-columns-using-awk-or-sed%23new-answer', 'question_page');
      }
      );

      Post as a guest















      Required, but never shown

























      2 Answers
      2






      active

      oldest

      votes








      2 Answers
      2






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes









      4
















      If the column delimiter in your file is a single character, e.g. a space, cut can do that easily:



      cut -d' ' -f-676 <in >out


      This prints only the space-separated columns from the first to the 676th.



      If you need e.g. every whitespace character to count as a delimiter, a sed solution is:



      sed -r 's/s+S+//677g' <in >out


      This replaces every column (= at least one whitespace character followed by at least one non-whitespace character) beginning with the 677th with nothing. Using character groups you can specify any set of delimiters you need, e.g. for “4”, “#” and “K”:



      sed -r 's/[4#K]+[^4#K]+//677g' <in >out


      For a reasonable awk approach kindly refer to steeldriver’s answer, but here is another one looping over the columns and only printing them (separated by FS) if their number is <= 676:



      awk '{for (i=1;i<=676;i++) {printf (i==1?"":FS)$i}; print ""}' <in >out


      For a character group you have to specify the output field separator for the output, e.g. for [4#K] and "sep":




      awk -F'[4#K]' '{for (i=1;i<=676;i++) {printf (i==1?"":"sep")$i}; print ""}' <in >out





      share|improve this answer






























        4
















        If the column delimiter in your file is a single character, e.g. a space, cut can do that easily:



        cut -d' ' -f-676 <in >out


        This prints only the space-separated columns from the first to the 676th.



        If you need e.g. every whitespace character to count as a delimiter, a sed solution is:



        sed -r 's/s+S+//677g' <in >out


        This replaces every column (= at least one whitespace character followed by at least one non-whitespace character) beginning with the 677th with nothing. Using character groups you can specify any set of delimiters you need, e.g. for “4”, “#” and “K”:



        sed -r 's/[4#K]+[^4#K]+//677g' <in >out


        For a reasonable awk approach kindly refer to steeldriver’s answer, but here is another one looping over the columns and only printing them (separated by FS) if their number is <= 676:



        awk '{for (i=1;i<=676;i++) {printf (i==1?"":FS)$i}; print ""}' <in >out


        For a character group you have to specify the output field separator for the output, e.g. for [4#K] and "sep":




        awk -F'[4#K]' '{for (i=1;i<=676;i++) {printf (i==1?"":"sep")$i}; print ""}' <in >out





        share|improve this answer




























          4












          4








          4









          If the column delimiter in your file is a single character, e.g. a space, cut can do that easily:



          cut -d' ' -f-676 <in >out


          This prints only the space-separated columns from the first to the 676th.



          If you need e.g. every whitespace character to count as a delimiter, a sed solution is:



          sed -r 's/s+S+//677g' <in >out


          This replaces every column (= at least one whitespace character followed by at least one non-whitespace character) beginning with the 677th with nothing. Using character groups you can specify any set of delimiters you need, e.g. for “4”, “#” and “K”:



          sed -r 's/[4#K]+[^4#K]+//677g' <in >out


          For a reasonable awk approach kindly refer to steeldriver’s answer, but here is another one looping over the columns and only printing them (separated by FS) if their number is <= 676:



          awk '{for (i=1;i<=676;i++) {printf (i==1?"":FS)$i}; print ""}' <in >out


          For a character group you have to specify the output field separator for the output, e.g. for [4#K] and "sep":




          awk -F'[4#K]' '{for (i=1;i<=676;i++) {printf (i==1?"":"sep")$i}; print ""}' <in >out





          share|improve this answer

















          If the column delimiter in your file is a single character, e.g. a space, cut can do that easily:



          cut -d' ' -f-676 <in >out


          This prints only the space-separated columns from the first to the 676th.



          If you need e.g. every whitespace character to count as a delimiter, a sed solution is:



          sed -r 's/s+S+//677g' <in >out


          This replaces every column (= at least one whitespace character followed by at least one non-whitespace character) beginning with the 677th with nothing. Using character groups you can specify any set of delimiters you need, e.g. for “4”, “#” and “K”:



          sed -r 's/[4#K]+[^4#K]+//677g' <in >out


          For a reasonable awk approach kindly refer to steeldriver’s answer, but here is another one looping over the columns and only printing them (separated by FS) if their number is <= 676:



          awk '{for (i=1;i<=676;i++) {printf (i==1?"":FS)$i}; print ""}' <in >out


          For a character group you have to specify the output field separator for the output, e.g. for [4#K] and "sep":




          awk -F'[4#K]' '{for (i=1;i<=676;i++) {printf (i==1?"":"sep")$i}; print ""}' <in >out






          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited 4 hours ago

























          answered 5 hours ago









          dessertdessert

          24.7k672105




          24.7k672105

























              1














              For a single-character delimiter (such as space or comma) I would recommend using the cut command over either awk or sed.



              However since you asked about awk specifically, I think a reasonable way to do it would be to decrement the field count:



              awk -v last=676 '{while(NF>last) NF--} 1' datafile


              Tested in GNU Awk (gawk) and mawk.






              share|improve this answer






























                1














                For a single-character delimiter (such as space or comma) I would recommend using the cut command over either awk or sed.



                However since you asked about awk specifically, I think a reasonable way to do it would be to decrement the field count:



                awk -v last=676 '{while(NF>last) NF--} 1' datafile


                Tested in GNU Awk (gawk) and mawk.






                share|improve this answer




























                  1












                  1








                  1







                  For a single-character delimiter (such as space or comma) I would recommend using the cut command over either awk or sed.



                  However since you asked about awk specifically, I think a reasonable way to do it would be to decrement the field count:



                  awk -v last=676 '{while(NF>last) NF--} 1' datafile


                  Tested in GNU Awk (gawk) and mawk.






                  share|improve this answer















                  For a single-character delimiter (such as space or comma) I would recommend using the cut command over either awk or sed.



                  However since you asked about awk specifically, I think a reasonable way to do it would be to decrement the field count:



                  awk -v last=676 '{while(NF>last) NF--} 1' datafile


                  Tested in GNU Awk (gawk) and mawk.







                  share|improve this answer














                  share|improve this answer



                  share|improve this answer








                  edited 3 hours ago

























                  answered 4 hours ago









                  steeldriversteeldriver

                  69.8k11114186




                  69.8k11114186






















                      andrec is a new contributor. Be nice, and check out our Code of Conduct.










                      draft saved

                      draft discarded


















                      andrec is a new contributor. Be nice, and check out our Code of Conduct.













                      andrec is a new contributor. Be nice, and check out our Code of Conduct.












                      andrec is a new contributor. Be nice, and check out our Code of Conduct.
















                      Thanks for contributing an answer to Ask Ubuntu!


                      • Please be sure to answer the question. Provide details and share your research!

                      But avoid …



                      • Asking for help, clarification, or responding to other answers.

                      • Making statements based on opinion; back them up with references or personal experience.


                      To learn more, see our tips on writing great answers.




                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function () {
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1127670%2fdelete-multiple-columns-using-awk-or-sed%23new-answer', 'question_page');
                      }
                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      -

                      Popular posts from this blog

                      A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks

                      Image
                      0 I found a lot of questions abount appendices and ToC. Many users want appendices to be grouped in an Appendix part, however some problems arise with ToC, hyperref, PDF viewer bookmarks, and so on. There are different solutions which require extra packages, command patching and other extra code, however none of them satisfies me. I almost found an easy way to accomplish a good result, where appendices are added to bookmarks in the right way and hyperref links point to the right page. However, the number of the "Appendix" part page is wrong (it's the number of appendix A). Is there any EASY way to fix that? This is a MWE: documentclass{book} usepackage[nottoc,notlot,notlof]{tocbibind} usepackage{hyperref} begin{document} frontmatter tableofcontents mainmatter part{First} chapter{...
                      Read more

                      Calculate evaluation metrics using cross_val_predict sklearn

                      Image
                      1 In the sklearn.model_selection.cross_val_predict page it is stated: Generate cross-validated estimates for each input data point. It is not appropriate to pass these predictions into an evaluation metric. Can someone explain what does it mean? If this gives estimate of Y (y prediction) for every Y (true Y), why can't I calculate metrics such as RMSE or coefficient of determination using these results? python scikit-learn cross-validation share | improve this question edited Nov 28 '18 at 17:52 desertnaut 20.3k 7 43 79 ...
                      Read more

                      Insert data from modal to MySQL (multiple modal on website)

                      Image
                      0 I have problem with inserting data to MySQL from modal. My modal: <a href="#" class="badge badge-pill badge-success">6 komentarzy</a> <a href="#" class="badge badge-pill badge-danger">brak komentarzy</a> <a data-toggle="modal" href="#add_desk_comm_{$desk_['desk_id']}" data-target="#add_desk_comm_{$desk_['desk_id']}" class="ediiit">(dodaj)</a> <div class="modal fade" id="add_desk_comm_{$desk_['desk_id']}" tabindex="-1" role="dialog" aria-labelledby="edit_printer" aria-hidden="true"> <div class="modal-dialog" role="document"> ...
                      Read more