How to read zipfile from bytes in Python 3.x?











up vote
0
down vote

favorite












I'm reading gzip file from bytes, which I have loaded from AWS S3, now I have tried below code to read:



gzip_bytes = s3.get_file()  # for example I have loaded S3
gzip_file = BytesIO(gzip_bytes)

with GzipFile(gzip_file, mode="rb") as file:
# Todo somthing


I'm getting below error:



Traceback (most recent call last):
...
with GzipFile(BytesIO(pre_file_bytes), mode="rb") as pre_zip_file:
File "/usr/lib/python3.6/gzip.py", line 163, in __init__
fileobj = self.myfileobj = builtins.open(filename, mode or 'rb')
TypeError: expected str, bytes or os.PathLike object, not _io.BytesIO


How can I resolve that issue? Or maybe I'm missing something



Many Thanks










share|improve this question




























    up vote
    0
    down vote

    favorite












    I'm reading gzip file from bytes, which I have loaded from AWS S3, now I have tried below code to read:



    gzip_bytes = s3.get_file()  # for example I have loaded S3
    gzip_file = BytesIO(gzip_bytes)

    with GzipFile(gzip_file, mode="rb") as file:
    # Todo somthing


    I'm getting below error:



    Traceback (most recent call last):
    ...
    with GzipFile(BytesIO(pre_file_bytes), mode="rb") as pre_zip_file:
    File "/usr/lib/python3.6/gzip.py", line 163, in __init__
    fileobj = self.myfileobj = builtins.open(filename, mode or 'rb')
    TypeError: expected str, bytes or os.PathLike object, not _io.BytesIO


    How can I resolve that issue? Or maybe I'm missing something



    Many Thanks










    share|improve this question


























      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      I'm reading gzip file from bytes, which I have loaded from AWS S3, now I have tried below code to read:



      gzip_bytes = s3.get_file()  # for example I have loaded S3
      gzip_file = BytesIO(gzip_bytes)

      with GzipFile(gzip_file, mode="rb") as file:
      # Todo somthing


      I'm getting below error:



      Traceback (most recent call last):
      ...
      with GzipFile(BytesIO(pre_file_bytes), mode="rb") as pre_zip_file:
      File "/usr/lib/python3.6/gzip.py", line 163, in __init__
      fileobj = self.myfileobj = builtins.open(filename, mode or 'rb')
      TypeError: expected str, bytes or os.PathLike object, not _io.BytesIO


      How can I resolve that issue? Or maybe I'm missing something



      Many Thanks










      share|improve this question















      I'm reading gzip file from bytes, which I have loaded from AWS S3, now I have tried below code to read:



      gzip_bytes = s3.get_file()  # for example I have loaded S3
      gzip_file = BytesIO(gzip_bytes)

      with GzipFile(gzip_file, mode="rb") as file:
      # Todo somthing


      I'm getting below error:



      Traceback (most recent call last):
      ...
      with GzipFile(BytesIO(pre_file_bytes), mode="rb") as pre_zip_file:
      File "/usr/lib/python3.6/gzip.py", line 163, in __init__
      fileobj = self.myfileobj = builtins.open(filename, mode or 'rb')
      TypeError: expected str, bytes or os.PathLike object, not _io.BytesIO


      How can I resolve that issue? Or maybe I'm missing something



      Many Thanks







      python-3.x amazon-web-services amazon-s3






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 22 at 21:19









      John Rotenstein

      66.8k774118




      66.8k774118










      asked Nov 22 at 16:36









      Yougesh

      143112




      143112
























          1 Answer
          1






          active

          oldest

          votes

















          up vote
          1
          down vote



          accepted










          The gzipfile contructor takes:



          class gzip.GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None)


          However, you are passing Bytes instead of a string as the filename.



          This is explained by the error message:




          expected str, bytes or os.PathLike object, not _io.BytesIO




          It looks like you should download the file, then provide the filename to the downloaded file.






          share|improve this answer





















          • Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
            – Yougesh
            Nov 23 at 8:18










          • I have resolve my issue by using GzipFile class read function, Thanks again
            – Yougesh
            Nov 23 at 8:39











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53435156%2fhow-to-read-zipfile-from-bytes-in-python-3-x%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          up vote
          1
          down vote



          accepted










          The gzipfile contructor takes:



          class gzip.GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None)


          However, you are passing Bytes instead of a string as the filename.



          This is explained by the error message:




          expected str, bytes or os.PathLike object, not _io.BytesIO




          It looks like you should download the file, then provide the filename to the downloaded file.






          share|improve this answer





















          • Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
            – Yougesh
            Nov 23 at 8:18










          • I have resolve my issue by using GzipFile class read function, Thanks again
            – Yougesh
            Nov 23 at 8:39















          up vote
          1
          down vote



          accepted










          The gzipfile contructor takes:



          class gzip.GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None)


          However, you are passing Bytes instead of a string as the filename.



          This is explained by the error message:




          expected str, bytes or os.PathLike object, not _io.BytesIO




          It looks like you should download the file, then provide the filename to the downloaded file.






          share|improve this answer





















          • Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
            – Yougesh
            Nov 23 at 8:18










          • I have resolve my issue by using GzipFile class read function, Thanks again
            – Yougesh
            Nov 23 at 8:39













          up vote
          1
          down vote



          accepted







          up vote
          1
          down vote



          accepted






          The gzipfile contructor takes:



          class gzip.GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None)


          However, you are passing Bytes instead of a string as the filename.



          This is explained by the error message:




          expected str, bytes or os.PathLike object, not _io.BytesIO




          It looks like you should download the file, then provide the filename to the downloaded file.






          share|improve this answer












          The gzipfile contructor takes:



          class gzip.GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None)


          However, you are passing Bytes instead of a string as the filename.



          This is explained by the error message:




          expected str, bytes or os.PathLike object, not _io.BytesIO




          It looks like you should download the file, then provide the filename to the downloaded file.







          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Nov 22 at 21:19









          John Rotenstein

          66.8k774118




          66.8k774118












          • Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
            – Yougesh
            Nov 23 at 8:18










          • I have resolve my issue by using GzipFile class read function, Thanks again
            – Yougesh
            Nov 23 at 8:39


















          • Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
            – Yougesh
            Nov 23 at 8:18










          • I have resolve my issue by using GzipFile class read function, Thanks again
            – Yougesh
            Nov 23 at 8:39
















          Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
          – Yougesh
          Nov 23 at 8:18




          Thanks for the answer, now I have used the fileobj parameter and its not throwing error, but in the gzip file I have single CSV which I want to read in csv.reader, you have any idea?
          – Yougesh
          Nov 23 at 8:18












          I have resolve my issue by using GzipFile class read function, Thanks again
          – Yougesh
          Nov 23 at 8:39




          I have resolve my issue by using GzipFile class read function, Thanks again
          – Yougesh
          Nov 23 at 8:39


















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.





          Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


          Please pay close attention to the following guidance:


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53435156%2fhow-to-read-zipfile-from-bytes-in-python-3-x%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks

          Calculate evaluation metrics using cross_val_predict sklearn

          Insert data from modal to MySQL (multiple modal on website)