Not able to get more than 1000 rows from azure storage table
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}
I am beginner in Python and try to retrieve all rows (more than 1000 rows) from azure storage table. Below is the sample code.
The code gives me 1000 records but the table (testtable) has more than 50000 rows.i read in some blog using continuation token can pull all records. Let me know how can i implement in this
table='testtable'
now2='14042018'
count=0
try:
table_service = TableService(account_name=myaccount, account_key=mykey)
logging.info('connected successfully')
except Exception as e:
logging.error(e)
tasks = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for task in tasks:
count=count+1
a=task.desc
#print(a)
print(count)
python-3.x
azure-table-storage asked Nov 29 '18 at 6:22
vinothvinoth
10016
add a comment |
I am beginner in Python and try to retrieve all rows (more than 1000 rows) from azure storage table. Below is the sample code.
The code gives me 1000 records but the table (testtable) has more than 50000 rows.i read in some blog using continuation token can pull all records. Let me know how can i implement in this
table='testtable'
now2='14042018'
count=0
try:
table_service = TableService(account_name=myaccount, account_key=mykey)
logging.info('connected successfully')
except Exception as e:
logging.error(e)
tasks = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for task in tasks:
count=count+1
a=task.desc
#print(a)
print(count)
python-3.x
azure-table-storage asked Nov 29 '18 at 6:22
vinothvinoth
10016
add a comment |
I am beginner in Python and try to retrieve all rows (more than 1000 rows) from azure storage table. Below is the sample code.
The code gives me 1000 records but the table (testtable) has more than 50000 rows.i read in some blog using continuation token can pull all records. Let me know how can i implement in this
table='testtable'
now2='14042018'
count=0
try:
table_service = TableService(account_name=myaccount, account_key=mykey)
logging.info('connected successfully')
except Exception as e:
logging.error(e)
tasks = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for task in tasks:
count=count+1
a=task.desc
#print(a)
print(count)
python-3.x
azure-table-storage asked Nov 29 '18 at 6:22
vinothvinoth
10016
I am beginner in Python and try to retrieve all rows (more than 1000 rows) from azure storage table. Below is the sample code.
The code gives me 1000 records but the table (testtable) has more than 50000 rows.i read in some blog using continuation token can pull all records. Let me know how can i implement in this
table='testtable'
now2='14042018'
count=0
try:
table_service = TableService(account_name=myaccount, account_key=mykey)
logging.info('connected successfully')
except Exception as e:
logging.error(e)
tasks = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for task in tasks:
count=count+1
a=task.desc
#print(a)
print(count)
python-3.x
azure-table-storage python-3.x
azure-table-storage asked Nov 29 '18 at 6:22
vinothvinoth
10016
asked Nov 29 '18 at 6:22
vinothvinoth
10016
asked Nov 29 '18 at 6:22
vinothvinoth
10016
asked Nov 29 '18 at 6:22
vinothvinoth
10016
asked Nov 29 '18 at 6:22
vinothvinoth
10016
10016
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Update:
Even if I just use this line of code:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
and all of the rows in my table can be fetched(more than 10000 rows).
Use the code below:
from azure.cosmosdb.table.tableservice import TableService
from azure.cosmosdb.table.models import Entity
table_service = TableService(account_name='your account',account_key='your key')
table='tasktable'
now2='03042018'
count=0
next_pk=None
next_rk = None
while True:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for entity in entities:
count=count+1
if hasattr(entities, 'x_ms_continuation'):
x_ms_continuation = getattr(entities, 'x_ms_continuation')
next_pk = x_ms_continuation['nextpartitionkey']
next_rk = x_ms_continuation['nextrowkey']
else:
break
print(count)
Test result as below:
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53532966%2fnot-able-to-get-more-than-1000-rows-from-azure-storage-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Update:
Even if I just use this line of code:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
and all of the rows in my table can be fetched(more than 10000 rows).
Use the code below:
from azure.cosmosdb.table.tableservice import TableService
from azure.cosmosdb.table.models import Entity
table_service = TableService(account_name='your account',account_key='your key')
table='tasktable'
now2='03042018'
count=0
next_pk=None
next_rk = None
while True:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for entity in entities:
count=count+1
if hasattr(entities, 'x_ms_continuation'):
x_ms_continuation = getattr(entities, 'x_ms_continuation')
next_pk = x_ms_continuation['nextpartitionkey']
next_rk = x_ms_continuation['nextrowkey']
else:
break
print(count)
Test result as below:
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
add a comment |
Update:
Even if I just use this line of code:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
and all of the rows in my table can be fetched(more than 10000 rows).
Use the code below:
from azure.cosmosdb.table.tableservice import TableService
from azure.cosmosdb.table.models import Entity
table_service = TableService(account_name='your account',account_key='your key')
table='tasktable'
now2='03042018'
count=0
next_pk=None
next_rk = None
while True:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for entity in entities:
count=count+1
if hasattr(entities, 'x_ms_continuation'):
x_ms_continuation = getattr(entities, 'x_ms_continuation')
next_pk = x_ms_continuation['nextpartitionkey']
next_rk = x_ms_continuation['nextrowkey']
else:
break
print(count)
Test result as below:
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
add a comment |
Update:
Even if I just use this line of code:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
and all of the rows in my table can be fetched(more than 10000 rows).
Use the code below:
from azure.cosmosdb.table.tableservice import TableService
from azure.cosmosdb.table.models import Entity
table_service = TableService(account_name='your account',account_key='your key')
table='tasktable'
now2='03042018'
count=0
next_pk=None
next_rk = None
while True:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for entity in entities:
count=count+1
if hasattr(entities, 'x_ms_continuation'):
x_ms_continuation = getattr(entities, 'x_ms_continuation')
next_pk = x_ms_continuation['nextpartitionkey']
next_rk = x_ms_continuation['nextrowkey']
else:
break
print(count)
Test result as below:
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
Update:
Even if I just use this line of code:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
and all of the rows in my table can be fetched(more than 10000 rows).
Use the code below:
from azure.cosmosdb.table.tableservice import TableService
from azure.cosmosdb.table.models import Entity
table_service = TableService(account_name='your account',account_key='your key')
table='tasktable'
now2='03042018'
count=0
next_pk=None
next_rk = None
while True:
entities = table_service.query_entities(table,filter='PartitionKey eq '' + now2 + ''')
for entity in entities:
count=count+1
if hasattr(entities, 'x_ms_continuation'):
x_ms_continuation = getattr(entities, 'x_ms_continuation')
next_pk = x_ms_continuation['nextpartitionkey']
next_rk = x_ms_continuation['nextrowkey']
else:
break
print(count)
Test result as below:
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
edited Nov 29 '18 at 9:56
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
answered Nov 29 '18 at 8:24
Ivan YangIvan Yang
4,319128
4,319128
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53532966%2fnot-able-to-get-more-than-1000-rows-from-azure-storage-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
