Azure Data Explorer partitioning policy

0 votes
If I have a column with 100,000 cardinality. Shouldn't the maximum number of partitions be 100,000? Isn't it true that ADX should construct a partition for each different value in the column? Why is it even necessary to fill out the MaxPartitionCount property?
Mar 23 in Azure by Edureka
• 10,880 points
96 views

1 answer to this question.

0 votes
The end objective isn't to have a different partition for each individual value of the partition key in suggested cases (described in the doc you linked to).

Having a large number of partitions (100k in your case, or billions in the event of a unique device ID) can result in a large number of little data shards, which isn't ideal.

Even with "only" 128 partitions as the maximum, and default built-in indexing (regardless of explicit data partitioning), the ability to narrow the full data set down to a small number of partitions/shards at query planning time can result in significant resource utilisation and execution time savings.
answered Mar 25 by Edureka
• 12,390 points

Related Questions In Azure

0 votes
1 answer

Unzip gzip files in Azure Data factory

How to unzip a GZIP file? here's ...READ MORE

answered Mar 24 in Azure by Edureka
• 10,880 points
263 views
0 votes
1 answer
+1 vote
2 answers
0 votes
1 answer

What OS is Jenkins installed on Azure Virtual Machine?

Under Managed Jenkins there's a section called ...READ MORE

answered Apr 4, 2018 in DevOps & Agile by DareDev
• 6,890 points
294 views
+1 vote
4 answers

Where to find the Microsoft.IdentityModel dll?

I finally found this Nuget package: https://www.nuget.org/packages/Microsoft.SharePointOnline.CSOM, which ...READ MORE

answered Oct 23, 2018 in Azure by Trisha
5,532 views
+1 vote
4 answers

How do Connect to Azure website via FTP?

First set up your FTP credentials are ...READ MORE

answered Oct 23, 2018 in Azure by abc
2,598 views
0 votes
1 answer

Azure Data Studio - Why Is Restore Option Missing Entirely?

The SERVERS sidebar allows you to access ...READ MORE

answered Mar 2 in Azure by Edureka
• 12,390 points
364 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP