Computing frequency distribution for many fields in one pass in parallel

摘要: Provided are a techniques for determining frequency distribution set of records. A count table distributions is built in memory each field the records, wherein record includes identifier, value, and number times value occurs identifier concatenated with comprises composite key value. It determined that at least one approaching maximum amount allocated to table. The records sent sorting additional counting, include values.