Active parameters is 86B, so wouldn't that be the size of the largest two expert...

		cma on March 17, 2024 \| parent \| context \| favorite \| on: Grok Active parameters is 86B, so wouldn't that be the size of the largest two experts (where they may all be the same) + the weights of the selector?