Entrelangues le 28 octobre 2025 à 15:20

2025-10-28T15:20:50Z

← Version précédente		Version du 28 octobre 2025 à 17:20
Ligne 2 :		Ligne 2 :


	'''Abstract''':		'''Abstract''' :
	"We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method built upon product quantization to store word embeddings. While the original technique leads to a loss in accuracy, we adapt this method to circumvent quantization artefacts. Our experiments carried out on several benchmarks show that our approach typically requires two orders of magnitude less memory than fastText while being only slightly inferior with respect to accuracy. As a result, it outperforms the state of the art by a good margin in terms of the compromise between memory usage and accuracy."		"We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method built upon product quantization to store word embeddings. While the original technique leads to a loss in accuracy, we adapt this method to circumvent quantization artefacts. Our experiments carried out on several benchmarks show that our approach typically requires two orders of magnitude less memory than fastText while being only slightly inferior with respect to accuracy. As a result, it outperforms the state of the art by a good margin in terms of the compromise between memory usage and accuracy."


	[[Category:TAL\|Categories]]		[[Category:TAL\|Categories]]

Entrelangues : Page créée avec « * Joulin, Armand, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, Tomas Mikolov. 2016. ''Compressing text classification models'', [https://arxiv.org/abs/1612.03651 texte]. '''Abstract''': "We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method built upon produ... »

2023-11-30T10:01:09Z

Page créée avec « * Joulin, Armand, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, Tomas Mikolov. 2016. ''Compressing text classification models'', [https://arxiv.org/abs/1612.03651 texte]. '''Abstract''': "We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method built upon produ... »

Nouvelle page

* Joulin, Armand, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, Tomas Mikolov. 2016. ''Compressing text classification models'', [https://arxiv.org/abs/1612.03651 texte].

'''Abstract''':
"We consider the problem of producing compact architectures for text classification, such that the full model fits in a limited amount of memory. After considering different solutions inspired by the hashing literature, we propose a method built upon product quantization to store word embeddings. While the original technique leads to a loss in accuracy, we adapt this method to circumvent quantization artefacts. Our experiments carried out on several benchmarks show that our approach typically requires two orders of magnitude less memory than fastText while being only slightly inferior with respect to accuracy. As a result, it outperforms the state of the art by a good margin in terms of the compromise between memory usage and accuracy."

[[Category:TAL|Categories]]

Joulin et al. (2016b) - Historique des versions

Entrelangues le 28 octobre 2025 à 15:20