Month: March 2023
-
Autoregressive Models, OOD Prompts and the Interpolation Regime
[ad_1] March 30, 2023 A few years ago I was very much into maximum likelihood-based generative modeling and autoregressive models (see this, this or this). More recently, my focus shifted to characterising inductive biases of gradient-based optimization focussing mostly on supervised learning. I only very recently started combining the two ideas, revisiting autoregressive models throuh…
-
The Illustrated Retrieval Transformer – Jay Alammar – Visualizing machine learning one concept at a time.
[ad_1] Discussion: Discussion Thread for comments, corrections, or any feedback. Translations: Korean, Russian Summary: The latest batch of language models can be much smaller yet achieve GPT-3 like performance by being able to query a database or search the web for information. A key indication is that building larger and larger models is not the…
-
[2309.07133] Using wearable device-based machine learning models to autonomously identify older adults with poor cognition
[ad_1] arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to…