Tag: network-architecture-search

• Scaling Vision Transformers (23 Sep 2023)
  

  This is my reading note for Scaling Vision Transformers. This paper provides a detailed comparison and study of designing vision transformer.

• Neural Architecture Search A Survey (30 May 2019)
  

  Deep Learning has enabled remarkable progress over the last years on a variety of tasks, such as image recognition, speech recognition, and machine translation. One crucial aspect for this progress are novel neural architectures. Currently employed architectures have mostly been developed manually by human experts, which is a time-consuming and error-prone process. Because of this, there is growing interest in automated neural architecture search methods. We provide an overview of existing work in this field of research and categorize them according to three dimensions: search space, search strategy, and performance estimation strategy.