Tag: cm3leon

• Jointly Training Large Autoregressive Multimodal Models (28 Jul 2023)
  

  This is my reading note for Jointly Training Large Autoregressive Multimodal Models. This paper proposes a multimodality model for generating images. The paper is not just dilution based method but instead auto regressive method.it argues to initialize the model from the weight of frozen models.

• Scaling Laws for Generative Mixed-Modal Language Models (22 Jun 2023)
  

  This is my reading note for Scaling Laws for Generative Mixed-Modal Language Models. This paper provides a study of scaling raw on dataset size and model size in multimodality settings.