Paper: https://arxiv.org/abs/2405.07987 Code: https://github.com/minyoungg/platonic-rep/ Project page: https://phillipi.github.io/prh/ Abstract: We argue that representations in AI models, particularly deep networks, are converging. First, we survey many examples of convergence in the literature: over time and across multiple domains, the ways by which...

arxiv: https://arxiv.org/pdf/2405.07987 Project page: https://phillipi.github.io/prh/ github: https://github.com/minyoungg/platonic-rep/ Interesting positional paper on the convergence of self-supervised, multi-modal representation learning. submitted by /u/dan994 [link] [comments]

I had posted on reddit to help me get a model zoo. I think instance segmentation doesn't have good model zoo. Apparently finding even single model good repo for instance segmentation is a hassle. Currently I am looking for single model github repos for instance segmentation. I searched a lot, but didn't succeed yet. (It doesn't need to be a model zoo....

Hello everyone, I am attempting to train a hybrid Resnet18 encoder-6 layer 520 dmodel Transformer decoder to do full page handwriting recognition and I am struggling to properly train it. The main issues/questions I am stuck at are: I have a dataset that has around 6000 samples of pages of handwriting distributed 80% training/20% validation, how would...

I'm trying to extract past key, value pair using attention_layers and hidden_state for a particular layer import torch import torch.nn.functional as F from transformers import LlamaConfig from transformers import LlamaModel, LlamaTokenizer, LlamaForCausalLM tokenizer = LlamaTokenizer.from_pretrained(path_to_llama2) # Load the configuration and enable...

Hi everyone, I am looking for any video analysis tools that I can use for the following usecase: I have screen recordings of candidates during interviews. I would like to detect if the user has switched from the interview test tab to a different tab/application frequently. I know that there are browser APIs to detect tab switching but users can still...