Autoregressive Local Attention - Flax module for Jax
$ pip install local-attention-flax
from jax import random
from local_attention_flax import LocalAttention
attn = LocalAttention(
dim = 256,
dim_head = 64,
heads = 8,
window_size = 128
)
key = random.PRNGKey(0)
x = random.normal(key, (512, 256))
params = attn.init(key, x)
out = attn.apply(params, x) # (512, 256)
cloob-training Pretrained models There are two pretrained CLOOB models in this repo at the moment, a 16 epoch and a 32 epoch ViT-B/16 checkpoint train
HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re
LESA Introduction This repository contains the official implementation of Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Cont
PyTorch实现多种计算机视觉中网络设计中用到的Attention机制，还收集了一些即插即用模块。由于能力有限精力有限，可能很多模块并没有包括进来，有任何的建议或者改进，可以提交issue或者进行PR。
Invariant Point Attention - Pytorch Implementation of Invariant Point Attention as a standalone module, which was used in the structure module of Alph
RoBERTa base model for Marathi Language (मराठी भाषा) Pretrained model on Marathi language using a masked language modeling (MLM) objective. RoBERTa wa
Memory Efficient Attention This is unofficial implementation of Self-attention Does Not Need O(n^2) Memory for Jax and PyTorch. Implementation is almo
Treex A Pytree-based Module system for Deep Learning in JAX Intuitive: Modules are simple Python objects that respect Object-Oriented semantics and sh
Adjacent Attention Network An implementation of a simple transformer that is equivalent to graph neural network where the message passing is done with
Overview 架构设计 插件介绍 安装使用 框架简介 方便使用，支持多模态，多任务的统一训练框架 能力列表： bert + 分类任务 自定义任务训练（插件注册） 框架设计 框架采用分层的思想组织模型训练流程。 DATA 层负责读取用户数据，根据 field 管理数据。 Parser 层负责转换原
Autoformer (NeurIPS 2021) Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Time series forecasting is a c
PiCO: Contrastive Label Disambiguation for Partial Label Learning This is a PyTorch implementation of ICLR 2022 paper PiCO: Contrastive Label Disambig
Expert Finding in Legal Community Question Answering Arian Askari, Suzan Verberne, and Gabriella Pasi. Expert Finding in Legal Community Question Answ
Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods Introduction Graph Neural Networks (GNNs) have demonstrated
Pydantic models for pywttr and aiopywttr.
Recurrent Model-Free RL is a Strong Baseline for Many POMDPs Welcome to the POMDP world! This repo provides some simple baselines for POMDPs, specific
CoG-BART Contrast and Generation Make BART a Good Dialogue Emotion Recognizer Quick Start: To run the model on test sets of four datasets, Download th
AntiFuzz: Impeding Fuzzing Audits of Binary Executables Get the paper here: https://www.usenix.org/system/files/sec19-guler.pdf Usage: The python scri
ReFine: Multi-Grained Explainability for GNNs We are trying hard to update the code, but it may take a while to complete due to our tight schedule rec
Articulation-Aware Canonical Surface Mapping Nilesh Kulkarni, Abhinav Gupta, David F. Fouhey, Shubham Tulsiani Paper Project Page Requirements Python
Ratio Image Based Rendering for Deep Single-Image Portrait Relighting [Project Page] This is part of the Deep Portrait Relighting project. If you find
LightSeq: A High Performance Library for Sequence Processing and Generation
Introduction QRec is a Python framework for recommender systems (Supported by Python 3.7.4 and Tensorflow 1.14+) in which a number of influential and
This codebase supports using language models (LMs) for true few-shot learning: learning to perform a task using a limited number of examples from a single task distribution.
FRS Face_recognize_system This project contains my work that target on solving some problems of FRS: Face detection: Retinaface Face anti-spoofing: Fo
Encoding Causal Macrovariables Data Natural climate data ('El Nino') Self-generated data ('Simulated') Experiments Detecting macrovariables through th
OPFython: A Python-Inspired Optimum-Path Forest Classifier Welcome to OPFython. Note that this implementation relies purely on the standard LibOPF. Th
Earth Observation Companies & Jobs source Portals & Jobs Geospatial Geospatial jobs newsletter: ~biweekly newsletter with geospatial jobs by Ali Ahmad
Minimal code and simple experiments to play with Denoising Diffusion Probabilist
64 Nov 27, 2022
189 Nov 22, 2022
20 Dec 31, 2021
599 Dec 23, 2022
23 Oct 19, 2022
126 Dec 27, 2022
216 Dec 20, 2022
265 Dec 22, 2022
847 Jan 08, 2023
147 Jan 07, 2023
3 Oct 31, 2022
37 Dec 15, 2022
2 Dec 08, 2022
172 Dec 29, 2022
39 Dec 24, 2022
88 Dec 21, 2022
47 Dec 16, 2022
56 Dec 16, 2022
62 Dec 21, 2022
2.5k Jan 06, 2023
1.4k Dec 30, 2022
124 Jan 04, 2023
4 Nov 18, 2021
3 Jul 31, 2022
30 Jan 04, 2023
64 Dec 27, 2022
16 Oct 06, 2022