Create README.md

README.md

@@ -0,0 +1,21 @@
+---
+tags:
+- biology
+- DNA
+- genomics
+---
+This is the official pre-trained model introduced in [GROVER : A foundation DNA language with optimized vocabulary learns sequence context in the human genome](https://www.biorxiv.org/content/10.1101/2023.07.19.549677v2)
+
+
+
+    from transformers import AutoTokenizer, AutoModelForMaskedLM
+    import torch
+
+    # Import the tokenizer and the model
+    tokenizer = AutoTokenizer.from_pretrained("PoetschLab/GROVER")
+    model = AutoModelForMaskedLM.from_pretrained("PoetschLab/GROVER")
+
+
+Some preliminary analysis shows that sequence re-tokenization using Byte Pair Encoding (BPE) changes significantly if the sequence is less than 50 nucleotides long. Longer than 50 nucleotides, you should still be careful with sequence edges.
+We advice to add 100 nucleotides at the beginning and end of every sequence in order to garantee that your sequence is represented with the same tokens as the original tokenization.
+We also provide the tokenized chromosomes with their respective nucleotide mappers (They are available in the folder tokenized chromosomes).