Finetuning models on posts and responses on the /r/AskNYC subreddit
Nick Doiron
monsoon-nlp
AI & ML interests
biology and multilingual models
Recent Activity
reacted to pankajpandey-dev's post with š„ 4 days ago
š®š³ Qwen3-4B Hindi Instruct v2 ā a Hindi LLM that runs on your own machine
Most strong Hindi-capable models are either huge or cloud-only. I wanted one that's small enough to run locally but actually follows instructions in Hindi ā so I fine-tuned Qwen3-4B on 10K Hindi instruction pairs and shipped it with a full GGUF quant ladder.
ā
Fine-tune (16-bit): huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2
ā
GGUF (Q4/Q5/Q8): huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2-GGUF
Runs in Ollama, llama.cpp, and LM Studio. The Q4_K_M is just 2.5 GB ā fits comfortably on a laptop, CPU or GPU.
Part of my Hindi LLM Series ā building openly-licensed Indic models for local and edge use. More coming (Gemma next). Feedback welcome š
#Hindi #IndicNLP #GGUF #LocalLLM #Qwen
liked a model 5 days ago
biohub/ESMC-6B liked a model 5 days ago
biohub/ESMFold2Organizations
Models and datasets relevant to genetic counselors
During a wave of monolingual models, trained these to compete with mBERT
Embeddings and NLG related to biology / amino acid sequences
-
monsoon-nlp/codellama-abliterated
Text Generation ā¢ 7B ā¢ Updated ā¢ 4 ā¢ 1 -
monsoon-nlp/codellama-abliterated-2xd
Text Generation ā¢ 7B ā¢ Updated ā¢ 6 -
Refusal in Language Models Is Mediated by a Single Direction
Paper ā¢ 2406.11717 ā¢ Published ā¢ 13 -
Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
Paper ā¢ 2502.17424 ā¢ Published ā¢ 4
Finetuning models on posts and responses on the /r/AskNYC subreddit
Embeddings and NLG related to biology / amino acid sequences
Models and datasets relevant to genetic counselors
-
monsoon-nlp/codellama-abliterated
Text Generation ā¢ 7B ā¢ Updated ā¢ 4 ā¢ 1 -
monsoon-nlp/codellama-abliterated-2xd
Text Generation ā¢ 7B ā¢ Updated ā¢ 6 -
Refusal in Language Models Is Mediated by a Single Direction
Paper ā¢ 2406.11717 ā¢ Published ā¢ 13 -
Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
Paper ā¢ 2502.17424 ā¢ Published ā¢ 4
During a wave of monolingual models, trained these to compete with mBERT