https://github.com/tloen/llama-int8
https://github.com/facebookresearch/llama/issues/79#issuecomment-1454687232
This is a fork of the LLaMA code that runs LLaMA-13B comfortably within 24 GiB of RAM
https://github.com/go-noah/llama
LLaMA 7B example
| 번호 | 분류 | 제목 | 글쓴이 | 날짜 | 조회 수 |
|---|---|---|---|---|---|
| 공지 | Tool/etc | Programming 게시판 관련 2 | MoA | 2014.11.01 | 2475 |
| 21 | Deeplearning | Using Machine Learning to Predict Customers’ Next Purchase Day | OBG | 2024.02.27 | 72 |
| 20 | Deeplearning | [ifkakao] 추천 시스템: 맥락과 취향 사이 줄타 | OBG | 2024.01.10 | 72 |
| 19 | Deeplearning | [한빛미디어] 머신러닝·딥러닝 도서 선택 가이드 | OBG | 2023.06.11 | 103 |
| 18 | Deeplearning | 마이크로소프트가 공개한 무료 AI 코스들 | OBG | 2023.11.28 | 104 |
| 17 | Deeplearning | PyTorch 딥러닝 챗봇 | OBG | 2023.07.04 | 105 |
| 16 | Deeplearning | LSTM-AE를 이용한 시퀀스 데이터 이상 탐지 | OBG | 2023.08.14 | 108 |
| » | Deeplearning | LLaMA: INT8 edition | OBG | 2023.03.09 | 113 |
| 14 | Deeplearning | Top 3 most used Pytorch Ecosystem Libraries you should Know about | OBG | 2023.08.02 | 113 |
| 13 | Deeplearning | 내 마음대로 선정한 머신러닝/딥러닝 학습 추천 서적 | OBG | 2023.08.14 | 124 |
| 12 | Deeplearning | 시계열 데이터 예측 모델 | OBG | 2022.11.08 | 135 |
| 11 | Deeplearning | Play Super Mario Bros with a Double Deep Q-Network | OBG | 2022.09.15 | 140 |
| 10 | Deeplearning | 파이썬 머신러닝 무료 강의 (7시간) | OBG | 2022.07.06 | 142 |
| 9 | Deeplearning | Reinforcement Learning for Dynamic Pricing Suggestion | OBG | 2023.04.01 | 153 |
| 8 | Deeplearning | 추천 시스템 | OBG | 2023.03.30 | 157 |
| 7 | Deeplearning | Keras를 활용한 주식 가격 예측 | OBG | 2022.09.02 | 161 |
| 6 | Deeplearning | The State of AI & Art 2022 1 | OBG | 2022.10.06 | 167 |
| 5 | Deeplearning | Stable Diffusion | OBG | 2022.09.27 | 172 |
| 4 | Deeplearning | 강화학습 학습 관련 정리 | OBG | 2022.08.10 | 174 |
| 3 | Deeplearning | RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED ... | OBG | 2022.09.06 | 211 |
| 2 | Deeplearning | 추천(Recommendation) 시스템 - 알고리즘 Trend 정리 | OBG | 2021.08.03 | 232 |