Commit Graph
44 Commits
Author SHA1 Message Date
费政聪andGitHub f99a01fa96 dense to moe convert 2024-08-27 11:23:35 +08:00
费政聪andGitHub 8c16f12fb4 Update README.md 2024-08-18 06:22:41 -05:00
费政聪andGitHub 547a0961c8 debug 2024-08-15 16:40:37 +08:00
费政聪andGitHub 1818c20b33 Update train_deepspeed.py 2024-08-15 02:56:08 -05:00
费政聪andGitHub c8c7791a1f accumulation debug 2024-08-15 15:04:49 +08:00
费政聪andGitHub 6364106241 rf updation 2024-08-14 15:37:28 +08:00
费政聪andGitHub 5d9775735d debug 2024-08-14 14:22:50 +08:00
费政聪andGitHub 936fb27b55 Update README.md 2024-08-13 20:48:44 -05:00
费政聪andGitHub 784abf3d6a support rectified flow 2024-08-14 09:43:18 +08:00
费政聪andGitHub dc3ac87854 save ckpts unify
we can save ckpts using deepspeed save
2024-07-26 17:39:19 +08:00
费政聪andGitHub 5fbdafe2ca optimize zero3 training and inference 2024-07-25 11:40:52 +08:00
费政聪andGitHub ebe2b1a28a Update README.md 2024-07-23 01:20:22 -05:00
费政聪andGitHub fd2ba56582 clean code 2024-07-22 14:36:33 +08:00
费政聪andGitHub f3145e451f clean code
1.support fp16 inference 
2.check dtype for moe infer
2024-07-21 10:51:56 +08:00
费政聪andGitHub e73bc9962d Update README.md 2024-07-20 21:50:47 -05:00
费政聪andGitHub cdef0f2a17 Update README.md 2024-07-19 03:33:08 -05:00
费政聪andGitHub 25d30be5e1 Update README.md 2024-07-19 03:32:01 -05:00
费政聪andGitHub 68a54f4ed8 Update README.md 2024-07-19 03:22:07 -05:00
费政聪andGitHub 85a8d79e2b Update README.md 2024-07-19 03:21:25 -05:00
费政聪andGitHub da52f30b64 Update README.md 2024-07-19 03:17:48 -05:00
费政聪andGitHub f0874b4b8e add flash attention, deepspeed 2024-07-19 16:10:36 +08:00
费政聪andGitHub 137cc19666 Update README.md 2024-07-18 01:41:59 -05:00
费政聪andGitHub dc763caed1 Update README.md 2024-07-18 01:24:05 -05:00
费政聪andGitHub 809e635b3d Update README.md 2024-07-18 01:20:54 -05:00
费政聪andGitHub 85136ff419 Add files via upload 2024-07-18 14:20:29 +08:00
费政聪andGitHub d2a932ab0b Update README.md 2024-07-18 01:19:07 -05:00
费政聪andGitHub 96b890a3f3 Delete sample_ddp.py 2024-07-18 01:09:05 -05:00
费政聪andGitHub 57aab130bf clean code 2024-07-18 14:08:19 +08:00
费政聪andGitHub 416ce5a329 Update README.md 2024-07-17 02:22:45 -05:00
费政聪andGitHub 8b163d0155 Update README.md 2024-07-17 02:22:29 -05:00
费政聪andGitHub bd91902fdd Update README.md 2024-07-16 20:30:26 -05:00
费政聪andGitHub d736605e51 Update README.md 2024-07-16 20:30:09 -05:00
费政聪andGitHub 42563d3467 Update README.md 2024-07-16 20:17:12 -05:00
费政聪andGitHub fc07d0fa3a Update README.md 2024-07-16 05:29:42 -05:00
费政聪andGitHub c339c7f97c Update README.md 2024-07-16 05:25:05 -05:00
费政聪andGitHub 09da9d842e add image 2024-07-16 18:24:42 +08:00
费政聪andGitHub 611239d92a Update README.md 2024-07-16 05:19:54 -05:00
费政聪andGitHub 9965a54a29 Update README.md 2024-07-16 03:44:32 -05:00
费政聪andGitHub e662619608 basic code 2024-07-16 16:33:03 +08:00
费政聪andGitHub cd058f2c37 Update README.md 2024-07-16 03:05:12 -05:00
费政聪andGitHub 973d486530 clean code 2024-07-16 03:04:55 -05:00
费政聪andGitHub 1c216fc04a basic frame 2024-07-01 11:35:48 +08:00
费政聪andGitHub 0c01661a8d Update README.md 2024-06-25 03:28:25 -05:00
费政聪andGitHub e1088c1dc3 Initial commit 2024-06-25 03:27:55 -05:00