Commit Graph

16 Commits

Author SHA1 Message Date
Zchen
e399cf262a ff 2025-10-20 13:37:11 +08:00
Zchen
06ddbc6ac2 Refactor input function to implement batch-first approach with dynamic padding and apply data augmentation post-batching for TPU compatibility 2025-10-20 00:58:29 +08:00
Zchen
fabf70cfa9 Enhance dataset shape analysis by implementing parallel processing and improving sampling logic 2025-10-20 00:35:17 +08:00
Zchen
6e02894a8a f 2025-10-20 00:13:39 +08:00
Zchen
4db3625dc5 f 2025-10-19 23:55:56 +08:00
Zchen
4b373ab317 ff 2025-10-19 20:16:23 +08:00
Zchen
40d0fc50de f 2025-10-19 13:18:20 +08:00
Zchen
4328114ed6 Add dataset shape analysis function and integrate into input function for TPU optimization 2025-10-19 11:04:36 +08:00
Zchen
cfd9653da9 Enhance dataset caching logic for training and validation sets with improved messaging 2025-10-19 10:31:31 +08:00
Zchen
558be0ad98 Refactor individual dataset creation for improved I/O efficiency and add logging for error handling 2025-10-19 10:31:18 +08:00
Zchen
d83f990beb f 2025-10-17 12:20:17 +08:00
Zchen
c2661550ef 内存泄漏修复 2025-10-16 20:26:32 +08:00
Zchen
be578f2e1d 修复数据加载器低效问题 2025-10-16 17:14:06 +08:00
Zchen
0ff6634192 简单修复 2025-10-16 10:53:42 +08:00
Zchen
e8f0308fef tpu 2025-10-15 20:45:25 +08:00
Zchen
7965f7dbfe TPU 2025-10-15 16:55:52 +08:00