1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70
| class Cosmos3IMSConfig: """ Cosmos 3 在 IMS 数据合成中的能力映射 关键优势: 1. 文本→视频:直接生成驾驶场景视频 2. 物理推理:理解驾驶员-座椅-方向盘空间关系 3. 声音生成:合成车内环境声(引擎、风噪、对话) 4. 动作轨迹:生成驾驶员头部/手部运动轨迹 5. 多视角一致性:多摄像头同步生成 """ MODELS = { "Super": { "参数量": "大(未公开具体数字)", "精度": "最高物理准确性", "速度": "较慢", "用途": "训练数据生成、精细场景合成", "部署": "云端/DGX" }, "Nano": { "参数量": "小", "精度": "高质量", "速度": "亚秒级生成", "用途": "快速原型、迭代验证", "部署": "云端/本地GPU" }, "Edge": { "参数量": "最小(量化)", "精度": "良好", "速度": "实时推理", "用途": "车载实时推理(未来)", "部署": "QCS8255/Orin" } } SCENE_TEMPLATES = { "fatigue_normal": { "prompt": "Driver yawning, eyes closing slowly, head nodding forward, daytime highway driving, frontal camera view", "modalities": ["video", "depth", "segmentation", "sound"], "labels": ["PERCLOS>30%", "yawning", "head_nod"], "duration_sec": 30, }, "distraction_phone": { "prompt": "Driver looking down at phone, typing, eyes off road for 3 seconds, urban driving, IR camera view", "modalities": ["video", "depth", "segmentation", "action_trajectory"], "labels": ["gaze_off_road>3s", "phone_use", "manual_distraction"], "duration_sec": 10, }, "oop_forward_lean": { "prompt": "Passenger leaning forward excessively, torso angle >30 degrees, hands reaching to dashboard, side camera view", "modalities": ["video", "depth", "segmentation", "skeleton"], "labels": ["OOP-01", "forward_lean", "torso_angle>30"], "duration_sec": 15, }, "cpd_child_rear": { "prompt": "Child left alone in rear seat, irregular breathing, lying on seat, rear camera with depth sensing", "modalities": ["video", "depth", "radar_simulation"], "labels": ["CPD", "child_detected", "irregular_posture"], "duration_sec": 60, }, "alcohol_impaired": { "prompt": "Driver with flushed face, drooping eyelids, delayed blink response, erratic steering movements, nighttime driving", "modalities": ["video", "depth", "sound", "action_trajectory"], "labels": ["BAC>0.08", "facial_flush", "ptosis", "erratic_steering"], "duration_sec": 30, }, }
|