Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
43314444e9 | ||
|
|
4854da8518 | ||
|
|
15ea776b82 | ||
|
|
03d609cc1f |
+73
-13
@@ -40,8 +40,9 @@ LTC2980 margin 控制器。TTL 只負責「按順序 `sendln` 並把畫面收進
|
||||
| BMC 存取 | host 端 `bmc-manager run "<cmd>"`(不需對 BMC 開 SSH,繞開其 busybox 工具鏈);`bmc-first-enroll` / `bmc-manager version\|status` |
|
||||
| 背景工作管理 | `bgctl run/list/stop --all/reset`(平台工具);長時間 ping 用 `systemd-run --unit=` 掛成 transient unit |
|
||||
| 管理網路 | iproute2(`ip link set` / `ip address replace` / `ip route replace ... metric`)+ `ping -I` |
|
||||
| 測試 session | `hw-test-session start\|log\|status\|finish`;job log 收在 `/host/hw-eval/current/jobs/` |
|
||||
| 測試 session | `hw-test-session start\|log\|status\|finish`;job log 收在 `/host/hw-eval/jobs/` |
|
||||
| 風扇控制 | max31790 driver rebind(`/sys/bus/i2c/drivers/max31790/{bind,unbind}`)+ `fan-speed-control.sh <%>` |
|
||||
| 100G PRBS | `bcmcmd -n <unit> -c 'dsh -c "phy diag <phy> prbs …"'`(set / prbsstat STArt / get / Ber / STOp / clear) |
|
||||
| 壓力測試 | `mlucas-avx2`(AMD CPU)、`bgctl run` 排程的 `memtester` / `qfx5252-stress-ssd` / `qfx5252-stress-usb` |
|
||||
| 資料面流量 | `bcmcmd`(Broadcom drivshell)VLAN loopback + `tx` burst,switch unit 0 / 1 |
|
||||
| 流量報表 | DUT 上 awk(`blanton_traffic_linespeed report`);離線 `python3 tools/bcm_mibpair_report_V1.1.0.py` |
|
||||
@@ -119,6 +120,7 @@ Blanton_TTL_Script/
|
||||
│ ├── Blantons_FPGA_Registers_draft.docx # 同上,客戶原始 docx
|
||||
│ ├── Blantons_FPGA_Registers_Map_draft.xlsx
|
||||
│ ├── Blantons_PCIe_AER_and_DDR_EDAC_checks.pdf # AER / EDAC 檢查點依據
|
||||
│ ├── LTC2980_channel_map.csv # 9 個 settings/*.conf 合併:Board,CONN,Ch,NetName,Vnom(144 列)
|
||||
│ ├── TTL_Script_Blanton_Status_20260814.xlsx
|
||||
│ └── TTL_Script_Blanton_Status_20260817.xlsx # ⭐ 最新:三支腳本逐項 Status(OK / On-Going + Owner)
|
||||
│
|
||||
@@ -126,9 +128,13 @@ Blanton_TTL_Script/
|
||||
│ ├── bcm_mibpair_report_V1.1.0.py # 離線解析 drivshell log → per-pair TX/RX + PASS/FAIL
|
||||
│ ├── traffic_loopback_vlan_setting.txt # bcmcmd VLAN 30..137 建立 + 成對 pbm(cdN <-> cdN+32)
|
||||
│ ├── traffic_loopback_start.txt # bcmcmd tx 100 length=512 VLantag=<vid>
|
||||
│ └── traffic_loopback_vlan_remove.txt # bcmcmd vlan remove <vid> pbm=...
|
||||
│ # ↑ 三份為手動貼上用的原始指令表,
|
||||
│ # blanton_traffic_linespeed.sh 是其 bash 版
|
||||
│ ├── traffic_loopback_vlan_remove.txt # bcmcmd vlan remove <vid> pbm=...
|
||||
│ │ # ↑ 三份為手動貼上用的原始指令表,
|
||||
│ │ # blanton_traffic_linespeed.sh 是其 bash 版
|
||||
│ ├── 100G_PRBS.txt # 100G PRBS 原始指令(port_prbs_monitor.sh 的來源)
|
||||
│ ├── TR518.txt # 內建封包測試 tr 518(Scenario=6 Profile=2)— 尚未腳本化
|
||||
│ ├── fan_ctrl.txt # MAX31790 unbind/bind + fan-speed-control.sh 30
|
||||
│ └── gen_channel_map.sh # settings/*.conf → docs/LTC2980_channel_map.csv(需 gawk)
|
||||
│
|
||||
├── secret/ # 🚫 gitignored — DUT 密碼、per-unit BDF、COM 設定
|
||||
│ ├── README.md # ✅ committed — 用途索引
|
||||
@@ -177,12 +183,16 @@ Blanton_TTL_Script/
|
||||
├── blanton_traffic_linespeed.sh # SWB loopback 線速流量(bcmcmd unit 0/1)
|
||||
│ # init/clear/show/start/stop/ps/report/run
|
||||
├── mgmt_ping_monitor.sh # 10G/1G 管理網路 ping 監控(iproute2)
|
||||
│ # eth0→TARGET_10G、eth1→TARGET_1G,兩張卡都保持 up
|
||||
│ # eth0→TARGET_10G、eth1→TARGET_1G,兩張卡同時持續 ping
|
||||
├── port_prbs_monitor.sh # 100G uplink PRBS 測試(bcmcmd phy diag)
|
||||
│ # ⚠️ 已納入交付,但 A/B/C 的呼叫仍註解掉(bring-up 中)
|
||||
├── usb_target.sh # 偵測 USB 裝置節點/掛載點(排除系統碟)
|
||||
├── bmc_monitor.sh # BMC 監控:free -m + I2C 寫入/讀回圖樣測試
|
||||
├── bmc_monitor_ddr.sh # ⚠️ 已停用:B/C 內呼叫處已註解,DDR 壓力改走 bgctl + bmc-manager
|
||||
│ # ↑ 三支都要 chmod +x 才能跑(見 Key Constraints)
|
||||
└── LTC2980_Margin_Script/ # 電壓 margin 子專案(另有獨立 repo)
|
||||
├── margin.sh # margin_init/status/set/apply_profile/save
|
||||
# # v2.7.0:margin_save all / margin_save blanton
|
||||
├── settings/*.conf # 一個 .conf = 一顆 LTC2980(CB + SWB0/1 × CONN13~16)
|
||||
├── profiles/*.conf # 16-ch 批次組合(comboA/B、high3/5、low3/5、normal、off)
|
||||
├── script/*_all.sh # 跨 9 顆 LTC2980 的批次 status / apply / save
|
||||
@@ -205,7 +215,7 @@ project_name = "Blanton" ; 專案名,進 log 檔名
|
||||
strTestcase = "ENV" ; 測項名(ENV/EMC/Margin...),進 log 檔名
|
||||
EN_Margin = 0 ; 1=跑 margin 掃描, 0=跳過
|
||||
EN_log = 1 ; 1=logopen 存檔, 0=不存
|
||||
FAN_SPEED = 30 ; 傳給 fan-speed-control.sh 的風扇轉速 (%)
|
||||
FAN_SPEED = 100 ; 傳給 fan-speed-control.sh 的風扇轉速 (%),預設全速
|
||||
SWB_UNIT0 = 1 ; 這台有 switch unit 0(流量與 wait_init 都依此)
|
||||
SWB_UNIT1 = 1 ; 這台有 switch unit 1
|
||||
prompt_login = "sonic login:"
|
||||
@@ -242,6 +252,31 @@ Channel 定址:`ch / 8` → `CHIPS[]` index,`ch % 8` → LTC2977 PMBus PAGE
|
||||
> 同一顆 LTC2980 的兩個位址**相差 2**(7-bit,由規格書 8-bit 配對除以 2 而來),不是 1。
|
||||
> 兩張板共用一條通道,所以同通道上的位址必須互斥 —— 上表兩組(`0x5C/0x5E` 與 `0x62/0x64`)不重疊。
|
||||
|
||||
**同一批 LTC2977 也掛在原生 i2c bus 上**(2026-08-27 上機驗證):Blanton 的 SONiC 把 CB FPGA F3
|
||||
的這四條 I2C 通道同時註冊成 kernel i2c adapter,因此除了 `cb_pmbus_*` → pcimem 這條路,
|
||||
還可以用 `i2cset -f -y <bus>` 直接打到同一顆晶片:
|
||||
|
||||
| FPGA F3 通道 | Linux bus | CB FPGA 路徑 | 原生 i2c 路徑 |
|
||||
|---|---|---|---|
|
||||
| Ch6 | 13 | `cb_pmbus_write 6 <addr> …` | `i2cset -f -y 13 <addr> …` |
|
||||
| Ch7 | 14 | `cb_pmbus_write 7 <addr> …` | `i2cset -f -y 14 <addr> …` |
|
||||
| Ch8 | 15 | `cb_pmbus_write 8 <addr> …` | `i2cset -f -y 15 <addr> …` |
|
||||
| Ch9 | 16 | `cb_pmbus_write 9 <addr> …` | `i2cset -f -y 16 <addr> …` |
|
||||
|
||||
`margin.sh` 的 `margin_save blanton` 走原生路徑(`MARGIN_BLANTON_STORE` 表),
|
||||
其餘功能仍走 `TRANSPORT="swb"` 的 FPGA 路徑。兩條路到的是同一顆 LTC2977,
|
||||
**不要同時用**(同一條匯流排上兩個 master 語意的存取)。
|
||||
|
||||
**全通道 net / 電壓對照:`docs/LTC2980_channel_map.csv`**(9 個 `.conf` × 16ch = 144 列,
|
||||
欄位 `Board,CONN,Ch,NetName,Vnom`)。查「某個 net 在哪片哪個 channel」比翻 9 個 `.conf` 快。
|
||||
CSV 是產出物,不是正本 —— 改完 `.conf` 用 `./tools/gen_channel_map.sh` 重產,別手改 CSV。
|
||||
兩件從表上看得出來、改 `.conf` 時要記得的事:
|
||||
|
||||
- **SWB0 與 SWB1 的 net / 電壓完全相同**,差別只在 `CHIPS[]` 的 bus(`0:` vs `1:`)與 `CB_I2C_CH`。
|
||||
也就是說有兩份會各自漂移的重複資料 —— 改了 SWB0 沒改 SWB1,不會有任何東西擋你。
|
||||
- **8 個 NC 通道**(SWB0/1 CONN14 的 CH10/CH11/CH13、CONN15 的 CH10)在 CSV 裡以
|
||||
`NC` / `-` 原樣保留,不是漏掉;濾掉它們會讓 page 編號對不上。
|
||||
|
||||
### 3. `profiles/*.conf` — 16-ch 批次 margin 組合
|
||||
|
||||
```bash
|
||||
@@ -311,9 +346,12 @@ PROFILE_CHANNELS=( "0:high:8" "1:low:8" ... ) # "channel:operation:change_perc
|
||||
| **溫度** | `temp_cb` / `temp_icb` / `temp_all` | TMP75(12-bit 左靠齊 ×0.0625)、TMP432(含 RANGE bit 的 −64 偏移、remote1/2) |
|
||||
| **電源資料** | `pwr_data` / `pwr_data_pdb` / `pwr_pdb_id` | SWB VRM 全軌 Vin/Vout/Iout/Temp 對齊表;MP29816 解析度**執行期從 `MFR_VOUT_SCALE_LOOP` 讀**,不寫死 |
|
||||
| **電壓 Margin** | `margin_init/status/set/apply_profile/save` + `*_all.sh` | 9 顆 LTC2980(CB CONN13、SWB0/1 CONN13~16)批次 high/low margin 與狀態掃描。v2.6.0 起 SWB 路徑真正接上共用 cb_i2c 後端,並有 `margin_swb_info/probe/scan/reset/sem` 除錯包裝 |
|
||||
| **Margin 寫 NVM** | `margin_save` / `margin_save all` / `margin_save blanton` | ⚠️ 永久寫入。`0x15` 送 PMBus **send-byte**(不帶 data byte)。`all` = 依 `settings/` 走 9 顆、跑完還原原本載入的板子;`blanton` = 本平台捷徑,18 顆全走原生 i2c bus(`MARGIN_BLANTON_STORE` 表),不需 `margin_init`。每筆之間 `MARGIN_STORE_SETTLE`(0.5s),工具**不 poll busy bit** |
|
||||
| **管理網路 ping** | `mgmt_ping_monitor.sh {start\|stop\|status\|fg\|tail\|clear\|summary}` | 一輪 = 10G leg + 1G leg,各自 `ip address/route replace` 後 `ping -I <if>` 打自己的對端;兩張卡都保持 up。每 leg 記 `ip -s link show` 與該卡的 TX/RX packet delta,另出一行可 grep 的 `RESULT` |
|
||||
| **BMC 監控** | `bmc_monitor.sh {start\|stop\|status\|fg\|tail\|clear}` | 由 host 端 `bmc-manager run` 週期取樣 `free -m`,另加一組 **I2C 寫入/讀回圖樣測試**(bus 1、addr 0x41、offset 0x00C0,寫 `55AA55AA` 讀回、再寫 `AA55AA55` 讀回)。B 啟動、C 停止並 `cat log/bmc_poll.log` |
|
||||
| **BMC DDR 壓力** | `bmc_monitor_ddr.sh` | ⚠️ **已停用** —— B/C 內呼叫處已註解,改由 `bgctl run bmc-manager run memtester` 取代。檔案保留未刪 |
|
||||
| **100G PRBS** | `port_prbs_monitor.sh {start [both\|a\|b]\|stop\|status\|report\|clear}` | 兩個 uplink 各一個 worker,可同時或單獨跑。setup(`lpmode off` → `prbs set` → `prbsstat STArt`)→ 週期 `prbs get`(判定)+ `prbsstat Ber`(只記錄)→ teardown(`STOp` + `prbs clear`)。輸出含 `PRBS OK!` 才算 PASS。**⚠️ A/B/C 的呼叫目前註解掉** |
|
||||
| **USB 目標偵測** | `usb_target.sh [-o dev\|mnt\|both\|id] [-n] [-r sec]` | 找出插入的 USB 儲存裝置,排除 `/` 與 `/host` 的底層碟(本平台可能從 USB DOM 開機),多顆時拒絕猜;掛載時會驗證真的可寫 |
|
||||
| **打包交付** | `publish/publish.sh [-v Ver] [-f] [-z] [-n]` | 版號讀 Script A 檔頭,複製成 `publish/Script_ABC_Blanton_<Ver>/`,排除 `*.log`,可另出 zip |
|
||||
|
||||
---
|
||||
@@ -330,7 +368,7 @@ Script A ── logopen Logs/Blanton_Margin_<ts>.log ──┐ (之後所有畫
|
||||
│ │
|
||||
├─ 登入 admin → sudo -i → root@sonic:~# │
|
||||
├─ date -s "<host 時間>" ← 讓 DUT 時戳可對照
|
||||
├─ rm /host/hw-eval/current/jobs/* ← 清掉上一輪的 job log
|
||||
├─ rm /host/hw-eval/jobs/* ← 清掉上一輪的 job log
|
||||
├─ hw-test-session start / log / status
|
||||
├─ 風扇:max31790 unbind→sleep→bind(18-0020 與 25-0020 各一次)
|
||||
│ → fan-speed-control.sh <FAN_SPEED> → 回答 y 確認 │
|
||||
@@ -374,7 +412,8 @@ Script C
|
||||
├─ nvme smart-log / smartctl -x /dev/nvme0
|
||||
├─ traffic: stop → report ← per-pair TX/RX 交叉比對,PASS/FAIL/NA(exit 2 = 有 FAIL/NA)
|
||||
├─ show reboot-cause / show uptime ← soak 期間有沒有意外重開,一眼看得到
|
||||
├─ cp -r /host/hw-eval/current/jobs/ /mnt/usb/jobs-<YYYYmmdd>_<HHMM>
|
||||
├─ usb_target.sh -o dev → sync → mount <dev> /mnt/usb
|
||||
├─ cp bmc_poll.log / mgmt_ping.log → jobs/,再 cp -r jobs/ /mnt/usb/jobs-<YYYYmmdd>_<HHMM>
|
||||
└─ hw-test-session finish
|
||||
▼
|
||||
[messagebox "GOOD JOB! Test Case DONE"] → 人工檢查 log
|
||||
@@ -413,6 +452,8 @@ pwr_data
|
||||
只吃 Sr;只有純暫存器裝置兩種都行。
|
||||
7. **`margin_save`(`STORE_USER_ALL`)會永久寫進 NVM**,斷電保留。測試流程中**絕不執行**,
|
||||
以免覆蓋客戶出廠 config。`margin.sh` 的 auto-enable 只改 RAM(`ON_OFF_CONFIG`),斷電復原。
|
||||
`margin_save all` / `margin_save blanton`(v2.7.0)一次對 9 顆 LTC2980(18 個 LTC2977)
|
||||
下同一道命令,風險同性質但範圍是全機;命令本身是 PMBus send-byte(`0x15`,不帶 data byte)。
|
||||
8. **操作硬體電壓有損壞 DUT 的風險**:套 profile 前先確認該軌 OV/UV limit 與 servo DAC 注入電阻
|
||||
有 populate(本板部分 margin 電阻標 PROTO,沒 populate 的軌電壓不會動)。
|
||||
9. **`ARB_LOST` 不等於裝置存在**:`vi2c_scan` 只看 `RX_ACK`,仲裁失敗會被誤報成「有裝置」。
|
||||
@@ -461,7 +502,7 @@ pwr_data
|
||||
| **客戶機密文件** | `docs/` 內 FPGA 規格(docx/xlsx/md)屬客戶 NDA 範圍;schematic 原始檔(`*.DSN`)一律 gitignore,不進 repo |
|
||||
| **Remote 限制** | 只推私有 remote:`nas`(`git.et-wen.com:51222`)+ `gitea`(`etgit.et-wen.com`)。**不設 GitHub `origin`** |
|
||||
| **測試 log** | `logs/*.log` 含 DUT 序號、MAC、韌體版本等可識別資訊 → gitignore,只保留目錄結構(`.gitkeep`) |
|
||||
| **破壞性硬體指令** | `margin_save` / `STORE_USER_ALL` 為永久 NVM 寫入,工具預設不呼叫;批次腳本 `margin_save_all.sh` 在 README 與腳本頂端都有警語 |
|
||||
| **破壞性硬體指令** | `margin_save` / `margin_save all` / `margin_save blanton` / `STORE_USER_ALL` 為永久 NVM 寫入,工具預設不呼叫;`margin_save all` 與批次腳本 `margin_save_all.sh` 在 README 與程式頂端都有警語 |
|
||||
| **root 權限** | 全流程在 `root@sonic:~#` 下執行(pcimem / i2c 需要);腳本不留任何 `chmod 777` 或放寬權限的動作 |
|
||||
| **For_AI/** | AI 協作素材(截圖、草稿筆記)整個資料夾 gitignore,避免不小心把客戶圖面帶進 repo |
|
||||
|
||||
@@ -593,9 +634,11 @@ margin status、全部 VRM 軌的 Vin/Vout/Iout/Temp、CB + ICB 溫感讀值,
|
||||
- [x] 壓力層改用平台的 `bgctl`(`memtester` / `qfx5252-stress-ssd` / `qfx5252-stress-usb`),
|
||||
取代 `~/hammer/tools/stress_*.py`;Script B 以 `jobs` + `bgctl list` 兩者並列確認
|
||||
- [ ] `bgctl list` 之後加數量驗證,不符時 `messagebox` 提示(目前只印出來給人看)
|
||||
**← V1.0.10 起 `bgctl list` + `jobs` 改為每輪都印,中途死掉的 job 看得到,但仍要靠人眼比對**
|
||||
- [ ] soak 迴圈改為「每輪先 `date`、跑完 `pause <間隔>`」,
|
||||
把 `EN_LoopInterval`(預設 600 秒 = 10 min)放進 `config.ttl`,兌現 Status 表的「Get data every 10mins」
|
||||
**← 目前 `while 1` 仍無 `pause`,實際間隔取決於指令執行時間,不是 10 分鐘**
|
||||
**← V1.0.10 已補上 `pause 60`(迴圈不再全速空轉),但 60 秒是寫死的、也還沒有每輪 `date`;
|
||||
距 Status 表的 10 分鐘仍有差距,故本項未結**
|
||||
- [x] soak 每輪補 `show platform psustatus` / `voltage` / `current`
|
||||
—— 迴圈已改為 `include "utils/setup_pmon.ttl"`,九項全收
|
||||
- [ ] 補 `; ========== CLEAR EVENT ==========`(Status 表 ScriptB #1,Owner: Alan)
|
||||
@@ -717,14 +760,31 @@ margin status、全部 VRM 軌的 Vin/Vout/Iout/Temp、CB + ICB 溫感讀值,
|
||||
- **`bmc_monitor_ddr.sh` 已停用**:B/C 內的呼叫已註解,DDR 壓力改由 `bgctl run bmc-manager run memtester`
|
||||
取代。檔案還留在 repo,待確認不再需要後刪除,或在檔頭標註停用。
|
||||
(`bmc_monitor.sh` 已於 2026-08-25 重新啟用,並加上 I2C 寫入/讀回圖樣測試。)
|
||||
- **`rm /host/hw-eval/current/jobs/*` 清不掉子目錄**:Script A 用的是不帶 `-r` 的 `rm`,但 Script C
|
||||
- **`rm /host/hw-eval/jobs/*` 清不掉子目錄**:Script A 用的是不帶 `-r` 的 `rm`,但 Script C
|
||||
是 `cp -r` 那個目錄,代表裡面可能有子目錄。清不乾淨的話,上一輪的 job log 會被當成這輪的一起
|
||||
複製到 USB。要確認 `bgctl` 的產出結構,必要時改成 `rm -rf .../jobs/*`。
|
||||
- **100G PRBS 尚未接進 A/B/C**:`port_prbs_monitor.sh` 已隨包交付、可手動執行,但三支腳本裡的呼叫
|
||||
都還註解著(bring-up 中)。要啟用時記得 PRBS 期間 link 會顯示 down,`stop` 之後才會回來。
|
||||
- **Script C 的 USB 掛載走 `mount` 而非 `usb_target.sh -o mnt`**:目前是 `-o dev` 取節點再自己
|
||||
`mount <dev> /mnt/usb`,繞過了工具內建的 `mkdir -p`、exfat/ntfs `modprobe` 與可寫性驗證。
|
||||
掛載點不存在、檔案系統模組沒載、或媒體唯讀時只會失敗一行,job log 就沒帶出來。
|
||||
- **風扇確認提示是無限等待**:`wait "Set all configured fan channels to"` 之後才 `sendln "y"`;
|
||||
若該版 `fan-speed-control.sh` 不再詢問(或字串改了),這個 `wait` 會永遠等下去,Script A 停在那裡
|
||||
且不報錯。加個 `timeout` + 分支會比較保險(記得還原 `timeout = 0`)。
|
||||
- **USB 掛載點未檢查**:Script C 直接 `cp -r ... /mnt/usb/`,`/mnt/usb` 沒掛載時只會失敗一行,
|
||||
整輪測試的 job log 就沒被帶出來。可在複製前先 `mountpoint -q /mnt/usb` 判斷。
|
||||
- **TR518 內建封包測試尚未腳本化**:`tools/TR518.txt` 記下了 `tr 518 Scenario=6 Profile=2 Count=260
|
||||
PktSize=324 PortList=1-259,270-565` 這組指令(含 `port all lb=mac` + `l2 learn off` 前置),
|
||||
目前只能手貼。它與 `blanton_traffic_linespeed` 是兩條互斥的打流路線(都會動 loopback 與 L2 學習),
|
||||
要腳本化的話得先決定兩者怎麼共存,不能同時跑。
|
||||
- **SWB 的 LTC2977 有兩條路可以到,目前工具兩條都在用**:`cb_pmbus_*`(CB FPGA F3 → pcimem)
|
||||
是 `margin_init` / `margin_status` / `margin_set` 走的路;原生 i2c bus(Ch+7 = bus 13/14/15/16)
|
||||
是 `margin_save blanton` 走的路。後者短很多 —— 不需要通道初始化、不需要 pcimem,
|
||||
單一 `i2cset` 就到。若原生 bus 在這平台夠穩,整個 `TRANSPORT="swb"` 層其實可以退成
|
||||
「bus 號不同的 i2c 路徑」,`_swb_*`、probe、semaphore、prescale 那整套都能拿掉。
|
||||
要動之前得先確認:讀取(`margin_status` 的 LINEAR16 word read)是否也同樣可靠,
|
||||
以及 kernel driver 有沒有搶著存取(`margin_save blanton` 帶 `-f` 就是為了繞過這件事)。
|
||||
- **`settings/` 裡 SWB0 與 SWB1 是兩份相同的資料**:8 個 `.conf` 中,SWB1 的四個除了 `CHIPS[]` 的
|
||||
bus 與 `CB_I2C_CH` 之外,net name 與 `VNOM` 與 SWB0 逐欄相同(見 `docs/LTC2980_channel_map.csv`)。
|
||||
改一邊忘了改另一邊不會有任何警告。可考慮改成「共用 net 定義 + 各自的 transport 覆寫」兩層檔案。
|
||||
- **Script C 沒有倒出 `mgmt_ping.log`**:C 會 `stop` 管理網路監控並印 `ip -s link show`,
|
||||
但沒有 `cat ~/Blanton_Script/log/mgmt_ping.log`,所以整個 soak 期間累積的 per-leg `RESULT`
|
||||
留在 DUT 上、沒進 master log。Script A 那輪基線有 `cat`。
|
||||
|
||||
@@ -9,12 +9,15 @@ DUT 端的取數能力由一組 **bash 工具庫** 提供(CB FPGA `pcimem` →
|
||||
|
||||
完整架構見 [ARCHITECTURE.md](ARCHITECTURE.md)。
|
||||
|
||||
**目前狀態(2026-08-25)**:Script A 為 **V1.0.7**(A 集中記錄 A/B/C 三支的變更)。涵蓋
|
||||
**目前狀態(2026-08-27)**:Script A 為 **V1.0.10**(A 集中記錄 A/B/C 三支的變更)。涵蓋
|
||||
PCIe AER / DDR EDAC / PMON+TPM / 電壓 margin(9 顆 LTC2980)/ SWB loopback 線速流量 /
|
||||
10G+1G 管理網路 ping / BMC DDR 與 USB / NVMe 健康,壓力層走平台的 `bgctl`。
|
||||
switch unit 數量由 `config.ttl` 的 `SWB_UNIT0` / `SWB_UNIT1` 宣告,風扇轉速由 `FAN_SPEED` 指定。
|
||||
測試 job log 收在 DUT 的 `/host/hw-eval/current/jobs/`,Script C 結束時帶時戳複製到 `/mnt/usb/`。
|
||||
最後一次發布是 **V1.0.5**;SWB 的 I2C 通道與位址已於 2026-08-19 上機驗證。
|
||||
switch unit 數量由 `config.ttl` 的 `SWB_UNIT0` / `SWB_UNIT1` 宣告,風扇轉速由 `FAN_SPEED` 指定
|
||||
(預設 100 = 全速;soak 是熱測試,散熱不該是變因)。
|
||||
測試 job log 收在 DUT 的 `/host/hw-eval/jobs/`,Script C 結束時掛好 USB 再帶時戳複製到 `/mnt/usb/`。
|
||||
100G PRBS(`port_prbs_monitor.sh`)已隨包交付,但 **A/B/C 的呼叫仍註解掉**,還在 bring-up。
|
||||
Script B 的 soak 迴圈每輪印 `bgctl list` + `jobs`,並 `pause 60`(V1.0.10 之前完全沒有 pause)。
|
||||
最後一次發布是 **V1.0.9**;SWB 的 I2C 通道與位址已於 2026-08-19 上機驗證。
|
||||
交付用 `./publish/publish.sh` 打包。
|
||||
|
||||
## 技術棧
|
||||
@@ -61,6 +64,14 @@ temp_all # CB + ICB 溫感
|
||||
pwr_data # SWB VRM 全軌
|
||||
margin_init Blanton_CB_CONN13 && margin_status
|
||||
|
||||
# ── 電壓 margin 寫 NVM(⚠️ 永久,測試中絕不執行)─────
|
||||
margin_save # 只寫當前 margin_init 載入的那顆(2 個 LTC2977)
|
||||
margin_save all # settings/ 全部 9 顆;跑完自動切回原本載入的那顆
|
||||
margin_save blanton # Blanton SONiC 捷徑:18 顆全走原生 i2c,不用 margin_init
|
||||
# 0x15 是 send-byte,不帶 data byte:i2cset -f -y <bus> <addr> 0x15
|
||||
# bus = FPGA F3 通道 + 7 → Ch6=13, Ch7=14, Ch8=15, Ch9=16(CB 本來就是 bus 4)
|
||||
# ⚠️ 沒裝滿的機器:改 margin.sh 頂端的 MARGIN_BLANTON_STORE,把沒有的板子註解掉
|
||||
|
||||
# ── SWB loopback 流量(bcmcmd,unit 0/1)─────────────
|
||||
# 不帶 -u 就是預設 TL_UNITS="0 1",兩塊 switch board 都做(TTL 三支腳本即如此)
|
||||
blanton_traffic_linespeed ps # 對照線的 link/speed
|
||||
@@ -88,11 +99,28 @@ chmod +x ~/Blanton_Script/*.sh # 佈署後必做一次
|
||||
# bmc_monitor.sh start/stop # free -m + BMC I2C 寫入/讀回圖樣測試,log/bmc_poll.log
|
||||
# ⚠️ bmc_monitor_ddr.sh 已停用(DDR 壓力改走 bgctl + bmc-manager),檔案仍在
|
||||
|
||||
# ── 100G PRBS(目前 TTL 未啟用,手動測用)────────────
|
||||
bash ~/Blanton_Script/port_prbs_monitor.sh start # 兩個 port 同時
|
||||
bash ~/Blanton_Script/port_prbs_monitor.sh start a # 只跑 Ethernet513
|
||||
bash ~/Blanton_Script/port_prbs_monitor.sh start b # 只跑 Ethernet514
|
||||
bash ~/Blanton_Script/port_prbs_monitor.sh report # PASS/FAIL 統計(沒跑的顯示 SKIP)
|
||||
bash ~/Blanton_Script/port_prbs_monitor.sh stop # 收尾會跑 prbsstat STOp + prbs clear
|
||||
# ⚠️ PRBS 打起來時 link 會顯示 down,這是正常的 —— 所以 start 刻意不印 port status
|
||||
|
||||
# ── USB 目標偵測 ────────────────────────────────────
|
||||
bash ~/Blanton_Script/usb_target.sh -o dev # /dev/sdX1
|
||||
bash ~/Blanton_Script/usb_target.sh -o mnt # 掛好並回傳掛載點
|
||||
|
||||
# ── 背景壓力(平台工具)──────────────────────────────
|
||||
bgctl run /usr/sbin/memtester 1G 100
|
||||
bgctl list
|
||||
bgctl stop --all ; bgctl reset --yes
|
||||
|
||||
# ── 通道對照表(開發機上跑,改完 settings/*.conf 一定要重產)──
|
||||
./tools/gen_channel_map.sh # → docs/LTC2980_channel_map.csv(144 列)
|
||||
./tools/gen_channel_map.sh - # 只印到 stdout
|
||||
# ⚠️ 需要 gawk(用到 3 參數的 match());mawk 會直接擋下並提示
|
||||
|
||||
# ── 各工具的 help ───────────────────────────────────
|
||||
blanton_fpga_help ; blanton_cb_i2c_help ; vi2c_help
|
||||
temp_sensor_help ; pwr_data_help ; blanton_traffic_linespeed_help
|
||||
@@ -159,6 +187,11 @@ Tera Term 連 COM port (115200-8-N-1)
|
||||
- ⚠️ **I2C 讀一律 Repeated START**(不是 STOP + START),否則 PMBus/SMBus 裝置(VRM、EFUSE)不理。
|
||||
- ⚠️ **`margin_save` / `STORE_USER_ALL` 會永久寫 NVM**,斷電保留 → **測試流程中絕不執行**,
|
||||
以免覆蓋客戶出廠 config。`margin.sh` 的 auto-enable(`ON_OFF_CONFIG=0x1a`)只改 RAM,斷電復原。
|
||||
v2.7.0 新增的 **`margin_save all` / `margin_save blanton` 一次寫 18 個 LTC2977**,
|
||||
同一個警告放大 9 倍;另外 `0x15` 現在送 send-byte,不再帶多餘的 `0x00` data byte。
|
||||
- ⚠️ **SWB 的 LTC2977 有兩條路可以到**:`cb_pmbus_*`(CB FPGA F3 Ch6/7/8/9 → pcimem)與
|
||||
原生 i2c bus(`i2cset -f -y 13/14/15/16`,Ch+7 = bus)。`margin_save blanton` 走後者,
|
||||
其餘功能走前者。同一顆晶片,**不要同時用兩條路**。
|
||||
- ⚠️ **改電壓會弄壞 DUT**:套 profile 前確認該軌 OV/UV limit,且 servo DAC 注入電阻有 populate
|
||||
(本板部分 margin 電阻標 PROTO,沒 populate 的軌電壓不會動,不是腳本壞掉)。
|
||||
- ⚠️ **`ARB_LOST` ≠ 有裝置**:`vi2c_scan` 只看 `RX_ACK`,仲裁失敗會被誤報成裝置存在。
|
||||
@@ -187,6 +220,8 @@ Tera Term 連 COM port (115200-8-N-1)
|
||||
- ⚠️ **兩張管理網卡同網段會 ARP flux**:`mgmt_ping_monitor.sh` 讓 eth0/eth1 同時 up,同一個 /24 下
|
||||
對端 ARP 可能由任一張卡回應,回包落在沒送封包的那張。`ARP_STRICT=1` 擋掉;判讀時看 `RESULT` 行的
|
||||
`nic_tx`/`nic_rx`(該卡自己的 packet delta)—— **ping 成功但 `nic_tx` 接近 0 = 封包從另一張卡出去的**
|
||||
- ⚠️ **PRBS 跑起來時 `show interfaces status` 會顯示 DOWN**,那是 link 離開正常運作模式,不是故障。
|
||||
`port_prbs_monitor.sh` 的 `start` 因此刻意不印 port status(避免測試員誤判),只在 `prbs clear` 之後的報表裡印
|
||||
- ⚠️ **`ip -s link` 的欄位順序是 `bytes packets errors ...`**,要 packet 數取的是**第 2 欄**不是第 1 欄
|
||||
- ⚠️ **`mgmt_ping_monitor.sh` / `bmc_monitor*.sh` 需要 exec bit**,且**不是改用 `bash x.sh start` 就能繞過** ——
|
||||
`do_start` 內部是 `setsid "$SCRIPT_PATH" __daemon`,直接執行該路徑。git 記錄是 `100644`,
|
||||
@@ -207,10 +242,13 @@ Tera Term 連 COM port (115200-8-N-1)
|
||||
## 資料夾說明
|
||||
|
||||
- `src/Script_ABC_Blanton/` — 可執行內容(Tera Term 工作目錄;內含要 scp 到 DUT 的 `Blanton_Script/`)
|
||||
- `docs/` — 客戶 FPGA 規格、AER/EDAC 檢查依據、逐項 Status 表(最新為 `*_20260817.xlsx`)
|
||||
- `docs/` — 客戶 FPGA 規格、AER/EDAC 檢查依據、逐項 Status 表(最新為 `*_20260817.xlsx`)、
|
||||
`LTC2980_channel_map.csv`(9 個 `settings/*.conf` 合併成 Board,CONN,Ch,NetName,Vnom 144 列,
|
||||
查 net 對應哪片哪個 channel 用;**改 `.conf` 後要重跑產生**)
|
||||
- `tools/` — Host / 離線端:`bcm_mibpair_report_V1.1.0.py`(drivshell log → per-pair 報表)、
|
||||
`traffic_loopback_*.txt`(bcmcmd 原始指令表,`blanton_traffic_linespeed.sh` 是其 bash 版,
|
||||
**改 loopback 線路時兩邊要同步**)
|
||||
**改 loopback 線路時兩邊要同步**)、`100G_PRBS.txt` / `TR518.txt` / `fan_ctrl.txt`
|
||||
(上機手貼用的原始指令;PRBS 已有 `.sh`,TR518 尚未腳本化)
|
||||
- `publish/` — `publish.sh`(打包工具,**進 git**)+ `Script_ABC_Blanton_<Ver>/` 產出(**gitignored**)
|
||||
- `secret/` — 🚫 gitignored(除 `README.md` 與 `*.example`):DUT 帳密、per-unit BDF 覆寫、COM 設定
|
||||
- `For_AI/` — 🚫 gitignored:AI 協作素材(波形截圖、草稿筆記)
|
||||
|
||||
@@ -0,0 +1,145 @@
|
||||
Board,CONN,Ch,NetName,Vnom
|
||||
CB,CONN13,CH0,V5P0_ALW,5.0
|
||||
CB,CONN13,CH1,V3P3_ALW,3.3
|
||||
CB,CONN13,CH2,PWR_VDD_MISC_ALW,0.75
|
||||
CB,CONN13,CH3,V1P8_ALW,1.8
|
||||
CB,CONN13,CH4,PWR_APU_VDDIO_SUS,1.1
|
||||
CB,CONN13,CH5,PWR_VDD_MISC_RUN,0.75
|
||||
CB,CONN13,CH6,PWR_APU_VDD_MEM_RUN,0.78
|
||||
CB,CONN13,CH7,V0P8_PHY2_DVDD,0.8
|
||||
CB,CONN13,CH8,V0P8_AVDD,0.8
|
||||
CB,CONN13,CH9,V0P8_PHY,0.8
|
||||
CB,CONN13,CH10,V1P8_FPGA,1.8
|
||||
CB,CONN13,CH11,V2P5_FPGA,2.5
|
||||
CB,CONN13,CH12,V1P1_FPGA,1.1
|
||||
CB,CONN13,CH13,P5V_STBY,5.0
|
||||
CB,CONN13,CH14,P3V3_STBY,3.3
|
||||
CB,CONN13,CH15,V0P8_PHY2_AVDD,0.8
|
||||
SWB0,CONN13,CH0,P0V75_DVDD_47,0.75
|
||||
SWB0,CONN13,CH1,P0V75_AVDD_47,0.75
|
||||
SWB0,CONN13,CH2,P1V5_AVDD_47,1.5
|
||||
SWB0,CONN13,CH3,P0V9_AVDD_47,0.9
|
||||
SWB0,CONN13,CH4,P1V8_1,1.8
|
||||
SWB0,CONN13,CH5,PVDD3_3V_SYNTH_LDO_A3,3.3
|
||||
SWB0,CONN13,CH6,PVDD3_3V_SYNTH_LDO_B1,3.3
|
||||
SWB0,CONN13,CH7,P1V8_3,1.8
|
||||
SWB0,CONN13,CH8,P1V8_DVDDIO_3,1.8
|
||||
SWB0,CONN13,CH9,P0V75_DVDD_39,0.75
|
||||
SWB0,CONN13,CH10,P0V75_AVDD_39,0.75
|
||||
SWB0,CONN13,CH11,P1V5_AVDD_39,1.5
|
||||
SWB0,CONN13,CH12,P0V9_AVDD_39,0.9
|
||||
SWB0,CONN13,CH13,PVDD1V5_2,1.5
|
||||
SWB0,CONN13,CH14,PVDD1V8_DUT,1.8
|
||||
SWB0,CONN13,CH15,PVDD_MDIO,1.2
|
||||
SWB0,CONN14,CH0,P0V75_AVDD_7,0.75
|
||||
SWB0,CONN14,CH1,P1V5_AVDD_7,1.5
|
||||
SWB0,CONN14,CH2,P0V9_AVDD_7,0.9
|
||||
SWB0,CONN14,CH3,P1V8_5,1.8
|
||||
SWB0,CONN14,CH4,P1V8_2,1.8
|
||||
SWB0,CONN14,CH5,PVDD3_3V_SYNTH_LDO_B2,3.3
|
||||
SWB0,CONN14,CH6,PVDD3_3V_SYNTH_LDO_A2,3.3
|
||||
SWB0,CONN14,CH7,PVDD3_3V_SYNTH_LDO_A1,3.3
|
||||
SWB0,CONN14,CH8,PVDD1V5_TSC,1.5
|
||||
SWB0,CONN14,CH9,PVDD1V5_ANLG,1.5
|
||||
SWB0,CONN14,CH10,NC,-
|
||||
SWB0,CONN14,CH11,NC,-
|
||||
SWB0,CONN14,CH12,PVDD1V5_1,1.5
|
||||
SWB0,CONN14,CH13,NC,-
|
||||
SWB0,CONN14,CH14,P1V8_DVDDIO_1,1.8
|
||||
SWB0,CONN14,CH15,P0V75_DVDD_7,0.75
|
||||
SWB0,CONN15,CH0,P1V5_AVDD_55,1.5
|
||||
SWB0,CONN15,CH1,P0V9_AVDD_55,0.9
|
||||
SWB0,CONN15,CH2,P0V75_DVDD_63,0.75
|
||||
SWB0,CONN15,CH3,P0V75_AVDD_63,0.75
|
||||
SWB0,CONN15,CH4,P1V5_AVDD_63,1.5
|
||||
SWB0,CONN15,CH5,P0V9_AVDD_63,0.9
|
||||
SWB0,CONN15,CH6,PVDD3_3V_SYNTH_LDO_B3,3.3
|
||||
SWB0,CONN15,CH7,PVDD1V5_3,1.5
|
||||
SWB0,CONN15,CH8,P0V85_STBY,0.85
|
||||
SWB0,CONN15,CH9,P1V8_STBY,1.8
|
||||
SWB0,CONN15,CH10,NC,-
|
||||
SWB0,CONN15,CH11,P3V3_STBY,3.3
|
||||
SWB0,CONN15,CH12,PVDD0V9_2,0.9
|
||||
SWB0,CONN15,CH13,P0V75_DVDD_55,0.75
|
||||
SWB0,CONN15,CH14,P0V75_AVDD_55,0.75
|
||||
SWB0,CONN15,CH15,P1V8_DVDDIO_4,1.8
|
||||
SWB0,CONN16,CH0,PVDD1V5_0,1.5
|
||||
SWB0,CONN16,CH1,P1V8_4,1.8
|
||||
SWB0,CONN16,CH2,PVDD3_3V_SYNTH_LDO_B5,3.3
|
||||
SWB0,CONN16,CH3,PVDD3_3V_SYNTH_LDO_A5,3.3
|
||||
SWB0,CONN16,CH4,PVDD3_3V_SYNTH_LDO_B4,3.3
|
||||
SWB0,CONN16,CH5,PVDD3_3V_SYNTH_LDO_A4,3.3
|
||||
SWB0,CONN16,CH6,P3V3,3.3
|
||||
SWB0,CONN16,CH7,PVDD0_8V_T3,0.8
|
||||
SWB0,CONN16,CH8,P0V75_DVDD_1,0.75
|
||||
SWB0,CONN16,CH9,P0V75_AVDD_1,0.75
|
||||
SWB0,CONN16,CH10,P1V5_AVDD_1,1.5
|
||||
SWB0,CONN16,CH11,P0V9_AVDD_1,0.9
|
||||
SWB0,CONN16,CH12,PVDD0V9_0,0.9
|
||||
SWB0,CONN16,CH13,PVDD0V9_1,0.9
|
||||
SWB0,CONN16,CH14,PVDD0V9_3,0.9
|
||||
SWB0,CONN16,CH15,PVDD1V2_T3,1.2
|
||||
SWB1,CONN13,CH0,P0V75_DVDD_47,0.75
|
||||
SWB1,CONN13,CH1,P0V75_AVDD_47,0.75
|
||||
SWB1,CONN13,CH2,P1V5_AVDD_47,1.5
|
||||
SWB1,CONN13,CH3,P0V9_AVDD_47,0.9
|
||||
SWB1,CONN13,CH4,P1V8_1,1.8
|
||||
SWB1,CONN13,CH5,PVDD3_3V_SYNTH_LDO_A3,3.3
|
||||
SWB1,CONN13,CH6,PVDD3_3V_SYNTH_LDO_B1,3.3
|
||||
SWB1,CONN13,CH7,P1V8_3,1.8
|
||||
SWB1,CONN13,CH8,P1V8_DVDDIO_3,1.8
|
||||
SWB1,CONN13,CH9,P0V75_DVDD_39,0.75
|
||||
SWB1,CONN13,CH10,P0V75_AVDD_39,0.75
|
||||
SWB1,CONN13,CH11,P1V5_AVDD_39,1.5
|
||||
SWB1,CONN13,CH12,P0V9_AVDD_39,0.9
|
||||
SWB1,CONN13,CH13,PVDD1V5_2,1.5
|
||||
SWB1,CONN13,CH14,PVDD1V8_DUT,1.8
|
||||
SWB1,CONN13,CH15,PVDD_MDIO,1.2
|
||||
SWB1,CONN14,CH0,P0V75_AVDD_7,0.75
|
||||
SWB1,CONN14,CH1,P1V5_AVDD_7,1.5
|
||||
SWB1,CONN14,CH2,P0V9_AVDD_7,0.9
|
||||
SWB1,CONN14,CH3,P1V8_5,1.8
|
||||
SWB1,CONN14,CH4,P1V8_2,1.8
|
||||
SWB1,CONN14,CH5,PVDD3_3V_SYNTH_LDO_B2,3.3
|
||||
SWB1,CONN14,CH6,PVDD3_3V_SYNTH_LDO_A2,3.3
|
||||
SWB1,CONN14,CH7,PVDD3_3V_SYNTH_LDO_A1,3.3
|
||||
SWB1,CONN14,CH8,PVDD1V5_TSC,1.5
|
||||
SWB1,CONN14,CH9,PVDD1V5_ANLG,1.5
|
||||
SWB1,CONN14,CH10,NC,-
|
||||
SWB1,CONN14,CH11,NC,-
|
||||
SWB1,CONN14,CH12,PVDD1V5_1,1.5
|
||||
SWB1,CONN14,CH13,NC,-
|
||||
SWB1,CONN14,CH14,P1V8_DVDDIO_1,1.8
|
||||
SWB1,CONN14,CH15,P0V75_DVDD_7,0.75
|
||||
SWB1,CONN15,CH0,P1V5_AVDD_55,1.5
|
||||
SWB1,CONN15,CH1,P0V9_AVDD_55,0.9
|
||||
SWB1,CONN15,CH2,P0V75_DVDD_63,0.75
|
||||
SWB1,CONN15,CH3,P0V75_AVDD_63,0.75
|
||||
SWB1,CONN15,CH4,P1V5_AVDD_63,1.5
|
||||
SWB1,CONN15,CH5,P0V9_AVDD_63,0.9
|
||||
SWB1,CONN15,CH6,PVDD3_3V_SYNTH_LDO_B3,3.3
|
||||
SWB1,CONN15,CH7,PVDD1V5_3,1.5
|
||||
SWB1,CONN15,CH8,P0V85_STBY,0.85
|
||||
SWB1,CONN15,CH9,P1V8_STBY,1.8
|
||||
SWB1,CONN15,CH10,NC,-
|
||||
SWB1,CONN15,CH11,P3V3_STBY,3.3
|
||||
SWB1,CONN15,CH12,PVDD0V9_2,0.9
|
||||
SWB1,CONN15,CH13,P0V75_DVDD_55,0.75
|
||||
SWB1,CONN15,CH14,P0V75_AVDD_55,0.75
|
||||
SWB1,CONN15,CH15,P1V8_DVDDIO_4,1.8
|
||||
SWB1,CONN16,CH0,PVDD1V5_0,1.5
|
||||
SWB1,CONN16,CH1,P1V8_4,1.8
|
||||
SWB1,CONN16,CH2,PVDD3_3V_SYNTH_LDO_B5,3.3
|
||||
SWB1,CONN16,CH3,PVDD3_3V_SYNTH_LDO_A5,3.3
|
||||
SWB1,CONN16,CH4,PVDD3_3V_SYNTH_LDO_B4,3.3
|
||||
SWB1,CONN16,CH5,PVDD3_3V_SYNTH_LDO_A4,3.3
|
||||
SWB1,CONN16,CH6,P3V3,3.3
|
||||
SWB1,CONN16,CH7,PVDD0_8V_T3,0.8
|
||||
SWB1,CONN16,CH8,P0V75_DVDD_1,0.75
|
||||
SWB1,CONN16,CH9,P0V75_AVDD_1,0.75
|
||||
SWB1,CONN16,CH10,P1V5_AVDD_1,1.5
|
||||
SWB1,CONN16,CH11,P0V9_AVDD_1,0.9
|
||||
SWB1,CONN16,CH12,PVDD0V9_0,0.9
|
||||
SWB1,CONN16,CH13,PVDD0V9_1,0.9
|
||||
SWB1,CONN16,CH14,PVDD0V9_3,0.9
|
||||
SWB1,CONN16,CH15,PVDD1V2_T3,1.2
|
||||
|
@@ -0,0 +1,56 @@
|
||||
# v1.0.10 — The soak loop stops spinning flat out, and shows you what is still running
|
||||
|
||||
## ✨ New features
|
||||
|
||||
**Every soak round now reports the background jobs**
|
||||
* Script B's monitoring loop prints `bgctl list` (platform jobs) and `jobs` (the login shell's own background jobs) on every pass, right after the platform data. A stress job that dies three hours into an overnight soak now shows up as a shorter list on the next round, instead of only being noticed at the end — or not at all.
|
||||
* The two lists answer different questions and are both worth having: `bgctl` knows about the platform's job runner, `jobs` knows about anything the macro backgrounded in that shell.
|
||||
|
||||
**A single table for all 144 margin channels**
|
||||
* `docs/LTC2980_channel_map.csv` flattens the nine `settings/*.conf` files into one sheet — `Board,CONN,Ch,NetName,Vnom` — so "which board and channel is `PVDD1V5_TSC` on?" is one search instead of opening nine files.
|
||||
* `tools/gen_channel_map.sh` regenerates it. **The CSV is output, not source**: edit the `.conf` files and re-run the script, never the other way round.
|
||||
* Unused channels stay in the table as `NC` / `-` rather than being dropped, because the channel number is also the PMBus page (`ch / 8` picks the chip, `ch % 8` picks the page) — filtering the gaps out would shift everything after them.
|
||||
|
||||
**The bench command lists that these scripts came from**
|
||||
* `tools/100G_PRBS.txt`, `tools/TR518.txt` and `tools/fan_ctrl.txt` join the existing `traffic_loopback_*.txt` set: the raw `bcmcmd` / sysfs sequences, kept in the form you can paste into a console when a script is misbehaving and you want to drive the hardware directly.
|
||||
|
||||
## 🐛 Bug fixes
|
||||
|
||||
**The soak loop ran as fast as the DUT could answer**
|
||||
* `while 1` had no pause at all, so each round started the moment the previous one finished. Over a long soak that means constant console traffic and a log full of near-identical samples taken seconds apart. The loop now ends each round with `pause 60`.
|
||||
* Note the gap this leaves: the Status sheet asks for a 10-minute sampling interval, and 60 seconds is still hard-coded rather than configurable. This makes the loop sane, it does not finish the job.
|
||||
|
||||
**A comment promised a cadence the code never had**
|
||||
* The loop was labelled `Get data every 10mins` while running with no delay whatsoever. It now says what it does.
|
||||
|
||||
## 📦 Downloads
|
||||
|
||||
| File | Contents |
|
||||
|---|---|
|
||||
| `Script_ABC_Blanton_V1.0.10.zip` | The full Tera Term working directory, including `Blanton_Script/` to copy onto the DUT |
|
||||
|
||||
**After copying to the DUT:**
|
||||
|
||||
```bash
|
||||
chmod +x ~/Blanton_Script/*.sh # see below
|
||||
grep -rlU $'\r' ~/Blanton_Script # expect no output
|
||||
```
|
||||
|
||||
`mgmt_ping_monitor.sh` and `port_prbs_monitor.sh` launch their workers through `bash`, so those two run without the execute bit. `bmc_monitor.sh` and `usb_target.sh` still need it, and neither git (mode 100644) nor a Windows/USB copy carries it. Without the `chmod`, `start` fails with `Permission denied` and the later `cat` finds nothing: **the section ends up empty and nothing reports an error.**
|
||||
|
||||
## ⚠️ Before you run
|
||||
|
||||
* **Declare the switch population.** `SWB_UNIT0` / `SWB_UNIT1` in `config.ttl` say which switch units this DUT has; traffic and the readiness gate both follow them.
|
||||
* **Set `FAN_SPEED`.** It is applied at the start of every run.
|
||||
* **Management connectivity is in use, not preserved.** Both management NICs are up and pinging — drive the run from the serial console.
|
||||
* **PRBS is still not wired into the macros.** Run `port_prbs_monitor.sh` by hand if you want it; the calls in A/B/C remain commented out, unchanged from v1.0.9.
|
||||
* **TR518 and the loopback traffic test cannot both run.** `tools/TR518.txt` sets `port all lb=mac` and `l2 learn off` across the whole unit, which is the same hardware `blanton_traffic_linespeed` is using. Pick one.
|
||||
* **Two settings persist to `config_db.json`** and survive a reboot: LLDP is left disabled and the 100G uplinks are left configured. Restore them before the DUT moves on.
|
||||
|
||||
## 🔗 Links
|
||||
|
||||
* [ARCHITECTURE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/ARCHITECTURE.md) — test flow, data models, constraints
|
||||
* [CLAUDE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/CLAUDE.md) — commands and the bench gotchas
|
||||
* [LTC2980_channel_map.csv](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/docs/LTC2980_channel_map.csv) — all 144 margin channels
|
||||
|
||||
**Full changelog:** [V1.0.9...V1.0.10](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/compare/V1.0.9...V1.0.10)
|
||||
@@ -0,0 +1,59 @@
|
||||
# v1.0.11 — Saving the margin settings to NVM is now one command, and the command is correct
|
||||
|
||||
## ✨ New features
|
||||
|
||||
**`margin_save blanton` — all 18 LTC2977 in one go**
|
||||
* On this platform the CB FPGA's I2C channels are also exposed as ordinary Linux i2c buses, so every margin controller on the box — CB and both switch boards — can be reached with plain `i2cset`. `margin_save blanton` walks all 18 of them from one flat list: no `margin_init`, no FPGA channel setup, no `pcimem`.
|
||||
* The channel-to-bus mapping it relies on (F3 Ch6 → bus 13, Ch7 → 14, Ch8 → 15, Ch9 → 16; CB is bus 4 as before) is now written down in `ARCHITECTURE.md` and the margin README, not just known at the bench.
|
||||
* **A partly-populated DUT is a normal build.** Comment out the lines you do not have in `MARGIN_BLANTON_STORE` at the top of `margin.sh` rather than letting the tool talk to boards that are not there.
|
||||
* Missing bus and unresponsive chip are reported as two different failures. `/dev/i2c-16 does not exist` means the FPGA's i2c adapters did not enumerate; `i2cset failed (NACK/busy)` means the board is absent or the address is wrong. Chasing the second when you have the first wastes an afternoon.
|
||||
|
||||
**`margin_save all` — every board in `settings/`**
|
||||
* Runs `margin_init` + `margin_save` across all nine boards, then puts back whichever board you had loaded, so a following `margin_status` still reports the board you were looking at.
|
||||
* It does not stop at the first failure: a half-saved set is harder to reason about than a fully-attempted one. The summary names the boards that failed.
|
||||
|
||||
Both print a per-chip line and a `N saved, M failed` tally, and both return a non-zero exit code when anything failed.
|
||||
|
||||
**The fans now default to full speed**
|
||||
* `FAN_SPEED` in `config.ttl` is 100 instead of 30. A soak is a thermal test of everything *except* the cooling, so the cooling should not be a variable in it — and a DUT that throttles halfway through a run produces results that look like a different fault. Lower it deliberately if quiet operation is what you are measuring.
|
||||
|
||||
## 🐛 Bug fixes
|
||||
|
||||
**A failed NVM write still reported success**
|
||||
* `margin_save` discarded the result of every write, so a NACK printed `Change Saved` exactly like a successful store. For the one operation in this tool that is permanent, that is the worst place to stay quiet. Each store is now checked and named if it fails.
|
||||
|
||||
**`STORE_USER_ALL` was sent with a data byte it should not have**
|
||||
* The command went out as `0x15` followed by a dummy `0x00` — an SMBus write-byte, where `STORE_USER_ALL` is a send-byte. The LTC2977 tolerated it, but tolerance is not correctness. It is now `i2cset ... 0x15 c` on the native path and a no-data `cb_pmbus_write` on the FPGA path.
|
||||
|
||||
## 📦 Downloads
|
||||
|
||||
| File | Contents |
|
||||
|---|---|
|
||||
| `Script_ABC_Blanton_V1.0.11.zip` | The full Tera Term working directory, including `Blanton_Script/` to copy onto the DUT |
|
||||
|
||||
**After copying to the DUT:**
|
||||
|
||||
```bash
|
||||
chmod +x ~/Blanton_Script/*.sh # see below
|
||||
grep -rlU $'\r' ~/Blanton_Script # expect no output
|
||||
```
|
||||
|
||||
`mgmt_ping_monitor.sh` and `port_prbs_monitor.sh` launch their workers through `bash`, so those two run without the execute bit. `bmc_monitor.sh` and `usb_target.sh` still need it, and neither git (mode 100644) nor a Windows/USB copy carries it. Without the `chmod`, `start` fails with `Permission denied` and the later `cat` finds nothing: **the section ends up empty and nothing reports an error.**
|
||||
|
||||
## ⚠️ Before you run
|
||||
|
||||
* **`margin_save` in any form writes NVM permanently.** A power cycle does not undo it. `margin_save all` and `margin_save blanton` do it to all 18 controllers at once. Run `margin_status_all.sh` first and never call any of them during a test run — the macros do not, and should not be made to.
|
||||
* **The 18 raw commands were verified on the DUT; the wrapper was not.** `margin_save blanton` issues exactly the sequence that was run by hand at the bench, and the packaging was tested against stubbed hardware, but the function itself has not been run on a DUT yet. Watch the per-chip lines the first time.
|
||||
* **Declare the switch population.** `SWB_UNIT0` / `SWB_UNIT1` in `config.ttl` say which switch units this DUT has; traffic and the readiness gate both follow them.
|
||||
* **`FAN_SPEED` is now 100.** It is applied at the start of every run, so this build runs the fans flat out unless you change `config.ttl`. Expect the noise.
|
||||
* **Management connectivity is in use, not preserved.** Both management NICs are up and pinging — drive the run from the serial console.
|
||||
* **PRBS is still not wired into the macros.** Run `port_prbs_monitor.sh` by hand if you want it; the calls in A/B/C remain commented out.
|
||||
* **Two settings persist to `config_db.json`** and survive a reboot: LLDP is left disabled and the 100G uplinks are left configured. Restore them before the DUT moves on.
|
||||
|
||||
## 🔗 Links
|
||||
|
||||
* [ARCHITECTURE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/ARCHITECTURE.md) — test flow, data models, constraints
|
||||
* [CLAUDE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/CLAUDE.md) — commands and the bench gotchas
|
||||
* [LTC2980_Margin_Script/README.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/src/Script_ABC_Blanton/Blanton_Script/LTC2980_Margin_Script/README.md) — the three `margin_save` variants and what each one sends
|
||||
|
||||
**Full changelog:** [V1.0.10...V1.0.11](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/compare/V1.0.10...V1.0.11)
|
||||
@@ -0,0 +1,63 @@
|
||||
# v1.0.9 — 100G PRBS testing, and the job logs actually reach the USB stick
|
||||
|
||||
## ✨ New features
|
||||
|
||||
**100G uplink PRBS test**
|
||||
* New `port_prbs_monitor.sh` drives a PRBS test on both 100G uplinks: it clears low-power mode, arms the pattern, then polls `phy diag <phy> prbs get` in the background until stopped. A poll counts as PASS only when the output says `PRBS OK!`; `prbsstat Ber` is captured alongside every poll for the record.
|
||||
* `stop` runs `prbsstat STOp` and `prbs clear` on each port before rendering the report, so the test does not leave PRBS armed behind it.
|
||||
* `report` gives the tally the bench actually wants:
|
||||
|
||||
```
|
||||
PORT POLLS PASS FAIL RESULT
|
||||
Ethernet513 42 42 0 PASS
|
||||
Ethernet514 42 40 2 FAIL
|
||||
```
|
||||
* **One port at a time is a first-class mode.** `start a` or `start b` runs a single uplink, which is how you separate a genuine port fault from the DUT not coping with two PRBS streams at once. A port that was not run reports `SKIP`, not `FAIL`.
|
||||
* Every command and its full output — setup, each poll, teardown — goes to that port's raw log.
|
||||
|
||||
> ⚠️ The script ships in this build and can be run by hand, but **the calls in Script A, B and C are commented out**: PRBS is still under bring-up on this platform.
|
||||
|
||||
**USB target detection**
|
||||
* `usb_target.sh` reports an inserted USB device's node, mount point or by-id path. It excludes whatever disk backs `/` and `/host` — this platform can boot from a USB DOM, which also reports as USB — refuses to guess when several USB disks are present, and when mounting, verifies the result is writable rather than trusting that `mount` succeeded.
|
||||
* Script B builds the USB stress command from the detected node instead of a hard-coded `/dev/sda1`.
|
||||
|
||||
## 🐛 Bug fixes
|
||||
|
||||
**The job logs were being written to a path nobody collected**
|
||||
* Stress output, the monitors' logs and the USB archive disagreed about where the job directory lives. Everything now uses `/host/hw-eval/jobs/`, so what Script B writes is what Script C copies out.
|
||||
|
||||
**Script C copied to a USB that was never mounted**
|
||||
* The archive step assumed `/mnt/usb` was ready. Script C now finds the device and mounts it first, so a run's logs leave the DUT instead of being written into an empty mount point.
|
||||
|
||||
**`show interfaces status` right after starting PRBS reads as a failure**
|
||||
* With PRBS armed the link is out of normal operation and reports DOWN. `port_prbs_monitor.sh` deliberately does not print the port status at `start` — it appears in the report instead, after `prbs clear`, labelled as the recovered state.
|
||||
|
||||
## 📦 Downloads
|
||||
|
||||
| File | Contents |
|
||||
|---|---|
|
||||
| `Script_ABC_Blanton_V1.0.9.zip` | The full Tera Term working directory, including `Blanton_Script/` to copy onto the DUT |
|
||||
|
||||
**After copying to the DUT:**
|
||||
|
||||
```bash
|
||||
chmod +x ~/Blanton_Script/*.sh # see below
|
||||
grep -rlU $'\r' ~/Blanton_Script # expect no output
|
||||
```
|
||||
|
||||
`mgmt_ping_monitor.sh` and `port_prbs_monitor.sh` launch their workers through `bash`, so those two run without the execute bit. `bmc_monitor.sh` and `usb_target.sh` still need it, and neither git (mode 100644) nor a Windows/USB copy carries it. Without the `chmod`, `start` fails with `Permission denied` and the later `cat` finds nothing: **the section ends up empty and nothing reports an error.**
|
||||
|
||||
## ⚠️ Before you run
|
||||
|
||||
* **Declare the switch population.** `SWB_UNIT0` / `SWB_UNIT1` in `config.ttl` say which switch units this DUT has; traffic and the readiness gate both follow them.
|
||||
* **Set `FAN_SPEED`.** It is applied at the start of every run.
|
||||
* **Management connectivity is in use, not preserved.** Both management NICs are up and pinging — drive the run from the serial console.
|
||||
* **PRBS is not wired into the macros yet.** Run `port_prbs_monitor.sh` by hand if you want it; uncommenting the calls in A/B/C is not supported in this build.
|
||||
* **Two settings persist to `config_db.json`** and survive a reboot: LLDP is left disabled and the 100G uplinks are left configured. Restore them before the DUT moves on.
|
||||
|
||||
## 🔗 Links
|
||||
|
||||
* [ARCHITECTURE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/ARCHITECTURE.md) — test flow, data models, constraints
|
||||
* [CLAUDE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/CLAUDE.md) — commands and the bench gotchas
|
||||
|
||||
**Full changelog:** [V1.0.8...V1.0.9](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/compare/V1.0.8...V1.0.9)
|
||||
@@ -1,7 +1,7 @@
|
||||
; =============================================================================
|
||||
; Script A for Blanton
|
||||
; Version : V1.0.8
|
||||
; Date : 2026-08-25
|
||||
; Version : V1.0.11
|
||||
; Date : 2026-08-28
|
||||
; Author : ETWen
|
||||
; =============================================================================
|
||||
; Version History:
|
||||
@@ -58,6 +58,43 @@
|
||||
; ScriptA MGMT ping baseline 45s -> 30s, clear the log afterwards
|
||||
; ScriptB Show mgmt_ping status after start
|
||||
; ScriptC Show mgmt_ping status before stop, cat the report after
|
||||
; V1.0.9 2026-08-26 Blanton_Script/port_prbs_monitor.sh Add 100G Port PRBS test
|
||||
; start [both|a|b] - single port isolates a port fault from
|
||||
; the DUT not coping with two PRBS streams at once
|
||||
; !! TTL calls are commented out in A/B/C - still under bring-up
|
||||
; ScriptA/B/C Job log path /host/hw-eval/current/jobs -> /host/hw-eval/jobs
|
||||
; ScriptC Mount the USB (usb_target.sh) before copying the job logs
|
||||
; ScriptC Reorder results: stress logs, then MGMT ping, then 100G status
|
||||
; V1.0.10 2026-08-27 ScriptB Monitor loop lists the background jobs every round
|
||||
; + bgctl list - platform jobs
|
||||
; + jobs - shell jobs of the login shell
|
||||
; + pause 60 - the loop used to run with no pause at all
|
||||
; docs/LTC2980_channel_map.csv Channel / net / Vnom map built from settings/*.conf
|
||||
; tools/gen_channel_map.sh Regenerates that CSV - the CSV is output, not source
|
||||
; tools/100G_PRBS.txt Bench command references, kept for hand-run debug
|
||||
; tools/TR518.txt TR518 = built-in packet test (swutil / bcmcmd tr 518)
|
||||
; tools/fan_ctrl.txt MAX31790 rebind + fan-speed-control.sh
|
||||
; V1.0.11 2026-08-28 LTC2980_Margin_Script/margin.sh v2.7.0 - margin_save fixes + two new subcommands
|
||||
; STORE_USER_ALL (0x15) is now a PMBus send-byte, not
|
||||
; 0x15 followed by a dummy 0x00 data byte. The LTC2977
|
||||
; tolerated the old form, but it was the wrong protocol
|
||||
; i2c: i2cset .. 0x15 c swb: cb_pmbus_write <ch> <addr> 0x15
|
||||
; + margin_save all - every board in settings/ (9 boards,
|
||||
; 18 chips), then re-init the one loaded beforehand
|
||||
; + margin_save blanton - Blanton SONiC shortcut: all 18
|
||||
; LTC2977 straight over the native i2c buses - no
|
||||
; margin_init, no FPGA channel setup, no pcimem
|
||||
; F3 Ch6->bus 13, Ch7->14, Ch8->15, Ch9->16
|
||||
; board list = MARGIN_BLANTON_STORE at the top of margin.sh
|
||||
; The store result is now checked - a NACK used to still
|
||||
; print "Change Saved"
|
||||
; MARGIN_STORE_SETTLE (0.5s) between stores; nothing in this
|
||||
; tool polls the part's busy bit
|
||||
; LTC2980_Margin_Script/README.md What each margin_save variant sends, and the
|
||||
; FPGA-channel -> i2c-bus map
|
||||
; LTC2980_Margin_Script/Ref/*.md 0x15 trace note corrected to send-byte
|
||||
; LTC2980_Margin_Script/script/margin_save_all.sh Point at margin_save all; keep it for subsets
|
||||
; config.ttl FAN_SPEED 30 -> 100 (full speed by default)
|
||||
; =============================================================================
|
||||
include "config.ttl"
|
||||
|
||||
@@ -94,7 +131,7 @@ sendln cmd
|
||||
|
||||
;Stress log clear
|
||||
wait prompt_sonic_root
|
||||
sendln "rm /host/hw-eval/current/jobs/*"
|
||||
sendln "rm /host/hw-eval/jobs/*"
|
||||
|
||||
; ========== HW Test Session ==========
|
||||
wait prompt_sonic_root
|
||||
@@ -218,7 +255,6 @@ sendln "~/Blanton_Script/mgmt_ping_monitor.sh clear"
|
||||
|
||||
|
||||
; ========== 100G Port Status ==========
|
||||
; Lpmode Disable
|
||||
wait prompt_sonic_root
|
||||
sendln "sudo sfputil lpmode off Ethernet513"
|
||||
wait prompt_sonic_root
|
||||
@@ -233,6 +269,37 @@ sendln "config save -y"
|
||||
wait prompt_sonic_root
|
||||
sendln "show interfaces status Ethernet513,Ethernet514"
|
||||
|
||||
;=============================================================================================================
|
||||
; ========== 100G PRBS ==========
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh start"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "sleep 10"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh status"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh stop"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh report"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh clear"
|
||||
|
||||
; ========== 100G Port Status ==========
|
||||
;wait prompt_sonic_root
|
||||
;sendln "sudo sfputil lpmode off Ethernet513"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "sudo sfputil lpmode off Ethernet514"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "config interface -n asic0 startup Ethernet513"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "config interface -n asic1 startup Ethernet514"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "config save -y"
|
||||
|
||||
;wait prompt_sonic_root
|
||||
;sendln "show interfaces status Ethernet513,Ethernet514"
|
||||
;=============================================================================================================
|
||||
|
||||
; ========== First Traffic Test ==========
|
||||
; Silent MAC
|
||||
wait prompt_sonic_root
|
||||
|
||||
@@ -40,7 +40,7 @@ sendln "bgctl run /usr/sbin/memtester 1G" ; Continue Execture
|
||||
|
||||
; ========== SSD read/write ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "bgctl run qfx5252-stress-ssd 1G --runtime 3600 --passes 5 --write --force --log /host/hw-eval/current/qfx5252-stress-ssd.log"
|
||||
sendln "bgctl run qfx5252-stress-ssd 1G --runtime 3600 --passes 5 --write --force --log /host/hw-eval/jobs/qfx5252-stress-ssd.log"
|
||||
|
||||
; ========== USB read/write ==========
|
||||
; ---- Get USB partition node -> usb_dev ----
|
||||
@@ -51,7 +51,7 @@ waitregex '<<DEV=([^>]*)>>'
|
||||
usb_dev = groupmatchstr1
|
||||
|
||||
wait prompt_sonic_root
|
||||
sprintf2 cmd "bgctl run qfx5252-stress-usb %s 256M --runtime 60 --passes 1 --write --log /host/hw-eval/qfx5252-stress-usb.log" usb_dev
|
||||
sprintf2 cmd "bgctl run qfx5252-stress-usb %s 256M --runtime 60 --passes 1 --write --log /host/hw-eval/jobs/qfx5252-stress-usb.log" usb_dev
|
||||
sendln cmd
|
||||
|
||||
;wait prompt_sonic_root
|
||||
@@ -105,6 +105,12 @@ sendln "./Blanton_Script/mgmt_ping_monitor.sh status"
|
||||
wait prompt_sonic_root
|
||||
sendln "show interfaces status Ethernet513,Ethernet514"
|
||||
|
||||
;=============================================================================================================
|
||||
; ========== 100G PRBS ==========
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh start"
|
||||
;=============================================================================================================
|
||||
|
||||
|
||||
; ========== Traffic START ==========
|
||||
; Silent MAC
|
||||
@@ -155,11 +161,16 @@ endif
|
||||
|
||||
|
||||
|
||||
; ========== Get data every 10mins ==========
|
||||
; ========== Monitor loop: platform data + background jobs (pause 60s per round) ==========
|
||||
while 1
|
||||
include "utils/setup_pmon.ttl"
|
||||
wait prompt_sonic_root
|
||||
sendln "bgctl list"
|
||||
wait prompt_sonic_root
|
||||
sendln "jobs"
|
||||
; ========== Check Margin ==========
|
||||
if EN_Margin = 1 then
|
||||
include "utils/show_margin_status.ttl"
|
||||
endif
|
||||
endwhile
|
||||
pause 60
|
||||
endwhile
|
||||
|
||||
@@ -25,8 +25,23 @@ wait prompt_sonic_root
|
||||
sendln "~/Blanton_Script/mgmt_ping_monitor.sh status"
|
||||
wait prompt_sonic_root
|
||||
sendln "~/Blanton_Script/mgmt_ping_monitor.sh stop"
|
||||
wait prompt_sonic_root
|
||||
sendln "cat ~/Blanton_Script/log/mgmt_ping.log"
|
||||
|
||||
;=============================================================================================================
|
||||
; 100G PRBS STOP
|
||||
;wait prompt_sonic_root
|
||||
;sendln "~/Blanton_Script/port_prbs_monitor.sh stop"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "sudo sfputil lpmode off Ethernet513"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "sudo sfputil lpmode off Ethernet514"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "config interface -n asic0 startup Ethernet513"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "config interface -n asic1 startup Ethernet514"
|
||||
;=============================================================================================================
|
||||
|
||||
|
||||
|
||||
|
||||
; ========== TAKE DATA ==========
|
||||
include "utils/setup_pmon.ttl"
|
||||
@@ -64,16 +79,26 @@ sendln "cat ./Blanton_Script/log/bmc_poll.log"
|
||||
;wait prompt_sonic_root
|
||||
;sendln "journalctl -u qfx5252-bmc-usb-net-test.service --no-pager"
|
||||
|
||||
; ========== 10G/1G MGMT Test result ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "ip -s link show eth0"
|
||||
wait prompt_sonic_root
|
||||
sendln "ip -s link show eth1"
|
||||
|
||||
|
||||
; ========== CHECK Stress results ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "cat ~/hammer/tools/amd/mlucas_amm_log"
|
||||
wait prompt_sonic_root
|
||||
sendln "cat /host/hw-eval/jobs/qfx5252-stress-ssd.log"
|
||||
wait prompt_sonic_root
|
||||
sendln "cat /host/hw-eval/jobs/qfx5252-stress-usb.log"
|
||||
|
||||
; ========== 10G/1G MGMT Test result ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "cat ~/Blanton_Script/log/mgmt_ping.log"
|
||||
|
||||
; ========== 100G Port ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "show interfaces status Ethernet513,Ethernet514"
|
||||
;=============================================================================================================
|
||||
;wait prompt_sonic_root
|
||||
;sendln "cat ~/Blanton_Script/log/port_prbs.log "
|
||||
;=============================================================================================================
|
||||
|
||||
; ========== CHECK Traffic counters ==========
|
||||
if SWB_UNIT0 = 1 && SWB_UNIT1 = 1 then
|
||||
@@ -109,17 +134,31 @@ sendln "show reboot-cause"
|
||||
wait prompt_sonic_root
|
||||
sendln "show uptime"
|
||||
|
||||
|
||||
; ---- Get USB partition node -> usb_dev ----
|
||||
usb_dev = ''
|
||||
wait prompt_sonic_root
|
||||
sendln 'D=$(bash ~/Blanton_Script/usb_target.sh -o dev 2>/dev/null); echo "<<D""EV=${D:-NONE}>>"'
|
||||
waitregex '<<DEV=([^>]*)>>'
|
||||
usb_dev = groupmatchstr1
|
||||
|
||||
wait prompt_sonic_root
|
||||
sendln "sync"
|
||||
wait prompt_sonic_root
|
||||
sprintf2 cmd "mount %s /mnt/usb" usb_dev
|
||||
sendln cmd
|
||||
|
||||
; ========== Copy Stress Log to USB ==========
|
||||
wait prompt_sonic_root
|
||||
sendln "cp ./Blanton_Script/log/bmc_poll.log /host/hw-eval/current/jobs/"
|
||||
sendln "cp ./Blanton_Script/log/bmc_poll.log /host/hw-eval/jobs/"
|
||||
wait prompt_sonic_root
|
||||
sendln "cp ./Blanton_Script/log/mgmt_ping.log /host/hw-eval/current/jobs/"
|
||||
sendln "cp ./Blanton_Script/log/mgmt_ping.log /host/hw-eval/jobs/"
|
||||
|
||||
wait prompt_sonic_root
|
||||
getdate ts_date "%Y%m%d"
|
||||
gettime ts_time "%H%M"
|
||||
sprintf2 usb_dst "/mnt/usb/jobs-%s_%s" ts_date ts_time
|
||||
sprintf2 cmd "cp -r /host/hw-eval/current/jobs/ %s" usb_dst
|
||||
sprintf2 cmd "cp -r /host/hw-eval/jobs/ %s" usb_dst
|
||||
sendln cmd
|
||||
|
||||
; ========== HW Test Session ==========
|
||||
|
||||
@@ -14,6 +14,8 @@
|
||||
| `margin_operation <ch> <op>` | 只切 OPERATION register |
|
||||
| `margin_apply_profile <file>` | 批次套用 profile(套用在當前載入的 LTC2980) |
|
||||
| `margin_save` | 寫入 NVM(當前 LTC2980 的兩個 LTC2977 都寫) |
|
||||
| `margin_save all` | 對 `settings/` 底下**全部** LTC2980 寫入 NVM,結束後回到原本載入的那顆 |
|
||||
| `margin_save blanton` | **Blanton SONiC 專用**:18 顆 LTC2977 全部走原生 i2c bus 寫入,不需要 `margin_init` |
|
||||
| `margin_debug [on\|off]` | 開關 debug 模式(不帶參數則 toggle) |
|
||||
| `margin_log [on\|off]` | 開關 log 記錄(不帶參數則 toggle,預設開啟) |
|
||||
|
||||
@@ -79,7 +81,9 @@ margin_init Blanton_SWB1_CONN16
|
||||
margin_apply_profile profiles/comboA.conf
|
||||
|
||||
# 儲存到 NVM(斷電後保留)
|
||||
margin_save
|
||||
margin_save # 只寫當前載入的那顆
|
||||
margin_save all # settings/ 底下 9 顆全部寫,最後自動切回原本那顆
|
||||
margin_save blanton # Blanton SONiC 專用捷徑,18 顆一次寫完(見下)
|
||||
```
|
||||
|
||||
## 一次掃所有 LTC2980
|
||||
@@ -131,16 +135,87 @@ PROFILES=(
|
||||
|
||||
## 一次把所有 LTC2980 寫入 NVM
|
||||
|
||||
`script/margin_save_all.sh` 對 `BOARDS` 列出的每顆 LTC2980 跑 `margin_save`。
|
||||
|
||||
> ⚠️ `margin_save` 會把當前 margin / OV / UV 設定**永久寫入 NVM**,
|
||||
> 斷電後保留。執行前先用 `margin_status_all.sh` 確認狀態正確。
|
||||
|
||||
**全部 9 顆**直接用內建的:
|
||||
|
||||
```bash
|
||||
margin_save all
|
||||
```
|
||||
|
||||
依 `settings/*.conf` 的檔名順序跑,中途某顆失敗**不會停**(半套完成的狀態比全部試完更難查),
|
||||
最後印出「幾顆成功 / 哪幾顆失敗」的總結,並把 `margin_init` 切回你呼叫前載入的那顆。
|
||||
|
||||
**只寫其中幾顆**才需要 `script/margin_save_all.sh`,編 script 頂端的 `BOARDS` 陣列:
|
||||
|
||||
```bash
|
||||
source script/margin_save_all.sh
|
||||
```
|
||||
|
||||
要改寫哪幾顆,編 script 頂端的 `BOARDS` 陣列即可(同前述)。
|
||||
### 送出去的是什麼
|
||||
|
||||
`margin_save` 對每顆 LTC2977 送一次 `STORE_USER_ALL`(PMBus command `0x15`),
|
||||
**不分 page**(這是整顆晶片的命令),也**不帶 data byte** —— 它是 SMBus send-byte:
|
||||
|
||||
```bash
|
||||
i2cset -y 4 0x5C 0x15 c # CB CONN13(原生 bus 4)
|
||||
cb_pmbus_write 8 0x5C 0x15 # SWB0 CONN13(CB FPGA F3 Ch8)
|
||||
```
|
||||
|
||||
> v2.7.0 之前送的是 `0x15 0x00`(write-byte)。LTC2977 在 CB 上吃得下去,但那是零件寬容,
|
||||
> 不是規範。同時 v2.7.0 起會檢查回傳值 —— 以前 NACK 了還是印 `Change Saved`。
|
||||
|
||||
每顆之間會 `sleep $MARGIN_STORE_SETTLE`(預設 0.5 秒)。這不是量測值,是保守的保護:
|
||||
NVM 寫入需要時間,而這支工具**沒有**去 poll 零件的 busy bit。`margin_save all` 連續送 18 次,
|
||||
這個間隔就是唯一的緩衝。要關掉設成空字串即可。
|
||||
|
||||
## `margin_save blanton` — Blanton SONiC 專用
|
||||
|
||||
Blanton 這台把 CB FPGA F3 的 I2C 通道**同時掛成了原生 Linux i2c adapter**,
|
||||
所以 SWB 上的 LTC2977 不必走 `cb_pmbus_*` / pcimem,用 `i2cset` 直接打得到:
|
||||
|
||||
| FPGA F3 通道 | Linux bus | 板 / 接頭 |
|
||||
|---|---|---|
|
||||
| Ch6 | 13 | SWB0 CONN14 / CONN16 |
|
||||
| Ch8 | 15 | SWB0 CONN13 / CONN15 |
|
||||
| Ch7 | 14 | SWB1 CONN14 / CONN16 |
|
||||
| Ch9 | 16 | SWB1 CONN13 / CONN15 |
|
||||
| —(原生) | 4 | CB CONN13 |
|
||||
|
||||
因此 `margin_save blanton` 就是一張平表跑完 18 顆,**不需要 `margin_init`**、
|
||||
不做 FPGA 通道初始化、不做 probe,也不會動到你當前載入的那顆板子:
|
||||
|
||||
```bash
|
||||
margin_save blanton
|
||||
```
|
||||
|
||||
```
|
||||
CB CONN13 bus 4 0x5C : saved
|
||||
SWB0 CONN13 bus 15 0x5C : saved
|
||||
...
|
||||
margin_save blanton: 18 saved, 0 failed
|
||||
```
|
||||
|
||||
送出去的就是這 18 行(2026-08-27 上機驗證):
|
||||
|
||||
```bash
|
||||
i2cset -f -y 4 0x5C 0x15 ; i2cset -f -y 4 0x5E 0x15 # CB CONN13
|
||||
i2cset -f -y 15 0x5C 0x15 ; i2cset -f -y 15 0x5E 0x15 # SWB0 CONN13
|
||||
i2cset -f -y 13 0x5C 0x15 ; i2cset -f -y 13 0x5E 0x15 # SWB0 CONN14
|
||||
i2cset -f -y 15 0x62 0x15 ; i2cset -f -y 15 0x64 0x15 # SWB0 CONN15
|
||||
i2cset -f -y 13 0x62 0x15 ; i2cset -f -y 13 0x64 0x15 # SWB0 CONN16
|
||||
i2cset -f -y 16 0x5C 0x15 ; i2cset -f -y 16 0x5E 0x15 # SWB1 CONN13
|
||||
i2cset -f -y 14 0x5C 0x15 ; i2cset -f -y 14 0x5E 0x15 # SWB1 CONN14
|
||||
i2cset -f -y 16 0x62 0x15 ; i2cset -f -y 16 0x64 0x15 # SWB1 CONN15
|
||||
i2cset -f -y 14 0x62 0x15 ; i2cset -f -y 14 0x64 0x15 # SWB1 CONN16
|
||||
```
|
||||
|
||||
`-f` 是因為這些 bus 上的 LTC2977 可能已被 kernel driver 認走;上機驗證過的指令帶 `-f`,就照原樣保留。
|
||||
|
||||
**這台沒裝滿的話**,把 `margin.sh` 頂端 `MARGIN_BLANTON_STORE` 陣列裡對應的行註解掉即可,
|
||||
不要讓它去打不存在的板子。bus 節點不存在(`/dev/i2c-N` 沒有)與晶片不回應(NACK)
|
||||
會分別報不同訊息 —— 前者代表 FPGA 的 i2c adapter 根本沒 enumerate,後者才是板子的問題。
|
||||
|
||||
## Operation 對應
|
||||
|
||||
|
||||
+3
-2
@@ -424,8 +424,9 @@ SWB debug 指令(margin.sh v2.6.0 新增,皆為 `blanton_cb_i2c.sh` 的薄包裝
|
||||
`Blanton_SWB0_CONN14.conf` 的第一顆也是 `0:0x5E`。兩個 CONN 現在同在 Ch6,
|
||||
位址相撞。對照 SWB1 的規律(CONN13=`0x5C/0x5D`、CONN14=`0x5E/0x5F`),
|
||||
SWB0_CONN13 第二顆推測應為 `0:0x5D` — **尚未修改,待硬體確認**。
|
||||
- `margin_save` 走 `0x15` + data byte(`i2cset ... 0x15 0x00 b`)。PMBus 規範
|
||||
STORE_USER_ALL 是 send-byte;CB 上實測可用故保留原樣,swb 路徑沿用同一寫法。
|
||||
- `margin_save` 走 `0x15` **send-byte**(`i2cset ... 0x15 c` / `cb_pmbus_write <ch> <addr> 0x15`),
|
||||
不帶 data byte。v2.7.0 之前送的是 `0x15 0x00`(write-byte),CB 上實測可用,
|
||||
但那是零件寬容而非規範。
|
||||
|
||||
---
|
||||
|
||||
|
||||
@@ -5,6 +5,24 @@
|
||||
# =============================================================================
|
||||
# Version Control
|
||||
# -----------------------------------------------------------------------------
|
||||
# v2.7.0 margin_save fixes and batching:
|
||||
# * STORE_USER_ALL (0x15) is now issued as an SMBus send-byte instead
|
||||
# of a write-byte with a dummy 0x00 data byte. The LTC2977 accepted
|
||||
# the old form on CB, but it was the wrong protocol.
|
||||
# i2c path: i2cset ... 0x15 c swb path: cb_pmbus_write ch addr 0x15
|
||||
# * margin_save all -- STORE_USER_ALL on every board in settings/,
|
||||
# then re-init whichever board was loaded beforehand. Does not stop
|
||||
# on the first failure; prints a per-board summary at the end.
|
||||
# * The store result is now checked. It used to be discarded, so a
|
||||
# NACK still printed "Change Saved".
|
||||
# * MARGIN_STORE_SETTLE (default 0.5s) between stores - nothing polls
|
||||
# the part's busy bit, and `all` issues 18 of them in a row.
|
||||
# * margin_save blanton -- Blanton SONiC shortcut. On this platform the
|
||||
# CB FPGA F3 I2C channels also appear as native Linux i2c adapters
|
||||
# (Ch6->bus 13, Ch7->14, Ch8->15, Ch9->16), so all 18 LTC2977 can be
|
||||
# stored with plain i2cset: no margin_init, no FPGA channel setup,
|
||||
# no pcimem. Bench-verified on the DUT 2026-08-27. The board list is
|
||||
# MARGIN_BLANTON_STORE at the top of this file.
|
||||
# v2.6.0 SWB path actually wired to the shared CB I2C package. blanton_cb_i2c.sh
|
||||
# and blanton_fpga_pcimem.sh live in the PARENT dir (Blanton_Script/), not
|
||||
# next to margin.sh, so the backend is now searched in both places.
|
||||
@@ -115,6 +133,45 @@ ONOFF_ENABLE_VALUE="0x1a" # controlled_on=1, use_pmbus=1, use_control=0, b1=1
|
||||
# margin_status after all channels are set. Bump this if you want margin_set's own
|
||||
# read-back to reflect the settled value.
|
||||
MARGIN_SETTLE="0.3"
|
||||
# Pause after each STORE_USER_ALL. The LTC2977 is busy committing NVM once the
|
||||
# command lands and nothing here polls a busy bit, so this is a plain guard
|
||||
# rather than a measured value - it matters most for `margin_save all`, which
|
||||
# fires 18 stores back to back. Set to "" to disable.
|
||||
MARGIN_STORE_SETTLE="${MARGIN_STORE_SETTLE:-0.5}"
|
||||
|
||||
# --- `margin_save blanton`: the bench-verified Blanton SONiC store list -------
|
||||
# On this platform the CB FPGA F3 I2C channels are ALSO exposed as native Linux
|
||||
# i2c adapters, so every LTC2977 - CB and SWB alike - can be reached with plain
|
||||
# i2cset. That path needs no FPGA channel setup, no pcimem, and no margin_init:
|
||||
# one flat list, 18 commands, done. Verified on the DUT 2026-08-27.
|
||||
#
|
||||
# FPGA F3 channel -> Linux bus: Ch6->13 Ch7->14 Ch8->15 Ch9->16
|
||||
#
|
||||
# Entry format: "bus:addr:label". Comment out the lines for boards this DUT does
|
||||
# not have rather than letting them fail - a single-SWB unit is a normal build.
|
||||
MARGIN_BLANTON_STORE=(
|
||||
"4:0x5C:CB CONN13"
|
||||
"4:0x5E:CB CONN13"
|
||||
"15:0x5C:SWB0 CONN13"
|
||||
"15:0x5E:SWB0 CONN13"
|
||||
"13:0x5C:SWB0 CONN14"
|
||||
"13:0x5E:SWB0 CONN14"
|
||||
"15:0x62:SWB0 CONN15"
|
||||
"15:0x64:SWB0 CONN15"
|
||||
"13:0x62:SWB0 CONN16"
|
||||
"13:0x64:SWB0 CONN16"
|
||||
"16:0x5C:SWB1 CONN13"
|
||||
"16:0x5E:SWB1 CONN13"
|
||||
"14:0x5C:SWB1 CONN14"
|
||||
"14:0x5E:SWB1 CONN14"
|
||||
"16:0x62:SWB1 CONN15"
|
||||
"16:0x64:SWB1 CONN15"
|
||||
"14:0x62:SWB1 CONN16"
|
||||
"14:0x64:SWB1 CONN16"
|
||||
)
|
||||
# -f because the LTC2977s may be claimed by a kernel driver on these buses; the
|
||||
# command that was verified on the bench carries it, so it stays.
|
||||
MARGIN_BLANTON_I2CSET_FLAGS="${MARGIN_BLANTON_I2CSET_FLAGS:--f -y}"
|
||||
_BUS=""
|
||||
_ADDR=""
|
||||
_PRE_SCOPE="" # set while inside a PRE/POST wrapped operation; prevents nested re-entry
|
||||
@@ -257,6 +314,20 @@ _swb_write() {
|
||||
return 0
|
||||
}
|
||||
|
||||
# _swb_send <cmd> -> cb_pmbus_write with NO data byte (SMBus send-byte).
|
||||
# cb_pmbus_write routes a no-data call to _cbi2c_xfer_cmd_only: START, slave+W,
|
||||
# command byte, STOP. That is what STORE_USER_ALL expects.
|
||||
_swb_send() {
|
||||
local reg=$1
|
||||
[ "$DEBUG_MODE" = "1" ] && echo -e "\033[90m[DEBG] cb_pmbus_write $CB_I2C_CH $_ADDR $reg (send-byte)\033[0m"
|
||||
if ! _swb_call cb_pmbus_write "$CB_I2C_CH" "$_ADDR" "$reg" >/dev/null 2>&1; then
|
||||
echo -e "[\033[31mERRO\033[0m] cb_pmbus_write ch=$CB_I2C_CH $_ADDR reg=$reg (send-byte) failed (NACK/timeout)" >&2
|
||||
_log_detail "ERRO cb_pmbus_write ch=$CB_I2C_CH $_ADDR $reg send-byte"
|
||||
return 1
|
||||
fi
|
||||
return 0
|
||||
}
|
||||
|
||||
# _swb_read_word <reg> -> echoes "0xXXXX" parsed out of cb_pmbus_read's "=> 0xXXXX"
|
||||
_swb_read_word() {
|
||||
local reg=$1 out word
|
||||
@@ -520,6 +591,20 @@ _i2c_write_byte() {
|
||||
i2cset -y "$_BUS" "$_ADDR" "$1" "$2" b >/dev/null 2>&1
|
||||
}
|
||||
|
||||
# Send a PMBus command with NO data byte (SMBus send-byte).
|
||||
# STORE_USER_ALL (0x15) and its relatives are send-byte commands: the command
|
||||
# byte alone triggers them. Appending a dummy 0x00 makes it a write-byte, which
|
||||
# is a different SMBus protocol - the LTC2977 happened to accept it, but that is
|
||||
# tolerance, not correctness. i2cset's "c" mode is the send-byte form.
|
||||
_i2c_send_byte() {
|
||||
if [ "$TRANSPORT" = "swb" ]; then
|
||||
_swb_send "$1"
|
||||
return
|
||||
fi
|
||||
[ "$DEBUG_MODE" = "1" ] && echo -e "\033[90m[DEBG] i2cset -y $_BUS $_ADDR $1 c\033[0m"
|
||||
i2cset -y "$_BUS" "$_ADDR" "$1" c >/dev/null 2>&1
|
||||
}
|
||||
|
||||
# Read a 16-bit word; echoes "0xXXXX". For swb, parse cb_pmbus_read's "=> 0xXXXX".
|
||||
_i2c_read_word() {
|
||||
if [ "$TRANSPORT" = "swb" ]; then
|
||||
@@ -730,20 +815,171 @@ margin_apply_profile() {
|
||||
}
|
||||
|
||||
# --- Save to NVM ---
|
||||
# margin_save -- STORE_USER_ALL on the currently initialised board
|
||||
# margin_save all -- ... on every board in settings/, then re-init the one
|
||||
# that was loaded when you called it
|
||||
# margin_save blanton -- Blanton SONiC shortcut: all 18 LTC2977 straight over
|
||||
# the native i2c buses, no margin_init needed
|
||||
#
|
||||
# ⚠️ This is the only permanent write in the tool: it commits the current
|
||||
# margin / OV / UV registers to NVM, and a power cycle will NOT undo it.
|
||||
# Run margin_status first and never call it during a test run.
|
||||
margin_save() {
|
||||
if [ "${1:-}" = "all" ]; then
|
||||
_margin_save_every_board
|
||||
return
|
||||
fi
|
||||
if [ "${1:-}" = "blanton" ]; then
|
||||
_margin_save_blanton
|
||||
return
|
||||
fi
|
||||
|
||||
local _own=0
|
||||
_pre_enter_own && _own=1
|
||||
|
||||
local chip fails=0
|
||||
for chip in "${CHIPS[@]}"; do
|
||||
IFS=':' read -r _BUS _ADDR <<< "$chip"
|
||||
_i2c_write_byte 0x15 0x00
|
||||
# STORE_USER_ALL is chip-wide (all 8 pages), so no _open_page here.
|
||||
if _i2c_send_byte 0x15; then
|
||||
_log_detail "STORE_USER_ALL $PART_NUMBER $_ADDR ok"
|
||||
else
|
||||
fails=$(( fails + 1 ))
|
||||
echo -e "[\033[31mERRO\033[0m] STORE_USER_ALL failed on $_ADDR" >&2
|
||||
_log_detail "ERRO STORE_USER_ALL $PART_NUMBER $_ADDR"
|
||||
fi
|
||||
# The part is busy writing NVM after this; nothing here polls a busy bit,
|
||||
# so leave a gap before touching it again. See MARGIN_STORE_SETTLE.
|
||||
[ -n "$MARGIN_STORE_SETTLE" ] && sleep "$MARGIN_STORE_SETTLE"
|
||||
done
|
||||
echo "Change Saved (${#CHIPS[@]} chips)"
|
||||
_log_label "margin_save $PART_NUMBER (${#CHIPS[@]} chips)"
|
||||
|
||||
if [ "$fails" -eq 0 ]; then
|
||||
echo "Change Saved (${#CHIPS[@]} chips)"
|
||||
else
|
||||
echo -e "[\033[31mERRO\033[0m] $fails of ${#CHIPS[@]} chips did NOT save"
|
||||
fi
|
||||
_log_label "margin_save $PART_NUMBER (${#CHIPS[@]} chips, $fails failed)"
|
||||
|
||||
[ "$_own" = "1" ] && _pre_exit
|
||||
return $(( fails > 0 ))
|
||||
}
|
||||
|
||||
# margin_save all -- every .conf in settings/, in filename order.
|
||||
# Deliberately does NOT stop on the first failure: a half-saved set is worse to
|
||||
# diagnose than a fully-attempted one, and the summary tells you which boards
|
||||
# to redo. margin_init is re-run per board because CHIPS / TRANSPORT /
|
||||
# CB_I2C_CH are global state.
|
||||
_margin_save_every_board() {
|
||||
local files=( "$SETTINGS_DIR"/*.conf )
|
||||
if [ ! -e "${files[0]}" ]; then
|
||||
echo -e "[\033[31mERRO\033[0m] no .conf found in $SETTINGS_DIR"
|
||||
return 1
|
||||
fi
|
||||
|
||||
local restore="$PART_NUMBER" # empty if margin_init was never run
|
||||
local board f ok=0 bad=0 failed=""
|
||||
|
||||
echo "-------------"
|
||||
echo "margin_save all -- ${#files[@]} boards, permanent NVM write"
|
||||
echo "-------------"
|
||||
_log_label "margin_save all (${#files[@]} boards)"
|
||||
|
||||
for f in "${files[@]}"; do
|
||||
board=$(basename "$f" .conf)
|
||||
echo ""
|
||||
if ! margin_init "$board"; then
|
||||
bad=$(( bad + 1 )); failed="$failed $board(init)"
|
||||
continue
|
||||
fi
|
||||
if margin_save; then
|
||||
ok=$(( ok + 1 ))
|
||||
else
|
||||
bad=$(( bad + 1 )); failed="$failed $board"
|
||||
fi
|
||||
done
|
||||
|
||||
echo ""
|
||||
echo "-------------"
|
||||
printf "margin_save all: %d saved, %d failed\n" "$ok" "$bad"
|
||||
[ "$bad" -gt 0 ] && echo -e "[\033[31mERRO\033[0m] failed:$failed"
|
||||
echo "-------------"
|
||||
_log_label "margin_save all done: $ok ok, $bad failed$failed"
|
||||
|
||||
# Put back whatever board the caller had loaded, so a following
|
||||
# margin_status does not silently report the last board in the list.
|
||||
if [ -n "$restore" ] && [ "$restore" != "$board" ]; then
|
||||
echo ""
|
||||
echo -e "[\033[34mINFO\033[0m] restoring previous board: $restore"
|
||||
margin_init "$restore" >/dev/null
|
||||
fi
|
||||
|
||||
return $(( bad > 0 ))
|
||||
}
|
||||
|
||||
# margin_save blanton -- Blanton SONiC only. Walks MARGIN_BLANTON_STORE and
|
||||
# sends STORE_USER_ALL to each LTC2977 over the native i2c buses.
|
||||
#
|
||||
# Deliberately does NOT use margin_init / CHIPS / TRANSPORT: the whole point is
|
||||
# that on this platform every LTC2977 is reachable with plain i2cset, so the
|
||||
# FPGA channel setup and the per-board probe are not needed. That also means it
|
||||
# does not touch the loaded board - PART_NUMBER is the same afterwards.
|
||||
_margin_save_blanton() {
|
||||
local n=${#MARGIN_BLANTON_STORE[@]}
|
||||
if [ "$n" -eq 0 ]; then
|
||||
echo -e "[\033[31mERRO\033[0m] MARGIN_BLANTON_STORE is empty"
|
||||
return 1
|
||||
fi
|
||||
|
||||
echo "-------------"
|
||||
echo "margin_save blanton -- $n LTC2977, permanent NVM write"
|
||||
echo "-------------"
|
||||
_log_label "margin_save blanton ($n chips)"
|
||||
|
||||
local entry bus addr label ok=0 bad=0 failed=""
|
||||
for entry in "${MARGIN_BLANTON_STORE[@]}"; do
|
||||
IFS=':' read -r bus addr label <<< "$entry"
|
||||
|
||||
# "no such bus" and "chip did not answer" are different faults: the first
|
||||
# means the FPGA i2c adapters did not enumerate, the second means the
|
||||
# board is absent or the address is wrong. Do not blur them into one.
|
||||
if [ ! -e "/dev/i2c-$bus" ]; then
|
||||
echo -e "[\033[31mERRO\033[0m] $label bus $bus addr $addr : /dev/i2c-$bus does not exist"
|
||||
_log_detail "ERRO STORE_USER_ALL $label bus=$bus addr=$addr no-such-bus"
|
||||
bad=$(( bad + 1 )); failed="$failed [$label $addr]"
|
||||
continue
|
||||
fi
|
||||
|
||||
[ "$DEBUG_MODE" = "1" ] && echo -e "\033[90m[DEBG] i2cset $MARGIN_BLANTON_I2CSET_FLAGS $bus $addr 0x15\033[0m"
|
||||
if i2cset $MARGIN_BLANTON_I2CSET_FLAGS "$bus" "$addr" 0x15 >/dev/null 2>&1; then
|
||||
printf " %-12s bus %-2s %s : saved\n" "$label" "$bus" "$addr"
|
||||
ok=$(( ok + 1 ))
|
||||
_log_detail "STORE_USER_ALL $label bus=$bus addr=$addr ok"
|
||||
else
|
||||
echo -e "[\033[31mERRO\033[0m] $label bus $bus addr $addr : i2cset failed (NACK/busy)"
|
||||
_log_detail "ERRO STORE_USER_ALL $label bus=$bus addr=$addr"
|
||||
bad=$(( bad + 1 )); failed="$failed [$label $addr]"
|
||||
fi
|
||||
|
||||
# No busy-bit poll anywhere in this tool; this gap is the only buffer.
|
||||
[ -n "$MARGIN_STORE_SETTLE" ] && sleep "$MARGIN_STORE_SETTLE"
|
||||
done
|
||||
|
||||
echo "-------------"
|
||||
printf "margin_save blanton: %d saved, %d failed\n" "$ok" "$bad"
|
||||
[ "$bad" -gt 0 ] && echo -e "[\033[31mERRO\033[0m] failed:$failed"
|
||||
echo "-------------"
|
||||
_log_label "margin_save blanton done: $ok ok, $bad failed$failed"
|
||||
|
||||
return $(( bad > 0 ))
|
||||
}
|
||||
|
||||
# --- Tab completion for margin_save ---
|
||||
_margin_save_completions() {
|
||||
[ "$COMP_CWORD" -ne 1 ] && return
|
||||
COMPREPLY=($(compgen -W "all blanton" -- "${COMP_WORDS[COMP_CWORD]}"))
|
||||
}
|
||||
complete -F _margin_save_completions margin_save
|
||||
|
||||
if [ -z "$_LOG_FILE" ]; then
|
||||
_LOG_FILE="$LOGS_DIR/margin_$(date '+%Y%m%d_%H%M%S').log"
|
||||
_LOG_DETAIL_FILE="${_LOG_FILE%.log}_detail.log"
|
||||
|
||||
@@ -4,6 +4,10 @@
|
||||
# ⚠️ margin_save 會把目前的 margin / OV / UV 設定**永久寫入 NVM**,
|
||||
# 斷電後仍保留。執行前請務必先 margin_status 確認各 channel 狀態正確。
|
||||
#
|
||||
# 全部 9 顆請直接用 margin.sh v2.7.0 內建的 `margin_save all` —— 它有成功/失敗總結,
|
||||
# 跑完還會把 margin_init 切回你原本載入的那顆。這支只在「只想寫其中幾顆」時才需要,
|
||||
# 編下面的 BOARDS 陣列。
|
||||
#
|
||||
# Usage:
|
||||
# source script/margin_save_all.sh
|
||||
|
||||
|
||||
@@ -0,0 +1,431 @@
|
||||
#!/bin/bash
|
||||
###############################################################################
|
||||
# port_prbs_monitor.sh
|
||||
#
|
||||
# Version : V1.0.0
|
||||
# Author : ETWen
|
||||
# Date : 20260826
|
||||
#
|
||||
# Purpose : Run a PRBS test on the two 100G uplinks AT THE SAME TIME and keep
|
||||
# polling until stopped. Each port gets its own background worker:
|
||||
#
|
||||
# setup : sfputil lpmode off <port>
|
||||
# phy diag <phy> prbs set <poly>
|
||||
# phy diag <phy> prbsstat STArt Interval=<n>
|
||||
# poll : phy diag <phy> prbs get <- PASS/FAIL comes from here
|
||||
# phydiag <phy> prbsstat Ber <- recorded only
|
||||
# stop : phydiag <phy> prbsstat STOp
|
||||
# phydiag <phy> prbs clear
|
||||
#
|
||||
# Every command and its full output goes to that port's raw log.
|
||||
# `stop` tears the test down and renders the report; `report`
|
||||
# prints the PASS/FAIL tally per port.
|
||||
#
|
||||
# Notes : - A poll counts as PASS only when the output contains "PRBS OK!".
|
||||
# bcmcmd exits 0 even when the BCM shell rejects a command, so the
|
||||
# exit status cannot be used -- only the output can.
|
||||
# - bcmcmd is always run with </dev/null. Without it, it inherits the
|
||||
# polling loop's stdin and eats it, and the loop runs once.
|
||||
#
|
||||
# Version History
|
||||
# V1.0.0 20260826 Initial Version
|
||||
###############################################################################
|
||||
|
||||
set -u
|
||||
|
||||
###############################################################################
|
||||
# User Configurable Section -- normally this is the only part you need to edit
|
||||
###############################################################################
|
||||
|
||||
# --- port A ---
|
||||
PORT_A_NAME="Ethernet513"
|
||||
PORT_A_UNIT=0 # bcmcmd -n <unit>
|
||||
PORT_A_PHY=268 # phy diag <phy>
|
||||
|
||||
# --- port B ---
|
||||
PORT_B_NAME="Ethernet514"
|
||||
PORT_B_UNIT=1
|
||||
PORT_B_PHY=268
|
||||
|
||||
# Which ports `start` runs when no argument is given: both | a | b
|
||||
# Override per run: start a / start b / start both
|
||||
# Running one at a time is how you tell a genuine port fault from the DUT not
|
||||
# coping with two PRBS streams at once.
|
||||
PORTS="both"
|
||||
|
||||
# --- PRBS ---
|
||||
PRBS_POLY="p=3" # passed to "prbs set"
|
||||
PRBS_STAT_INTERVAL=5 # passed to "prbsstat STArt Interval="
|
||||
POLL_INTERVAL_SEC=10 # seconds between polls
|
||||
PASS_PATTERN="PRBS OK!" # a poll is PASS only if the output contains this
|
||||
|
||||
# Seconds to wait after the setup commands before the first poll, so the link
|
||||
# has settled and the counters mean something.
|
||||
SETTLE_SEC=10
|
||||
|
||||
|
||||
# Stop after this many polls per port. 0 = run until stopped manually.
|
||||
MAX_POLLS=0
|
||||
|
||||
# How many recent poll blocks the report shows per port.
|
||||
TAIL_ENTRIES=20
|
||||
|
||||
# Prefix for privileged commands; empty because this already runs as root.
|
||||
SUDO=""
|
||||
BCMCMD="bcmcmd"
|
||||
|
||||
# Logging
|
||||
LOG_DIR="" # empty = <script directory>/log
|
||||
LOG_NAME="port_prbs.log"
|
||||
|
||||
# What `start` does with the log left behind by the previous run:
|
||||
# new | archive | append
|
||||
START_LOG_MODE="new"
|
||||
|
||||
###############################################################################
|
||||
# Internal
|
||||
###############################################################################
|
||||
SCRIPT_NAME="$(basename -- "${BASH_SOURCE[0]}")"
|
||||
SCRIPT_DIR="$(cd -- "$(dirname -- "${BASH_SOURCE[0]}")" && pwd)"
|
||||
SCRIPT_PATH="${SCRIPT_DIR}/${SCRIPT_NAME}"
|
||||
[ -n "${LOG_DIR}" ] || LOG_DIR="${SCRIPT_DIR}/log"
|
||||
|
||||
LOG_FILE="${LOG_DIR}/${LOG_NAME}"
|
||||
BASE="${LOG_DIR}/${LOG_NAME%.log}"
|
||||
PID_FILE="${BASE}.pid"
|
||||
STATE_FILE="${BASE}.state"
|
||||
RAW_A="${BASE}_${PORT_A_NAME}.raw"
|
||||
RAW_B="${BASE}_${PORT_B_NAME}.raw"
|
||||
|
||||
ts() { date '+%Y-%m-%d %H:%M:%S'; }
|
||||
|
||||
# port_tally <name> <raw> -> "<polls> <pass> <fail> <verdict>"
|
||||
# A raw without a "PRBS START" line means the port was not run this session,
|
||||
# which is SKIP -- reporting it as FAIL would make a deliberate single-port
|
||||
# run look like half the hardware is broken.
|
||||
port_tally() {
|
||||
local name="$1" raw="$2" pass fail polls verdict
|
||||
if [ ! -s "${raw}" ] || ! grep -aq "PRBS START ${name}" "${raw}" 2>/dev/null; then
|
||||
printf '0 0 0 SKIP'; return 0
|
||||
fi
|
||||
pass=$(grep -ac "PRBS ${name} poll=[0-9]* PASS" "${raw}" 2>/dev/null); pass=${pass:-0}
|
||||
fail=$(grep -ac "PRBS ${name} poll=[0-9]* FAIL" "${raw}" 2>/dev/null); fail=${fail:-0}
|
||||
polls=$(( pass + fail ))
|
||||
if [ "${polls}" -gt 0 ] && [ "${fail}" -eq 0 ]; then verdict=PASS; else verdict=FAIL; fi
|
||||
printf '%s %s %s %s' "${polls}" "${pass}" "${fail}" "${verdict}"
|
||||
}
|
||||
die() { printf '[ERROR] %s\n' "$*" >&2; exit 1; }
|
||||
|
||||
# bcm <unit> <dsh command> -- output on stdout, never trusts the exit status.
|
||||
# </dev/null so it cannot consume the caller's stdin.
|
||||
bcm() {
|
||||
local unit="$1" cmd="$2"
|
||||
${SUDO} "${BCMCMD}" -n "${unit}" -c "dsh -c \"${cmd}\"" </dev/null 2>&1
|
||||
}
|
||||
|
||||
# run_step <unit> <dsh command>
|
||||
# The command and its full output are written to the LOG via stderr, because
|
||||
# the worker has stderr pointed at the raw file. Only the output itself goes to
|
||||
# stdout, so `out="$(run_step ...)"` captures the output without swallowing the
|
||||
# log lines -- writing both to stdout would have put the whole record inside
|
||||
# the variable and left the log with nothing but the poll verdicts.
|
||||
run_step() {
|
||||
local unit="$1" cmd="$2" out
|
||||
out="$(bcm "${unit}" "${cmd}")"
|
||||
{
|
||||
printf '[%s] CMD : bcmcmd -n %s -c '\''dsh -c "%s"'\''\n' "$(ts)" "${unit}" "${cmd}"
|
||||
printf '%s\n' "${out}"
|
||||
} >&2
|
||||
printf '%s' "${out}"
|
||||
}
|
||||
|
||||
# Echo "<pid_a> <pid_b>" and return 0 while at least one worker is alive. A
|
||||
# port that was not started this run is recorded as "-", so a single-port run
|
||||
# is a first-class case rather than a half-broken two-port one.
|
||||
is_running() {
|
||||
local pa pb alive=0
|
||||
[ -f "${PID_FILE}" ] || return 1
|
||||
pa="$(sed -n '1p' "${PID_FILE}" 2>/dev/null)"; pa="${pa:--}"
|
||||
pb="$(sed -n '2p' "${PID_FILE}" 2>/dev/null)"; pb="${pb:--}"
|
||||
[[ "${pa}" =~ ^[0-9]+$ ]] && kill -0 "${pa}" 2>/dev/null && alive=1
|
||||
[[ "${pb}" =~ ^[0-9]+$ ]] && kill -0 "${pb}" 2>/dev/null && alive=1
|
||||
[ "${alive}" -eq 1 ] || return 1
|
||||
printf '%s %s' "${pa}" "${pb}"
|
||||
return 0
|
||||
}
|
||||
|
||||
###############################################################################
|
||||
# Worker -- one per port, launched by `start`
|
||||
###############################################################################
|
||||
WORKER_STOP=0
|
||||
worker_on_signal() { WORKER_STOP=1; }
|
||||
|
||||
# __worker <name> <unit> <phy> <rawfile>
|
||||
do_worker() {
|
||||
local name="$1" unit="$2" phy="$3" raw="$4"
|
||||
local n=0 pass=0 fail=0 out
|
||||
|
||||
exec >>"${raw}" 2>&1
|
||||
trap worker_on_signal INT TERM
|
||||
|
||||
printf '#############################################################\n'
|
||||
printf '[%s] PRBS START %s (unit %s, phy %s) poly=%s interval=%ss poll=%ss\n' \
|
||||
"$(ts)" "${name}" "${unit}" "${phy}" "${PRBS_POLY}" \
|
||||
"${PRBS_STAT_INTERVAL}" "${POLL_INTERVAL_SEC}"
|
||||
printf '#############################################################\n'
|
||||
|
||||
# --- setup ---
|
||||
printf '[%s] CMD : sfputil lpmode off %s\n' "$(ts)" "${name}"
|
||||
${SUDO} sfputil lpmode off "${name}" </dev/null 2>&1
|
||||
run_step "${unit}" "phy diag ${phy} prbs set ${PRBS_POLY}" >/dev/null
|
||||
run_step "${unit}" "phy diag ${phy} prbsstat STArt Interval=${PRBS_STAT_INTERVAL}" >/dev/null
|
||||
|
||||
sleep "${SETTLE_SEC}"
|
||||
|
||||
# --- poll ---
|
||||
while [ "${WORKER_STOP}" -eq 0 ]; do
|
||||
n=$(( n + 1 ))
|
||||
printf -- '---------- %s POLL %d @ %s ----------\n' "${name}" "${n}" "$(ts)"
|
||||
|
||||
out="$(run_step "${unit}" "phy diag ${phy} prbs get")"
|
||||
# Ber is recorded for the log only; it does not decide the verdict.
|
||||
run_step "${unit}" "phydiag ${phy} prbsstat Ber" >/dev/null
|
||||
|
||||
if printf '%s' "${out}" | grep -qF "${PASS_PATTERN}"; then
|
||||
pass=$(( pass + 1 ))
|
||||
printf '[%s] PRBS %s poll=%d PASS\n' "$(ts)" "${name}" "${n}"
|
||||
else
|
||||
fail=$(( fail + 1 ))
|
||||
printf '[%s] PRBS %s poll=%d FAIL\n' "$(ts)" "${name}" "${n}"
|
||||
fi
|
||||
|
||||
[ "${MAX_POLLS}" -gt 0 ] && [ "${n}" -ge "${MAX_POLLS}" ] && break
|
||||
[ "${WORKER_STOP}" -eq 0 ] || break
|
||||
sleep "${POLL_INTERVAL_SEC}"
|
||||
done
|
||||
|
||||
# --- teardown ---
|
||||
run_step "${unit}" "phydiag ${phy} prbsstat STOp" >/dev/null
|
||||
run_step "${unit}" "phydiag ${phy} prbs clear" >/dev/null
|
||||
printf '[%s] PRBS STOP %s polls=%d PASS=%d FAIL=%d\n' \
|
||||
"$(ts)" "${name}" "${n}" "${pass}" "${fail}"
|
||||
}
|
||||
|
||||
###############################################################################
|
||||
# Report
|
||||
###############################################################################
|
||||
# render_port <name> <unit> <phy> <raw>
|
||||
render_port() {
|
||||
local name="$1" unit="$2" phy="$3" raw="$4"
|
||||
local t polls pass fail verdict
|
||||
|
||||
t="$(port_tally "${name}" "${raw}")"
|
||||
polls="$(printf '%s' "${t}" | awk '{print $1}')"
|
||||
pass="$(printf '%s' "${t}" | awk '{print $2}')"
|
||||
fail="$(printf '%s' "${t}" | awk '{print $3}')"
|
||||
verdict="$(printf '%s' "${t}" | awk '{print $4}')"
|
||||
|
||||
if [ "${verdict}" = "SKIP" ]; then
|
||||
printf -- '----- %s (unit %s, phy %s) : not run this session -----\n\n' \
|
||||
"${name}" "${unit}" "${phy}"
|
||||
printf '[%s] RESULT %-12s polls=%-4s PASS=%-4s FAIL=%-4s %s\n\n' \
|
||||
"$(ts)" "${name}" "${polls}" "${pass}" "${fail}" "${verdict}"
|
||||
return 0
|
||||
fi
|
||||
|
||||
printf -- '----- %s (unit %s, phy %s) : last %s poll blocks -----\n' \
|
||||
"${name}" "${unit}" "${phy}" "${TAIL_ENTRIES}"
|
||||
grep -aE "^-{10} ${name} POLL|PRBS ${name} poll=|prbsstat Ber|^ *[0-9]+ *: " "${raw}" 2>/dev/null \
|
||||
| tail -n $(( TAIL_ENTRIES * 3 ))
|
||||
printf '\n'
|
||||
printf '[%s] RESULT %-12s polls=%-4s PASS=%-4s FAIL=%-4s %s\n\n' \
|
||||
"$(ts)" "${name}" "${polls}" "${pass}" "${fail}" "${verdict}"
|
||||
}
|
||||
|
||||
write_report() {
|
||||
local started
|
||||
started="$(sed -n '1p' "${STATE_FILE}" 2>/dev/null)"
|
||||
{
|
||||
printf '#############################################################\n'
|
||||
printf '[%s] 100G PRBS report\n' "$(ts)"
|
||||
printf ' started : %s\n' "${started:-unknown}"
|
||||
printf ' stopped : %s\n' "$(ts)"
|
||||
printf ' %s : unit %s, phy %s\n' "${PORT_A_NAME}" "${PORT_A_UNIT}" "${PORT_A_PHY}"
|
||||
printf ' %s : unit %s, phy %s\n' "${PORT_B_NAME}" "${PORT_B_UNIT}" "${PORT_B_PHY}"
|
||||
printf ' poly=%s prbsstat Interval=%s poll every %ss\n' \
|
||||
"${PRBS_POLY}" "${PRBS_STAT_INTERVAL}" "${POLL_INTERVAL_SEC}"
|
||||
printf ' a poll is PASS only when the output contains "%s"\n' "${PASS_PATTERN}"
|
||||
printf '#############################################################\n\n'
|
||||
|
||||
render_port "${PORT_A_NAME}" "${PORT_A_UNIT}" "${PORT_A_PHY}" "${RAW_A}"
|
||||
render_port "${PORT_B_NAME}" "${PORT_B_UNIT}" "${PORT_B_PHY}" "${RAW_B}"
|
||||
|
||||
# Taken after prbsstat STOp + prbs clear, so this is the recovered
|
||||
# state. During the test the same command would have reported DOWN.
|
||||
printf -- '--- show interfaces status %s,%s (after prbsstat STOp + prbs clear) ---\n' \
|
||||
"${PORT_A_NAME}" "${PORT_B_NAME}"
|
||||
${SUDO} show interfaces status "${PORT_A_NAME},${PORT_B_NAME}" </dev/null 2>&1
|
||||
} >> "${LOG_FILE}"
|
||||
}
|
||||
|
||||
###############################################################################
|
||||
# Sub-commands
|
||||
###############################################################################
|
||||
prepare_log_on_start() {
|
||||
local stamp
|
||||
case "${START_LOG_MODE}" in
|
||||
append) return 0 ;;
|
||||
archive)
|
||||
if [ -s "${LOG_FILE}" ]; then
|
||||
stamp="$(date '+%Y%m%d-%H%M%S')"
|
||||
mv -f "${LOG_FILE}" "${LOG_FILE}.${stamp}" || die "cannot archive ${LOG_FILE}"
|
||||
fi ;;
|
||||
new)
|
||||
[ -f "${LOG_FILE}" ] && { : > "${LOG_FILE}" || die "cannot truncate ${LOG_FILE}"; } ;;
|
||||
*) die "invalid START_LOG_MODE: ${START_LOG_MODE}" ;;
|
||||
esac
|
||||
}
|
||||
|
||||
# do_start [both|a|b|<port name>]
|
||||
do_start() {
|
||||
local which="${1:-${PORTS}}" pids pa="-" pb="-" run_a=0 run_b=0
|
||||
|
||||
case "${which}" in
|
||||
both|BOTH|all) run_a=1; run_b=1 ;;
|
||||
a|A|"${PORT_A_NAME}") run_a=1 ;;
|
||||
b|B|"${PORT_B_NAME}") run_b=1 ;;
|
||||
*) die "unknown port selector '${which}' (use: both | a | b | ${PORT_A_NAME} | ${PORT_B_NAME})" ;;
|
||||
esac
|
||||
|
||||
pids="$(is_running)" && die "already running (pids=${pids})"
|
||||
command -v "${BCMCMD}" >/dev/null 2>&1 || die "${BCMCMD} not found"
|
||||
|
||||
mkdir -p "${LOG_DIR}" || die "cannot create ${LOG_DIR}"
|
||||
prepare_log_on_start
|
||||
# Only the selected ports are truncated. A raw with no "PRBS START" line is
|
||||
# what the report uses to tell "not run this session" from "ran and failed".
|
||||
[ "${run_a}" -eq 1 ] && : > "${RAW_A}"
|
||||
[ "${run_b}" -eq 1 ] && : > "${RAW_B}"
|
||||
printf '%s\n' "$(ts)" > "${STATE_FILE}"
|
||||
|
||||
# One worker per selected port; with both, they run at the same time.
|
||||
# Invoked through bash so the file does not need the execute bit.
|
||||
if [ "${run_a}" -eq 1 ]; then
|
||||
setsid bash "${SCRIPT_PATH}" __worker \
|
||||
"${PORT_A_NAME}" "${PORT_A_UNIT}" "${PORT_A_PHY}" "${RAW_A}" >/dev/null 2>&1 &
|
||||
pa=$!
|
||||
disown "${pa}" 2>/dev/null
|
||||
fi
|
||||
if [ "${run_b}" -eq 1 ]; then
|
||||
setsid bash "${SCRIPT_PATH}" __worker \
|
||||
"${PORT_B_NAME}" "${PORT_B_UNIT}" "${PORT_B_PHY}" "${RAW_B}" >/dev/null 2>&1 &
|
||||
pb=$!
|
||||
disown "${pb}" 2>/dev/null
|
||||
fi
|
||||
printf '%s\n%s\n' "${pa}" "${pb}" > "${PID_FILE}"
|
||||
|
||||
sleep 1
|
||||
[ "${run_a}" -eq 1 ] && { kill -0 "${pa}" 2>/dev/null || die "${PORT_A_NAME} worker failed, see ${RAW_A}"; }
|
||||
[ "${run_b}" -eq 1 ] && { kill -0 "${pb}" 2>/dev/null || die "${PORT_B_NAME} worker failed, see ${RAW_B}"; }
|
||||
printf 'started (%s pid=%s, %s pid=%s)\nlog: %s\n' \
|
||||
"${PORT_A_NAME}" "${pa}" "${PORT_B_NAME}" "${pb}" "${LOG_FILE}"
|
||||
|
||||
# Deliberately NOT printing "show interfaces status" here. With PRBS armed
|
||||
# the link is out of normal operation and reports DOWN, which reads as a
|
||||
# failure to anyone glancing at the console. The status is shown in the
|
||||
# report instead, once PRBS has been cleared.
|
||||
}
|
||||
|
||||
do_stop() {
|
||||
local pids pa pb i
|
||||
pids="$(is_running)" || { printf 'not running\n'; rm -f "${PID_FILE}"; return 0; }
|
||||
pa="${pids% *}"; pb="${pids#* }"
|
||||
|
||||
# TERM lets each worker finish its poll and run prbsstat STOp / prbs clear.
|
||||
[[ "${pa}" =~ ^[0-9]+$ ]] && kill -TERM "${pa}" 2>/dev/null
|
||||
[[ "${pb}" =~ ^[0-9]+$ ]] && kill -TERM "${pb}" 2>/dev/null
|
||||
for (( i = 0; i < 120; i++ )); do
|
||||
kill -0 "${pa}" 2>/dev/null || kill -0 "${pb}" 2>/dev/null || break
|
||||
sleep 0.5
|
||||
done
|
||||
if kill -0 "${pa}" 2>/dev/null || kill -0 "${pb}" 2>/dev/null; then
|
||||
printf 'workers did not exit in time, sending SIGKILL (PRBS may be left running)\n' >&2
|
||||
kill -KILL "${pa}" 2>/dev/null
|
||||
kill -KILL "${pb}" 2>/dev/null
|
||||
fi
|
||||
|
||||
write_report
|
||||
rm -f "${PID_FILE}"
|
||||
printf 'stopped\nreport: %s\n' "${LOG_FILE}"
|
||||
}
|
||||
|
||||
do_report() {
|
||||
local name raw pass fail polls verdict
|
||||
printf '%-14s %-8s %-8s %-8s %s\n' PORT POLLS PASS FAIL RESULT
|
||||
printf '%-14s %-8s %-8s %-8s %s\n' -------------- -------- -------- -------- ------
|
||||
for spec in "${PORT_A_NAME}:${RAW_A}" "${PORT_B_NAME}:${RAW_B}"; do
|
||||
name="${spec%%:*}"; raw="${spec#*:}"
|
||||
set -- $(port_tally "${name}" "${raw}")
|
||||
printf '%-14s %-8s %-8s %-8s %s\n' "${name}" "$1" "$2" "$3" "$4"
|
||||
done
|
||||
}
|
||||
|
||||
do_status() {
|
||||
local pids
|
||||
if pids="$(is_running)"; then
|
||||
printf 'status : running (%s pid=%s, %s pid=%s)\n' \
|
||||
"${PORT_A_NAME}" "${pids% *}" "${PORT_B_NAME}" "${pids#* }"
|
||||
else
|
||||
printf 'status : stopped\n'
|
||||
fi
|
||||
printf 'log : %s\n' "${LOG_FILE}"
|
||||
do_report
|
||||
}
|
||||
|
||||
usage() {
|
||||
cat <<EOF
|
||||
Usage: ${SCRIPT_NAME} {start [both|a|b]|stop|status|report|clear}
|
||||
|
||||
start Set up PRBS and poll in the background. With no argument it runs
|
||||
\$PORTS (currently "${PORTS}"); "a" or "b" runs that port alone,
|
||||
which is how you tell a genuine port fault from the DUT not coping
|
||||
with two PRBS streams at once.
|
||||
start both ports at the same time
|
||||
start a ${PORT_A_NAME} only
|
||||
start b ${PORT_B_NAME} only
|
||||
Port status is NOT shown here: with PRBS armed the link reports
|
||||
DOWN, which looks like a failure. See the report instead.
|
||||
stop Stop polling, run prbsstat STOp + prbs clear on both ports, and
|
||||
render the report into the log
|
||||
report Print the PASS/FAIL tally per port
|
||||
status Show worker pids plus the current tally
|
||||
clear Remove the log and raw captures (must be stopped first)
|
||||
|
||||
Log file : ${LOG_FILE}
|
||||
Raw : ${RAW_A}
|
||||
${RAW_B}
|
||||
|
||||
A poll is PASS only when "phy diag <phy> prbs get" reports "${PASS_PATTERN}".
|
||||
prbsstat Ber is captured alongside every poll but does not decide the verdict.
|
||||
A port that was not run in this session reports SKIP, not FAIL.
|
||||
EOF
|
||||
}
|
||||
|
||||
###############################################################################
|
||||
# Entry point
|
||||
###############################################################################
|
||||
case "${1:-}" in
|
||||
start) shift; do_start "${1:-${PORTS}}" ;;
|
||||
stop) do_stop ;;
|
||||
status) do_status ;;
|
||||
report) do_report ;;
|
||||
clear)
|
||||
is_running >/dev/null && die "still running, stop it first"
|
||||
rm -f "${LOG_FILE}" "${LOG_FILE}".[0-9]* "${RAW_A}" "${RAW_B}" "${STATE_FILE}"
|
||||
printf 'log cleared\n' ;;
|
||||
__worker)
|
||||
shift
|
||||
do_worker "$1" "$2" "$3" "$4" ;;
|
||||
-h|--help|"") usage ;;
|
||||
*) printf '[ERROR] unknown sub-command: %s\n\n' "$1" >&2; usage; exit 1 ;;
|
||||
esac
|
||||
@@ -10,7 +10,7 @@ EN_log = 1 ; 1: Enable log, 0: Disable log
|
||||
;================================================================
|
||||
; FAN_SPEED
|
||||
;================================================================
|
||||
FAN_SPEED = 30
|
||||
FAN_SPEED = 100
|
||||
;================================================================
|
||||
; Switch Unit Population
|
||||
;================================================================
|
||||
|
||||
@@ -0,0 +1,63 @@
|
||||
|
||||
|
||||
echo PORTS0=$(bcmcmd -n 0 -c ps | grep -w up | wc -l)
|
||||
echo PORTS0=$(bcmcmd -n 1 -c ps | grep -w up | wc -l)
|
||||
|
||||
show interfaces status Ethernet513,Ethernet514
|
||||
|
||||
|
||||
//100G Port 513
|
||||
sudo sfputil lpmode off Ethernet513
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbs set p=3"'
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbsstat STArt Interval=5"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbs get"'
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbsstat Ber"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbsstat STOp"'
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbs clear"'
|
||||
|
||||
|
||||
//100G Port 514
|
||||
sudo sfputil lpmode off Ethernet514
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbs set p=3"'
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbsstat STArt Interval=5"'
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbs get"'
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbsstat Ber"'
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbsstat STOp"'
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbs clear"'
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
//100G Port 513
|
||||
sudo sfputil lpmode off Ethernet513
|
||||
sudo sfputil lpmode off Ethernet514
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbs set p=3"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbs set p=3"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbsstat STArt Interval=5"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbsstat STArt Interval=5"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phy diag 268 prbs get"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phy diag 268 prbs get"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbsstat Ber"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbsstat Ber"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbsstat STOp"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbsstat STOp"'
|
||||
|
||||
bcmcmd -n 0 -c 'dsh -c "phydiag 268 prbs clear"'
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c 'dsh -c "phydiag 268 prbs clear"'
|
||||
|
||||
|
||||
|
||||
@@ -0,0 +1,32 @@
|
||||
bcmcmd -n 0 -c '*:port all lb=mac'
|
||||
bcmcmd -n 0 -c '*:l2 learn off'
|
||||
bcmcmd -n 0 -c '*:dsh -c "test mode nr=yes"'
|
||||
bcmcmd -n 0 -c '*:dsh -c "tr 518 Scenario=6 Profile=2 Count=260 PktSize=324 PortList=1-259,270-565 rm=ext CheckLinkTime=20 CheckDataTime=200 testphase=2"'
|
||||
|
||||
bcmcmd -n 1 -c "*:port all lb=mac"
|
||||
bcmcmd -n 1 -c "*:l2 learn off"
|
||||
bcmcmd -n 1 -c "*:dsh -c 'test mode nr=yes'"
|
||||
bcmcmd -n 1 -c "*:dsh -c 'tr 518 Scenario=6 Profile=2 Count=260 PktSize=324 PortList=1-259,270-565 rm=ext CheckLinkTime=20 CheckDataTime=200 testphase=2'"
|
||||
|
||||
|
||||
bcmcmd -n 0 -c "*:port all lb=mac"
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c "*:port all lb=mac"
|
||||
sleep 1
|
||||
bcmcmd -n 0 -c "*:l2 learn off"
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c "*:l2 learn off"
|
||||
sleep 1
|
||||
bcmcmd -n 0 -c "*:dsh -c 'test mode nr=yes'"
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c "*:dsh -c 'test mode nr=yes'"
|
||||
sleep 1
|
||||
bcmcmd -n 0 -c "*:dsh -c 'tr 518 Scenario=6 Profile=2 Count=260 PktSize=324 PortList=1-259,270-565 rm=ext CheckLinkTime=20 CheckDataTime=200 testphase=2'"
|
||||
sleep 1
|
||||
bcmcmd -n 1 -c "*:dsh -c 'tr 518 Scenario=6 Profile=2 Count=260 PktSize=324 PortList=1-259,270-565 rm=ext CheckLinkTime=20 CheckDataTime=200 testphase=2'"
|
||||
sleep 1
|
||||
|
||||
|
||||
root@(none):/usr/local/bin# swutil *:l2 learn off
|
||||
root@(none):/usr/local/bin# swutil *:dsh -c \"test mode nr=yes\"
|
||||
root@(none):/usr/local/bin# swutil *:dsh -c \"tr 518 Scenario=6 Profile=2 Count=260 PktSize=324 PortList=1-259,270-565 rm=ext CheckLinkTime=20 CheckDataTime=200 testphase=2"
|
||||
@@ -0,0 +1,7 @@
|
||||
echo 18-0020 > /sys/bus/i2c/drivers/max31790/unbind
|
||||
sleep .5
|
||||
echo 18-0020 > /sys/bus/i2c/drivers/max31790/bind
|
||||
echo 25-0020 > /sys/bus/i2c/drivers/max31790/unbind
|
||||
sleep .5
|
||||
echo 25-0020 > /sys/bus/i2c/drivers/max31790/bind
|
||||
fan-speed-control.sh 30
|
||||
@@ -0,0 +1,59 @@
|
||||
#!/bin/bash
|
||||
# =============================================================================
|
||||
# gen_channel_map.sh - Build docs/LTC2980_channel_map.csv from settings/*.conf
|
||||
# Version : V1.0.0
|
||||
# Date : 2026-08-27
|
||||
# Author : ETWen
|
||||
# =============================================================================
|
||||
# Runs on the DEV machine, not the DUT. Reads every LTC2980 margin settings
|
||||
# file and flattens CH<n>_VNOM / CH<n>_NET into one CSV:
|
||||
#
|
||||
# Board,CONN,Ch,NetName,Vnom
|
||||
# CB,CONN13,CH0,V5P0_ALW,5.0
|
||||
#
|
||||
# NC channels keep their literal NC / "-" so the page numbering still lines up
|
||||
# (ch/8 -> CHIPS[] index, ch%8 -> LTC2977 PAGE). Do not filter them out.
|
||||
#
|
||||
# Usage:
|
||||
# tools/gen_channel_map.sh # write docs/LTC2980_channel_map.csv
|
||||
# tools/gen_channel_map.sh - # write to stdout
|
||||
# =============================================================================
|
||||
set -eu
|
||||
|
||||
REPO_ROOT="$(cd "$(dirname "$0")/.." && pwd)"
|
||||
SET_DIR="${REPO_ROOT}/src/Script_ABC_Blanton/Blanton_Script/LTC2980_Margin_Script/settings"
|
||||
OUT="${1:-${REPO_ROOT}/docs/LTC2980_channel_map.csv}"
|
||||
|
||||
[ -d "${SET_DIR}" ] || { echo "settings dir not found: ${SET_DIR}" >&2; exit 1; }
|
||||
|
||||
# 3-argument match(str, regex, array) is a gawk extension. Under mawk it is a
|
||||
# syntax error at best and an empty CSV at worst - fail loudly instead.
|
||||
awk 'BEGIN { if (match("a", /a/, m) != 1) exit 1 }' 2>/dev/null \
|
||||
|| { echo "need gawk (3-arg match); this awk is: $(awk --version 2>&1 | head -1)" >&2; exit 1; }
|
||||
|
||||
gen() {
|
||||
printf 'Board,CONN,Ch,NetName,Vnom\n'
|
||||
# CB first, then SWB0/SWB1 CONN13..CONN16 - matches the physical walk order.
|
||||
for f in "${SET_DIR}"/Blanton_CB_CONN*.conf \
|
||||
"${SET_DIR}"/Blanton_SWB0_CONN*.conf \
|
||||
"${SET_DIR}"/Blanton_SWB1_CONN*.conf ; do
|
||||
[ -f "${f}" ] || continue
|
||||
base="$(basename "${f}" .conf)" # Blanton_SWB0_CONN13
|
||||
board="$(echo "${base}" | cut -d_ -f2)" # SWB0
|
||||
conn="$(echo "${base}" | cut -d_ -f3)" # CONN13
|
||||
|
||||
# .conf files are LF per .gitattributes, but strip CR anyway - a stray
|
||||
# CR would land inside the net name and travel into the CSV unseen.
|
||||
sed 's/\r$//' "${f}" | awk -v b="${board}" -v c="${conn}" '
|
||||
match($0, /^CH([0-9]+)_VNOM="([^"]*)"[^"]*CH[0-9]+_NET="([^"]*)"/, m) {
|
||||
printf "%s,%s,CH%s,%s,%s\n", b, c, m[1], m[3], m[2]
|
||||
}'
|
||||
done
|
||||
}
|
||||
|
||||
if [ "${OUT}" = "-" ]; then
|
||||
gen
|
||||
else
|
||||
gen > "${OUT}"
|
||||
echo "wrote ${OUT} ($(($(wc -l < "${OUT}") - 1)) channels)"
|
||||
fi
|
||||
Reference in New Issue
Block a user