feat(soak): Show the background jobs each round, and stop the loop spinning
Script B's monitoring loop had no pause at all - each round started the instant the last one ended, so an overnight soak filled the log with near-identical samples taken seconds apart. The section was even labelled "Get data every 10mins" while running with no delay whatsoever. The loop now ends each round with pause 60 and prints both job lists: bgctl list for the platform job runner, jobs for anything the macro backgrounded in that shell. A stress job that dies mid-soak shows up as a shorter list on the next round instead of going unnoticed until the end. 60s is still hard-coded and the Status sheet asks for 10 minutes, so the Phase 3 item stays open - this makes the loop sane, it does not close it. Also adds docs/LTC2980_channel_map.csv: the nine settings/*.conf flattened into one Board,CONN,Ch,NetName,Vnom sheet, generated by tools/gen_channel_map.sh. The CSV is output, not source. NC channels are kept as NC/- because the channel number is also the PMBus page - dropping the gaps would shift every channel after them. Two things the merged table makes visible: SWB0 and SWB1 carry identical net names and voltages (only the bus and CB_I2C_CH differ), so those are two copies that can drift apart silently; and there are exactly 8 NC channels, all on CONN14/CONN15. tools/100G_PRBS.txt, TR518.txt and fan_ctrl.txt join the existing traffic_loopback_*.txt references. TR518 is not scripted yet and cannot share the hardware with blanton_traffic_linespeed - both drive port loopback and L2 learning. Script A -> V1.0.10. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014RetWKFZFG1ZHcitQAyhwM
This commit is contained in:
@@ -0,0 +1,145 @@
|
||||
Board,CONN,Ch,NetName,Vnom
|
||||
CB,CONN13,CH0,V5P0_ALW,5.0
|
||||
CB,CONN13,CH1,V3P3_ALW,3.3
|
||||
CB,CONN13,CH2,PWR_VDD_MISC_ALW,0.75
|
||||
CB,CONN13,CH3,V1P8_ALW,1.8
|
||||
CB,CONN13,CH4,PWR_APU_VDDIO_SUS,1.1
|
||||
CB,CONN13,CH5,PWR_VDD_MISC_RUN,0.75
|
||||
CB,CONN13,CH6,PWR_APU_VDD_MEM_RUN,0.78
|
||||
CB,CONN13,CH7,V0P8_PHY2_DVDD,0.8
|
||||
CB,CONN13,CH8,V0P8_AVDD,0.8
|
||||
CB,CONN13,CH9,V0P8_PHY,0.8
|
||||
CB,CONN13,CH10,V1P8_FPGA,1.8
|
||||
CB,CONN13,CH11,V2P5_FPGA,2.5
|
||||
CB,CONN13,CH12,V1P1_FPGA,1.1
|
||||
CB,CONN13,CH13,P5V_STBY,5.0
|
||||
CB,CONN13,CH14,P3V3_STBY,3.3
|
||||
CB,CONN13,CH15,V0P8_PHY2_AVDD,0.8
|
||||
SWB0,CONN13,CH0,P0V75_DVDD_47,0.75
|
||||
SWB0,CONN13,CH1,P0V75_AVDD_47,0.75
|
||||
SWB0,CONN13,CH2,P1V5_AVDD_47,1.5
|
||||
SWB0,CONN13,CH3,P0V9_AVDD_47,0.9
|
||||
SWB0,CONN13,CH4,P1V8_1,1.8
|
||||
SWB0,CONN13,CH5,PVDD3_3V_SYNTH_LDO_A3,3.3
|
||||
SWB0,CONN13,CH6,PVDD3_3V_SYNTH_LDO_B1,3.3
|
||||
SWB0,CONN13,CH7,P1V8_3,1.8
|
||||
SWB0,CONN13,CH8,P1V8_DVDDIO_3,1.8
|
||||
SWB0,CONN13,CH9,P0V75_DVDD_39,0.75
|
||||
SWB0,CONN13,CH10,P0V75_AVDD_39,0.75
|
||||
SWB0,CONN13,CH11,P1V5_AVDD_39,1.5
|
||||
SWB0,CONN13,CH12,P0V9_AVDD_39,0.9
|
||||
SWB0,CONN13,CH13,PVDD1V5_2,1.5
|
||||
SWB0,CONN13,CH14,PVDD1V8_DUT,1.8
|
||||
SWB0,CONN13,CH15,PVDD_MDIO,1.2
|
||||
SWB0,CONN14,CH0,P0V75_AVDD_7,0.75
|
||||
SWB0,CONN14,CH1,P1V5_AVDD_7,1.5
|
||||
SWB0,CONN14,CH2,P0V9_AVDD_7,0.9
|
||||
SWB0,CONN14,CH3,P1V8_5,1.8
|
||||
SWB0,CONN14,CH4,P1V8_2,1.8
|
||||
SWB0,CONN14,CH5,PVDD3_3V_SYNTH_LDO_B2,3.3
|
||||
SWB0,CONN14,CH6,PVDD3_3V_SYNTH_LDO_A2,3.3
|
||||
SWB0,CONN14,CH7,PVDD3_3V_SYNTH_LDO_A1,3.3
|
||||
SWB0,CONN14,CH8,PVDD1V5_TSC,1.5
|
||||
SWB0,CONN14,CH9,PVDD1V5_ANLG,1.5
|
||||
SWB0,CONN14,CH10,NC,-
|
||||
SWB0,CONN14,CH11,NC,-
|
||||
SWB0,CONN14,CH12,PVDD1V5_1,1.5
|
||||
SWB0,CONN14,CH13,NC,-
|
||||
SWB0,CONN14,CH14,P1V8_DVDDIO_1,1.8
|
||||
SWB0,CONN14,CH15,P0V75_DVDD_7,0.75
|
||||
SWB0,CONN15,CH0,P1V5_AVDD_55,1.5
|
||||
SWB0,CONN15,CH1,P0V9_AVDD_55,0.9
|
||||
SWB0,CONN15,CH2,P0V75_DVDD_63,0.75
|
||||
SWB0,CONN15,CH3,P0V75_AVDD_63,0.75
|
||||
SWB0,CONN15,CH4,P1V5_AVDD_63,1.5
|
||||
SWB0,CONN15,CH5,P0V9_AVDD_63,0.9
|
||||
SWB0,CONN15,CH6,PVDD3_3V_SYNTH_LDO_B3,3.3
|
||||
SWB0,CONN15,CH7,PVDD1V5_3,1.5
|
||||
SWB0,CONN15,CH8,P0V85_STBY,0.85
|
||||
SWB0,CONN15,CH9,P1V8_STBY,1.8
|
||||
SWB0,CONN15,CH10,NC,-
|
||||
SWB0,CONN15,CH11,P3V3_STBY,3.3
|
||||
SWB0,CONN15,CH12,PVDD0V9_2,0.9
|
||||
SWB0,CONN15,CH13,P0V75_DVDD_55,0.75
|
||||
SWB0,CONN15,CH14,P0V75_AVDD_55,0.75
|
||||
SWB0,CONN15,CH15,P1V8_DVDDIO_4,1.8
|
||||
SWB0,CONN16,CH0,PVDD1V5_0,1.5
|
||||
SWB0,CONN16,CH1,P1V8_4,1.8
|
||||
SWB0,CONN16,CH2,PVDD3_3V_SYNTH_LDO_B5,3.3
|
||||
SWB0,CONN16,CH3,PVDD3_3V_SYNTH_LDO_A5,3.3
|
||||
SWB0,CONN16,CH4,PVDD3_3V_SYNTH_LDO_B4,3.3
|
||||
SWB0,CONN16,CH5,PVDD3_3V_SYNTH_LDO_A4,3.3
|
||||
SWB0,CONN16,CH6,P3V3,3.3
|
||||
SWB0,CONN16,CH7,PVDD0_8V_T3,0.8
|
||||
SWB0,CONN16,CH8,P0V75_DVDD_1,0.75
|
||||
SWB0,CONN16,CH9,P0V75_AVDD_1,0.75
|
||||
SWB0,CONN16,CH10,P1V5_AVDD_1,1.5
|
||||
SWB0,CONN16,CH11,P0V9_AVDD_1,0.9
|
||||
SWB0,CONN16,CH12,PVDD0V9_0,0.9
|
||||
SWB0,CONN16,CH13,PVDD0V9_1,0.9
|
||||
SWB0,CONN16,CH14,PVDD0V9_3,0.9
|
||||
SWB0,CONN16,CH15,PVDD1V2_T3,1.2
|
||||
SWB1,CONN13,CH0,P0V75_DVDD_47,0.75
|
||||
SWB1,CONN13,CH1,P0V75_AVDD_47,0.75
|
||||
SWB1,CONN13,CH2,P1V5_AVDD_47,1.5
|
||||
SWB1,CONN13,CH3,P0V9_AVDD_47,0.9
|
||||
SWB1,CONN13,CH4,P1V8_1,1.8
|
||||
SWB1,CONN13,CH5,PVDD3_3V_SYNTH_LDO_A3,3.3
|
||||
SWB1,CONN13,CH6,PVDD3_3V_SYNTH_LDO_B1,3.3
|
||||
SWB1,CONN13,CH7,P1V8_3,1.8
|
||||
SWB1,CONN13,CH8,P1V8_DVDDIO_3,1.8
|
||||
SWB1,CONN13,CH9,P0V75_DVDD_39,0.75
|
||||
SWB1,CONN13,CH10,P0V75_AVDD_39,0.75
|
||||
SWB1,CONN13,CH11,P1V5_AVDD_39,1.5
|
||||
SWB1,CONN13,CH12,P0V9_AVDD_39,0.9
|
||||
SWB1,CONN13,CH13,PVDD1V5_2,1.5
|
||||
SWB1,CONN13,CH14,PVDD1V8_DUT,1.8
|
||||
SWB1,CONN13,CH15,PVDD_MDIO,1.2
|
||||
SWB1,CONN14,CH0,P0V75_AVDD_7,0.75
|
||||
SWB1,CONN14,CH1,P1V5_AVDD_7,1.5
|
||||
SWB1,CONN14,CH2,P0V9_AVDD_7,0.9
|
||||
SWB1,CONN14,CH3,P1V8_5,1.8
|
||||
SWB1,CONN14,CH4,P1V8_2,1.8
|
||||
SWB1,CONN14,CH5,PVDD3_3V_SYNTH_LDO_B2,3.3
|
||||
SWB1,CONN14,CH6,PVDD3_3V_SYNTH_LDO_A2,3.3
|
||||
SWB1,CONN14,CH7,PVDD3_3V_SYNTH_LDO_A1,3.3
|
||||
SWB1,CONN14,CH8,PVDD1V5_TSC,1.5
|
||||
SWB1,CONN14,CH9,PVDD1V5_ANLG,1.5
|
||||
SWB1,CONN14,CH10,NC,-
|
||||
SWB1,CONN14,CH11,NC,-
|
||||
SWB1,CONN14,CH12,PVDD1V5_1,1.5
|
||||
SWB1,CONN14,CH13,NC,-
|
||||
SWB1,CONN14,CH14,P1V8_DVDDIO_1,1.8
|
||||
SWB1,CONN14,CH15,P0V75_DVDD_7,0.75
|
||||
SWB1,CONN15,CH0,P1V5_AVDD_55,1.5
|
||||
SWB1,CONN15,CH1,P0V9_AVDD_55,0.9
|
||||
SWB1,CONN15,CH2,P0V75_DVDD_63,0.75
|
||||
SWB1,CONN15,CH3,P0V75_AVDD_63,0.75
|
||||
SWB1,CONN15,CH4,P1V5_AVDD_63,1.5
|
||||
SWB1,CONN15,CH5,P0V9_AVDD_63,0.9
|
||||
SWB1,CONN15,CH6,PVDD3_3V_SYNTH_LDO_B3,3.3
|
||||
SWB1,CONN15,CH7,PVDD1V5_3,1.5
|
||||
SWB1,CONN15,CH8,P0V85_STBY,0.85
|
||||
SWB1,CONN15,CH9,P1V8_STBY,1.8
|
||||
SWB1,CONN15,CH10,NC,-
|
||||
SWB1,CONN15,CH11,P3V3_STBY,3.3
|
||||
SWB1,CONN15,CH12,PVDD0V9_2,0.9
|
||||
SWB1,CONN15,CH13,P0V75_DVDD_55,0.75
|
||||
SWB1,CONN15,CH14,P0V75_AVDD_55,0.75
|
||||
SWB1,CONN15,CH15,P1V8_DVDDIO_4,1.8
|
||||
SWB1,CONN16,CH0,PVDD1V5_0,1.5
|
||||
SWB1,CONN16,CH1,P1V8_4,1.8
|
||||
SWB1,CONN16,CH2,PVDD3_3V_SYNTH_LDO_B5,3.3
|
||||
SWB1,CONN16,CH3,PVDD3_3V_SYNTH_LDO_A5,3.3
|
||||
SWB1,CONN16,CH4,PVDD3_3V_SYNTH_LDO_B4,3.3
|
||||
SWB1,CONN16,CH5,PVDD3_3V_SYNTH_LDO_A4,3.3
|
||||
SWB1,CONN16,CH6,P3V3,3.3
|
||||
SWB1,CONN16,CH7,PVDD0_8V_T3,0.8
|
||||
SWB1,CONN16,CH8,P0V75_DVDD_1,0.75
|
||||
SWB1,CONN16,CH9,P0V75_AVDD_1,0.75
|
||||
SWB1,CONN16,CH10,P1V5_AVDD_1,1.5
|
||||
SWB1,CONN16,CH11,P0V9_AVDD_1,0.9
|
||||
SWB1,CONN16,CH12,PVDD0V9_0,0.9
|
||||
SWB1,CONN16,CH13,PVDD0V9_1,0.9
|
||||
SWB1,CONN16,CH14,PVDD0V9_3,0.9
|
||||
SWB1,CONN16,CH15,PVDD1V2_T3,1.2
|
||||
|
@@ -0,0 +1,56 @@
|
||||
# v1.0.10 — The soak loop stops spinning flat out, and shows you what is still running
|
||||
|
||||
## ✨ New features
|
||||
|
||||
**Every soak round now reports the background jobs**
|
||||
* Script B's monitoring loop prints `bgctl list` (platform jobs) and `jobs` (the login shell's own background jobs) on every pass, right after the platform data. A stress job that dies three hours into an overnight soak now shows up as a shorter list on the next round, instead of only being noticed at the end — or not at all.
|
||||
* The two lists answer different questions and are both worth having: `bgctl` knows about the platform's job runner, `jobs` knows about anything the macro backgrounded in that shell.
|
||||
|
||||
**A single table for all 144 margin channels**
|
||||
* `docs/LTC2980_channel_map.csv` flattens the nine `settings/*.conf` files into one sheet — `Board,CONN,Ch,NetName,Vnom` — so "which board and channel is `PVDD1V5_TSC` on?" is one search instead of opening nine files.
|
||||
* `tools/gen_channel_map.sh` regenerates it. **The CSV is output, not source**: edit the `.conf` files and re-run the script, never the other way round.
|
||||
* Unused channels stay in the table as `NC` / `-` rather than being dropped, because the channel number is also the PMBus page (`ch / 8` picks the chip, `ch % 8` picks the page) — filtering the gaps out would shift everything after them.
|
||||
|
||||
**The bench command lists that these scripts came from**
|
||||
* `tools/100G_PRBS.txt`, `tools/TR518.txt` and `tools/fan_ctrl.txt` join the existing `traffic_loopback_*.txt` set: the raw `bcmcmd` / sysfs sequences, kept in the form you can paste into a console when a script is misbehaving and you want to drive the hardware directly.
|
||||
|
||||
## 🐛 Bug fixes
|
||||
|
||||
**The soak loop ran as fast as the DUT could answer**
|
||||
* `while 1` had no pause at all, so each round started the moment the previous one finished. Over a long soak that means constant console traffic and a log full of near-identical samples taken seconds apart. The loop now ends each round with `pause 60`.
|
||||
* Note the gap this leaves: the Status sheet asks for a 10-minute sampling interval, and 60 seconds is still hard-coded rather than configurable. This makes the loop sane, it does not finish the job.
|
||||
|
||||
**A comment promised a cadence the code never had**
|
||||
* The loop was labelled `Get data every 10mins` while running with no delay whatsoever. It now says what it does.
|
||||
|
||||
## 📦 Downloads
|
||||
|
||||
| File | Contents |
|
||||
|---|---|
|
||||
| `Script_ABC_Blanton_V1.0.10.zip` | The full Tera Term working directory, including `Blanton_Script/` to copy onto the DUT |
|
||||
|
||||
**After copying to the DUT:**
|
||||
|
||||
```bash
|
||||
chmod +x ~/Blanton_Script/*.sh # see below
|
||||
grep -rlU $'\r' ~/Blanton_Script # expect no output
|
||||
```
|
||||
|
||||
`mgmt_ping_monitor.sh` and `port_prbs_monitor.sh` launch their workers through `bash`, so those two run without the execute bit. `bmc_monitor.sh` and `usb_target.sh` still need it, and neither git (mode 100644) nor a Windows/USB copy carries it. Without the `chmod`, `start` fails with `Permission denied` and the later `cat` finds nothing: **the section ends up empty and nothing reports an error.**
|
||||
|
||||
## ⚠️ Before you run
|
||||
|
||||
* **Declare the switch population.** `SWB_UNIT0` / `SWB_UNIT1` in `config.ttl` say which switch units this DUT has; traffic and the readiness gate both follow them.
|
||||
* **Set `FAN_SPEED`.** It is applied at the start of every run.
|
||||
* **Management connectivity is in use, not preserved.** Both management NICs are up and pinging — drive the run from the serial console.
|
||||
* **PRBS is still not wired into the macros.** Run `port_prbs_monitor.sh` by hand if you want it; the calls in A/B/C remain commented out, unchanged from v1.0.9.
|
||||
* **TR518 and the loopback traffic test cannot both run.** `tools/TR518.txt` sets `port all lb=mac` and `l2 learn off` across the whole unit, which is the same hardware `blanton_traffic_linespeed` is using. Pick one.
|
||||
* **Two settings persist to `config_db.json`** and survive a reboot: LLDP is left disabled and the 100G uplinks are left configured. Restore them before the DUT moves on.
|
||||
|
||||
## 🔗 Links
|
||||
|
||||
* [ARCHITECTURE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/ARCHITECTURE.md) — test flow, data models, constraints
|
||||
* [CLAUDE.md](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/CLAUDE.md) — commands and the bench gotchas
|
||||
* [LTC2980_channel_map.csv](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/src/branch/main/docs/LTC2980_channel_map.csv) — all 144 margin channels
|
||||
|
||||
**Full changelog:** [V1.0.9...V1.0.10](https://etgit.et-wen.com/etwen/Blanton_TTL_Script/compare/V1.0.9...V1.0.10)
|
||||
Reference in New Issue
Block a user