Documentation/driver-api/ipmi.rst GitHub 원문 ↗

Linux 6.18.37 · Driver API

The Linux IPMI Driver

Linux IPMI의 message handler, SMI·SSIF·IPMB transport, userspace ioctl, watchdog, panic event와 poweroff 동작을 설명합니다.

Source pathDocumentation/driver-api/ipmi.rst
Source versionLinux v6.18.37
TranslationDUJINLABS 전문 번역 + 해설

요약·해설과 원문, 전문 번역을 서로 분리했습니다. API 이름, symbol, source path는 원문 표기를 사용합니다.

1. 요약·해설

원문의 핵심 논리와 kernel programming 관점의 보충 설명입니다. 아래의 전문 번역과는 별도로 작성했습니다.

요약과 해설

ipmi.rst:1-807

Linux IPMI stack은 `ipmi_msghandler`를 중심으로 kernel·userland client와 KCS/SMIC/BT, SMBus, IPMB transport를 분리합니다. 안정적인 운용에는 firmware discovery, message buffer ownership, command registration, polling latency·CPU trade-off, watchdog NMI 제약과 panic SEL routing을 함께 이해해야 합니다.

2. 영어 원문 전체

번역 기준이 된 Linux v6.18.37 원문입니다. 줄 번호는 이 버전의 파일 좌표입니다.

원문 전체 펼치기
1 =====================
2 The Linux IPMI Driver
3 =====================
4
5 :Author: Corey Minyard <[email protected]> / <[email protected]>
6
7 The Intelligent Platform Management Interface, or IPMI, is a
8 standard for controlling intelligent devices that monitor a system.
9 It provides for dynamic discovery of sensors in the system and the
10 ability to monitor the sensors and be informed when the sensor's
11 values change or go outside certain boundaries. It also has a
12 standardized database for field-replaceable units (FRUs) and a watchdog
13 timer.
14
15 To use this, you need an interface to an IPMI controller in your
16 system (called a Baseboard Management Controller, or BMC) and
17 management software that can use the IPMI system.
18
19 This document describes how to use the IPMI driver for Linux. If you
20 are not familiar with IPMI itself, see the web site at
21 https://www.intel.com/design/servers/ipmi/index.htm. IPMI is a big
22 subject and I can't cover it all here!
23
24 Configuration
25 -------------
26
27 The Linux IPMI driver is modular, which means you have to pick several
28 things to have it work right depending on your hardware. Most of
29 these are available in the 'Character Devices' menu then the IPMI
30 menu.
31
32 No matter what, you must pick 'IPMI top-level message handler' to use
33 IPMI. What you do beyond that depends on your needs and hardware.
34
35 The message handler does not provide any user-level interfaces.
36 Kernel code (like the watchdog) can still use it. If you need access
37 from userland, you need to select 'Device interface for IPMI' if you
38 want access through a device driver.
39
40 The driver interface depends on your hardware. If your system
41 properly provides the SMBIOS info for IPMI, the driver will detect it
42 and just work. If you have a board with a standard interface (These
43 will generally be either "KCS", "SMIC", or "BT", consult your hardware
44 manual), choose the 'IPMI SI handler' option. A driver also exists
45 for direct I2C access to the IPMI management controller. Some boards
46 support this, but it is unknown if it will work on every board. For
47 this, choose 'IPMI SMBus handler', but be ready to try to do some
48 figuring to see if it will work on your system if the SMBIOS/ACPI
49 information is wrong or not present. It is fairly safe to have both
50 these enabled and let the drivers auto-detect what is present.
51
52 You should generally enable ACPI on your system, as systems with IPMI
53 can have ACPI tables describing them.
54
55 If you have a standard interface and the board manufacturer has done
56 their job correctly, the IPMI controller should be automatically
57 detected (via ACPI or SMBIOS tables) and should just work. Sadly,
58 many boards do not have this information. The driver attempts
59 standard defaults, but they may not work. If you fall into this
60 situation, you need to read the section below named 'The SI Driver' or
61 "The SMBus Driver" on how to hand-configure your system.
62
63 IPMI defines a standard watchdog timer. You can enable this with the
64 'IPMI Watchdog Timer' config option. If you compile the driver into
65 the kernel, then via a kernel command-line option you can have the
66 watchdog timer start as soon as it initializes. It also has a lot
67 of other options, see the 'Watchdog' section below for more details.
68 Note that you can also have the watchdog continue to run if it is
69 closed (by default it is disabled on close). Go into the 'Watchdog
70 Cards' menu, enable 'Watchdog Timer Support', and enable the option
71 'Disable watchdog shutdown on close'.
72
73 IPMI systems can often be powered off using IPMI commands. Select
74 'IPMI Poweroff' to do this. The driver will auto-detect if the system
75 can be powered off by IPMI. It is safe to enable this even if your
76 system doesn't support this option. This works on ATCA systems, the
77 Radisys CPI1 card, and any IPMI system that supports standard chassis
78 management commands.
79
80 If you want the driver to put an event into the event log on a panic,
81 enable the 'Generate a panic event to all BMCs on a panic' option. If
82 you want the whole panic string put into the event log using OEM
83 events, enable the 'Generate OEM events containing the panic string'
84 option. You can also enable these dynamically by setting the module
85 parameter named "panic_op" in the ipmi_msghandler module to "event"
86 or "string". Setting that parameter to "none" disables this function.
87
88 Basic Design
89 ------------
90
91 The Linux IPMI driver is designed to be very modular and flexible, you
92 only need to take the pieces you need and you can use it in many
93 different ways. Because of that, it's broken into many chunks of
94 code. These chunks (by module name) are:
95
96 ipmi_msghandler - This is the central piece of software for the IPMI
97 system. It handles all messages, message timing, and responses. The
98 IPMI users tie into this, and the IPMI physical interfaces (called
99 System Management Interfaces, or SMIs) also tie in here. This
100 provides the kernelland interface for IPMI, but does not provide an
101 interface for use by application processes.
102
103 ipmi_devintf - This provides a userland IOCTL interface for the IPMI
104 driver, each open file for this device ties in to the message handler
105 as an IPMI user.
106
107 ipmi_si - A driver for various system interfaces. This supports KCS,
108 SMIC, and BT interfaces. Unless you have an SMBus interface or your
109 own custom interface, you probably need to use this.
110
111 ipmi_ssif - A driver for accessing BMCs on the SMBus. It uses the
112 I2C kernel driver's SMBus interfaces to send and receive IPMI messages
113 over the SMBus.
114
115 ipmi_powernv - A driver for access BMCs on POWERNV systems.
116
117 ipmi_watchdog - IPMI requires systems to have a very capable watchdog
118 timer. This driver implements the standard Linux watchdog timer
119 interface on top of the IPMI message handler.
120
121 ipmi_poweroff - Some systems support the ability to be turned off via
122 IPMI commands.
123
124 bt-bmc - This is not part of the main driver, but instead a driver for
125 accessing a BMC-side interface of a BT interface. It is used on BMCs
126 running Linux to provide an interface to the host.
127
128 These are all individually selectable via configuration options.
129
130 Much documentation for the interface is in the include files. The
131 IPMI include files are:
132
133 linux/ipmi.h - Contains the user interface and IOCTL interface for IPMI.
134
135 linux/ipmi_smi.h - Contains the interface for system management interfaces
136 (things that interface to IPMI controllers) to use.
137
138 linux/ipmi_msgdefs.h - General definitions for base IPMI messaging.
139
140
141 Addressing
142 ----------
143
144 The IPMI addressing works much like IP addresses, you have an overlay
145 to handle the different address types. The overlay is::
146
147 struct ipmi_addr
148 {
149 int addr_type;
150 short channel;
151 char data[IPMI_MAX_ADDR_SIZE];
152 };
153
154 The addr_type determines what the address really is. The driver
155 currently understands two different types of addresses.
156
157 "System Interface" addresses are defined as::
158
159 struct ipmi_system_interface_addr
160 {
161 int addr_type;
162 short channel;
163 };
164
165 and the type is IPMI_SYSTEM_INTERFACE_ADDR_TYPE. This is used for talking
166 straight to the BMC on the current card. The channel must be
167 IPMI_BMC_CHANNEL.
168
169 Messages that are destined to go out on the IPMB bus going through the
170 BMC use the IPMI_IPMB_ADDR_TYPE address type. The format is::
171
172 struct ipmi_ipmb_addr
173 {
174 int addr_type;
175 short channel;
176 unsigned char slave_addr;
177 unsigned char lun;
178 };
179
180 The "channel" here is generally zero, but some devices support more
181 than one channel, it corresponds to the channel as defined in the IPMI
182 spec.
183
184 There is also an IPMB direct address for a situation where the sender
185 is directly on an IPMB bus and doesn't have to go through the BMC.
186 You can send messages to a specific management controller (MC) on the
187 IPMB using the IPMI_IPMB_DIRECT_ADDR_TYPE with the following format::
188
189 struct ipmi_ipmb_direct_addr
190 {
191 int addr_type;
192 short channel;
193 unsigned char slave_addr;
194 unsigned char rq_lun;
195 unsigned char rs_lun;
196 };
197
198 The channel is always zero. You can also receive commands from other
199 MCs that you have registered to handle and respond to them, so you can
200 use this to implement a management controller on a bus..
201
202 Messages
203 --------
204
205 Messages are defined as::
206
207 struct ipmi_msg
208 {
209 unsigned char netfn;
210 unsigned char lun;
211 unsigned char cmd;
212 unsigned char *data;
213 int data_len;
214 };
215
216 The driver takes care of adding/stripping the header information. The
217 data portion is just the data to be send (do NOT put addressing info
218 here) or the response. Note that the completion code of a response is
219 the first item in "data", it is not stripped out because that is how
220 all the messages are defined in the spec (and thus makes counting the
221 offsets a little easier :-).
222
223 When using the IOCTL interface from userland, you must provide a block
224 of data for "data", fill it, and set data_len to the length of the
225 block of data, even when receiving messages. Otherwise the driver
226 will have no place to put the message.
227
228 Messages coming up from the message handler in kernelland will come in
229 as::
230
231 struct ipmi_recv_msg
232 {
233 struct list_head link;
234
235 /* The type of message as defined in the "Receive Types"
236 defines above. */
237 int recv_type;
238
239 ipmi_user_t *user;
240 struct ipmi_addr addr;
241 long msgid;
242 struct ipmi_msg msg;
243
244 /* Call this when done with the message. It will presumably free
245 the message and do any other necessary cleanup. */
246 void (*done)(struct ipmi_recv_msg *msg);
247
248 /* Place-holder for the data, don't make any assumptions about
249 the size or existence of this, since it may change. */
250 unsigned char msg_data[IPMI_MAX_MSG_LENGTH];
251 };
252
253 You should look at the receive type and handle the message
254 appropriately.
255
256
257 The Upper Layer Interface (Message Handler)
258 -------------------------------------------
259
260 The upper layer of the interface provides the users with a consistent
261 view of the IPMI interfaces. It allows multiple SMI interfaces to be
262 addressed (because some boards actually have multiple BMCs on them)
263 and the user should not have to care what type of SMI is below them.
264
265
266 Watching For Interfaces
267 ^^^^^^^^^^^^^^^^^^^^^^^
268
269 When your code comes up, the IPMI driver may or may not have detected
270 if IPMI devices exist. So you might have to defer your setup until
271 the device is detected, or you might be able to do it immediately.
272 To handle this, and to allow for discovery, you register an SMI
273 watcher with ipmi_smi_watcher_register() to iterate over interfaces
274 and tell you when they come and go.
275
276
277 Creating the User
278 ^^^^^^^^^^^^^^^^^
279
280 To use the message handler, you must first create a user using
281 ipmi_create_user. The interface number specifies which SMI you want
282 to connect to, and you must supply callback functions to be called
283 when data comes in. This also allows to you pass in a piece of data,
284 the handler_data, that will be passed back to you on all calls.
285
286 Once you are done, call ipmi_destroy_user() to get rid of the user.
287
288 From userland, opening the device automatically creates a user, and
289 closing the device automatically destroys the user.
290
291
292 Messaging
293 ^^^^^^^^^
294
295 To send a message from kernel-land, the ipmi_request_settime() call does
296 pretty much all message handling. Most of the parameter are
297 self-explanatory. However, it takes a "msgid" parameter. This is NOT
298 the sequence number of messages. It is simply a long value that is
299 passed back when the response for the message is returned. You may
300 use it for anything you like.
301
302 Responses come back in the function pointed to by the ipmi_recv_hndl
303 field of the "handler" that you passed in to ipmi_create_user().
304 Remember to look at the receive type, too.
305
306 From userland, you fill out an ipmi_req_t structure and use the
307 IPMICTL_SEND_COMMAND ioctl. For incoming stuff, you can use select()
308 or poll() to wait for messages to come in. However, you cannot use
309 read() to get them, you must call the IPMICTL_RECEIVE_MSG with the
310 ipmi_recv_t structure to actually get the message. Remember that you
311 must supply a pointer to a block of data in the msg.data field, and
312 you must fill in the msg.data_len field with the size of the data.
313 This gives the receiver a place to actually put the message.
314
315 If the message cannot fit into the data you provide, you will get an
316 EMSGSIZE error and the driver will leave the data in the receive
317 queue. If you want to get it and have it truncate the message, use
318 the IPMICTL_RECEIVE_MSG_TRUNC ioctl.
319
320 When you send a command (which is defined by the lowest-order bit of
321 the netfn per the IPMI spec) on the IPMB bus, the driver will
322 automatically assign the sequence number to the command and save the
323 command. If the response is not received in the IPMI-specified 5
324 seconds, it will generate a response automatically saying the command
325 timed out. If an unsolicited response comes in (if it was after 5
326 seconds, for instance), that response will be ignored.
327
328 In kernelland, after you receive a message and are done with it, you
329 MUST call ipmi_free_recv_msg() on it, or you will leak messages. Note
330 that you should NEVER mess with the "done" field of a message, that is
331 required to properly clean up the message.
332
333 Note that when sending, there is an ipmi_request_supply_msgs() call
334 that lets you supply the smi and receive message. This is useful for
335 pieces of code that need to work even if the system is out of buffers
336 (the watchdog timer uses this, for instance). You supply your own
337 buffer and own free routines. This is not recommended for normal use,
338 though, since it is tricky to manage your own buffers.
339
340
341 Events and Incoming Commands
342 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
343
344 The driver takes care of polling for IPMI events and receiving
345 commands (commands are messages that are not responses, they are
346 commands that other things on the IPMB bus have sent you). To receive
347 these, you must register for them, they will not automatically be sent
348 to you.
349
350 To receive events, you must call ipmi_set_gets_events() and set the
351 "val" to non-zero. Any events that have been received by the driver
352 since startup will immediately be delivered to the first user that
353 registers for events. After that, if multiple users are registered
354 for events, they will all receive all events that come in.
355
356 For receiving commands, you have to individually register commands you
357 want to receive. Call ipmi_register_for_cmd() and supply the netfn
358 and command name for each command you want to receive. You also
359 specify a bitmask of the channels you want to receive the command from
360 (or use IPMI_CHAN_ALL for all channels if you don't care). Only one
361 user may be registered for each netfn/cmd/channel, but different users
362 may register for different commands, or the same command if the
363 channel bitmasks do not overlap.
364
365 To respond to a received command, set the response bit in the returned
366 netfn, use the address from the received message, and use the same
367 msgid that you got in the received message.
368
369 From userland, equivalent IOCTLs are provided to do these functions.
370
371
372 The Lower Layer (SMI) Interface
373 -------------------------------
374
375 As mentioned before, multiple SMI interfaces may be registered to the
376 message handler, each of these is assigned an interface number when
377 they register with the message handler. They are generally assigned
378 in the order they register, although if an SMI unregisters and then
379 another one registers, all bets are off.
380
381 The ipmi_smi.h defines the interface for management interfaces, see
382 that for more details.
383
384
385 The SI Driver
386 -------------
387
388 The SI driver allows KCS, BT, and SMIC interfaces to be configured
389 in the system. It discovers interfaces through a host of different
390 methods, depending on the system.
391
392 You can specify up to four interfaces on the module load line and
393 control some module parameters::
394
395 modprobe ipmi_si.o type=<type1>,<type2>....
396 ports=<port1>,<port2>... addrs=<addr1>,<addr2>...
397 irqs=<irq1>,<irq2>...
398 regspacings=<sp1>,<sp2>,... regsizes=<size1>,<size2>,...
399 regshifts=<shift1>,<shift2>,...
400 slave_addrs=<addr1>,<addr2>,...
401 force_kipmid=<enable1>,<enable2>,...
402 kipmid_max_busy_us=<ustime1>,<ustime2>,...
403 unload_when_empty=[0|1]
404 trydmi=[0|1] tryacpi=[0|1]
405 tryplatform=[0|1] trypci=[0|1]
406
407 Each of these except try... items is a list, the first item for the
408 first interface, second item for the second interface, etc.
409
410 The si_type may be either "kcs", "smic", or "bt". If you leave it blank, it
411 defaults to "kcs".
412
413 If you specify addrs as non-zero for an interface, the driver will
414 use the memory address given as the address of the device. This
415 overrides si_ports.
416
417 If you specify ports as non-zero for an interface, the driver will
418 use the I/O port given as the device address.
419
420 If you specify irqs as non-zero for an interface, the driver will
421 attempt to use the given interrupt for the device.
422
423 The other try... items disable discovery by their corresponding
424 names. These are all enabled by default, set them to zero to disable
425 them. The tryplatform disables openfirmware.
426
427 The next three parameters have to do with register layout. The
428 registers used by the interfaces may not appear at successive
429 locations and they may not be in 8-bit registers. These parameters
430 allow the layout of the data in the registers to be more precisely
431 specified.
432
433 The regspacings parameter give the number of bytes between successive
434 register start addresses. For instance, if the regspacing is set to 4
435 and the start address is 0xca2, then the address for the second
436 register would be 0xca6. This defaults to 1.
437
438 The regsizes parameter gives the size of a register, in bytes. The
439 data used by IPMI is 8-bits wide, but it may be inside a larger
440 register. This parameter allows the read and write type to be specified.
441 It may be 1, 2, 4, or 8. The default is 1.
442
443 Since the register size may be larger than 32 bits, the IPMI data may not
444 be in the lower 8 bits. The regshifts parameter give the amount to shift
445 the data to get to the actual IPMI data.
446
447 The slave_addrs specifies the IPMI address of the local BMC. This is
448 usually 0x20 and the driver defaults to that, but in case it's not, it
449 can be specified when the driver starts up.
450
451 The force_ipmid parameter forcefully enables (if set to 1) or disables
452 (if set to 0) the kernel IPMI daemon. Normally this is auto-detected
453 by the driver, but systems with broken interrupts might need an enable,
454 or users that don't want the daemon (don't need the performance, don't
455 want the CPU hit) can disable it.
456
457 If unload_when_empty is set to 1, the driver will be unloaded if it
458 doesn't find any interfaces or all the interfaces fail to work. The
459 default is one. Setting to 0 is useful with the hotmod, but is
460 obviously only useful for modules.
461
462 When compiled into the kernel, the parameters can be specified on the
463 kernel command line as::
464
465 ipmi_si.type=<type1>,<type2>...
466 ipmi_si.ports=<port1>,<port2>... ipmi_si.addrs=<addr1>,<addr2>...
467 ipmi_si.irqs=<irq1>,<irq2>...
468 ipmi_si.regspacings=<sp1>,<sp2>,...
469 ipmi_si.regsizes=<size1>,<size2>,...
470 ipmi_si.regshifts=<shift1>,<shift2>,...
471 ipmi_si.slave_addrs=<addr1>,<addr2>,...
472 ipmi_si.force_kipmid=<enable1>,<enable2>,...
473 ipmi_si.kipmid_max_busy_us=<ustime1>,<ustime2>,...
474
475 It works the same as the module parameters of the same names.
476
477 If your IPMI interface does not support interrupts and is a KCS or
478 SMIC interface, the IPMI driver will start a kernel thread for the
479 interface to help speed things up. This is a low-priority kernel
480 thread that constantly polls the IPMI driver while an IPMI operation
481 is in progress. The force_kipmid module parameter will allow the user
482 to force this thread on or off. If you force it off and don't have
483 interrupts, the driver will run VERY slowly. Don't blame me,
484 these interfaces suck.
485
486 Unfortunately, this thread can use a lot of CPU depending on the
487 interface's performance. This can waste a lot of CPU and cause
488 various issues with detecting idle CPU and using extra power. To
489 avoid this, the kipmid_max_busy_us sets the maximum amount of time, in
490 microseconds, that kipmid will spin before sleeping for a tick. This
491 value sets a balance between performance and CPU waste and needs to be
492 tuned to your needs. Maybe, someday, auto-tuning will be added, but
493 that's not a simple thing and even the auto-tuning would need to be
494 tuned to the user's desired performance.
495
496 The driver supports a hot add and remove of interfaces. This way,
497 interfaces can be added or removed after the kernel is up and running.
498 This is done using /sys/modules/ipmi_si/parameters/hotmod, which is a
499 write-only parameter. You write a string to this interface. The string
500 has the format::
501
502 <op1>[:op2[:op3...]]
503
504 The "op"s are::
505
506 add|remove,kcs|bt|smic,mem|i/o,<address>[,<opt1>[,<opt2>[,...]]]
507
508 You can specify more than one interface on the line. The "opt"s are::
509
510 rsp=<regspacing>
511 rsi=<regsize>
512 rsh=<regshift>
513 irq=<irq>
514 ipmb=<ipmb slave addr>
515
516 and these have the same meanings as discussed above. Note that you
517 can also use this on the kernel command line for a more compact format
518 for specifying an interface. Note that when removing an interface,
519 only the first three parameters (si type, address type, and address)
520 are used for the comparison. Any options are ignored for removing.
521
522 The SMBus Driver (SSIF)
523 -----------------------
524
525 The SMBus driver allows up to 4 SMBus devices to be configured in the
526 system. By default, the driver will only register with something it
527 finds in DMI or ACPI tables. You can change this
528 at module load time (for a module) with::
529
530 modprobe ipmi_ssif.o
531 addr=<i2caddr1>[,<i2caddr2>[,...]]
532 adapter=<adapter1>[,<adapter2>[...]]
533 dbg=<flags1>,<flags2>...
534 slave_addrs=<addr1>,<addr2>,...
535 tryacpi=[0|1] trydmi=[0|1]
536 [dbg_probe=1]
537 alerts_broken
538
539 The addresses are normal I2C addresses. The adapter is the string
540 name of the adapter, as shown in /sys/bus/i2c/devices/i2c-<n>/name.
541 It is *NOT* i2c-<n> itself. Also, the comparison is done ignoring
542 spaces, so if the name is "This is an I2C chip" you can say
543 adapter_name=ThisisanI2cchip. This is because it's hard to pass in
544 spaces in kernel parameters.
545
546 The debug flags are bit flags for each BMC found, they are:
547 IPMI messages: 1, driver state: 2, timing: 4, I2C probe: 8
548
549 The tryxxx parameters can be used to disable detecting interfaces
550 from various sources.
551
552 Setting dbg_probe to 1 will enable debugging of the probing and
553 detection process for BMCs on the SMBusses.
554
555 The slave_addrs specifies the IPMI address of the local BMC. This is
556 usually 0x20 and the driver defaults to that, but in case it's not, it
557 can be specified when the driver starts up.
558
559 alerts_broken does not enable SMBus alert for SSIF. Otherwise SMBus
560 alert will be enabled on supported hardware.
561
562 Discovering the IPMI compliant BMC on the SMBus can cause devices on
563 the I2C bus to fail. The SMBus driver writes a "Get Device ID" IPMI
564 message as a block write to the I2C bus and waits for a response.
565 This action can be detrimental to some I2C devices. It is highly
566 recommended that the known I2C address be given to the SMBus driver in
567 the smb_addr parameter unless you have DMI or ACPI data to tell the
568 driver what to use.
569
570 When compiled into the kernel, the addresses can be specified on the
571 kernel command line as::
572
573 ipmb_ssif.addr=<i2caddr1>[,<i2caddr2>[...]]
574 ipmi_ssif.adapter=<adapter1>[,<adapter2>[...]]
575 ipmi_ssif.dbg=<flags1>[,<flags2>[...]]
576 ipmi_ssif.dbg_probe=1
577 ipmi_ssif.slave_addrs=<addr1>[,<addr2>[...]]
578 ipmi_ssif.tryacpi=[0|1] ipmi_ssif.trydmi=[0|1]
579
580 These are the same options as on the module command line.
581
582 The I2C driver does not support non-blocking access or polling, so
583 this driver cannot do IPMI panic events, extend the watchdog at panic
584 time, or other panic-related IPMI functions without special kernel
585 patches and driver modifications. You can get those at the openipmi
586 web page.
587
588 The driver supports a hot add and remove of interfaces through the I2C
589 sysfs interface.
590
591 The IPMI IPMB Driver
592 --------------------
593
594 This driver is for supporting a system that sits on an IPMB bus; it
595 allows the interface to look like a normal IPMI interface. Sending
596 system interface addressed messages to it will cause the message to go
597 to the registered BMC on the system (default at IPMI address 0x20).
598
599 It also allows you to directly address other MCs on the bus using the
600 ipmb direct addressing. You can receive commands from other MCs on
601 the bus and they will be handled through the normal received command
602 mechanism described above.
603
604 Parameters are::
605
606 ipmi_ipmb.bmcaddr=<address to use for system interface addresses messages>
607 ipmi_ipmb.retry_time_ms=<Time between retries on IPMB>
608 ipmi_ipmb.max_retries=<Number of times to retry a message>
609
610 Loading the module will not result in the driver automatically
611 starting unless there is device tree information setting it up. If
612 you want to instantiate one of these by hand, do::
613
614 echo ipmi-ipmb <addr> > /sys/class/i2c-dev/i2c-<n>/device/new_device
615
616 Note that the address you give here is the I2C address, not the IPMI
617 address. So if you want your MC address to be 0x60, you put 0x30
618 here. See the I2C driver info for more details.
619
620 Command bridging to other IPMB buses through this interface does not
621 work. The receive message queue is not implemented, by design. There
622 is only one receive message queue on a BMC, and that is meant for the
623 host drivers, not something on the IPMB bus.
624
625 A BMC may have multiple IPMB buses, which bus your device sits on
626 depends on how the system is wired. You can fetch the channels with
627 "ipmitool channel info <n>" where <n> is the channel, with the
628 channels being 0-7 and try the IPMB channels.
629
630 Other Pieces
631 ------------
632
633 Get the detailed info related with the IPMI device
634 --------------------------------------------------
635
636 Some users need more detailed information about a device, like where
637 the address came from or the raw base device for the IPMI interface.
638 You can use the IPMI smi_watcher to catch the IPMI interfaces as they
639 come or go, and to grab the information, you can use the function
640 ipmi_get_smi_info(), which returns the following structure::
641
642 struct ipmi_smi_info {
643 enum ipmi_addr_src addr_src;
644 struct device *dev;
645 union {
646 struct {
647 void *acpi_handle;
648 } acpi_info;
649 } addr_info;
650 };
651
652 Currently special info for only for SI_ACPI address sources is
653 returned. Others may be added as necessary.
654
655 Note that the dev pointer is included in the above structure, and
656 assuming ipmi_smi_get_info returns success, you must call put_device
657 on the dev pointer.
658
659
660 Watchdog
661 --------
662
663 A watchdog timer is provided that implements the Linux-standard
664 watchdog timer interface. It has three module parameters that can be
665 used to control it::
666
667 modprobe ipmi_watchdog timeout=<t> pretimeout=<t> action=<action type>
668 preaction=<preaction type> preop=<preop type> start_now=x
669 nowayout=x ifnum_to_use=n panic_wdt_timeout=<t>
670
671 ifnum_to_use specifies which interface the watchdog timer should use.
672 The default is -1, which means to pick the first one registered.
673
674 The timeout is the number of seconds to the action, and the pretimeout
675 is the amount of seconds before the reset that the pre-timeout panic will
676 occur (if pretimeout is zero, then pretimeout will not be enabled). Note
677 that the pretimeout is the time before the final timeout. So if the
678 timeout is 50 seconds and the pretimeout is 10 seconds, then the pretimeout
679 will occur in 40 second (10 seconds before the timeout). The panic_wdt_timeout
680 is the value of timeout which is set on kernel panic, in order to let actions
681 such as kdump to occur during panic.
682
683 The action may be "reset", "power_cycle", or "power_off", and
684 specifies what to do when the timer times out, and defaults to
685 "reset".
686
687 The preaction may be "pre_smi" for an indication through the SMI
688 interface, "pre_int" for an indication through the SMI with an
689 interrupts, and "pre_nmi" for a NMI on a preaction. This is how
690 the driver is informed of the pretimeout.
691
692 The preop may be set to "preop_none" for no operation on a pretimeout,
693 "preop_panic" to set the preoperation to panic, or "preop_give_data"
694 to provide data to read from the watchdog device when the pretimeout
695 occurs. A "pre_nmi" setting CANNOT be used with "preop_give_data"
696 because you can't do data operations from an NMI.
697
698 When preop is set to "preop_give_data", one byte comes ready to read
699 on the device when the pretimeout occurs. Select and fasync work on
700 the device, as well.
701
702 If start_now is set to 1, the watchdog timer will start running as
703 soon as the driver is loaded.
704
705 If nowayout is set to 1, the watchdog timer will not stop when the
706 watchdog device is closed. The default value of nowayout is true
707 if the CONFIG_WATCHDOG_NOWAYOUT option is enabled, or false if not.
708
709 When compiled into the kernel, the kernel command line is available
710 for configuring the watchdog::
711
712 ipmi_watchdog.timeout=<t> ipmi_watchdog.pretimeout=<t>
713 ipmi_watchdog.action=<action type>
714 ipmi_watchdog.preaction=<preaction type>
715 ipmi_watchdog.preop=<preop type>
716 ipmi_watchdog.start_now=x
717 ipmi_watchdog.nowayout=x
718 ipmi_watchdog.panic_wdt_timeout=<t>
719
720 The options are the same as the module parameter options.
721
722 The watchdog will panic and start a 120 second reset timeout if it
723 gets a pre-action. During a panic or a reboot, the watchdog will
724 start a 120 timer if it is running to make sure the reboot occurs.
725
726 Note that if you use the NMI preaction for the watchdog, you MUST NOT
727 use the nmi watchdog. There is no reasonable way to tell if an NMI
728 comes from the IPMI controller, so it must assume that if it gets an
729 otherwise unhandled NMI, it must be from IPMI and it will panic
730 immediately.
731
732 Once you open the watchdog timer, you must write a 'V' character to the
733 device to close it, or the timer will not stop. This is a new semantic
734 for the driver, but makes it consistent with the rest of the watchdog
735 drivers in Linux.
736
737
738 Panic Timeouts
739 --------------
740
741 The OpenIPMI driver supports the ability to put semi-custom and custom
742 events in the system event log if a panic occurs. if you enable the
743 'Generate a panic event to all BMCs on a panic' option, you will get
744 one event on a panic in a standard IPMI event format. If you enable
745 the 'Generate OEM events containing the panic string' option, you will
746 also get a bunch of OEM events holding the panic string.
747
748
749 The field settings of the events are:
750
751 * Generator ID: 0x21 (kernel)
752 * EvM Rev: 0x03 (this event is formatting in IPMI 1.0 format)
753 * Sensor Type: 0x20 (OS critical stop sensor)
754 * Sensor #: The first byte of the panic string (0 if no panic string)
755 * Event Dir | Event Type: 0x6f (Assertion, sensor-specific event info)
756 * Event Data 1: 0xa1 (Runtime stop in OEM bytes 2 and 3)
757 * Event data 2: second byte of panic string
758 * Event data 3: third byte of panic string
759
760 See the IPMI spec for the details of the event layout. This event is
761 always sent to the local management controller. It will handle routing
762 the message to the right place
763
764 Other OEM events have the following format:
765
766 * Record ID (bytes 0-1): Set by the SEL.
767 * Record type (byte 2): 0xf0 (OEM non-timestamped)
768 * byte 3: The slave address of the card saving the panic
769 * byte 4: A sequence number (starting at zero)
770 The rest of the bytes (11 bytes) are the panic string. If the panic string
771 is longer than 11 bytes, multiple messages will be sent with increasing
772 sequence numbers.
773
774 Because you cannot send OEM events using the standard interface, this
775 function will attempt to find an SEL and add the events there. It
776 will first query the capabilities of the local management controller.
777 If it has an SEL, then they will be stored in the SEL of the local
778 management controller. If not, and the local management controller is
779 an event generator, the event receiver from the local management
780 controller will be queried and the events sent to the SEL on that
781 device. Otherwise, the events go nowhere since there is nowhere to
782 send them.
783
784
785 Poweroff
786 --------
787
788 If the poweroff capability is selected, the IPMI driver will install
789 a shutdown function into the standard poweroff function pointer. This
790 is in the ipmi_poweroff module. When the system requests a powerdown,
791 it will send the proper IPMI commands to do this. This is supported on
792 several platforms.
793
794 There is a module parameter named "poweroff_powercycle" that may
795 either be zero (do a power down) or non-zero (do a power cycle, power
796 the system off, then power it on in a few seconds). Setting
797 ipmi_poweroff.poweroff_control=x will do the same thing on the kernel
798 command line. The parameter is also available via the proc filesystem
799 in /proc/sys/dev/ipmi/poweroff_powercycle. Note that if the system
800 does not support power cycling, it will always do the power off.
801
802 The "ifnum_to_use" parameter specifies which interface the poweroff
803 code should use. The default is -1, which means to pick the first one
804 registered.
805
806 Note that if you have ACPI enabled, the system will prefer using ACPI to
807 power off.
808

3. 한국어 전문 번역

영어 원문의 문단 순서와 의미를 유지한 전체 번역입니다. 코드, 함수명, symbol과 URL은 원문 표기를 유지합니다.

Linux IPMI driver 개요

1-23

문서 제목은 `The Linux IPMI Driver`이며 저자는 Corey Minyard입니다. IPMI(Intelligent Platform Management Interface)는 system을 감시하는 intelligent device를 제어하기 위한 표준입니다.

IPMI는 system sensor를 dynamic discovery하고 값을 monitor하며 값이 변하거나 정해진 boundary를 벗어날 때 통지하는 기능을 제공합니다. 또한 FRU(field-replaceable unit)를 위한 표준 database와 watchdog timer를 정의합니다.

이 기능을 사용하려면 system 안의 IPMI controller인 BMC(Baseboard Management Controller)에 접근할 interface와 IPMI system을 사용할 management software가 필요합니다. 이 문서는 Linux IPMI driver 사용법을 설명하며 IPMI 자체의 전체 specification은 원문에 연결된 Intel IPMI site를 참고해야 합니다.

Linux IPMI 기본 구성
Management softwareLinux IPMI upper layerSystem Management InterfaceBMCSensor·FRU·watchdog

Management software가 Linux driver를 거쳐 BMC와 sensor에 접근합니다.

Configuration

24-87

Linux IPMI driver는 modular하므로 hardware와 필요 기능에 맞춰 여러 항목을 선택해야 합니다. 대부분의 option은 `Character Devices` 아래 IPMI menu에 있습니다. IPMI를 사용하려면 항상 `IPMI top-level message handler`를 선택해야 하며, 그 밖의 항목은 목적과 hardware에 따라 결정합니다.

Message handler 자체는 user-level interface를 제공하지 않지만 watchdog 같은 kernel code는 사용할 수 있습니다. Userland에서 device driver를 통해 접근하려면 `Device interface for IPMI`를 선택합니다.

Physical interface 선택은 hardware에 달려 있습니다. SMBIOS가 올바른 IPMI 정보를 제공하면 driver가 자동 감지합니다. 표준 KCS, SMIC, BT interface에는 `IPMI SI handler`를 사용합니다. BMC에 직접 I2C로 접근하는 board에는 `IPMI SMBus handler`를 사용할 수 있지만 SMBIOS/ACPI 정보가 없거나 잘못되면 수동 확인이 필요합니다. SI와 SMBus handler를 함께 enable하고 auto-detection에 맡겨도 대체로 안전합니다.

IPMI system은 ACPI table로 description될 수 있으므로 일반적으로 ACPI를 enable해야 합니다. 제조사가 ACPI 또는 SMBIOS table을 올바르게 제공했다면 controller가 자동 검출되지만, 정보가 없는 board에서는 standard default가 실패할 수 있으므로 아래 `The SI Driver` 또는 `The SMBus Driver` 절의 수동 설정을 사용합니다.

`IPMI Watchdog Timer` option은 IPMI 표준 watchdog을 enable합니다. Driver를 kernel에 built-in하면 command-line option으로 initialization 직후 timer를 시작할 수 있습니다. 기본적으로 device close 때 watchdog을 disable하지만 `Watchdog Timer Support`와 `Disable watchdog shutdown on close`를 enable하면 close 뒤에도 계속 실행할 수 있습니다.

`IPMI Poweroff`는 standard chassis management command 등을 지원하는 system을 IPMI로 끕니다. Driver가 capability를 auto-detect하므로 미지원 system에서도 option을 enable하는 것은 안전합니다. ATCA system, Radisys CPI1 card와 standard chassis command를 지원하는 IPMI system에서 동작합니다.

Panic 때 모든 BMC의 event log에 event를 남기려면 `Generate a panic event to all BMCs on a panic`을, panic string 전체를 OEM event로 남기려면 `Generate OEM events containing the panic string`을 enable합니다. Runtime에는 `ipmi_msghandler`의 `panic_op` module parameter를 `event`, `string`, `none`으로 설정해 각각 standard event, OEM string event, disable을 선택합니다.

IPMI configuration 선택
목적Option·module
필수 message routingIPMI top-level message handler
Userland ioctl accessDevice interface for IPMI
KCS·SMIC·BTIPMI SI handler
SMBus/I2C BMCIPMI SMBus handler
WatchdogIPMI Watchdog Timer
Power controlIPMI Poweroff
Panic loggingpanic event·OEM event option 또는 panic_op

기능과 필요한 kernel option을 대응시켰습니다.

Interface 자동 감지와 fallback
ACPI·SMBIOS IPMI table 확인정보가 유효한가?예: SI/SSIF auto-detect아니오: standard default 시도실패: SI 또는 SMBus parameter 수동 설정

Firmware 정보가 없을 때 수동 SI·SMBus 설정으로 전환합니다.

Basic Design

88-140

Linux IPMI driver는 필요한 component만 선택하도록 여러 module로 분리되어 있습니다. `ipmi_msghandler`는 message, timing, response를 모두 처리하는 중심 component입니다. IPMI user와 physical SMI(System Management Interface)가 여기에 연결되며 kernel interface를 제공하지만 application process용 interface는 직접 제공하지 않습니다.

`ipmi_devintf`는 userland ioctl interface를 제공하고, 이 device의 open file 하나마다 message handler에 IPMI user 하나로 연결됩니다. `ipmi_si`는 KCS, SMIC, BT system interface driver입니다. SMBus 또는 custom interface가 아니라면 일반적으로 이 module이 필요합니다.

`ipmi_ssif`는 I2C kernel driver의 SMBus interface를 이용해 SMBus 위로 IPMI message를 송수신합니다. `ipmi_powernv`는 POWERNV system에서 BMC access를 제공합니다.

`ipmi_watchdog`는 IPMI의 강력한 watchdog timer를 standard Linux watchdog interface로 노출합니다. `ipmi_poweroff`는 IPMI command로 system을 끌 수 있는 platform을 지원합니다. `bt-bmc`는 main driver 일부가 아니라 Linux를 실행하는 BMC에서 BT interface의 BMC-side를 host에 제공하는 별도 driver입니다.

각 component는 configuration option으로 개별 선택할 수 있습니다. Interface 상세는 include file에도 있습니다. `linux/ipmi.h`는 user·ioctl interface, `linux/ipmi_smi.h`는 IPMI controller에 연결하는 system management interface, `linux/ipmi_msgdefs.h`는 base IPMI messaging의 일반 definition을 담습니다.

IPMI module architecture
Kernel user 또는 ipmi_devintfipmi_msghandleripmi_si / ipmi_ssif / ipmi_powernvBMCipmi_watchdog·ipmi_poweroff가 upper layer 사용

Upper-layer user와 physical interface가 message handler를 중심으로 결합됩니다.

주요 IPMI module
Module역할
ipmi_msghandlerMessage·timing·response 중심 처리
ipmi_devintfUserland ioctl interface
ipmi_siKCS·SMIC·BT interface
ipmi_ssifSMBus transport
ipmi_powernvPOWERNV BMC access
ipmi_watchdogLinux watchdog interface
ipmi_poweroffIPMI system poweroff
bt-bmcBMC-side BT host interface

Module별 책임을 정리했습니다.

Addressing

141-201

IPMI addressing은 IP address와 비슷하게 공통 overlay가 여러 address type을 표현합니다. `struct ipmi_addr`의 `addr_type`이 실제 address layout을 결정하고 `channel`과 최대 크기의 `data`가 뒤따릅니다.

struct ipmi_addr
{
      int   addr_type;
      short channel;
      char  data[IPMI_MAX_ADDR_SIZE];
};

System interface address는 `struct ipmi_system_interface_addr`이며 type은 `IPMI_SYSTEM_INTERFACE_ADDR_TYPE`입니다. 현재 card의 BMC와 직접 통신할 때 사용하고 channel은 반드시 `IPMI_BMC_CHANNEL`이어야 합니다.

struct ipmi_system_interface_addr
{
      int   addr_type;
      short channel;
};

BMC를 거쳐 IPMB bus로 나가는 message에는 `IPMI_IPMB_ADDR_TYPE`과 `struct ipmi_ipmb_addr`를 사용합니다. `channel`은 일반적으로 0이지만 여러 channel을 지원하는 device에서는 IPMI specification의 channel 번호에 대응합니다.

struct ipmi_ipmb_addr
{
      int           addr_type;
      short         channel;
      unsigned char slave_addr;
      unsigned char lun;
};

Sender가 IPMB bus에 직접 연결되어 BMC를 거치지 않는 경우에는 `IPMI_IPMB_DIRECT_ADDR_TYPE`과 `struct ipmi_ipmb_direct_addr`를 사용합니다. `channel`은 항상 0입니다. 등록한 command를 다른 MC에서 받아 응답할 수도 있으므로 이 address type으로 bus 위 management controller를 구현할 수 있습니다.

struct ipmi_ipmb_direct_addr
{
      int           addr_type;
      short         channel;
      unsigned char slave_addr;
      unsigned char rq_lun;
      unsigned char rs_lun;
};
IPMI address type
TypeRouteChannel
IPMI_SYSTEM_INTERFACE_ADDR_TYPE현재 card의 BMC로 직접IPMI_BMC_CHANNEL
IPMI_IPMB_ADDR_TYPEBMC를 거쳐 IPMB MC로보통 0, spec channel 가능
IPMI_IPMB_DIRECT_ADDR_TYPEIPMB bus에서 MC로 직접항상 0

Destination과 route에 따른 address layout입니다.

IPMI addressing route
SenderSystem interface → local BMCIPMB address → BMC → IPMB targetIPMB direct → IPMB target MC

System interface와 두 IPMB route의 차이입니다.

Messages

202-256

IPMI message는 `struct ipmi_msg`로 표현합니다. Driver가 address header를 추가하고 제거하므로 `data`에는 addressing 정보가 아니라 보낼 payload 또는 response만 넣습니다. Response completion code는 specification의 message layout대로 `data`의 첫 byte에 남아 있으며 driver가 제거하지 않습니다.

struct ipmi_msg
{
      unsigned char netfn;
      unsigned char lun;
      unsigned char cmd;
      unsigned char *data;
      int           data_len;
};

Userland ioctl interface를 사용할 때는 message 수신 시에도 `data`용 buffer를 할당해 pointer를 제공하고 `data_len`에 buffer 크기를 넣어야 합니다. 그렇지 않으면 driver가 message를 저장할 곳이 없습니다.

Kernel message handler가 upper layer로 전달하는 message는 `struct ipmi_recv_msg`입니다. `recv_type`을 확인해 message 종류에 맞게 처리해야 합니다. `done` callback은 사용이 끝난 message를 free하고 필요한 cleanup을 수행하며, `msg_data`는 내부 placeholder이므로 size나 존재 여부에 의존하면 안 됩니다.

struct ipmi_recv_msg
{
      struct list_head link;

      /* The type of message as defined in the "Receive Types"
         defines above. */
      int         recv_type;

      ipmi_user_t      *user;
      struct ipmi_addr addr;
      long             msgid;
      struct ipmi_msg  msg;

      /* Call this when done with the message.  It will presumably free
         the message and do any other necessary cleanup. */
      void (*done)(struct ipmi_recv_msg *msg);

      /* Place-holder for the data, don't make any assumptions about
         the size or existence of this, since it may change. */
      unsigned char   msg_data[IPMI_MAX_MSG_LENGTH];
};
IPMI message payload 처리
Caller가 netfn·lun·cmd·data 준비Driver가 address header 추가SMI/BMC 전송Response header 제거Completion code를 data[0]에 유지recv_type에 따라 처리

Driver가 header를 관리하고 caller는 payload buffer를 소유합니다.

Receive message 핵심 field
Field의미·규칙
recv_typeMessage 종류에 맞는 처리 선택
addr·msgid·msgRoute와 request correlation
done변경 금지, 완료 시 cleanup
msg_data내부 placeholder, layout 가정 금지

수신자가 지켜야 할 ownership 규칙입니다.

Upper layer와 interface 감시

257-276

Upper layer message handler는 user에게 모든 IPMI interface의 일관된 view를 제공합니다. 일부 board는 BMC가 여러 개이므로 여러 SMI interface를 address할 수 있고, user는 아래 physical SMI type을 알 필요가 없습니다.

Code가 시작될 때 IPMI device detection이 끝났을 수도 있고 아직 아닐 수도 있습니다. 즉시 setup하거나 detection까지 미뤄야 하는 두 경우를 모두 처리하려면 `ipmi_smi_watcher_register()`로 SMI watcher를 등록합니다. Watcher는 existing interface를 순회하고 interface가 추가되거나 제거될 때 알려 줍니다.

SMI watcher lifecycle
Code initializationipmi_smi_watcher_register()기존 SMI 순회새 interface 등록 통지Interface 제거 통지Setup·cleanup 수행

초기 discovery와 runtime add/remove를 같은 callback model로 처리합니다.

IPMI user 생성과 제거

277-291

Message handler를 사용하려면 먼저 `ipmi_create_user()`로 user를 생성합니다. Interface number로 연결할 SMI를 고르고 incoming data callback을 제공합니다. `handler_data`에는 모든 callback에서 되돌려 받을 caller data를 넣을 수 있습니다.

사용이 끝나면 `ipmi_destroy_user()`를 호출합니다. Userland에서는 device open이 user를 자동 생성하고 close가 자동 제거합니다.

IPMI user lifecycle
Kernel: ipmi_create_user()Callback·handler_data 등록Message 송수신Kernel: ipmi_destroy_user()Userland에서는 open·close가 같은 lifecycle 수행

Kernel API와 userland device lifecycle을 대응시켰습니다.

Messaging API

292-340

Kernel에서 message를 보낼 때 `ipmi_request_settime()`이 대부분의 message 처리를 수행합니다. `msgid`는 sequence number가 아니라 response가 돌아올 때 그대로 반환되는 `long` 값이므로 caller가 원하는 correlation 용도로 사용할 수 있습니다. Response는 `ipmi_create_user()`에 넘긴 handler의 `ipmi_recv_hndl` callback으로 전달되며 `recv_type`도 확인해야 합니다.

Userland에서는 `ipmi_req_t`를 채워 `IPMICTL_SEND_COMMAND` ioctl로 보냅니다. Incoming message는 `select()` 또는 `poll()`로 기다릴 수 있지만 `read()`로 받을 수는 없습니다. 실제 수신은 `ipmi_recv_t`와 `IPMICTL_RECEIVE_MSG` ioctl을 사용하며 `msg.data`에 buffer pointer, `msg.data_len`에 buffer 크기를 반드시 제공합니다.

Message가 caller buffer에 들어가지 않으면 `EMSGSIZE`를 반환하고 receive queue에 그대로 둡니다. Truncation을 허용해 가져오려면 `IPMICTL_RECEIVE_MSG_TRUNC` ioctl을 사용합니다.

IPMI specification에서 netfn의 lowest-order bit로 구분되는 command를 IPMB로 보내면 driver가 sequence number를 자동 할당하고 command를 보관합니다. Specification의 5초 안에 response가 없으면 timeout response를 자동 생성하고, 5초 이후와 같은 unsolicited response는 무시합니다.

Kernel에서 received message 처리가 끝나면 반드시 `ipmi_free_recv_msg()`를 호출해야 합니다. 그렇지 않으면 message가 leak됩니다. Proper cleanup에 필요한 `done` field는 절대 변경하면 안 됩니다.

`ipmi_request_supply_msgs()`는 caller가 SMI message와 receive message buffer 및 free routine을 직접 제공하게 합니다. Watchdog처럼 system buffer가 고갈되어도 동작해야 하는 code에 유용하지만 buffer 관리가 까다로우므로 normal use에는 권장하지 않습니다.

Userland send·receive
ipmi_req_t + payload bufferIPMICTL_SEND_COMMANDselect()/poll()로 readiness 대기ipmi_recv_t + receive bufferIPMICTL_RECEIVE_MSGBuffer 부족 시 EMSGSIZE 또는 TRUNC

ioctl 기반 message path와 buffer requirement입니다.

Messaging ownership·timeout
항목동작
msgidResponse correlation용 opaque long
IPMB sequenceDriver가 자동 할당
Response timeout5초 후 timeout response 자동 생성
Late unsolicited response무시
Received message완료 후 ipmi_free_recv_msg() 필수
Supply messages APIBuffer 고갈 대응용, normal use 비권장

Kernel caller가 지켜야 할 수명 규칙입니다.

Event와 incoming command

341-371

Driver는 IPMI event polling과 incoming command 수신을 처리합니다. 여기서 command는 response가 아니라 IPMB bus의 다른 component가 보낸 request입니다. Event와 command는 자동 전달되지 않으므로 user가 등록해야 합니다.

Event를 받으려면 `ipmi_set_gets_events()`의 `val`을 0이 아닌 값으로 설정합니다. Driver start 이후 쌓인 event는 event를 처음 등록한 user에게 즉시 전달됩니다. 그 뒤 여러 user가 등록되어 있으면 새 event를 모두에게 전달합니다.

Command는 받을 `netfn`과 command마다 `ipmi_register_for_cmd()`를 호출합니다. Channel bitmask를 지정하거나 모든 channel에는 `IPMI_CHAN_ALL`을 사용합니다. 동일한 `netfn/cmd/channel`에는 user 하나만 등록할 수 있지만 command가 다르거나 channel bitmask가 겹치지 않으면 서로 다른 user가 등록할 수 있습니다.

Received command에 응답하려면 반환된 netfn에 response bit를 설정하고, received message의 address와 같은 `msgid`를 사용합니다. Userland에도 이 기능에 대응하는 ioctl이 제공됩니다.

Event delivery
Driver가 event polling첫 event user 등록Startup 이후 backlog를 첫 user에게 전달추가 user 등록새 event는 모든 등록 user에게 전달

Startup backlog와 이후 fan-out 동작입니다.

Incoming command registration
항목규칙
Registrationnetfn + cmd + channel bitmask
All channelsIPMI_CHAN_ALL
Exclusivity같은 netfn/cmd/channel에는 user 하나
Responsenetfn response bit + received addr + same msgid

Registration key와 response identity 규칙입니다.

Lower layer SMI interface

372-384

여러 SMI interface가 message handler에 등록될 수 있으며 등록 시 각 interface number를 받습니다. 일반적으로 등록 순서대로 번호가 정해지지만 SMI가 unregister된 뒤 다른 SMI가 등록되면 번호 순서를 가정할 수 없습니다.

Management interface가 구현해야 할 lower-layer contract의 상세는 `linux/ipmi_smi.h`에 정의되어 있습니다.

SMI registration
Physical SMI 발견Message handler에 registerInterface number 할당Upper-layer user가 number로 선택Unregister 뒤 번호 재사용 가능

Runtime 등록 상태에 따라 interface number가 부여됩니다.

SI driver 설정

385-461

SI driver는 KCS, BT, SMIC interface를 구성하며 system 종류에 따라 여러 discovery method를 사용합니다. Module load line에서 interface를 최대 4개 지정하고 각 parameter list의 첫 항목은 첫 interface, 둘째 항목은 둘째 interface에 대응합니다.

modprobe ipmi_si.o type=<type1>,<type2>....
     ports=<port1>,<port2>... addrs=<addr1>,<addr2>...
     irqs=<irq1>,<irq2>...
     regspacings=<sp1>,<sp2>,... regsizes=<size1>,<size2>,...
     regshifts=<shift1>,<shift2>,...
     slave_addrs=<addr1>,<addr2>,...
     force_kipmid=<enable1>,<enable2>,...
     kipmid_max_busy_us=<ustime1>,<ustime2>,...
     unload_when_empty=[0|1]
     trydmi=[0|1] tryacpi=[0|1]
     tryplatform=[0|1] trypci=[0|1]

`type`은 `kcs`, `smic`, `bt` 중 하나이며 생략하면 `kcs`입니다. Interface의 `addrs`가 0이 아니면 memory address를 device address로 사용하고 `ports`보다 우선합니다. `ports`가 0이 아니면 지정 I/O port를 사용하며, `irqs`가 0이 아니면 해당 interrupt 사용을 시도합니다.

`trydmi`, `tryacpi`, `tryplatform`, `trypci`는 이름에 대응하는 discovery source를 제어합니다. 기본적으로 모두 enable이며 0으로 disable합니다. `tryplatform`은 OpenFirmware도 disable합니다.

Register가 연속 address에 있지 않거나 8-bit register가 아닐 수 있으므로 `regspacings`, `regsizes`, `regshifts`로 layout을 지정합니다. `regspacings`는 연속 register start 사이 byte 수이며 기본값은 1입니다. 예를 들어 start `0xca2`, spacing 4이면 둘째 register는 `0xca6`입니다.

`regsizes`는 register byte 크기로 1, 2, 4, 8 중 하나이며 기본값은 1입니다. IPMI data는 8-bit지만 더 큰 register 안에 있을 수 있습니다. `regshifts`는 실제 IPMI data에 맞추기 위해 shift할 bit 수입니다.

`slave_addrs`는 local BMC의 IPMI address입니다. 보통 `0x20`이고 기본값도 `0x20`이지만 다르면 startup 때 지정합니다. 원문 parameter list의 `force_kipmid`가 kernel IPMI daemon을 강제로 enable(1) 또는 disable(0)합니다. Driver가 보통 자동 판단하지만 broken interrupt system은 enable이 필요할 수 있고, performance보다 CPU 절약을 원하는 사용자는 disable할 수 있습니다.

`unload_when_empty=1`이면 interface를 찾지 못하거나 모두 실패할 때 module을 unload합니다. 기본값은 1이며 hotmod를 사용할 때는 0이 유용합니다. 이 option은 module일 때만 의미가 있습니다.

SI address·register parameter
Parameter의미기본·우선순위
typekcs·smic·btkcs
addrsMemory addressports보다 우선
portsI/O portaddrs가 0일 때
irqsInterrupt0이 아니면 사용 시도
regspacingsRegister start 간 byte1
regsizesRegister byte 크기1, 허용 1·2·4·8
regshiftsIPMI data bit shiftHardware layout
slave_addrsLocal BMC IPMI address0x20

Hardware resource와 register layout parameter를 정리했습니다.

SI discovery와 unload
DMI·ACPI·platform/OpenFirmware·PCI discoveryInterface 발견?예: register layout 적용아니오 또는 전부 실패unload_when_empty=1이면 module unload0이면 hotmod 대기

Discovery source와 empty module 처리 흐름입니다.

SI built-in·polling·hotmod

462-521

SI driver를 kernel에 built-in하면 module parameter와 같은 이름을 `ipmi_si.` prefix로 kernel command line에 지정합니다.

ipmi_si.type=<type1>,<type2>...
     ipmi_si.ports=<port1>,<port2>... ipmi_si.addrs=<addr1>,<addr2>...
     ipmi_si.irqs=<irq1>,<irq2>...
     ipmi_si.regspacings=<sp1>,<sp2>,...
     ipmi_si.regsizes=<size1>,<size2>,...
     ipmi_si.regshifts=<shift1>,<shift2>,...
     ipmi_si.slave_addrs=<addr1>,<addr2>,...
     ipmi_si.force_kipmid=<enable1>,<enable2>,...
     ipmi_si.kipmid_max_busy_us=<ustime1>,<ustime2>,...

KCS 또는 SMIC interface가 interrupt를 지원하지 않으면 driver가 operation 진행 중 interface를 계속 poll하는 low-priority kernel thread `kipmid`를 시작해 성능을 높입니다. `force_kipmid`로 강제 on/off할 수 있지만 interrupt가 없는데 off로 강제하면 driver가 매우 느려집니다.

Interface 성능에 따라 polling thread가 CPU를 많이 사용해 idle detection과 power consumption에 영향을 줄 수 있습니다. `kipmid_max_busy_us`는 kipmid가 한 tick sleep하기 전 spin할 최대 microsecond를 정합니다. Performance와 CPU 낭비 사이 균형을 workload에 맞춰 조정해야 합니다.

Runtime hot add/remove는 write-only `/sys/modules/ipmi_si/parameters/hotmod`에 operation string을 써서 수행합니다. 한 줄에 여러 interface를 지정할 수 있습니다.

<op1>[:op2[:op3...]]
add|remove,kcs|bt|smic,mem|i/o,<address>[,<opt1>[,<opt2>[,...]]]
rsp=<regspacing>
rsi=<regsize>
rsh=<regshift>
irq=<irq>
ipmb=<ipmb slave addr>

`rsp`, `rsi`, `rsh`, `irq`, `ipmb` option은 앞에서 설명한 register spacing, size, shift, interrupt, IPMB slave address와 같은 의미입니다. Compact interface specification으로 kernel command line에서도 사용할 수 있습니다. Remove 비교에는 SI type, address type, address의 첫 세 parameter만 사용하고 option은 무시합니다.

kipmid tuning
상태force_kipmid결과
Interrupt 없음on빠른 polling, CPU 사용 증가
Interrupt 없음off매우 느림
Interrupt 정상autoDriver가 thread 필요성 판단
CPU 사용 제한kipmid_max_busy_us 조정Spin latency와 idle/power 균형

Interrupt availability와 CPU·latency trade-off입니다.

SI hotmod operation
Operation string 작성add 또는 removekcs·bt·smic 선택mem 또는 i/o address 지정Optional rsp·rsi·rsh·irq·ipmbhotmod에 writeInterface register 또는 unregister

Write-only sysfs parameter가 interface lifecycle을 바꿉니다.

SMBus driver (SSIF)

522-590

SMBus driver는 system에 SMBus device를 최대 4개 구성합니다. 기본적으로 DMI 또는 ACPI table에서 찾은 device에만 register하며 module load parameter로 직접 바꿀 수 있습니다.

modprobe ipmi_ssif.o
      addr=<i2caddr1>[,<i2caddr2>[,...]]
      adapter=<adapter1>[,<adapter2>[...]]
      dbg=<flags1>,<flags2>...
      slave_addrs=<addr1>,<addr2>,...
      tryacpi=[0|1] trydmi=[0|1]
      [dbg_probe=1]
      alerts_broken

`addr`은 normal I2C address입니다. `adapter`는 `/sys/bus/i2c/devices/i2c-<n>/name`에 표시되는 adapter string name이며 `i2c-<n>` 자체가 아닙니다. 비교는 space를 무시하므로 space가 있는 name도 붙여서 parameter로 전달할 수 있습니다.

BMC별 `dbg` bit flag는 IPMI message 1, driver state 2, timing 4, I2C probe 8입니다. `tryacpi`, `trydmi`는 해당 source의 detection을 disable할 수 있고, `dbg_probe=1`은 SMBus BMC probing·detection debug를 enable합니다. `slave_addrs`는 local BMC IPMI address로 기본값은 보통 `0x20`입니다.

`alerts_broken`을 지정하면 SSIF의 SMBus alert를 enable하지 않습니다. 지정하지 않으면 지원 hardware에서 alert를 enable합니다.

SMBus에서 compliant BMC를 discovery하는 과정은 I2C bus의 다른 device를 실패하게 할 수 있습니다. Driver가 `Get Device ID` IPMI message를 I2C block write로 보내고 response를 기다리기 때문입니다. DMI/ACPI가 address를 제공하지 않는다면 알려진 I2C address를 driver parameter로 명시하는 것이 강하게 권장됩니다.

Built-in driver는 kernel command line에 같은 option을 `ipmi_ssif.` prefix로 지정합니다. 원문 첫 address 예시는 `ipmb_ssif.addr`로 표기되어 있으며 그대로 보존합니다.

ipmb_ssif.addr=<i2caddr1>[,<i2caddr2>[...]]
      ipmi_ssif.adapter=<adapter1>[,<adapter2>[...]]
      ipmi_ssif.dbg=<flags1>[,<flags2>[...]]
      ipmi_ssif.dbg_probe=1
      ipmi_ssif.slave_addrs=<addr1>[,<addr2>[...]]
      ipmi_ssif.tryacpi=[0|1] ipmi_ssif.trydmi=[0|1]

I2C driver는 non-blocking access나 polling을 지원하지 않으므로 special patch와 modification 없이는 panic event, panic 때 watchdog extension 등 panic-related IPMI 기능을 수행할 수 없습니다. Interface hot add/remove는 I2C sysfs interface를 통해 지원합니다.

SSIF parameter
Parameter의미
addrNormal I2C BMC address
adapteri2c-<n>/name의 string, space 무시
dbg1 message, 2 state, 4 timing, 8 probe
dbg_probeBMC probing debug
slave_addrsLocal BMC IPMI address, 보통 0x20
alerts_brokenSMBus alert disable
tryacpi·trydmiDiscovery source 제어

SMBus BMC discovery·debug 설정입니다.

안전한 SSIF discovery
DMI·ACPI에 BMC address가 있는가?예: firmware address 사용아니오: known I2C address parameter 제공Get Device ID block writeBMC response 확인Blind bus probe 최소화

Blind probe가 다른 I2C device에 미칠 위험을 줄입니다.

IPMI IPMB driver

591-629

이 driver는 IPMB bus 위에 있는 system을 지원하며 해당 interface를 normal IPMI interface처럼 보이게 합니다. System-interface address message를 보내면 system에 등록된 BMC, 기본 IPMI address `0x20`으로 전달합니다.

IPMB direct addressing으로 bus의 다른 MC를 직접 address할 수도 있습니다. 다른 MC가 보낸 command는 앞에서 설명한 normal received-command mechanism으로 처리됩니다.

ipmi_ipmb.bmcaddr=<address to use for system interface addresses messages>
      ipmi_ipmb.retry_time_ms=<Time between retries on IPMB>
      ipmi_ipmb.max_retries=<Number of times to retry a message>

Module load만으로는 device tree 설정이 없는 driver가 자동 시작되지 않습니다. 수동 instantiation에는 I2C sysfs `new_device`를 사용합니다.

echo ipmi-ipmb <addr> > /sys/class/i2c-dev/i2c-<n>/device/new_device

여기서 `<addr>`은 IPMI address가 아니라 I2C address입니다. MC address를 `0x60`으로 만들려면 I2C address `0x30`을 써야 합니다.

이 interface를 통한 다른 IPMB bus로의 command bridging은 동작하지 않습니다. Receive message queue도 의도적으로 구현하지 않았습니다. BMC에는 host driver용 receive queue 하나만 있기 때문입니다.

BMC는 IPMB bus를 여러 개 가질 수 있고 device가 어느 bus에 있는지는 wiring에 달려 있습니다. `ipmitool channel info <n>`으로 0~7 channel을 조회해 IPMB channel을 확인할 수 있습니다.

IPMB driver route
Normal IPMI upper layeripmi_ipmb interfaceSystem-interface address → registered BMC 0x20Direct address → target MCIncoming MC command → received-command handler

System interface address와 direct address가 bus에서 다른 route를 사용합니다.

IPMI·I2C address 변환
목표 MC IPMI addressnew_device I2C address
0x600x30
일반 규칙IPMI address를 1 bit right shift한 7-bit address

IPMB의 8-bit IPMI address와 7-bit I2C instantiation 값을 구분합니다.

IPMI device 상세 정보

630-659

일부 user는 address discovery source나 IPMI interface의 raw base device처럼 더 자세한 정보가 필요합니다. IPMI `smi_watcher`로 interface add/remove를 감시하고 `ipmi_get_smi_info()`로 다음 구조체를 얻을 수 있습니다.

struct ipmi_smi_info {
      enum ipmi_addr_src addr_src;
      struct device *dev;
      union {
              struct {
                      void *acpi_handle;
              } acpi_info;
      } addr_info;
};

현재 special address information은 `SI_ACPI` source에 대해서만 반환하며 필요에 따라 다른 source가 추가될 수 있습니다. Structure에 `dev` pointer가 포함되므로 `ipmi_get_smi_info()`가 success를 반환했다면 반드시 그 pointer에 `put_device()`를 호출해야 합니다.

SMI info ownership
smi_watcher가 interface 발견ipmi_get_smi_info()addr_src·dev·ACPI handle 사용Success였는지 확인put_device(dev)로 reference 반환

Watcher에서 device reference를 얻고 해제하는 순서입니다.

Watchdog

660-737

`ipmi_watchdog`는 Linux standard watchdog timer interface를 구현하며 module parameter로 timeout, pretimeout, timeout action, preaction, preop, 즉시 시작, nowayout, interface, panic timeout을 제어합니다.

modprobe ipmi_watchdog timeout=<t> pretimeout=<t> action=<action type>
    preaction=<preaction type> preop=<preop type> start_now=x
    nowayout=x ifnum_to_use=n panic_wdt_timeout=<t>

`ifnum_to_use`는 watchdog이 사용할 interface를 지정합니다. 기본값 `-1`은 처음 등록된 interface를 선택합니다. `timeout`은 final action까지의 초이고 `pretimeout`은 final timeout보다 몇 초 먼저 pre-timeout을 발생시킬지 정합니다. 예를 들어 timeout 50, pretimeout 10이면 40초에 pretimeout이 발생합니다. `pretimeout=0`이면 disable합니다. `panic_wdt_timeout`은 kdump 같은 panic action이 수행될 시간을 확보하도록 kernel panic 때 설정할 timeout입니다.

Final `action`은 `reset`, `power_cycle`, `power_off` 중 하나이며 기본값은 `reset`입니다. `preaction`은 SMI indication인 `pre_smi`, interrupt를 동반한 SMI indication인 `pre_int`, NMI인 `pre_nmi` 중 하나로 driver가 pretimeout을 인식하는 방식을 정합니다.

`preop`은 아무 동작도 하지 않는 `preop_none`, panic하는 `preop_panic`, watchdog device에서 읽을 data를 제공하는 `preop_give_data` 중 하나입니다. NMI context에서는 data operation을 할 수 없으므로 `pre_nmi`와 `preop_give_data`를 함께 사용할 수 없습니다.

`preop_give_data`이면 pretimeout 때 device에서 읽을 1 byte가 준비되고 `select`와 `fasync`도 동작합니다. `start_now=1`이면 driver load 즉시 watchdog을 시작합니다.

`nowayout=1`이면 watchdog device를 닫아도 timer가 멈추지 않습니다. 기본값은 `CONFIG_WATCHDOG_NOWAYOUT`이 enable이면 true, 아니면 false입니다. Built-in driver는 같은 option을 kernel command line으로 받습니다.

ipmi_watchdog.timeout=<t> ipmi_watchdog.pretimeout=<t>
      ipmi_watchdog.action=<action type>
      ipmi_watchdog.preaction=<preaction type>
      ipmi_watchdog.preop=<preop type>
      ipmi_watchdog.start_now=x
      ipmi_watchdog.nowayout=x
      ipmi_watchdog.panic_wdt_timeout=<t>

Watchdog가 pre-action을 받으면 panic하고 120초 reset timeout을 시작합니다. Panic 또는 reboot 중에도 watchdog이 이미 실행 중이면 reboot 완료를 보장하도록 120초 timer를 시작합니다.

Watchdog에 NMI preaction을 사용한다면 NMI watchdog을 함께 사용하면 안 됩니다. IPMI controller가 보낸 NMI인지 합리적으로 판별할 방법이 없어, 다른 handler가 처리하지 않은 NMI를 IPMI에서 온 것으로 간주하고 즉시 panic하기 때문입니다.

Watchdog device를 open한 뒤 정상적으로 닫아 timer를 정지하려면 device에 문자 `V`를 써야 합니다. 이는 다른 Linux watchdog driver와 같은 semantics입니다.

Watchdog timeout timeline
Timer starttimeout=50초40초: pretimeout 10초 전 발생preaction으로 driver 통지preop 수행50초: reset·power_cycle·power_off

Pretimeout은 final timeout보다 앞선 상대 시점입니다.

Watchdog preaction·preop
분류의미
preactionpre_smiSMI indication
preactionpre_intInterrupt 포함 SMI indication
preactionpre_nmiNMI indication
preoppreop_noneNo operation
preoppreop_panicKernel panic
preoppreop_give_data1 byte readable, select·fasync 지원
금지 조합pre_nmi + preop_give_dataNMI에서 data operation 불가

Notification context와 허용 operation 조합입니다.

Watchdog close semantics
설정·행동결과
nowayout=1Device close로 timer 정지 불가
nowayout=0 + 문자 V write 후 close정상 timer stop
start_now=1Module load 즉시 시작
Panic/reboot 중 running120초 reset timer 설정

nowayout과 magic close 문자를 구분합니다.

Panic timeout과 event log

738-784

OpenIPMI driver는 panic 때 system event log에 semi-custom 또는 custom event를 넣을 수 있습니다. `Generate a panic event to all BMCs on a panic`을 enable하면 standard IPMI format event 하나를 기록하고, `Generate OEM events containing the panic string`을 enable하면 panic string을 담은 여러 OEM event도 기록합니다.

Standard panic event field는 Generator ID `0x21`(kernel), EvM Rev `0x03`(IPMI 1.0 format), Sensor Type `0x20`(OS critical stop), Sensor number는 panic string 첫 byte 또는 string이 없으면 0, Event Dir·Type `0x6f`, Event Data 1 `0xa1`, Data 2와 3은 panic string 둘째·셋째 byte입니다. Event는 항상 local management controller로 보내며 controller가 적절한 destination으로 route합니다.

OEM non-timestamped record는 SEL이 정하는 Record ID bytes 0~1, Record type byte 2의 `0xf0`, panic을 저장하는 card의 slave address byte 3, 0부터 증가하는 sequence byte 4, 나머지 11 bytes의 panic string으로 구성됩니다. String이 11 bytes보다 길면 sequence를 증가시키며 여러 message를 보냅니다.

Standard interface로 OEM event를 보낼 수 없으므로 driver는 SEL을 찾아 직접 추가합니다. 먼저 local management controller capability를 조회해 SEL이 있으면 local SEL에 저장합니다. Local controller에 SEL은 없지만 event generator라면 event receiver를 조회해 그 device의 SEL로 보냅니다. 둘 다 아니면 보낼 곳이 없어 event가 저장되지 않습니다.

Standard panic event layout
FieldValue
Generator ID0x21 (kernel)
EvM Rev0x03
Sensor Type0x20
Sensor #Panic string first byte 또는 0
Event Dir | Type0x6f
Event Data 10xa1
Event Data 2·3Panic string second·third byte

IPMI 1.0 format의 panic event field입니다.

Panic OEM event destination
Local management controller capability queryLocal SEL이 있는가?예: local SEL에 저장아니오: local controller가 event generator인가?예: event receiver 조회 후 remote SEL로 전송아니오: 저장 destination 없음

SEL capability에 따라 저장 위치를 결정합니다.

Poweroff

785-807

Poweroff capability를 선택하면 `ipmi_poweroff` module이 standard poweroff function pointer에 shutdown function을 설치합니다. System이 powerdown을 요청하면 platform에 맞는 IPMI command를 전송합니다.

`poweroff_powercycle` module parameter가 0이면 power down, 0이 아니면 system을 끈 뒤 몇 초 후 다시 켜는 power cycle을 수행합니다. Kernel command line의 `ipmi_poweroff.poweroff_control=x`도 같은 역할을 하며 `/proc/sys/dev/ipmi/poweroff_powercycle`에서도 설정할 수 있습니다. System이 power cycle을 지원하지 않으면 항상 power off합니다.

`ifnum_to_use`는 poweroff code가 사용할 interface를 정하며 기본값 `-1`은 처음 등록된 interface를 선택합니다. ACPI가 enable되어 있으면 system은 IPMI보다 ACPI poweroff를 우선합니다.

System poweroff 선택
System powerdown requestACPI가 enable되어 usable한가?예: ACPI poweroff 우선아니오: ipmi_poweroff interface 선택poweroff_powercycle=0 → power downNon-zero → 지원 시 power cycle, 미지원 시 power off

ACPI 우선순위와 IPMI fallback 동작입니다.