1================================== 2How to use the QAPI code generator 3================================== 4 5.. 6 Copyright IBM Corp. 2011 7 Copyright (C) 2012-2016 Red Hat, Inc. 8 9 This work is licensed under the terms of the GNU GPL, version 2 or 10 later. See the COPYING file in the top-level directory. 11 12.. _qapi: 13 14Introduction 15============ 16 17QAPI is a native C API within QEMU which provides management-level 18functionality to internal and external users. For external 19users/processes, this interface is made available by a JSON-based wire 20format for the QEMU Monitor Protocol (QMP) for controlling qemu, as 21well as the QEMU Guest Agent (QGA) for communicating with the guest. 22The remainder of this document uses "Client JSON Protocol" when 23referring to the wire contents of a QMP or QGA connection. 24 25To map between Client JSON Protocol interfaces and the native C API, 26we generate C code from a QAPI schema. This document describes the 27QAPI schema language, and how it gets mapped to the Client JSON 28Protocol and to C. It additionally provides guidance on maintaining 29Client JSON Protocol compatibility. 30 31 32The QAPI schema language 33======================== 34 35The QAPI schema defines the Client JSON Protocol's commands and 36events, as well as types used by them. Forward references are 37allowed. 38 39It is permissible for the schema to contain additional types not used 40by any commands or events, for the side effect of generated C code 41used internally. 42 43There are several kinds of types: simple types (a number of built-in 44types, such as ``int`` and ``str``; as well as enumerations), arrays, 45complex types (structs and unions), and alternate types (a choice 46between other types). 47 48 49Schema syntax 50------------- 51 52Syntax is loosely based on `JSON <http://www.ietf.org/rfc/rfc8259.txt>`_. 53Differences: 54 55* Comments: start with a hash character (``#``) that is not part of a 56 string, and extend to the end of the line. 57 58* Strings are enclosed in ``'single quotes'``, not ``"double quotes"``. 59 60* Strings are restricted to printable ASCII, and escape sequences to 61 just ``\\``. 62 63* Numbers and ``null`` are not supported. 64 65A second layer of syntax defines the sequences of JSON texts that are 66a correctly structured QAPI schema. We provide a grammar for this 67syntax in an EBNF-like notation: 68 69* Production rules look like ``non-terminal = expression`` 70* Concatenation: expression ``A B`` matches expression ``A``, then ``B`` 71* Alternation: expression ``A | B`` matches expression ``A`` or ``B`` 72* Repetition: expression ``A...`` matches zero or more occurrences of 73 expression ``A`` 74* Repetition: expression ``A, ...`` matches zero or more occurrences of 75 expression ``A`` separated by ``,`` 76* Grouping: expression ``( A )`` matches expression ``A`` 77* JSON's structural characters are terminals: ``{ } [ ] : ,`` 78* JSON's literal names are terminals: ``false true`` 79* String literals enclosed in ``'single quotes'`` are terminal, and match 80 this JSON string, with a leading ``*`` stripped off 81* When JSON object member's name starts with ``*``, the member is 82 optional. 83* The symbol ``STRING`` is a terminal, and matches any JSON string 84* The symbol ``BOOL`` is a terminal, and matches JSON ``false`` or ``true`` 85* ALL-CAPS words other than ``STRING`` are non-terminals 86 87The order of members within JSON objects does not matter unless 88explicitly noted. 89 90A QAPI schema consists of a series of top-level expressions:: 91 92 SCHEMA = TOP-LEVEL-EXPR... 93 94The top-level expressions are all JSON objects. Code and 95documentation is generated in schema definition order. Code order 96should not matter. 97 98A top-level expressions is either a directive or a definition:: 99 100 TOP-LEVEL-EXPR = DIRECTIVE | DEFINITION 101 102There are two kinds of directives and six kinds of definitions:: 103 104 DIRECTIVE = INCLUDE | PRAGMA 105 DEFINITION = ENUM | STRUCT | UNION | ALTERNATE | COMMAND | EVENT 106 107These are discussed in detail below. 108 109 110Built-in Types 111-------------- 112 113The following types are predefined, and map to C as follows: 114 115 ============= ============== ============================================ 116 Schema C JSON 117 ============= ============== ============================================ 118 ``str`` ``char *`` any JSON string, UTF-8 119 ``number`` ``double`` any JSON number 120 ``int`` ``int64_t`` a JSON number without fractional part 121 that fits into the C integer type 122 ``int8`` ``int8_t`` likewise 123 ``int16`` ``int16_t`` likewise 124 ``int32`` ``int32_t`` likewise 125 ``int64`` ``int64_t`` likewise 126 ``uint8`` ``uint8_t`` likewise 127 ``uint16`` ``uint16_t`` likewise 128 ``uint32`` ``uint32_t`` likewise 129 ``uint64`` ``uint64_t`` likewise 130 ``size`` ``uint64_t`` like ``uint64_t``, except 131 ``StringInputVisitor`` accepts size suffixes 132 ``bool`` ``bool`` JSON ``true`` or ``false`` 133 ``null`` ``QNull *`` JSON ``null`` 134 ``any`` ``QObject *`` any JSON value 135 ``QType`` ``QType`` JSON string matching enum ``QType`` values 136 ============= ============== ============================================ 137 138 139Include directives 140------------------ 141 142Syntax:: 143 144 INCLUDE = { 'include': STRING } 145 146The QAPI schema definitions can be modularized using the 'include' directive:: 147 148 { 'include': 'path/to/file.json' } 149 150The directive is evaluated recursively, and include paths are relative 151to the file using the directive. Multiple includes of the same file 152are idempotent. 153 154As a matter of style, it is a good idea to have all files be 155self-contained, but at the moment, nothing prevents an included file 156from making a forward reference to a type that is only introduced by 157an outer file. The parser may be made stricter in the future to 158prevent incomplete include files. 159 160.. _pragma: 161 162Pragma directives 163----------------- 164 165Syntax:: 166 167 PRAGMA = { 'pragma': { 168 '*doc-required': BOOL, 169 '*command-name-exceptions': [ STRING, ... ], 170 '*command-returns-exceptions': [ STRING, ... ], 171 '*documentation-exceptions': [ STRING, ... ], 172 '*member-name-exceptions': [ STRING, ... ] } } 173 174The pragma directive lets you control optional generator behavior. 175 176Pragma's scope is currently the complete schema. Setting the same 177pragma to different values in parts of the schema doesn't work. 178 179Pragma 'doc-required' takes a boolean value. If true, documentation 180is required. Default is false. 181 182Pragma 'command-name-exceptions' takes a list of commands whose names 183may contain ``"_"`` instead of ``"-"``. Default is none. 184 185Pragma 'command-returns-exceptions' takes a list of commands that may 186violate the rules on permitted return types. Default is none. 187 188Pragma 'documentation-exceptions' takes a list of types, commands, and 189events whose members / arguments need not be documented. Default is 190none. 191 192Pragma 'member-name-exceptions' takes a list of types whose member 193names may contain uppercase letters, and ``"_"`` instead of ``"-"``. 194Default is none. 195 196.. _ENUM-VALUE: 197 198Enumeration types 199----------------- 200 201Syntax:: 202 203 ENUM = { 'enum': STRING, 204 'data': [ ENUM-VALUE, ... ], 205 '*prefix': STRING, 206 '*if': COND, 207 '*features': FEATURES } 208 ENUM-VALUE = STRING 209 | { 'name': STRING, 210 '*if': COND, 211 '*features': FEATURES } 212 213Member 'enum' names the enum type. 214 215Each member of the 'data' array defines a value of the enumeration 216type. The form STRING is shorthand for :code:`{ 'name': STRING }`. The 217'name' values must be be distinct. 218 219Example:: 220 221 { 'enum': 'MyEnum', 'data': [ 'value1', 'value2', 'value3' ] } 222 223Nothing prevents an empty enumeration, although it is probably not 224useful. 225 226On the wire, an enumeration type's value is represented by its 227(string) name. In C, it's represented by an enumeration constant. 228These are of the form PREFIX_NAME, where PREFIX is derived from the 229enumeration type's name, and NAME from the value's name. For the 230example above, the generator maps 'MyEnum' to MY_ENUM and 'value1' to 231VALUE1, resulting in the enumeration constant MY_ENUM_VALUE1. The 232optional 'prefix' member overrides PREFIX. This is rarely necessary, 233and should be used with restraint. 234 235The generated C enumeration constants have values 0, 1, ..., N-1 (in 236QAPI schema order), where N is the number of values. There is an 237additional enumeration constant PREFIX__MAX with value N. 238 239Do not use string or an integer type when an enumeration type can do 240the job satisfactorily. 241 242The optional 'if' member specifies a conditional. See `Configuring the 243schema`_ below for more on this. 244 245The optional 'features' member specifies features. See Features_ 246below for more on this. 247 248 249.. _TYPE-REF: 250 251Type references and array types 252------------------------------- 253 254Syntax:: 255 256 TYPE-REF = STRING | ARRAY-TYPE 257 ARRAY-TYPE = [ STRING ] 258 259A string denotes the type named by the string. 260 261A one-element array containing a string denotes an array of the type 262named by the string. Example: ``['int']`` denotes an array of ``int``. 263 264 265Struct types 266------------ 267 268Syntax:: 269 270 STRUCT = { 'struct': STRING, 271 'data': MEMBERS, 272 '*base': STRING, 273 '*if': COND, 274 '*features': FEATURES } 275 MEMBERS = { MEMBER, ... } 276 MEMBER = STRING : TYPE-REF 277 | STRING : { 'type': TYPE-REF, 278 '*if': COND, 279 '*features': FEATURES } 280 281Member 'struct' names the struct type. 282 283Each MEMBER of the 'data' object defines a member of the struct type. 284 285.. _MEMBERS: 286 287The MEMBER's STRING name consists of an optional ``*`` prefix and the 288struct member name. If ``*`` is present, the member is optional. 289 290The MEMBER's value defines its properties, in particular its type. 291The form TYPE-REF_ is shorthand for :code:`{ 'type': TYPE-REF }`. 292 293Example:: 294 295 { 'struct': 'MyType', 296 'data': { 'member1': 'str', 'member2': ['int'], '*member3': 'str' } } 297 298A struct type corresponds to a struct in C, and an object in JSON. 299The C struct's members are generated in QAPI schema order. 300 301The optional 'base' member names a struct type whose members are to be 302included in this type. They go first in the C struct. 303 304Example:: 305 306 { 'struct': 'BlockdevOptionsGenericFormat', 307 'data': { 'file': 'str' } } 308 { 'struct': 'BlockdevOptionsGenericCOWFormat', 309 'base': 'BlockdevOptionsGenericFormat', 310 'data': { '*backing': 'str' } } 311 312An example BlockdevOptionsGenericCOWFormat object on the wire could use 313both members like this:: 314 315 { "file": "/some/place/my-image", 316 "backing": "/some/place/my-backing-file" } 317 318The optional 'if' member specifies a conditional. See `Configuring 319the schema`_ below for more on this. 320 321The optional 'features' member specifies features. See Features_ 322below for more on this. 323 324 325Union types 326----------- 327 328Syntax:: 329 330 UNION = { 'union': STRING, 331 'base': ( MEMBERS | STRING ), 332 'discriminator': STRING, 333 'data': BRANCHES, 334 '*if': COND, 335 '*features': FEATURES } 336 BRANCHES = { BRANCH, ... } 337 BRANCH = STRING : TYPE-REF 338 | STRING : { 'type': TYPE-REF, '*if': COND } 339 340Member 'union' names the union type. 341 342The 'base' member defines the common members. If it is a MEMBERS_ 343object, it defines common members just like a struct type's 'data' 344member defines struct type members. If it is a STRING, it names a 345struct type whose members are the common members. 346 347Member 'discriminator' must name a non-optional enum-typed member of 348the base struct. That member's value selects a branch by its name. 349If no such branch exists, an empty branch is assumed. 350 351Each BRANCH of the 'data' object defines a branch of the union. A 352union must have at least one branch. 353 354The BRANCH's STRING name is the branch name. It must be a value of 355the discriminator enum type. 356 357The BRANCH's value defines the branch's properties, in particular its 358type. The type must a struct type. The form TYPE-REF_ is shorthand 359for :code:`{ 'type': TYPE-REF }`. 360 361In the Client JSON Protocol, a union is represented by an object with 362the common members (from the base type) and the selected branch's 363members. The two sets of member names must be disjoint. 364 365Example:: 366 367 { 'enum': 'BlockdevDriver', 'data': [ 'file', 'qcow2' ] } 368 { 'union': 'BlockdevOptions', 369 'base': { 'driver': 'BlockdevDriver', '*read-only': 'bool' }, 370 'discriminator': 'driver', 371 'data': { 'file': 'BlockdevOptionsFile', 372 'qcow2': 'BlockdevOptionsQcow2' } } 373 374Resulting in these JSON objects:: 375 376 { "driver": "file", "read-only": true, 377 "filename": "/some/place/my-image" } 378 { "driver": "qcow2", "read-only": false, 379 "backing": "/some/place/my-image", "lazy-refcounts": true } 380 381The order of branches need not match the order of the enum values. 382The branches need not cover all possible enum values. In the 383resulting generated C data types, a union is represented as a struct 384with the base members in QAPI schema order, and then a union of 385structures for each branch of the struct. 386 387The optional 'if' member specifies a conditional. See `Configuring 388the schema`_ below for more on this. 389 390The optional 'features' member specifies features. See Features_ 391below for more on this. 392 393 394Alternate types 395--------------- 396 397Syntax:: 398 399 ALTERNATE = { 'alternate': STRING, 400 'data': ALTERNATIVES, 401 '*if': COND, 402 '*features': FEATURES } 403 ALTERNATIVES = { ALTERNATIVE, ... } 404 ALTERNATIVE = STRING : STRING 405 | STRING : { 'type': STRING, '*if': COND } 406 407Member 'alternate' names the alternate type. 408 409Each ALTERNATIVE of the 'data' object defines a branch of the 410alternate. An alternate must have at least one branch. 411 412The ALTERNATIVE's STRING name is the branch name. 413 414The ALTERNATIVE's value defines the branch's properties, in particular 415its type. The form STRING is shorthand for :code:`{ 'type': STRING }`. 416 417Example:: 418 419 { 'alternate': 'BlockdevRef', 420 'data': { 'definition': 'BlockdevOptions', 421 'reference': 'str' } } 422 423An alternate type is like a union type, except there is no 424discriminator on the wire. Instead, the branch to use is inferred 425from the value. An alternate can only express a choice between types 426represented differently on the wire. 427 428If a branch is typed as the 'bool' built-in, the alternate accepts 429true and false; if it is typed as any of the various numeric 430built-ins, it accepts a JSON number; if it is typed as a 'str' 431built-in or named enum type, it accepts a JSON string; if it is typed 432as the 'null' built-in, it accepts JSON null; and if it is typed as a 433complex type (struct or union), it accepts a JSON object. 434 435The example alternate declaration above allows using both of the 436following example objects:: 437 438 { "file": "my_existing_block_device_id" } 439 { "file": { "driver": "file", 440 "read-only": false, 441 "filename": "/tmp/mydisk.qcow2" } } 442 443The optional 'if' member specifies a conditional. See `Configuring 444the schema`_ below for more on this. 445 446The optional 'features' member specifies features. See Features_ 447below for more on this. 448 449 450Commands 451-------- 452 453Syntax:: 454 455 COMMAND = { 'command': STRING, 456 ( 457 '*data': ( MEMBERS | STRING ), 458 | 459 'data': STRING, 460 'boxed': true, 461 ) 462 '*returns': TYPE-REF, 463 '*success-response': false, 464 '*gen': false, 465 '*allow-oob': true, 466 '*allow-preconfig': true, 467 '*coroutine': true, 468 '*if': COND, 469 '*features': FEATURES } 470 471Member 'command' names the command. 472 473Member 'data' defines the arguments. It defaults to an empty MEMBERS_ 474object. 475 476If 'data' is a MEMBERS_ object, then MEMBERS defines arguments just 477like a struct type's 'data' defines struct type members. 478 479If 'data' is a STRING, then STRING names a complex type whose members 480are the arguments. A union type requires ``'boxed': true``. 481 482Member 'returns' defines the command's return type. It defaults to an 483empty struct type. It must normally be a complex type or an array of 484a complex type. To return anything else, the command must be listed 485in pragma 'commands-returns-exceptions'. If you do this, extending 486the command to return additional information will be harder. Use of 487the pragma for new commands is strongly discouraged. 488 489A command's error responses are not specified in the QAPI schema. 490Error conditions should be documented in comments. 491 492In the Client JSON Protocol, the value of the "execute" or "exec-oob" 493member is the command name. The value of the "arguments" member then 494has to conform to the arguments, and the value of the success 495response's "return" member will conform to the return type. 496 497Some example commands:: 498 499 { 'command': 'my-first-command', 500 'data': { 'arg1': 'str', '*arg2': 'str' } } 501 { 'struct': 'MyType', 'data': { '*value': 'str' } } 502 { 'command': 'my-second-command', 503 'returns': [ 'MyType' ] } 504 505which would validate this Client JSON Protocol transaction:: 506 507 => { "execute": "my-first-command", 508 "arguments": { "arg1": "hello" } } 509 <= { "return": { } } 510 => { "execute": "my-second-command" } 511 <= { "return": [ { "value": "one" }, { } ] } 512 513The generator emits a prototype for the C function implementing the 514command. The function itself needs to be written by hand. See 515section `Code generated for commands`_ for examples. 516 517The function returns the return type. When member 'boxed' is absent, 518it takes the command arguments as arguments one by one, in QAPI schema 519order. Else it takes them wrapped in the C struct generated for the 520complex argument type. It takes an additional ``Error **`` argument in 521either case. 522 523The generator also emits a marshalling function that extracts 524arguments for the user's function out of an input QDict, calls the 525user's function, and if it succeeded, builds an output QObject from 526its return value. This is for use by the QMP monitor core. 527 528In rare cases, QAPI cannot express a type-safe representation of a 529corresponding Client JSON Protocol command. You then have to suppress 530generation of a marshalling function by including a member 'gen' with 531boolean value false, and instead write your own function. For 532example:: 533 534 { 'command': 'netdev_add', 535 'data': {'type': 'str', 'id': 'str'}, 536 'gen': false } 537 538Please try to avoid adding new commands that rely on this, and instead 539use type-safe unions. 540 541Normally, the QAPI schema is used to describe synchronous exchanges, 542where a response is expected. But in some cases, the action of a 543command is expected to change state in a way that a successful 544response is not possible (although the command will still return an 545error object on failure). When a successful reply is not possible, 546the command definition includes the optional member 'success-response' 547with boolean value false. So far, only QGA makes use of this member. 548 549Member 'allow-oob' declares whether the command supports out-of-band 550(OOB) execution. It defaults to false. For example:: 551 552 { 'command': 'migrate_recover', 553 'data': { 'uri': 'str' }, 'allow-oob': true } 554 555See the :doc:`/interop/qmp-spec` for out-of-band execution syntax 556and semantics. 557 558Commands supporting out-of-band execution can still be executed 559in-band. 560 561When a command is executed in-band, its handler runs in the main 562thread with the BQL held. 563 564When a command is executed out-of-band, its handler runs in a 565dedicated monitor I/O thread with the BQL *not* held. 566 567An OOB-capable command handler must satisfy the following conditions: 568 569- It terminates quickly. 570- It does not invoke system calls that may block. 571- It does not access guest RAM that may block when userfaultfd is 572 enabled for postcopy live migration. 573- It takes only "fast" locks, i.e. all critical sections protected by 574 any lock it takes also satisfy the conditions for OOB command 575 handler code. 576 577The restrictions on locking limit access to shared state. Such access 578requires synchronization, but OOB commands can't take the BQL or any 579other "slow" lock. 580 581When in doubt, do not implement OOB execution support. 582 583Member 'allow-preconfig' declares whether the command is available 584before the machine is built. It defaults to false. For example:: 585 586 { 'enum': 'QMPCapability', 587 'data': [ 'oob' ] } 588 { 'command': 'qmp_capabilities', 589 'data': { '*enable': [ 'QMPCapability' ] }, 590 'allow-preconfig': true } 591 592QMP is available before the machine is built only when QEMU was 593started with --preconfig. 594 595Member 'coroutine' tells the QMP dispatcher whether the command handler 596is safe to be run in a coroutine. It defaults to false. If it is true, 597the command handler is called from coroutine context and may yield while 598waiting for an external event (such as I/O completion) in order to avoid 599blocking the guest and other background operations. 600 601Coroutine safety can be hard to prove, similar to thread safety. Common 602pitfalls are: 603 604- The BQL isn't held across ``qemu_coroutine_yield()``, so 605 operations that used to assume that they execute atomically may have 606 to be more careful to protect against changes in the global state. 607 608- Nested event loops (``AIO_WAIT_WHILE()`` etc.) are problematic in 609 coroutine context and can easily lead to deadlocks. They should be 610 replaced by yielding and reentering the coroutine when the condition 611 becomes false. 612 613Since the command handler may assume coroutine context, any callers 614other than the QMP dispatcher must also call it in coroutine context. 615In particular, HMP commands calling such a QMP command handler must be 616marked ``.coroutine = true`` in hmp-commands.hx. 617 618It is an error to specify both ``'coroutine': true`` and ``'allow-oob': true`` 619for a command. We don't currently have a use case for both together and 620without a use case, it's not entirely clear what the semantics should 621be. 622 623The optional 'if' member specifies a conditional. See `Configuring 624the schema`_ below for more on this. 625 626The optional 'features' member specifies features. See Features_ 627below for more on this. 628 629 630Events 631------ 632 633Syntax:: 634 635 EVENT = { 'event': STRING, 636 ( 637 '*data': ( MEMBERS | STRING ), 638 | 639 'data': STRING, 640 'boxed': true, 641 ) 642 '*if': COND, 643 '*features': FEATURES } 644 645Member 'event' names the event. This is the event name used in the 646Client JSON Protocol. 647 648Member 'data' defines the event-specific data. It defaults to an 649empty MEMBERS object. 650 651If 'data' is a MEMBERS object, then MEMBERS defines event-specific 652data just like a struct type's 'data' defines struct type members. 653 654If 'data' is a STRING, then STRING names a complex type whose members 655are the event-specific data. A union type requires ``'boxed': true``. 656 657An example event is:: 658 659 { 'event': 'EVENT_C', 660 'data': { '*a': 'int', 'b': 'str' } } 661 662Resulting in this JSON object:: 663 664 { "event": "EVENT_C", 665 "data": { "b": "test string" }, 666 "timestamp": { "seconds": 1267020223, "microseconds": 435656 } } 667 668The generator emits a function to send the event. When member 'boxed' 669is absent, it takes event-specific data one by one, in QAPI schema 670order. Else it takes them wrapped in the C struct generated for the 671complex type. See section `Code generated for events`_ for examples. 672 673The optional 'if' member specifies a conditional. See `Configuring 674the schema`_ below for more on this. 675 676The optional 'features' member specifies features. See Features_ 677below for more on this. 678 679 680.. _FEATURE: 681 682Features 683-------- 684 685Syntax:: 686 687 FEATURES = [ FEATURE, ... ] 688 FEATURE = STRING 689 | { 'name': STRING, '*if': COND } 690 691Sometimes, the behaviour of QEMU changes compatibly, but without a 692change in the QMP syntax (usually by allowing values or operations 693that previously resulted in an error). QMP clients may still need to 694know whether the extension is available. 695 696For this purpose, a list of features can be specified for definitions, 697enumeration values, and struct members. Each feature list member can 698either be ``{ 'name': STRING, '*if': COND }``, or STRING, which is 699shorthand for ``{ 'name': STRING }``. 700 701The optional 'if' member specifies a conditional. See `Configuring 702the schema`_ below for more on this. 703 704Example:: 705 706 { 'struct': 'TestType', 707 'data': { 'number': 'int' }, 708 'features': [ 'allow-negative-numbers' ] } 709 710The feature strings are exposed to clients in introspection, as 711explained in section `Client JSON Protocol introspection`_. 712 713Intended use is to have each feature string signal that this build of 714QEMU shows a certain behaviour. 715 716 717Special features 718~~~~~~~~~~~~~~~~ 719 720Feature "deprecated" marks a command, event, enum value, or struct 721member as deprecated. It is not supported elsewhere so far. 722Interfaces so marked may be withdrawn in future releases in accordance 723with QEMU's deprecation policy. 724 725Feature "unstable" marks a command, event, enum value, or struct 726member as unstable. It is not supported elsewhere so far. Interfaces 727so marked may be withdrawn or changed incompatibly in future releases. 728 729 730Naming rules and reserved names 731------------------------------- 732 733All names must begin with a letter, and contain only ASCII letters, 734digits, hyphen, and underscore. There are two exceptions: enum values 735may start with a digit, and names that are downstream extensions (see 736section `Downstream extensions`_) start with underscore. 737 738Names beginning with ``q_`` are reserved for the generator, which uses 739them for munging QMP names that resemble C keywords or other 740problematic strings. For example, a member named ``default`` in qapi 741becomes ``q_default`` in the generated C code. 742 743Types, commands, and events share a common namespace. Therefore, 744generally speaking, type definitions should always use CamelCase for 745user-defined type names, while built-in types are lowercase. 746 747Type names ending with ``List`` are reserved for the generator, which 748uses them for array types. 749 750Command names, member names within a type, and feature names should be 751all lower case with words separated by a hyphen. However, some 752existing older commands and complex types use underscore; when 753extending them, consistency is preferred over blindly avoiding 754underscore. 755 756Event names should be ALL_CAPS with words separated by underscore. 757 758Member name ``u`` and names starting with ``has-`` or ``has_`` are reserved 759for the generator, which uses them for unions and for tracking 760optional members. 761 762Names beginning with ``x-`` used to signify "experimental". This 763convention has been replaced by special feature "unstable". 764 765Pragmas ``command-name-exceptions`` and ``member-name-exceptions`` let 766you violate naming rules. Use for new code is strongly discouraged. See 767`Pragma directives`_ for details. 768 769 770Downstream extensions 771--------------------- 772 773QAPI schema names that are externally visible, say in the Client JSON 774Protocol, need to be managed with care. Names starting with a 775downstream prefix of the form __RFQDN_ are reserved for the downstream 776who controls the valid, reverse fully qualified domain name RFQDN. 777RFQDN may only contain ASCII letters, digits, hyphen and period. 778 779Example: Red Hat, Inc. controls redhat.com, and may therefore add a 780downstream command ``__com.redhat_drive-mirror``. 781 782 783Configuring the schema 784---------------------- 785 786Syntax:: 787 788 COND = STRING 789 | { 'all: [ COND, ... ] } 790 | { 'any: [ COND, ... ] } 791 | { 'not': COND } 792 793All definitions take an optional 'if' member. Its value must be a 794string, or an object with a single member 'all', 'any' or 'not'. 795 796The C code generated for the definition will then be guarded by an #if 797preprocessing directive with an operand generated from that condition: 798 799 * STRING will generate defined(STRING) 800 * { 'all': [COND, ...] } will generate (COND && ...) 801 * { 'any': [COND, ...] } will generate (COND || ...) 802 * { 'not': COND } will generate !COND 803 804Example: a conditional struct :: 805 806 { 'struct': 'IfStruct', 'data': { 'foo': 'int' }, 807 'if': { 'all': [ 'CONFIG_FOO', 'HAVE_BAR' ] } } 808 809gets its generated code guarded like this:: 810 811 #if defined(CONFIG_FOO) && defined(HAVE_BAR) 812 ... generated code ... 813 #endif /* defined(HAVE_BAR) && defined(CONFIG_FOO) */ 814 815Individual members of complex types can also be made conditional. 816This requires the longhand form of MEMBER. 817 818Example: a struct type with unconditional member 'foo' and conditional 819member 'bar' :: 820 821 { 'struct': 'IfStruct', 822 'data': { 'foo': 'int', 823 'bar': { 'type': 'int', 'if': 'IFCOND'} } } 824 825A union's discriminator may not be conditional. 826 827Likewise, individual enumeration values may be conditional. This 828requires the longhand form of ENUM-VALUE_. 829 830Example: an enum type with unconditional value 'foo' and conditional 831value 'bar' :: 832 833 { 'enum': 'IfEnum', 834 'data': [ 'foo', 835 { 'name' : 'bar', 'if': 'IFCOND' } ] } 836 837Likewise, features can be conditional. This requires the longhand 838form of FEATURE_. 839 840Example: a struct with conditional feature 'allow-negative-numbers' :: 841 842 { 'struct': 'TestType', 843 'data': { 'number': 'int' }, 844 'features': [ { 'name': 'allow-negative-numbers', 845 'if': 'IFCOND' } ] } 846 847Please note that you are responsible to ensure that the C code will 848compile with an arbitrary combination of conditions, since the 849generator is unable to check it at this point. 850 851The conditions apply to introspection as well, i.e. introspection 852shows a conditional entity only when the condition is satisfied in 853this particular build. 854 855 856Documentation comments 857---------------------- 858 859A multi-line comment that starts and ends with a ``##`` line is a 860documentation comment. 861 862If the documentation comment starts like :: 863 864 ## 865 # @SYMBOL: 866 867it documents the definition of SYMBOL, else it's free-form 868documentation. 869 870See below for more on `Definition documentation`_. 871 872Free-form documentation may be used to provide additional text and 873structuring content. 874 875 876Headings and subheadings 877~~~~~~~~~~~~~~~~~~~~~~~~ 878 879A free-form documentation comment containing a line which starts with 880some ``=`` symbols and then a space defines a section heading:: 881 882 ## 883 # = This is a top level heading 884 # 885 # This is a free-form comment which will go under the 886 # top level heading. 887 ## 888 889 ## 890 # == This is a second level heading 891 ## 892 893A heading line must be the first line of the documentation 894comment block. 895 896Section headings must always be correctly nested, so you can only 897define a third-level heading inside a second-level heading, and so on. 898 899 900Documentation markup 901~~~~~~~~~~~~~~~~~~~~ 902 903Documentation comments can use most rST markup. In particular, 904a ``::`` literal block can be used for pre-formatted text:: 905 906 # :: 907 # 908 # Text of the example, may span 909 # multiple lines 910 911``*`` starts an itemized list:: 912 913 # * First item, may span 914 # multiple lines 915 # * Second item 916 917You can also use ``-`` instead of ``*``. 918 919A decimal number followed by ``.`` starts a numbered list:: 920 921 # 1. First item, may span 922 # multiple lines 923 # 2. Second item 924 925The actual number doesn't matter. 926 927Lists of either kind must be preceded and followed by a blank line. 928If a list item's text spans multiple lines, then the second and 929subsequent lines must be correctly indented to line up with the 930first character of the first line. 931 932The usual ****strong****, *\*emphasized\** and ````literal```` markup 933should be used. If you need a single literal ``*``, you will need to 934backslash-escape it. 935 936Use ``@foo`` to reference a name in the schema. This is an rST 937extension. It is rendered the same way as ````foo````, but carries 938additional meaning. 939 940Example:: 941 942 ## 943 # Some text foo with **bold** and *emphasis* 944 # 945 # 1. with a list 946 # 2. like that 947 # 948 # And some code: 949 # 950 # :: 951 # 952 # $ echo foo 953 # -> do this 954 # <- get that 955 ## 956 957For legibility, wrap text paragraphs so every line is at most 70 958characters long. 959 960Separate sentences with two spaces. 961 962 963Definition documentation 964~~~~~~~~~~~~~~~~~~~~~~~~ 965 966Definition documentation, if present, must immediately precede the 967definition it documents. 968 969When documentation is required (see pragma_ 'doc-required'), every 970definition must have documentation. 971 972Definition documentation starts with a line naming the definition, 973followed by an optional overview, a description of each argument (for 974commands and events), member (for structs and unions), branch (for 975alternates), or value (for enums), a description of each feature (if 976any), and finally optional tagged sections. 977 978Descriptions start with '\@name:'. The description text must be 979indented like this:: 980 981 # @name: Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed 982 # do eiusmod tempor incididunt ut labore et dolore magna aliqua. 983 984.. FIXME The parser accepts these things in almost any order. 985 986.. FIXME union branches should be described, too. 987 988Extensions added after the definition was first released carry a 989"(since x.y.z)" comment. 990 991The feature descriptions must be preceded by a blank line and then a 992line "Features:", like this:: 993 994 # 995 # Features: 996 # 997 # @feature: Description text 998 999A tagged section begins with a paragraph that starts with one of the 1000following words: "Since:", "Returns:", "Errors:", "TODO:". It ends with 1001the start of a new section. 1002 1003The second and subsequent lines of tagged sections must be indented 1004like this:: 1005 1006 # TODO: Ut enim ad minim veniam, quis nostrud exercitation ullamco 1007 # laboris nisi ut aliquip ex ea commodo consequat. 1008 # 1009 # Duis aute irure dolor in reprehenderit in voluptate velit esse 1010 # cillum dolore eu fugiat nulla pariatur. 1011 1012"Returns" and "Errors" sections are only valid for commands. They 1013document the success and the error response, respectively. 1014 1015"Errors" sections should be formatted as an rST list, each entry 1016detailing a relevant error condition. For example:: 1017 1018 # Errors: 1019 # - If @device does not exist, DeviceNotFound 1020 # - Any other error returns a GenericError. 1021 1022A "Since: x.y.z" tagged section lists the release that introduced the 1023definition. 1024 1025"TODO" sections are not rendered (they are for developers, not users of 1026QMP). In other sections, the text is formatted, and rST markup can be 1027used. 1028 1029QMP Examples can be added by using the ``.. qmp-example::`` 1030directive. In its simplest form, this can be used to contain a single 1031QMP code block which accepts standard JSON syntax with additional server 1032directionality indicators (``->`` and ``<-``), and elisions (``...``). 1033 1034Optionally, a plaintext title may be provided by using the ``:title:`` 1035directive option. If the title is omitted, the example title will 1036default to "Example:". 1037 1038A simple QMP example:: 1039 1040 # .. qmp-example:: 1041 # :title: Using query-block 1042 # 1043 # -> { "execute": "query-block" } 1044 # <- { ... } 1045 1046More complex or multi-step examples where exposition is needed before or 1047between QMP code blocks can be created by using the ``:annotated:`` 1048directive option. When using this option, nested QMP code blocks must be 1049entered explicitly with rST's ``::`` syntax. 1050 1051Highlighting in non-QMP languages can be accomplished by using the 1052``.. code-block:: lang`` directive, and non-highlighted text can be 1053achieved by omitting the language argument. 1054 1055For example:: 1056 1057 # .. qmp-example:: 1058 # :annotated: 1059 # :title: A more complex demonstration 1060 # 1061 # This is a more complex example that can use 1062 # ``arbitrary rST syntax`` in its exposition:: 1063 # 1064 # -> { "execute": "query-block" } 1065 # <- { ... } 1066 # 1067 # Above, lengthy output has been omitted for brevity. 1068 1069 1070Examples of complete definition documentation:: 1071 1072 ## 1073 # @BlockStats: 1074 # 1075 # Statistics of a virtual block device or a block backing device. 1076 # 1077 # @device: If the stats are for a virtual block device, the name 1078 # corresponding to the virtual block device. 1079 # 1080 # @node-name: The node name of the device. (Since 2.3) 1081 # 1082 # ... more members ... 1083 # 1084 # Since: 0.14 1085 ## 1086 { 'struct': 'BlockStats', 1087 'data': {'*device': 'str', '*node-name': 'str', 1088 ... more members ... } } 1089 1090 ## 1091 # @query-blockstats: 1092 # 1093 # Query the @BlockStats for all virtual block devices. 1094 # 1095 # @query-nodes: If true, the command will query all the block nodes 1096 # ... explain, explain ... 1097 # (Since 2.3) 1098 # 1099 # Returns: A list of @BlockStats for each virtual block devices. 1100 # 1101 # Since: 0.14 1102 # 1103 # .. qmp-example:: 1104 # 1105 # -> { "execute": "query-blockstats" } 1106 # <- { 1107 # ... 1108 # } 1109 ## 1110 { 'command': 'query-blockstats', 1111 'data': { '*query-nodes': 'bool' }, 1112 'returns': ['BlockStats'] } 1113 1114 1115Markup pitfalls 1116~~~~~~~~~~~~~~~ 1117 1118A blank line is required between list items and paragraphs. Without 1119it, the list may not be recognized, resulting in garbled output. Good 1120example:: 1121 1122 # An event's state is modified if: 1123 # 1124 # - its name matches the @name pattern, and 1125 # - if @vcpu is given, the event has the "vcpu" property. 1126 1127Without the blank line this would be a single paragraph. 1128 1129Indentation matters. Bad example:: 1130 1131 # @none: None (no memory side cache in this proximity domain, 1132 # or cache associativity unknown) 1133 # (since 5.0) 1134 1135The last line's de-indent is wrong. The second and subsequent lines 1136need to line up with each other, like this:: 1137 1138 # @none: None (no memory side cache in this proximity domain, 1139 # or cache associativity unknown) 1140 # (since 5.0) 1141 1142Section tags are case-sensitive and end with a colon. They are only 1143recognized after a blank line. Good example:: 1144 1145 # 1146 # Since: 7.1 1147 1148Bad examples (all ordinary paragraphs):: 1149 1150 # since: 7.1 1151 1152 # Since 7.1 1153 1154 # Since : 7.1 1155 1156Likewise, member descriptions require a colon. Good example:: 1157 1158 # @interface-id: Interface ID 1159 1160Bad examples (all ordinary paragraphs):: 1161 1162 # @interface-id Interface ID 1163 1164 # @interface-id : Interface ID 1165 1166Undocumented members are not flagged, yet. Instead, the generated 1167documentation describes them as "Not documented". Think twice before 1168adding more undocumented members. 1169 1170When you change documentation comments, please check the generated 1171documentation comes out as intended! 1172 1173 1174Client JSON Protocol introspection 1175================================== 1176 1177Clients of a Client JSON Protocol commonly need to figure out what 1178exactly the server (QEMU) supports. 1179 1180For this purpose, QMP provides introspection via command 1181query-qmp-schema. QGA currently doesn't support introspection. 1182 1183While Client JSON Protocol wire compatibility should be maintained 1184between qemu versions, we cannot make the same guarantees for 1185introspection stability. For example, one version of qemu may provide 1186a non-variant optional member of a struct, and a later version rework 1187the member to instead be non-optional and associated with a variant. 1188Likewise, one version of qemu may list a member with open-ended type 1189'str', and a later version could convert it to a finite set of strings 1190via an enum type; or a member may be converted from a specific type to 1191an alternate that represents a choice between the original type and 1192something else. 1193 1194query-qmp-schema returns a JSON array of SchemaInfo objects. These 1195objects together describe the wire ABI, as defined in the QAPI schema. 1196There is no specified order to the SchemaInfo objects returned; a 1197client must search for a particular name throughout the entire array 1198to learn more about that name, but is at least guaranteed that there 1199will be no collisions between type, command, and event names. 1200 1201However, the SchemaInfo can't reflect all the rules and restrictions 1202that apply to QMP. It's interface introspection (figuring out what's 1203there), not interface specification. The specification is in the QAPI 1204schema. To understand how QMP is to be used, you need to study the 1205QAPI schema. 1206 1207Like any other command, query-qmp-schema is itself defined in the QAPI 1208schema, along with the SchemaInfo type. This text attempts to give an 1209overview how things work. For details you need to consult the QAPI 1210schema. 1211 1212SchemaInfo objects have common members "name", "meta-type", 1213"features", and additional variant members depending on the value of 1214meta-type. 1215 1216Each SchemaInfo object describes a wire ABI entity of a certain 1217meta-type: a command, event or one of several kinds of type. 1218 1219SchemaInfo for commands and events have the same name as in the QAPI 1220schema. 1221 1222Command and event names are part of the wire ABI, but type names are 1223not. Therefore, the SchemaInfo for types have auto-generated 1224meaningless names. For readability, the examples in this section use 1225meaningful type names instead. 1226 1227Optional member "features" exposes the entity's feature strings as a 1228JSON array of strings. 1229 1230To examine a type, start with a command or event using it, then follow 1231references by name. 1232 1233QAPI schema definitions not reachable that way are omitted. 1234 1235The SchemaInfo for a command has meta-type "command", and variant 1236members "arg-type", "ret-type" and "allow-oob". On the wire, the 1237"arguments" member of a client's "execute" command must conform to the 1238object type named by "arg-type". The "return" member that the server 1239passes in a success response conforms to the type named by "ret-type". 1240When "allow-oob" is true, it means the command supports out-of-band 1241execution. It defaults to false. 1242 1243If the command takes no arguments, "arg-type" names an object type 1244without members. Likewise, if the command returns nothing, "ret-type" 1245names an object type without members. 1246 1247Example: the SchemaInfo for command query-qmp-schema :: 1248 1249 { "name": "query-qmp-schema", "meta-type": "command", 1250 "arg-type": "q_empty", "ret-type": "SchemaInfoList" } 1251 1252 Type "q_empty" is an automatic object type without members, and type 1253 "SchemaInfoList" is the array of SchemaInfo type. 1254 1255The SchemaInfo for an event has meta-type "event", and variant member 1256"arg-type". On the wire, a "data" member that the server passes in an 1257event conforms to the object type named by "arg-type". 1258 1259If the event carries no additional information, "arg-type" names an 1260object type without members. The event may not have a data member on 1261the wire then. 1262 1263Each command or event defined with 'data' as MEMBERS object in the 1264QAPI schema implicitly defines an object type. 1265 1266Example: the SchemaInfo for EVENT_C from section Events_ :: 1267 1268 { "name": "EVENT_C", "meta-type": "event", 1269 "arg-type": "q_obj-EVENT_C-arg" } 1270 1271 Type "q_obj-EVENT_C-arg" is an implicitly defined object type with 1272 the two members from the event's definition. 1273 1274The SchemaInfo for struct and union types has meta-type "object" and 1275variant member "members". 1276 1277The SchemaInfo for a union type additionally has variant members "tag" 1278and "variants". 1279 1280"members" is a JSON array describing the object's common members, if 1281any. Each element is a JSON object with members "name" (the member's 1282name), "type" (the name of its type), "features" (a JSON array of 1283feature strings), and "default". The latter two are optional. The 1284member is optional if "default" is present. Currently, "default" can 1285only have value null. Other values are reserved for future 1286extensions. The "members" array is in no particular order; clients 1287must search the entire object when learning whether a particular 1288member is supported. 1289 1290Example: the SchemaInfo for MyType from section `Struct types`_ :: 1291 1292 { "name": "MyType", "meta-type": "object", 1293 "members": [ 1294 { "name": "member1", "type": "str" }, 1295 { "name": "member2", "type": "int" }, 1296 { "name": "member3", "type": "str", "default": null } ] } 1297 1298"features" exposes the command's feature strings as a JSON array of 1299strings. 1300 1301Example: the SchemaInfo for TestType from section Features_:: 1302 1303 { "name": "TestType", "meta-type": "object", 1304 "members": [ 1305 { "name": "number", "type": "int" } ], 1306 "features": ["allow-negative-numbers"] } 1307 1308"tag" is the name of the common member serving as type tag. 1309"variants" is a JSON array describing the object's variant members. 1310Each element is a JSON object with members "case" (the value of type 1311tag this element applies to) and "type" (the name of an object type 1312that provides the variant members for this type tag value). The 1313"variants" array is in no particular order, and is not guaranteed to 1314list cases in the same order as the corresponding "tag" enum type. 1315 1316Example: the SchemaInfo for union BlockdevOptions from section 1317`Union types`_ :: 1318 1319 { "name": "BlockdevOptions", "meta-type": "object", 1320 "members": [ 1321 { "name": "driver", "type": "BlockdevDriver" }, 1322 { "name": "read-only", "type": "bool", "default": null } ], 1323 "tag": "driver", 1324 "variants": [ 1325 { "case": "file", "type": "BlockdevOptionsFile" }, 1326 { "case": "qcow2", "type": "BlockdevOptionsQcow2" } ] } 1327 1328Note that base types are "flattened": its members are included in the 1329"members" array. 1330 1331The SchemaInfo for an alternate type has meta-type "alternate", and 1332variant member "members". "members" is a JSON array. Each element is 1333a JSON object with member "type", which names a type. Values of the 1334alternate type conform to exactly one of its member types. There is 1335no guarantee on the order in which "members" will be listed. 1336 1337Example: the SchemaInfo for BlockdevRef from section `Alternate types`_ :: 1338 1339 { "name": "BlockdevRef", "meta-type": "alternate", 1340 "members": [ 1341 { "type": "BlockdevOptions" }, 1342 { "type": "str" } ] } 1343 1344The SchemaInfo for an array type has meta-type "array", and variant 1345member "element-type", which names the array's element type. Array 1346types are implicitly defined. For convenience, the array's name may 1347resemble the element type; however, clients should examine member 1348"element-type" instead of making assumptions based on parsing member 1349"name". 1350 1351Example: the SchemaInfo for ['str'] :: 1352 1353 { "name": "[str]", "meta-type": "array", 1354 "element-type": "str" } 1355 1356The SchemaInfo for an enumeration type has meta-type "enum" and 1357variant member "members". 1358 1359"members" is a JSON array describing the enumeration values. Each 1360element is a JSON object with member "name" (the member's name), and 1361optionally "features" (a JSON array of feature strings). The 1362"members" array is in no particular order; clients must search the 1363entire array when learning whether a particular value is supported. 1364 1365Example: the SchemaInfo for MyEnum from section `Enumeration types`_ :: 1366 1367 { "name": "MyEnum", "meta-type": "enum", 1368 "members": [ 1369 { "name": "value1" }, 1370 { "name": "value2" }, 1371 { "name": "value3" } 1372 ] } 1373 1374The SchemaInfo for a built-in type has the same name as the type in 1375the QAPI schema (see section `Built-in Types`_), with one exception 1376detailed below. It has variant member "json-type" that shows how 1377values of this type are encoded on the wire. 1378 1379Example: the SchemaInfo for str :: 1380 1381 { "name": "str", "meta-type": "builtin", "json-type": "string" } 1382 1383The QAPI schema supports a number of integer types that only differ in 1384how they map to C. They are identical as far as SchemaInfo is 1385concerned. Therefore, they get all mapped to a single type "int" in 1386SchemaInfo. 1387 1388As explained above, type names are not part of the wire ABI. Not even 1389the names of built-in types. Clients should examine member 1390"json-type" instead of hard-coding names of built-in types. 1391 1392 1393Compatibility considerations 1394============================ 1395 1396Maintaining backward compatibility at the Client JSON Protocol level 1397while evolving the schema requires some care. This section is about 1398syntactic compatibility, which is necessary, but not sufficient, for 1399actual compatibility. 1400 1401Clients send commands with argument data, and receive command 1402responses with return data and events with event data. 1403 1404Adding opt-in functionality to the send direction is backwards 1405compatible: adding commands, optional arguments, enumeration values, 1406union and alternate branches; turning an argument type into an 1407alternate of that type; making mandatory arguments optional. Clients 1408oblivious of the new functionality continue to work. 1409 1410Incompatible changes include removing commands, command arguments, 1411enumeration values, union and alternate branches, adding mandatory 1412command arguments, and making optional arguments mandatory. 1413 1414The specified behavior of an absent optional argument should remain 1415the same. With proper documentation, this policy still allows some 1416flexibility; for example, when an optional 'buffer-size' argument is 1417specified to default to a sensible buffer size, the actual default 1418value can still be changed. The specified default behavior is not the 1419exact size of the buffer, only that the default size is sensible. 1420 1421Adding functionality to the receive direction is generally backwards 1422compatible: adding events, adding return and event data members. 1423Clients are expected to ignore the ones they don't know. 1424 1425Removing "unreachable" stuff like events that can't be triggered 1426anymore, optional return or event data members that can't be sent 1427anymore, and return or event data member (enumeration) values that 1428can't be sent anymore makes no difference to clients, except for 1429introspection. The latter can conceivably confuse clients, so tread 1430carefully. 1431 1432Incompatible changes include removing return and event data members. 1433 1434Any change to a command definition's 'data' or one of the types used 1435there (recursively) needs to consider send direction compatibility. 1436 1437Any change to a command definition's 'return', an event definition's 1438'data', or one of the types used there (recursively) needs to consider 1439receive direction compatibility. 1440 1441Any change to types used in both contexts need to consider both. 1442 1443Enumeration type values and complex and alternate type members may be 1444reordered freely. For enumerations and alternate types, this doesn't 1445affect the wire encoding. For complex types, this might make the 1446implementation emit JSON object members in a different order, which 1447the Client JSON Protocol permits. 1448 1449Since type names are not visible in the Client JSON Protocol, types 1450may be freely renamed. Even certain refactorings are invisible, such 1451as splitting members from one type into a common base type. 1452 1453 1454Code generation 1455=============== 1456 1457The QAPI code generator qapi-gen.py generates code and documentation 1458from the schema. Together with the core QAPI libraries, this code 1459provides everything required to take JSON commands read in by a Client 1460JSON Protocol server, unmarshal the arguments into the underlying C 1461types, call into the corresponding C function, map the response back 1462to a Client JSON Protocol response to be returned to the user, and 1463introspect the commands. 1464 1465As an example, we'll use the following schema, which describes a 1466single complex user-defined type, along with command which takes a 1467list of that type as a parameter, and returns a single element of that 1468type. The user is responsible for writing the implementation of 1469qmp_my_command(); everything else is produced by the generator. :: 1470 1471 $ cat example-schema.json 1472 { 'struct': 'UserDefOne', 1473 'data': { 'integer': 'int', '*string': 'str', '*flag': 'bool' } } 1474 1475 { 'command': 'my-command', 1476 'data': { 'arg1': ['UserDefOne'] }, 1477 'returns': 'UserDefOne' } 1478 1479 { 'event': 'MY_EVENT' } 1480 1481We run qapi-gen.py like this:: 1482 1483 $ python scripts/qapi-gen.py --output-dir="qapi-generated" \ 1484 --prefix="example-" example-schema.json 1485 1486For a more thorough look at generated code, the testsuite includes 1487tests/qapi-schema/qapi-schema-tests.json that covers more examples of 1488what the generator will accept, and compiles the resulting C code as 1489part of 'make check-unit'. 1490 1491 1492Code generated for QAPI types 1493----------------------------- 1494 1495The following files are created: 1496 1497 ``$(prefix)qapi-types.h`` 1498 C types corresponding to types defined in the schema 1499 1500 ``$(prefix)qapi-types.c`` 1501 Cleanup functions for the above C types 1502 1503The $(prefix) is an optional parameter used as a namespace to keep the 1504generated code from one schema/code-generation separated from others so code 1505can be generated/used from multiple schemas without clobbering previously 1506created code. 1507 1508Example:: 1509 1510 $ cat qapi-generated/example-qapi-types.h 1511 [Uninteresting stuff omitted...] 1512 1513 #ifndef EXAMPLE_QAPI_TYPES_H 1514 #define EXAMPLE_QAPI_TYPES_H 1515 1516 #include "qapi/qapi-builtin-types.h" 1517 1518 typedef struct UserDefOne UserDefOne; 1519 1520 typedef struct UserDefOneList UserDefOneList; 1521 1522 typedef struct q_obj_my_command_arg q_obj_my_command_arg; 1523 1524 struct UserDefOne { 1525 int64_t integer; 1526 char *string; 1527 bool has_flag; 1528 bool flag; 1529 }; 1530 1531 void qapi_free_UserDefOne(UserDefOne *obj); 1532 G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOne, qapi_free_UserDefOne) 1533 1534 struct UserDefOneList { 1535 UserDefOneList *next; 1536 UserDefOne *value; 1537 }; 1538 1539 void qapi_free_UserDefOneList(UserDefOneList *obj); 1540 G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOneList, qapi_free_UserDefOneList) 1541 1542 struct q_obj_my_command_arg { 1543 UserDefOneList *arg1; 1544 }; 1545 1546 #endif /* EXAMPLE_QAPI_TYPES_H */ 1547 $ cat qapi-generated/example-qapi-types.c 1548 [Uninteresting stuff omitted...] 1549 1550 void qapi_free_UserDefOne(UserDefOne *obj) 1551 { 1552 Visitor *v; 1553 1554 if (!obj) { 1555 return; 1556 } 1557 1558 v = qapi_dealloc_visitor_new(); 1559 visit_type_UserDefOne(v, NULL, &obj, NULL); 1560 visit_free(v); 1561 } 1562 1563 void qapi_free_UserDefOneList(UserDefOneList *obj) 1564 { 1565 Visitor *v; 1566 1567 if (!obj) { 1568 return; 1569 } 1570 1571 v = qapi_dealloc_visitor_new(); 1572 visit_type_UserDefOneList(v, NULL, &obj, NULL); 1573 visit_free(v); 1574 } 1575 1576 [Uninteresting stuff omitted...] 1577 1578For a modular QAPI schema (see section `Include directives`_), code for 1579each sub-module SUBDIR/SUBMODULE.json is actually generated into :: 1580 1581 SUBDIR/$(prefix)qapi-types-SUBMODULE.h 1582 SUBDIR/$(prefix)qapi-types-SUBMODULE.c 1583 1584If qapi-gen.py is run with option --builtins, additional files are 1585created: 1586 1587 ``qapi-builtin-types.h`` 1588 C types corresponding to built-in types 1589 1590 ``qapi-builtin-types.c`` 1591 Cleanup functions for the above C types 1592 1593 1594Code generated for visiting QAPI types 1595-------------------------------------- 1596 1597These are the visitor functions used to walk through and convert 1598between a native QAPI C data structure and some other format (such as 1599QObject); the generated functions are named visit_type_FOO() and 1600visit_type_FOO_members(). 1601 1602The following files are generated: 1603 1604 ``$(prefix)qapi-visit.c`` 1605 Visitor function for a particular C type, used to automagically 1606 convert QObjects into the corresponding C type and vice-versa, as 1607 well as for deallocating memory for an existing C type 1608 1609 ``$(prefix)qapi-visit.h`` 1610 Declarations for previously mentioned visitor functions 1611 1612Example:: 1613 1614 $ cat qapi-generated/example-qapi-visit.h 1615 [Uninteresting stuff omitted...] 1616 1617 #ifndef EXAMPLE_QAPI_VISIT_H 1618 #define EXAMPLE_QAPI_VISIT_H 1619 1620 #include "qapi/qapi-builtin-visit.h" 1621 #include "example-qapi-types.h" 1622 1623 1624 bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp); 1625 1626 bool visit_type_UserDefOne(Visitor *v, const char *name, 1627 UserDefOne **obj, Error **errp); 1628 1629 bool visit_type_UserDefOneList(Visitor *v, const char *name, 1630 UserDefOneList **obj, Error **errp); 1631 1632 bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp); 1633 1634 #endif /* EXAMPLE_QAPI_VISIT_H */ 1635 $ cat qapi-generated/example-qapi-visit.c 1636 [Uninteresting stuff omitted...] 1637 1638 bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp) 1639 { 1640 bool has_string = !!obj->string; 1641 1642 if (!visit_type_int(v, "integer", &obj->integer, errp)) { 1643 return false; 1644 } 1645 if (visit_optional(v, "string", &has_string)) { 1646 if (!visit_type_str(v, "string", &obj->string, errp)) { 1647 return false; 1648 } 1649 } 1650 if (visit_optional(v, "flag", &obj->has_flag)) { 1651 if (!visit_type_bool(v, "flag", &obj->flag, errp)) { 1652 return false; 1653 } 1654 } 1655 return true; 1656 } 1657 1658 bool visit_type_UserDefOne(Visitor *v, const char *name, 1659 UserDefOne **obj, Error **errp) 1660 { 1661 bool ok = false; 1662 1663 if (!visit_start_struct(v, name, (void **)obj, sizeof(UserDefOne), errp)) { 1664 return false; 1665 } 1666 if (!*obj) { 1667 /* incomplete */ 1668 assert(visit_is_dealloc(v)); 1669 ok = true; 1670 goto out_obj; 1671 } 1672 if (!visit_type_UserDefOne_members(v, *obj, errp)) { 1673 goto out_obj; 1674 } 1675 ok = visit_check_struct(v, errp); 1676 out_obj: 1677 visit_end_struct(v, (void **)obj); 1678 if (!ok && visit_is_input(v)) { 1679 qapi_free_UserDefOne(*obj); 1680 *obj = NULL; 1681 } 1682 return ok; 1683 } 1684 1685 bool visit_type_UserDefOneList(Visitor *v, const char *name, 1686 UserDefOneList **obj, Error **errp) 1687 { 1688 bool ok = false; 1689 UserDefOneList *tail; 1690 size_t size = sizeof(**obj); 1691 1692 if (!visit_start_list(v, name, (GenericList **)obj, size, errp)) { 1693 return false; 1694 } 1695 1696 for (tail = *obj; tail; 1697 tail = (UserDefOneList *)visit_next_list(v, (GenericList *)tail, size)) { 1698 if (!visit_type_UserDefOne(v, NULL, &tail->value, errp)) { 1699 goto out_obj; 1700 } 1701 } 1702 1703 ok = visit_check_list(v, errp); 1704 out_obj: 1705 visit_end_list(v, (void **)obj); 1706 if (!ok && visit_is_input(v)) { 1707 qapi_free_UserDefOneList(*obj); 1708 *obj = NULL; 1709 } 1710 return ok; 1711 } 1712 1713 bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp) 1714 { 1715 if (!visit_type_UserDefOneList(v, "arg1", &obj->arg1, errp)) { 1716 return false; 1717 } 1718 return true; 1719 } 1720 1721 [Uninteresting stuff omitted...] 1722 1723For a modular QAPI schema (see section `Include directives`_), code for 1724each sub-module SUBDIR/SUBMODULE.json is actually generated into :: 1725 1726 SUBDIR/$(prefix)qapi-visit-SUBMODULE.h 1727 SUBDIR/$(prefix)qapi-visit-SUBMODULE.c 1728 1729If qapi-gen.py is run with option --builtins, additional files are 1730created: 1731 1732 ``qapi-builtin-visit.h`` 1733 Visitor functions for built-in types 1734 1735 ``qapi-builtin-visit.c`` 1736 Declarations for these visitor functions 1737 1738 1739Code generated for commands 1740--------------------------- 1741 1742These are the marshaling/dispatch functions for the commands defined 1743in the schema. The generated code provides qmp_marshal_COMMAND(), and 1744declares qmp_COMMAND() that the user must implement. 1745 1746The following files are generated: 1747 1748 ``$(prefix)qapi-commands.c`` 1749 Command marshal/dispatch functions for each QMP command defined in 1750 the schema 1751 1752 ``$(prefix)qapi-commands.h`` 1753 Function prototypes for the QMP commands specified in the schema 1754 1755 ``$(prefix)qapi-commands.trace-events`` 1756 Trace event declarations, see :ref:`tracing`. 1757 1758 ``$(prefix)qapi-init-commands.h`` 1759 Command initialization prototype 1760 1761 ``$(prefix)qapi-init-commands.c`` 1762 Command initialization code 1763 1764Example:: 1765 1766 $ cat qapi-generated/example-qapi-commands.h 1767 [Uninteresting stuff omitted...] 1768 1769 #ifndef EXAMPLE_QAPI_COMMANDS_H 1770 #define EXAMPLE_QAPI_COMMANDS_H 1771 1772 #include "example-qapi-types.h" 1773 1774 UserDefOne *qmp_my_command(UserDefOneList *arg1, Error **errp); 1775 void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp); 1776 1777 #endif /* EXAMPLE_QAPI_COMMANDS_H */ 1778 1779 $ cat qapi-generated/example-qapi-commands.trace-events 1780 # AUTOMATICALLY GENERATED, DO NOT MODIFY 1781 1782 qmp_enter_my_command(const char *json) "%s" 1783 qmp_exit_my_command(const char *result, bool succeeded) "%s %d" 1784 1785 $ cat qapi-generated/example-qapi-commands.c 1786 [Uninteresting stuff omitted...] 1787 1788 static void qmp_marshal_output_UserDefOne(UserDefOne *ret_in, 1789 QObject **ret_out, Error **errp) 1790 { 1791 Visitor *v; 1792 1793 v = qobject_output_visitor_new_qmp(ret_out); 1794 if (visit_type_UserDefOne(v, "unused", &ret_in, errp)) { 1795 visit_complete(v, ret_out); 1796 } 1797 visit_free(v); 1798 v = qapi_dealloc_visitor_new(); 1799 visit_type_UserDefOne(v, "unused", &ret_in, NULL); 1800 visit_free(v); 1801 } 1802 1803 void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp) 1804 { 1805 Error *err = NULL; 1806 bool ok = false; 1807 Visitor *v; 1808 UserDefOne *retval; 1809 q_obj_my_command_arg arg = {0}; 1810 1811 v = qobject_input_visitor_new_qmp(QOBJECT(args)); 1812 if (!visit_start_struct(v, NULL, NULL, 0, errp)) { 1813 goto out; 1814 } 1815 if (visit_type_q_obj_my_command_arg_members(v, &arg, errp)) { 1816 ok = visit_check_struct(v, errp); 1817 } 1818 visit_end_struct(v, NULL); 1819 if (!ok) { 1820 goto out; 1821 } 1822 1823 if (trace_event_get_state_backends(TRACE_QMP_ENTER_MY_COMMAND)) { 1824 g_autoptr(GString) req_json = qobject_to_json(QOBJECT(args)); 1825 1826 trace_qmp_enter_my_command(req_json->str); 1827 } 1828 1829 retval = qmp_my_command(arg.arg1, &err); 1830 if (err) { 1831 trace_qmp_exit_my_command(error_get_pretty(err), false); 1832 error_propagate(errp, err); 1833 goto out; 1834 } 1835 1836 qmp_marshal_output_UserDefOne(retval, ret, errp); 1837 1838 if (trace_event_get_state_backends(TRACE_QMP_EXIT_MY_COMMAND)) { 1839 g_autoptr(GString) ret_json = qobject_to_json(*ret); 1840 1841 trace_qmp_exit_my_command(ret_json->str, true); 1842 } 1843 1844 out: 1845 visit_free(v); 1846 v = qapi_dealloc_visitor_new(); 1847 visit_start_struct(v, NULL, NULL, 0, NULL); 1848 visit_type_q_obj_my_command_arg_members(v, &arg, NULL); 1849 visit_end_struct(v, NULL); 1850 visit_free(v); 1851 } 1852 1853 [Uninteresting stuff omitted...] 1854 $ cat qapi-generated/example-qapi-init-commands.h 1855 [Uninteresting stuff omitted...] 1856 #ifndef EXAMPLE_QAPI_INIT_COMMANDS_H 1857 #define EXAMPLE_QAPI_INIT_COMMANDS_H 1858 1859 #include "qapi/qmp-registry.h" 1860 1861 void example_qmp_init_marshal(QmpCommandList *cmds); 1862 1863 #endif /* EXAMPLE_QAPI_INIT_COMMANDS_H */ 1864 $ cat qapi-generated/example-qapi-init-commands.c 1865 [Uninteresting stuff omitted...] 1866 void example_qmp_init_marshal(QmpCommandList *cmds) 1867 { 1868 QTAILQ_INIT(cmds); 1869 1870 qmp_register_command(cmds, "my-command", 1871 qmp_marshal_my_command, 0, 0); 1872 } 1873 [Uninteresting stuff omitted...] 1874 1875For a modular QAPI schema (see section `Include directives`_), code for 1876each sub-module SUBDIR/SUBMODULE.json is actually generated into:: 1877 1878 SUBDIR/$(prefix)qapi-commands-SUBMODULE.h 1879 SUBDIR/$(prefix)qapi-commands-SUBMODULE.c 1880 1881 1882Code generated for events 1883------------------------- 1884 1885This is the code related to events defined in the schema, providing 1886qapi_event_send_EVENT(). 1887 1888The following files are created: 1889 1890 ``$(prefix)qapi-events.h`` 1891 Function prototypes for each event type 1892 1893 ``$(prefix)qapi-events.c`` 1894 Implementation of functions to send an event 1895 1896 ``$(prefix)qapi-emit-events.h`` 1897 Enumeration of all event names, and common event code declarations 1898 1899 ``$(prefix)qapi-emit-events.c`` 1900 Common event code definitions 1901 1902Example:: 1903 1904 $ cat qapi-generated/example-qapi-events.h 1905 [Uninteresting stuff omitted...] 1906 1907 #ifndef EXAMPLE_QAPI_EVENTS_H 1908 #define EXAMPLE_QAPI_EVENTS_H 1909 1910 #include "qapi/util.h" 1911 #include "example-qapi-types.h" 1912 1913 void qapi_event_send_my_event(void); 1914 1915 #endif /* EXAMPLE_QAPI_EVENTS_H */ 1916 $ cat qapi-generated/example-qapi-events.c 1917 [Uninteresting stuff omitted...] 1918 1919 void qapi_event_send_my_event(void) 1920 { 1921 QDict *qmp; 1922 1923 qmp = qmp_event_build_dict("MY_EVENT"); 1924 1925 example_qapi_event_emit(EXAMPLE_QAPI_EVENT_MY_EVENT, qmp); 1926 1927 qobject_unref(qmp); 1928 } 1929 1930 [Uninteresting stuff omitted...] 1931 $ cat qapi-generated/example-qapi-emit-events.h 1932 [Uninteresting stuff omitted...] 1933 1934 #ifndef EXAMPLE_QAPI_EMIT_EVENTS_H 1935 #define EXAMPLE_QAPI_EMIT_EVENTS_H 1936 1937 #include "qapi/util.h" 1938 1939 typedef enum example_QAPIEvent { 1940 EXAMPLE_QAPI_EVENT_MY_EVENT, 1941 EXAMPLE_QAPI_EVENT__MAX, 1942 } example_QAPIEvent; 1943 1944 #define example_QAPIEvent_str(val) \ 1945 qapi_enum_lookup(&example_QAPIEvent_lookup, (val)) 1946 1947 extern const QEnumLookup example_QAPIEvent_lookup; 1948 1949 void example_qapi_event_emit(example_QAPIEvent event, QDict *qdict); 1950 1951 #endif /* EXAMPLE_QAPI_EMIT_EVENTS_H */ 1952 $ cat qapi-generated/example-qapi-emit-events.c 1953 [Uninteresting stuff omitted...] 1954 1955 const QEnumLookup example_QAPIEvent_lookup = { 1956 .array = (const char *const[]) { 1957 [EXAMPLE_QAPI_EVENT_MY_EVENT] = "MY_EVENT", 1958 }, 1959 .size = EXAMPLE_QAPI_EVENT__MAX 1960 }; 1961 1962 [Uninteresting stuff omitted...] 1963 1964For a modular QAPI schema (see section `Include directives`_), code for 1965each sub-module SUBDIR/SUBMODULE.json is actually generated into :: 1966 1967 SUBDIR/$(prefix)qapi-events-SUBMODULE.h 1968 SUBDIR/$(prefix)qapi-events-SUBMODULE.c 1969 1970 1971Code generated for introspection 1972-------------------------------- 1973 1974The following files are created: 1975 1976 ``$(prefix)qapi-introspect.c`` 1977 Defines a string holding a JSON description of the schema 1978 1979 ``$(prefix)qapi-introspect.h`` 1980 Declares the above string 1981 1982Example:: 1983 1984 $ cat qapi-generated/example-qapi-introspect.h 1985 [Uninteresting stuff omitted...] 1986 1987 #ifndef EXAMPLE_QAPI_INTROSPECT_H 1988 #define EXAMPLE_QAPI_INTROSPECT_H 1989 1990 #include "qobject/qlit.h" 1991 1992 extern const QLitObject example_qmp_schema_qlit; 1993 1994 #endif /* EXAMPLE_QAPI_INTROSPECT_H */ 1995 $ cat qapi-generated/example-qapi-introspect.c 1996 [Uninteresting stuff omitted...] 1997 1998 const QLitObject example_qmp_schema_qlit = QLIT_QLIST(((QLitObject[]) { 1999 QLIT_QDICT(((QLitDictEntry[]) { 2000 { "arg-type", QLIT_QSTR("0"), }, 2001 { "meta-type", QLIT_QSTR("command"), }, 2002 { "name", QLIT_QSTR("my-command"), }, 2003 { "ret-type", QLIT_QSTR("1"), }, 2004 {} 2005 })), 2006 QLIT_QDICT(((QLitDictEntry[]) { 2007 { "arg-type", QLIT_QSTR("2"), }, 2008 { "meta-type", QLIT_QSTR("event"), }, 2009 { "name", QLIT_QSTR("MY_EVENT"), }, 2010 {} 2011 })), 2012 /* "0" = q_obj_my-command-arg */ 2013 QLIT_QDICT(((QLitDictEntry[]) { 2014 { "members", QLIT_QLIST(((QLitObject[]) { 2015 QLIT_QDICT(((QLitDictEntry[]) { 2016 { "name", QLIT_QSTR("arg1"), }, 2017 { "type", QLIT_QSTR("[1]"), }, 2018 {} 2019 })), 2020 {} 2021 })), }, 2022 { "meta-type", QLIT_QSTR("object"), }, 2023 { "name", QLIT_QSTR("0"), }, 2024 {} 2025 })), 2026 /* "1" = UserDefOne */ 2027 QLIT_QDICT(((QLitDictEntry[]) { 2028 { "members", QLIT_QLIST(((QLitObject[]) { 2029 QLIT_QDICT(((QLitDictEntry[]) { 2030 { "name", QLIT_QSTR("integer"), }, 2031 { "type", QLIT_QSTR("int"), }, 2032 {} 2033 })), 2034 QLIT_QDICT(((QLitDictEntry[]) { 2035 { "default", QLIT_QNULL, }, 2036 { "name", QLIT_QSTR("string"), }, 2037 { "type", QLIT_QSTR("str"), }, 2038 {} 2039 })), 2040 QLIT_QDICT(((QLitDictEntry[]) { 2041 { "default", QLIT_QNULL, }, 2042 { "name", QLIT_QSTR("flag"), }, 2043 { "type", QLIT_QSTR("bool"), }, 2044 {} 2045 })), 2046 {} 2047 })), }, 2048 { "meta-type", QLIT_QSTR("object"), }, 2049 { "name", QLIT_QSTR("1"), }, 2050 {} 2051 })), 2052 /* "2" = q_empty */ 2053 QLIT_QDICT(((QLitDictEntry[]) { 2054 { "members", QLIT_QLIST(((QLitObject[]) { 2055 {} 2056 })), }, 2057 { "meta-type", QLIT_QSTR("object"), }, 2058 { "name", QLIT_QSTR("2"), }, 2059 {} 2060 })), 2061 QLIT_QDICT(((QLitDictEntry[]) { 2062 { "element-type", QLIT_QSTR("1"), }, 2063 { "meta-type", QLIT_QSTR("array"), }, 2064 { "name", QLIT_QSTR("[1]"), }, 2065 {} 2066 })), 2067 QLIT_QDICT(((QLitDictEntry[]) { 2068 { "json-type", QLIT_QSTR("int"), }, 2069 { "meta-type", QLIT_QSTR("builtin"), }, 2070 { "name", QLIT_QSTR("int"), }, 2071 {} 2072 })), 2073 QLIT_QDICT(((QLitDictEntry[]) { 2074 { "json-type", QLIT_QSTR("string"), }, 2075 { "meta-type", QLIT_QSTR("builtin"), }, 2076 { "name", QLIT_QSTR("str"), }, 2077 {} 2078 })), 2079 QLIT_QDICT(((QLitDictEntry[]) { 2080 { "json-type", QLIT_QSTR("boolean"), }, 2081 { "meta-type", QLIT_QSTR("builtin"), }, 2082 { "name", QLIT_QSTR("bool"), }, 2083 {} 2084 })), 2085 {} 2086 })); 2087 2088 [Uninteresting stuff omitted...] 2089