xref: /qemu/docs/devel/qapi-code-gen.rst (revision eb9b25c6565d8c49a0db40f65a8a1f7932e81ff5)
1==================================
2How to use the QAPI code generator
3==================================
4
5..
6   Copyright IBM Corp. 2011
7   Copyright (C) 2012-2016 Red Hat, Inc.
8
9   This work is licensed under the terms of the GNU GPL, version 2 or
10   later.  See the COPYING file in the top-level directory.
11
12.. _qapi:
13
14Introduction
15============
16
17QAPI is a native C API within QEMU which provides management-level
18functionality to internal and external users.  For external
19users/processes, this interface is made available by a JSON-based wire
20format for the QEMU Monitor Protocol (QMP) for controlling qemu, as
21well as the QEMU Guest Agent (QGA) for communicating with the guest.
22The remainder of this document uses "Client JSON Protocol" when
23referring to the wire contents of a QMP or QGA connection.
24
25To map between Client JSON Protocol interfaces and the native C API,
26we generate C code from a QAPI schema.  This document describes the
27QAPI schema language, and how it gets mapped to the Client JSON
28Protocol and to C.  It additionally provides guidance on maintaining
29Client JSON Protocol compatibility.
30
31
32The QAPI schema language
33========================
34
35The QAPI schema defines the Client JSON Protocol's commands and
36events, as well as types used by them.  Forward references are
37allowed.
38
39It is permissible for the schema to contain additional types not used
40by any commands or events, for the side effect of generated C code
41used internally.
42
43There are several kinds of types: simple types (a number of built-in
44types, such as ``int`` and ``str``; as well as enumerations), arrays,
45complex types (structs and unions), and alternate types (a choice
46between other types).
47
48
49Schema syntax
50-------------
51
52Syntax is loosely based on `JSON <http://www.ietf.org/rfc/rfc8259.txt>`_.
53Differences:
54
55* Comments: start with a hash character (``#``) that is not part of a
56  string, and extend to the end of the line.
57
58* Strings are enclosed in ``'single quotes'``, not ``"double quotes"``.
59
60* Strings are restricted to printable ASCII, and escape sequences to
61  just ``\\``.
62
63* Numbers and ``null`` are not supported.
64
65A second layer of syntax defines the sequences of JSON texts that are
66a correctly structured QAPI schema.  We provide a grammar for this
67syntax in an EBNF-like notation:
68
69* Production rules look like ``non-terminal = expression``
70* Concatenation: expression ``A B`` matches expression ``A``, then ``B``
71* Alternation: expression ``A | B`` matches expression ``A`` or ``B``
72* Repetition: expression ``A...`` matches zero or more occurrences of
73  expression ``A``
74* Repetition: expression ``A, ...`` matches zero or more occurrences of
75  expression ``A`` separated by ``,``
76* Grouping: expression ``( A )`` matches expression ``A``
77* JSON's structural characters are terminals: ``{ } [ ] : ,``
78* JSON's literal names are terminals: ``false true``
79* String literals enclosed in ``'single quotes'`` are terminal, and match
80  this JSON string, with a leading ``*`` stripped off
81* When JSON object member's name starts with ``*``, the member is
82  optional.
83* The symbol ``STRING`` is a terminal, and matches any JSON string
84* The symbol ``BOOL`` is a terminal, and matches JSON ``false`` or ``true``
85* ALL-CAPS words other than ``STRING`` are non-terminals
86
87The order of members within JSON objects does not matter unless
88explicitly noted.
89
90A QAPI schema consists of a series of top-level expressions::
91
92    SCHEMA = TOP-LEVEL-EXPR...
93
94The top-level expressions are all JSON objects.  Code and
95documentation is generated in schema definition order.  Code order
96should not matter.
97
98A top-level expressions is either a directive or a definition::
99
100    TOP-LEVEL-EXPR = DIRECTIVE | DEFINITION
101
102There are two kinds of directives and six kinds of definitions::
103
104    DIRECTIVE = INCLUDE | PRAGMA
105    DEFINITION = ENUM | STRUCT | UNION | ALTERNATE | COMMAND | EVENT
106
107These are discussed in detail below.
108
109
110Built-in Types
111--------------
112
113The following types are predefined, and map to C as follows:
114
115  ============= ============== ============================================
116  Schema        C              JSON
117  ============= ============== ============================================
118  ``str``       ``char *``     any JSON string, UTF-8
119  ``number``    ``double``     any JSON number
120  ``int``       ``int64_t``    a JSON number without fractional part
121                               that fits into the C integer type
122  ``int8``      ``int8_t``     likewise
123  ``int16``     ``int16_t``    likewise
124  ``int32``     ``int32_t``    likewise
125  ``int64``     ``int64_t``    likewise
126  ``uint8``     ``uint8_t``    likewise
127  ``uint16``    ``uint16_t``   likewise
128  ``uint32``    ``uint32_t``   likewise
129  ``uint64``    ``uint64_t``   likewise
130  ``size``      ``uint64_t``   like ``uint64_t``, except
131                               ``StringInputVisitor`` accepts size suffixes
132  ``bool``      ``bool``       JSON ``true`` or ``false``
133  ``null``      ``QNull *``    JSON ``null``
134  ``any``       ``QObject *``  any JSON value
135  ``QType``     ``QType``      JSON string matching enum ``QType`` values
136  ============= ============== ============================================
137
138
139Include directives
140------------------
141
142Syntax::
143
144    INCLUDE = { 'include': STRING }
145
146The QAPI schema definitions can be modularized using the 'include' directive::
147
148 { 'include': 'path/to/file.json' }
149
150The directive is evaluated recursively, and include paths are relative
151to the file using the directive.  Multiple includes of the same file
152are idempotent.
153
154As a matter of style, it is a good idea to have all files be
155self-contained, but at the moment, nothing prevents an included file
156from making a forward reference to a type that is only introduced by
157an outer file.  The parser may be made stricter in the future to
158prevent incomplete include files.
159
160.. _pragma:
161
162Pragma directives
163-----------------
164
165Syntax::
166
167    PRAGMA = { 'pragma': {
168                   '*doc-required': BOOL,
169                   '*command-name-exceptions': [ STRING, ... ],
170                   '*command-returns-exceptions': [ STRING, ... ],
171                   '*documentation-exceptions': [ STRING, ... ],
172                   '*member-name-exceptions': [ STRING, ... ] } }
173
174The pragma directive lets you control optional generator behavior.
175
176Pragma's scope is currently the complete schema.  Setting the same
177pragma to different values in parts of the schema doesn't work.
178
179Pragma 'doc-required' takes a boolean value.  If true, documentation
180is required.  Default is false.
181
182Pragma 'command-name-exceptions' takes a list of commands whose names
183may contain ``"_"`` instead of ``"-"``.  Default is none.
184
185Pragma 'command-returns-exceptions' takes a list of commands that may
186violate the rules on permitted return types.  Default is none.
187
188Pragma 'documentation-exceptions' takes a list of types, commands, and
189events whose members / arguments need not be documented.  Default is
190none.
191
192Pragma 'member-name-exceptions' takes a list of types whose member
193names may contain uppercase letters, and ``"_"`` instead of ``"-"``.
194Default is none.
195
196.. _ENUM-VALUE:
197
198Enumeration types
199-----------------
200
201Syntax::
202
203    ENUM = { 'enum': STRING,
204             'data': [ ENUM-VALUE, ... ],
205             '*prefix': STRING,
206             '*if': COND,
207             '*features': FEATURES }
208    ENUM-VALUE = STRING
209               | { 'name': STRING,
210                   '*if': COND,
211                   '*features': FEATURES }
212
213Member 'enum' names the enum type.
214
215Each member of the 'data' array defines a value of the enumeration
216type.  The form STRING is shorthand for :code:`{ 'name': STRING }`.  The
217'name' values must be be distinct.
218
219Example::
220
221 { 'enum': 'MyEnum', 'data': [ 'value1', 'value2', 'value3' ] }
222
223Nothing prevents an empty enumeration, although it is probably not
224useful.
225
226On the wire, an enumeration type's value is represented by its
227(string) name.  In C, it's represented by an enumeration constant.
228These are of the form PREFIX_NAME, where PREFIX is derived from the
229enumeration type's name, and NAME from the value's name.  For the
230example above, the generator maps 'MyEnum' to MY_ENUM and 'value1' to
231VALUE1, resulting in the enumeration constant MY_ENUM_VALUE1.  The
232optional 'prefix' member overrides PREFIX.  This is rarely necessary,
233and should be used with restraint.
234
235The generated C enumeration constants have values 0, 1, ..., N-1 (in
236QAPI schema order), where N is the number of values.  There is an
237additional enumeration constant PREFIX__MAX with value N.
238
239Do not use string or an integer type when an enumeration type can do
240the job satisfactorily.
241
242The optional 'if' member specifies a conditional.  See `Configuring the
243schema`_ below for more on this.
244
245The optional 'features' member specifies features.  See Features_
246below for more on this.
247
248
249.. _TYPE-REF:
250
251Type references and array types
252-------------------------------
253
254Syntax::
255
256    TYPE-REF = STRING | ARRAY-TYPE
257    ARRAY-TYPE = [ STRING ]
258
259A string denotes the type named by the string.
260
261A one-element array containing a string denotes an array of the type
262named by the string.  Example: ``['int']`` denotes an array of ``int``.
263
264
265Struct types
266------------
267
268Syntax::
269
270    STRUCT = { 'struct': STRING,
271               'data': MEMBERS,
272               '*base': STRING,
273               '*if': COND,
274               '*features': FEATURES }
275    MEMBERS = { MEMBER, ... }
276    MEMBER = STRING : TYPE-REF
277           | STRING : { 'type': TYPE-REF,
278                        '*if': COND,
279                        '*features': FEATURES }
280
281Member 'struct' names the struct type.
282
283Each MEMBER of the 'data' object defines a member of the struct type.
284
285.. _MEMBERS:
286
287The MEMBER's STRING name consists of an optional ``*`` prefix and the
288struct member name.  If ``*`` is present, the member is optional.
289
290The MEMBER's value defines its properties, in particular its type.
291The form TYPE-REF_ is shorthand for :code:`{ 'type': TYPE-REF }`.
292
293Example::
294
295 { 'struct': 'MyType',
296   'data': { 'member1': 'str', 'member2': ['int'], '*member3': 'str' } }
297
298A struct type corresponds to a struct in C, and an object in JSON.
299The C struct's members are generated in QAPI schema order.
300
301The optional 'base' member names a struct type whose members are to be
302included in this type.  They go first in the C struct.
303
304Example::
305
306 { 'struct': 'BlockdevOptionsGenericFormat',
307   'data': { 'file': 'str' } }
308 { 'struct': 'BlockdevOptionsGenericCOWFormat',
309   'base': 'BlockdevOptionsGenericFormat',
310   'data': { '*backing': 'str' } }
311
312An example BlockdevOptionsGenericCOWFormat object on the wire could use
313both members like this::
314
315 { "file": "/some/place/my-image",
316   "backing": "/some/place/my-backing-file" }
317
318The optional 'if' member specifies a conditional.  See `Configuring
319the schema`_ below for more on this.
320
321The optional 'features' member specifies features.  See Features_
322below for more on this.
323
324
325Union types
326-----------
327
328Syntax::
329
330    UNION = { 'union': STRING,
331              'base': ( MEMBERS | STRING ),
332              'discriminator': STRING,
333              'data': BRANCHES,
334              '*if': COND,
335              '*features': FEATURES }
336    BRANCHES = { BRANCH, ... }
337    BRANCH = STRING : TYPE-REF
338           | STRING : { 'type': TYPE-REF, '*if': COND }
339
340Member 'union' names the union type.
341
342The 'base' member defines the common members.  If it is a MEMBERS_
343object, it defines common members just like a struct type's 'data'
344member defines struct type members.  If it is a STRING, it names a
345struct type whose members are the common members.
346
347Member 'discriminator' must name a non-optional enum-typed member of
348the base struct.  That member's value selects a branch by its name.
349If no such branch exists, an empty branch is assumed.
350
351Each BRANCH of the 'data' object defines a branch of the union.  A
352union must have at least one branch.
353
354The BRANCH's STRING name is the branch name.  It must be a value of
355the discriminator enum type.
356
357The BRANCH's value defines the branch's properties, in particular its
358type.  The type must a struct type.  The form TYPE-REF_ is shorthand
359for :code:`{ 'type': TYPE-REF }`.
360
361In the Client JSON Protocol, a union is represented by an object with
362the common members (from the base type) and the selected branch's
363members.  The two sets of member names must be disjoint.
364
365Example::
366
367 { 'enum': 'BlockdevDriver', 'data': [ 'file', 'qcow2' ] }
368 { 'union': 'BlockdevOptions',
369   'base': { 'driver': 'BlockdevDriver', '*read-only': 'bool' },
370   'discriminator': 'driver',
371   'data': { 'file': 'BlockdevOptionsFile',
372             'qcow2': 'BlockdevOptionsQcow2' } }
373
374Resulting in these JSON objects::
375
376 { "driver": "file", "read-only": true,
377   "filename": "/some/place/my-image" }
378 { "driver": "qcow2", "read-only": false,
379   "backing": "/some/place/my-image", "lazy-refcounts": true }
380
381The order of branches need not match the order of the enum values.
382The branches need not cover all possible enum values.  In the
383resulting generated C data types, a union is represented as a struct
384with the base members in QAPI schema order, and then a union of
385structures for each branch of the struct.
386
387The optional 'if' member specifies a conditional.  See `Configuring
388the schema`_ below for more on this.
389
390The optional 'features' member specifies features.  See Features_
391below for more on this.
392
393
394Alternate types
395---------------
396
397Syntax::
398
399    ALTERNATE = { 'alternate': STRING,
400                  'data': ALTERNATIVES,
401                  '*if': COND,
402                  '*features': FEATURES }
403    ALTERNATIVES = { ALTERNATIVE, ... }
404    ALTERNATIVE = STRING : STRING
405                | STRING : { 'type': STRING, '*if': COND }
406
407Member 'alternate' names the alternate type.
408
409Each ALTERNATIVE of the 'data' object defines a branch of the
410alternate.  An alternate must have at least one branch.
411
412The ALTERNATIVE's STRING name is the branch name.
413
414The ALTERNATIVE's value defines the branch's properties, in particular
415its type.  The form STRING is shorthand for :code:`{ 'type': STRING }`.
416
417Example::
418
419 { 'alternate': 'BlockdevRef',
420   'data': { 'definition': 'BlockdevOptions',
421             'reference': 'str' } }
422
423An alternate type is like a union type, except there is no
424discriminator on the wire.  Instead, the branch to use is inferred
425from the value.  An alternate can only express a choice between types
426represented differently on the wire.
427
428If a branch is typed as the 'bool' built-in, the alternate accepts
429true and false; if it is typed as any of the various numeric
430built-ins, it accepts a JSON number; if it is typed as a 'str'
431built-in or named enum type, it accepts a JSON string; if it is typed
432as the 'null' built-in, it accepts JSON null; and if it is typed as a
433complex type (struct or union), it accepts a JSON object.
434
435The example alternate declaration above allows using both of the
436following example objects::
437
438 { "file": "my_existing_block_device_id" }
439 { "file": { "driver": "file",
440             "read-only": false,
441             "filename": "/tmp/mydisk.qcow2" } }
442
443The optional 'if' member specifies a conditional.  See `Configuring
444the schema`_ below for more on this.
445
446The optional 'features' member specifies features.  See Features_
447below for more on this.
448
449
450Commands
451--------
452
453Syntax::
454
455    COMMAND = { 'command': STRING,
456                (
457                '*data': ( MEMBERS | STRING ),
458                |
459                'data': STRING,
460                'boxed': true,
461                )
462                '*returns': TYPE-REF,
463                '*success-response': false,
464                '*gen': false,
465                '*allow-oob': true,
466                '*allow-preconfig': true,
467                '*coroutine': true,
468                '*if': COND,
469                '*features': FEATURES }
470
471Member 'command' names the command.
472
473Member 'data' defines the arguments.  It defaults to an empty MEMBERS_
474object.
475
476If 'data' is a MEMBERS_ object, then MEMBERS defines arguments just
477like a struct type's 'data' defines struct type members.
478
479If 'data' is a STRING, then STRING names a complex type whose members
480are the arguments.  A union type requires ``'boxed': true``.
481
482Member 'returns' defines the command's return type.  It defaults to an
483empty struct type.  It must normally be a complex type or an array of
484a complex type.  To return anything else, the command must be listed
485in pragma 'commands-returns-exceptions'.  If you do this, extending
486the command to return additional information will be harder.  Use of
487the pragma for new commands is strongly discouraged.
488
489A command's error responses are not specified in the QAPI schema.
490Error conditions should be documented in comments.
491
492In the Client JSON Protocol, the value of the "execute" or "exec-oob"
493member is the command name.  The value of the "arguments" member then
494has to conform to the arguments, and the value of the success
495response's "return" member will conform to the return type.
496
497Some example commands::
498
499 { 'command': 'my-first-command',
500   'data': { 'arg1': 'str', '*arg2': 'str' } }
501 { 'struct': 'MyType', 'data': { '*value': 'str' } }
502 { 'command': 'my-second-command',
503   'returns': [ 'MyType' ] }
504
505which would validate this Client JSON Protocol transaction::
506
507 => { "execute": "my-first-command",
508      "arguments": { "arg1": "hello" } }
509 <= { "return": { } }
510 => { "execute": "my-second-command" }
511 <= { "return": [ { "value": "one" }, { } ] }
512
513The generator emits a prototype for the C function implementing the
514command.  The function itself needs to be written by hand.  See
515section `Code generated for commands`_ for examples.
516
517The function returns the return type.  When member 'boxed' is absent,
518it takes the command arguments as arguments one by one, in QAPI schema
519order.  Else it takes them wrapped in the C struct generated for the
520complex argument type.  It takes an additional ``Error **`` argument in
521either case.
522
523The generator also emits a marshalling function that extracts
524arguments for the user's function out of an input QDict, calls the
525user's function, and if it succeeded, builds an output QObject from
526its return value.  This is for use by the QMP monitor core.
527
528In rare cases, QAPI cannot express a type-safe representation of a
529corresponding Client JSON Protocol command.  You then have to suppress
530generation of a marshalling function by including a member 'gen' with
531boolean value false, and instead write your own function.  For
532example::
533
534 { 'command': 'netdev_add',
535   'data': {'type': 'str', 'id': 'str'},
536   'gen': false }
537
538Please try to avoid adding new commands that rely on this, and instead
539use type-safe unions.
540
541Normally, the QAPI schema is used to describe synchronous exchanges,
542where a response is expected.  But in some cases, the action of a
543command is expected to change state in a way that a successful
544response is not possible (although the command will still return an
545error object on failure).  When a successful reply is not possible,
546the command definition includes the optional member 'success-response'
547with boolean value false.  So far, only QGA makes use of this member.
548
549Member 'allow-oob' declares whether the command supports out-of-band
550(OOB) execution.  It defaults to false.  For example::
551
552 { 'command': 'migrate_recover',
553   'data': { 'uri': 'str' }, 'allow-oob': true }
554
555See the :doc:`/interop/qmp-spec` for out-of-band execution syntax
556and semantics.
557
558Commands supporting out-of-band execution can still be executed
559in-band.
560
561When a command is executed in-band, its handler runs in the main
562thread with the BQL held.
563
564When a command is executed out-of-band, its handler runs in a
565dedicated monitor I/O thread with the BQL *not* held.
566
567An OOB-capable command handler must satisfy the following conditions:
568
569- It terminates quickly.
570- It does not invoke system calls that may block.
571- It does not access guest RAM that may block when userfaultfd is
572  enabled for postcopy live migration.
573- It takes only "fast" locks, i.e. all critical sections protected by
574  any lock it takes also satisfy the conditions for OOB command
575  handler code.
576
577The restrictions on locking limit access to shared state.  Such access
578requires synchronization, but OOB commands can't take the BQL or any
579other "slow" lock.
580
581When in doubt, do not implement OOB execution support.
582
583Member 'allow-preconfig' declares whether the command is available
584before the machine is built.  It defaults to false.  For example::
585
586 { 'enum': 'QMPCapability',
587   'data': [ 'oob' ] }
588 { 'command': 'qmp_capabilities',
589   'data': { '*enable': [ 'QMPCapability' ] },
590   'allow-preconfig': true }
591
592QMP is available before the machine is built only when QEMU was
593started with --preconfig.
594
595Member 'coroutine' tells the QMP dispatcher whether the command handler
596is safe to be run in a coroutine.  It defaults to false.  If it is true,
597the command handler is called from coroutine context and may yield while
598waiting for an external event (such as I/O completion) in order to avoid
599blocking the guest and other background operations.
600
601Coroutine safety can be hard to prove, similar to thread safety.  Common
602pitfalls are:
603
604- The BQL isn't held across ``qemu_coroutine_yield()``, so
605  operations that used to assume that they execute atomically may have
606  to be more careful to protect against changes in the global state.
607
608- Nested event loops (``AIO_WAIT_WHILE()`` etc.) are problematic in
609  coroutine context and can easily lead to deadlocks.  They should be
610  replaced by yielding and reentering the coroutine when the condition
611  becomes false.
612
613Since the command handler may assume coroutine context, any callers
614other than the QMP dispatcher must also call it in coroutine context.
615In particular, HMP commands calling such a QMP command handler must be
616marked ``.coroutine = true`` in hmp-commands.hx.
617
618It is an error to specify both ``'coroutine': true`` and ``'allow-oob': true``
619for a command.  We don't currently have a use case for both together and
620without a use case, it's not entirely clear what the semantics should
621be.
622
623The optional 'if' member specifies a conditional.  See `Configuring
624the schema`_ below for more on this.
625
626The optional 'features' member specifies features.  See Features_
627below for more on this.
628
629
630Events
631------
632
633Syntax::
634
635    EVENT = { 'event': STRING,
636              (
637              '*data': ( MEMBERS | STRING ),
638              |
639              'data': STRING,
640              'boxed': true,
641              )
642              '*if': COND,
643              '*features': FEATURES }
644
645Member 'event' names the event.  This is the event name used in the
646Client JSON Protocol.
647
648Member 'data' defines the event-specific data.  It defaults to an
649empty MEMBERS object.
650
651If 'data' is a MEMBERS object, then MEMBERS defines event-specific
652data just like a struct type's 'data' defines struct type members.
653
654If 'data' is a STRING, then STRING names a complex type whose members
655are the event-specific data.  A union type requires ``'boxed': true``.
656
657An example event is::
658
659 { 'event': 'EVENT_C',
660   'data': { '*a': 'int', 'b': 'str' } }
661
662Resulting in this JSON object::
663
664 { "event": "EVENT_C",
665   "data": { "b": "test string" },
666   "timestamp": { "seconds": 1267020223, "microseconds": 435656 } }
667
668The generator emits a function to send the event.  When member 'boxed'
669is absent, it takes event-specific data one by one, in QAPI schema
670order.  Else it takes them wrapped in the C struct generated for the
671complex type.  See section `Code generated for events`_ for examples.
672
673The optional 'if' member specifies a conditional.  See `Configuring
674the schema`_ below for more on this.
675
676The optional 'features' member specifies features.  See Features_
677below for more on this.
678
679
680.. _FEATURE:
681
682Features
683--------
684
685Syntax::
686
687    FEATURES = [ FEATURE, ... ]
688    FEATURE = STRING
689            | { 'name': STRING, '*if': COND }
690
691Sometimes, the behaviour of QEMU changes compatibly, but without a
692change in the QMP syntax (usually by allowing values or operations
693that previously resulted in an error).  QMP clients may still need to
694know whether the extension is available.
695
696For this purpose, a list of features can be specified for definitions,
697enumeration values, and struct members.  Each feature list member can
698either be ``{ 'name': STRING, '*if': COND }``, or STRING, which is
699shorthand for ``{ 'name': STRING }``.
700
701The optional 'if' member specifies a conditional.  See `Configuring
702the schema`_ below for more on this.
703
704Example::
705
706 { 'struct': 'TestType',
707   'data': { 'number': 'int' },
708   'features': [ 'allow-negative-numbers' ] }
709
710The feature strings are exposed to clients in introspection, as
711explained in section `Client JSON Protocol introspection`_.
712
713Intended use is to have each feature string signal that this build of
714QEMU shows a certain behaviour.
715
716
717Special features
718~~~~~~~~~~~~~~~~
719
720Feature "deprecated" marks a command, event, enum value, or struct
721member as deprecated.  It is not supported elsewhere so far.
722Interfaces so marked may be withdrawn in future releases in accordance
723with QEMU's deprecation policy.
724
725Feature "unstable" marks a command, event, enum value, or struct
726member as unstable.  It is not supported elsewhere so far.  Interfaces
727so marked may be withdrawn or changed incompatibly in future releases.
728
729
730Naming rules and reserved names
731-------------------------------
732
733All names must begin with a letter, and contain only ASCII letters,
734digits, hyphen, and underscore.  There are two exceptions: enum values
735may start with a digit, and names that are downstream extensions (see
736section `Downstream extensions`_) start with underscore.
737
738Names beginning with ``q_`` are reserved for the generator, which uses
739them for munging QMP names that resemble C keywords or other
740problematic strings.  For example, a member named ``default`` in qapi
741becomes ``q_default`` in the generated C code.
742
743Types, commands, and events share a common namespace.  Therefore,
744generally speaking, type definitions should always use CamelCase for
745user-defined type names, while built-in types are lowercase.
746
747Type names ending with ``List`` are reserved for the generator, which
748uses them for array types.
749
750Command names, member names within a type, and feature names should be
751all lower case with words separated by a hyphen.  However, some
752existing older commands and complex types use underscore; when
753extending them, consistency is preferred over blindly avoiding
754underscore.
755
756Event names should be ALL_CAPS with words separated by underscore.
757
758Member name ``u`` and names starting with ``has-`` or ``has_`` are reserved
759for the generator, which uses them for unions and for tracking
760optional members.
761
762Names beginning with ``x-`` used to signify "experimental".  This
763convention has been replaced by special feature "unstable".
764
765Pragmas ``command-name-exceptions`` and ``member-name-exceptions`` let
766you violate naming rules.  Use for new code is strongly discouraged. See
767`Pragma directives`_ for details.
768
769
770Downstream extensions
771---------------------
772
773QAPI schema names that are externally visible, say in the Client JSON
774Protocol, need to be managed with care.  Names starting with a
775downstream prefix of the form __RFQDN_ are reserved for the downstream
776who controls the valid, reverse fully qualified domain name RFQDN.
777RFQDN may only contain ASCII letters, digits, hyphen and period.
778
779Example: Red Hat, Inc. controls redhat.com, and may therefore add a
780downstream command ``__com.redhat_drive-mirror``.
781
782
783Configuring the schema
784----------------------
785
786Syntax::
787
788    COND = STRING
789         | { 'all: [ COND, ... ] }
790         | { 'any: [ COND, ... ] }
791         | { 'not': COND }
792
793All definitions take an optional 'if' member.  Its value must be a
794string, or an object with a single member 'all', 'any' or 'not'.
795
796The C code generated for the definition will then be guarded by an #if
797preprocessing directive with an operand generated from that condition:
798
799 * STRING will generate defined(STRING)
800 * { 'all': [COND, ...] } will generate (COND && ...)
801 * { 'any': [COND, ...] } will generate (COND || ...)
802 * { 'not': COND } will generate !COND
803
804Example: a conditional struct ::
805
806 { 'struct': 'IfStruct', 'data': { 'foo': 'int' },
807   'if': { 'all': [ 'CONFIG_FOO', 'HAVE_BAR' ] } }
808
809gets its generated code guarded like this::
810
811 #if defined(CONFIG_FOO) && defined(HAVE_BAR)
812 ... generated code ...
813 #endif /* defined(HAVE_BAR) && defined(CONFIG_FOO) */
814
815Individual members of complex types can also be made conditional.
816This requires the longhand form of MEMBER.
817
818Example: a struct type with unconditional member 'foo' and conditional
819member 'bar' ::
820
821 { 'struct': 'IfStruct',
822   'data': { 'foo': 'int',
823             'bar': { 'type': 'int', 'if': 'IFCOND'} } }
824
825A union's discriminator may not be conditional.
826
827Likewise, individual enumeration values may be conditional.  This
828requires the longhand form of ENUM-VALUE_.
829
830Example: an enum type with unconditional value 'foo' and conditional
831value 'bar' ::
832
833 { 'enum': 'IfEnum',
834   'data': [ 'foo',
835             { 'name' : 'bar', 'if': 'IFCOND' } ] }
836
837Likewise, features can be conditional.  This requires the longhand
838form of FEATURE_.
839
840Example: a struct with conditional feature 'allow-negative-numbers' ::
841
842 { 'struct': 'TestType',
843   'data': { 'number': 'int' },
844   'features': [ { 'name': 'allow-negative-numbers',
845                   'if': 'IFCOND' } ] }
846
847Please note that you are responsible to ensure that the C code will
848compile with an arbitrary combination of conditions, since the
849generator is unable to check it at this point.
850
851The conditions apply to introspection as well, i.e. introspection
852shows a conditional entity only when the condition is satisfied in
853this particular build.
854
855
856Documentation comments
857----------------------
858
859A multi-line comment that starts and ends with a ``##`` line is a
860documentation comment.
861
862If the documentation comment starts like ::
863
864    ##
865    # @SYMBOL:
866
867it documents the definition of SYMBOL, else it's free-form
868documentation.
869
870See below for more on `Definition documentation`_.
871
872Free-form documentation may be used to provide additional text and
873structuring content.
874
875
876Headings and subheadings
877~~~~~~~~~~~~~~~~~~~~~~~~
878
879A free-form documentation comment containing a line which starts with
880some ``=`` symbols and then a space defines a section heading::
881
882    ##
883    # = This is a top level heading
884    #
885    # This is a free-form comment which will go under the
886    # top level heading.
887    ##
888
889    ##
890    # == This is a second level heading
891    ##
892
893A heading line must be the first line of the documentation
894comment block.
895
896Section headings must always be correctly nested, so you can only
897define a third-level heading inside a second-level heading, and so on.
898
899
900Documentation markup
901~~~~~~~~~~~~~~~~~~~~
902
903Documentation comments can use most rST markup.  In particular,
904a ``::`` literal block can be used for pre-formatted text::
905
906    # ::
907    #
908    #   Text of the example, may span
909    #   multiple lines
910
911``*`` starts an itemized list::
912
913    # * First item, may span
914    #   multiple lines
915    # * Second item
916
917You can also use ``-`` instead of ``*``.
918
919A decimal number followed by ``.`` starts a numbered list::
920
921    # 1. First item, may span
922    #    multiple lines
923    # 2. Second item
924
925The actual number doesn't matter.
926
927Lists of either kind must be preceded and followed by a blank line.
928If a list item's text spans multiple lines, then the second and
929subsequent lines must be correctly indented to line up with the
930first character of the first line.
931
932The usual ****strong****, *\*emphasized\** and ````literal```` markup
933should be used.  If you need a single literal ``*``, you will need to
934backslash-escape it.
935
936Use ``@foo`` to reference a name in the schema.  This is an rST
937extension.  It is rendered the same way as ````foo````, but carries
938additional meaning.
939
940Example::
941
942 ##
943 # Some text foo with **bold** and *emphasis*
944 #
945 # 1. with a list
946 # 2. like that
947 #
948 # And some code:
949 #
950 # ::
951 #
952 #   $ echo foo
953 #   -> do this
954 #   <- get that
955 ##
956
957For legibility, wrap text paragraphs so every line is at most 70
958characters long.
959
960Separate sentences with two spaces.
961
962
963Definition documentation
964~~~~~~~~~~~~~~~~~~~~~~~~
965
966Definition documentation, if present, must immediately precede the
967definition it documents.
968
969When documentation is required (see pragma_ 'doc-required'), every
970definition must have documentation.
971
972Definition documentation starts with a line naming the definition,
973followed by an optional overview, a description of each argument (for
974commands and events), member (for structs and unions), branch (for
975alternates), or value (for enums), a description of each feature (if
976any), and finally optional tagged sections.
977
978Descriptions start with '\@name:'.  The description text must be
979indented like this::
980
981 # @name: Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed
982 #     do eiusmod tempor incididunt ut labore et dolore magna aliqua.
983
984.. FIXME The parser accepts these things in almost any order.
985
986.. FIXME union branches should be described, too.
987
988Extensions added after the definition was first released carry a
989"(since x.y.z)" comment.
990
991The feature descriptions must be preceded by a blank line and then a
992line "Features:", like this::
993
994  #
995  # Features:
996  #
997  # @feature: Description text
998
999A tagged section begins with a paragraph that starts with one of the
1000following words: "Since:", "Returns:", "Errors:", "TODO:".  It ends with
1001the start of a new section.
1002
1003The second and subsequent lines of tagged sections must be indented
1004like this::
1005
1006 # TODO: Ut enim ad minim veniam, quis nostrud exercitation ullamco
1007 #     laboris nisi ut aliquip ex ea commodo consequat.
1008 #
1009 #     Duis aute irure dolor in reprehenderit in voluptate velit esse
1010 #     cillum dolore eu fugiat nulla pariatur.
1011
1012"Returns" and "Errors" sections are only valid for commands.  They
1013document the success and the error response, respectively.
1014
1015"Errors" sections should be formatted as an rST list, each entry
1016detailing a relevant error condition. For example::
1017
1018 # Errors:
1019 #     - If @device does not exist, DeviceNotFound
1020 #     - Any other error returns a GenericError.
1021
1022A "Since: x.y.z" tagged section lists the release that introduced the
1023definition.
1024
1025"TODO" sections are not rendered (they are for developers, not users of
1026QMP).  In other sections, the text is formatted, and rST markup can be
1027used.
1028
1029QMP Examples can be added by using the ``.. qmp-example::``
1030directive. In its simplest form, this can be used to contain a single
1031QMP code block which accepts standard JSON syntax with additional server
1032directionality indicators (``->`` and ``<-``), and elisions (``...``).
1033
1034Optionally, a plaintext title may be provided by using the ``:title:``
1035directive option. If the title is omitted, the example title will
1036default to "Example:".
1037
1038A simple QMP example::
1039
1040  # .. qmp-example::
1041  #    :title: Using query-block
1042  #
1043  #    -> { "execute": "query-block" }
1044  #    <- { ... }
1045
1046More complex or multi-step examples where exposition is needed before or
1047between QMP code blocks can be created by using the ``:annotated:``
1048directive option. When using this option, nested QMP code blocks must be
1049entered explicitly with rST's ``::`` syntax.
1050
1051Highlighting in non-QMP languages can be accomplished by using the
1052``.. code-block:: lang`` directive, and non-highlighted text can be
1053achieved by omitting the language argument.
1054
1055For example::
1056
1057  # .. qmp-example::
1058  #    :annotated:
1059  #    :title: A more complex demonstration
1060  #
1061  #    This is a more complex example that can use
1062  #    ``arbitrary rST syntax`` in its exposition::
1063  #
1064  #      -> { "execute": "query-block" }
1065  #      <- { ... }
1066  #
1067  #    Above, lengthy output has been omitted for brevity.
1068
1069
1070Examples of complete definition documentation::
1071
1072 ##
1073 # @BlockStats:
1074 #
1075 # Statistics of a virtual block device or a block backing device.
1076 #
1077 # @device: If the stats are for a virtual block device, the name
1078 #     corresponding to the virtual block device.
1079 #
1080 # @node-name: The node name of the device.  (Since 2.3)
1081 #
1082 # ... more members ...
1083 #
1084 # Since: 0.14
1085 ##
1086 { 'struct': 'BlockStats',
1087   'data': {'*device': 'str', '*node-name': 'str',
1088            ... more members ... } }
1089
1090 ##
1091 # @query-blockstats:
1092 #
1093 # Query the @BlockStats for all virtual block devices.
1094 #
1095 # @query-nodes: If true, the command will query all the block nodes
1096 #     ... explain, explain ...
1097 #     (Since 2.3)
1098 #
1099 # Returns: A list of @BlockStats for each virtual block devices.
1100 #
1101 # Since: 0.14
1102 #
1103 # .. qmp-example::
1104 #
1105 #     -> { "execute": "query-blockstats" }
1106 #     <- {
1107 #          ...
1108 #        }
1109 ##
1110 { 'command': 'query-blockstats',
1111   'data': { '*query-nodes': 'bool' },
1112   'returns': ['BlockStats'] }
1113
1114
1115Markup pitfalls
1116~~~~~~~~~~~~~~~
1117
1118A blank line is required between list items and paragraphs.  Without
1119it, the list may not be recognized, resulting in garbled output.  Good
1120example::
1121
1122 # An event's state is modified if:
1123 #
1124 # - its name matches the @name pattern, and
1125 # - if @vcpu is given, the event has the "vcpu" property.
1126
1127Without the blank line this would be a single paragraph.
1128
1129Indentation matters.  Bad example::
1130
1131 # @none: None (no memory side cache in this proximity domain,
1132 #              or cache associativity unknown)
1133 #     (since 5.0)
1134
1135The last line's de-indent is wrong.  The second and subsequent lines
1136need to line up with each other, like this::
1137
1138 # @none: None (no memory side cache in this proximity domain,
1139 #     or cache associativity unknown)
1140 #     (since 5.0)
1141
1142Section tags are case-sensitive and end with a colon.  They are only
1143recognized after a blank line.  Good example::
1144
1145 #
1146 # Since: 7.1
1147
1148Bad examples (all ordinary paragraphs)::
1149
1150 # since: 7.1
1151
1152 # Since 7.1
1153
1154 # Since : 7.1
1155
1156Likewise, member descriptions require a colon.  Good example::
1157
1158 # @interface-id: Interface ID
1159
1160Bad examples (all ordinary paragraphs)::
1161
1162 # @interface-id   Interface ID
1163
1164 # @interface-id : Interface ID
1165
1166Undocumented members are not flagged, yet.  Instead, the generated
1167documentation describes them as "Not documented".  Think twice before
1168adding more undocumented members.
1169
1170When you change documentation comments, please check the generated
1171documentation comes out as intended!
1172
1173
1174Client JSON Protocol introspection
1175==================================
1176
1177Clients of a Client JSON Protocol commonly need to figure out what
1178exactly the server (QEMU) supports.
1179
1180For this purpose, QMP provides introspection via command
1181query-qmp-schema.  QGA currently doesn't support introspection.
1182
1183While Client JSON Protocol wire compatibility should be maintained
1184between qemu versions, we cannot make the same guarantees for
1185introspection stability.  For example, one version of qemu may provide
1186a non-variant optional member of a struct, and a later version rework
1187the member to instead be non-optional and associated with a variant.
1188Likewise, one version of qemu may list a member with open-ended type
1189'str', and a later version could convert it to a finite set of strings
1190via an enum type; or a member may be converted from a specific type to
1191an alternate that represents a choice between the original type and
1192something else.
1193
1194query-qmp-schema returns a JSON array of SchemaInfo objects.  These
1195objects together describe the wire ABI, as defined in the QAPI schema.
1196There is no specified order to the SchemaInfo objects returned; a
1197client must search for a particular name throughout the entire array
1198to learn more about that name, but is at least guaranteed that there
1199will be no collisions between type, command, and event names.
1200
1201However, the SchemaInfo can't reflect all the rules and restrictions
1202that apply to QMP.  It's interface introspection (figuring out what's
1203there), not interface specification.  The specification is in the QAPI
1204schema.  To understand how QMP is to be used, you need to study the
1205QAPI schema.
1206
1207Like any other command, query-qmp-schema is itself defined in the QAPI
1208schema, along with the SchemaInfo type.  This text attempts to give an
1209overview how things work.  For details you need to consult the QAPI
1210schema.
1211
1212SchemaInfo objects have common members "name", "meta-type",
1213"features", and additional variant members depending on the value of
1214meta-type.
1215
1216Each SchemaInfo object describes a wire ABI entity of a certain
1217meta-type: a command, event or one of several kinds of type.
1218
1219SchemaInfo for commands and events have the same name as in the QAPI
1220schema.
1221
1222Command and event names are part of the wire ABI, but type names are
1223not.  Therefore, the SchemaInfo for types have auto-generated
1224meaningless names.  For readability, the examples in this section use
1225meaningful type names instead.
1226
1227Optional member "features" exposes the entity's feature strings as a
1228JSON array of strings.
1229
1230To examine a type, start with a command or event using it, then follow
1231references by name.
1232
1233QAPI schema definitions not reachable that way are omitted.
1234
1235The SchemaInfo for a command has meta-type "command", and variant
1236members "arg-type", "ret-type" and "allow-oob".  On the wire, the
1237"arguments" member of a client's "execute" command must conform to the
1238object type named by "arg-type".  The "return" member that the server
1239passes in a success response conforms to the type named by "ret-type".
1240When "allow-oob" is true, it means the command supports out-of-band
1241execution.  It defaults to false.
1242
1243If the command takes no arguments, "arg-type" names an object type
1244without members.  Likewise, if the command returns nothing, "ret-type"
1245names an object type without members.
1246
1247Example: the SchemaInfo for command query-qmp-schema ::
1248
1249 { "name": "query-qmp-schema", "meta-type": "command",
1250   "arg-type": "q_empty", "ret-type": "SchemaInfoList" }
1251
1252   Type "q_empty" is an automatic object type without members, and type
1253   "SchemaInfoList" is the array of SchemaInfo type.
1254
1255The SchemaInfo for an event has meta-type "event", and variant member
1256"arg-type".  On the wire, a "data" member that the server passes in an
1257event conforms to the object type named by "arg-type".
1258
1259If the event carries no additional information, "arg-type" names an
1260object type without members.  The event may not have a data member on
1261the wire then.
1262
1263Each command or event defined with 'data' as MEMBERS object in the
1264QAPI schema implicitly defines an object type.
1265
1266Example: the SchemaInfo for EVENT_C from section Events_ ::
1267
1268    { "name": "EVENT_C", "meta-type": "event",
1269      "arg-type": "q_obj-EVENT_C-arg" }
1270
1271    Type "q_obj-EVENT_C-arg" is an implicitly defined object type with
1272    the two members from the event's definition.
1273
1274The SchemaInfo for struct and union types has meta-type "object" and
1275variant member "members".
1276
1277The SchemaInfo for a union type additionally has variant members "tag"
1278and "variants".
1279
1280"members" is a JSON array describing the object's common members, if
1281any.  Each element is a JSON object with members "name" (the member's
1282name), "type" (the name of its type), "features" (a JSON array of
1283feature strings), and "default".  The latter two are optional.  The
1284member is optional if "default" is present.  Currently, "default" can
1285only have value null.  Other values are reserved for future
1286extensions.  The "members" array is in no particular order; clients
1287must search the entire object when learning whether a particular
1288member is supported.
1289
1290Example: the SchemaInfo for MyType from section `Struct types`_ ::
1291
1292    { "name": "MyType", "meta-type": "object",
1293      "members": [
1294          { "name": "member1", "type": "str" },
1295          { "name": "member2", "type": "int" },
1296          { "name": "member3", "type": "str", "default": null } ] }
1297
1298"features" exposes the command's feature strings as a JSON array of
1299strings.
1300
1301Example: the SchemaInfo for TestType from section Features_::
1302
1303    { "name": "TestType", "meta-type": "object",
1304      "members": [
1305          { "name": "number", "type": "int" } ],
1306      "features": ["allow-negative-numbers"] }
1307
1308"tag" is the name of the common member serving as type tag.
1309"variants" is a JSON array describing the object's variant members.
1310Each element is a JSON object with members "case" (the value of type
1311tag this element applies to) and "type" (the name of an object type
1312that provides the variant members for this type tag value).  The
1313"variants" array is in no particular order, and is not guaranteed to
1314list cases in the same order as the corresponding "tag" enum type.
1315
1316Example: the SchemaInfo for union BlockdevOptions from section
1317`Union types`_ ::
1318
1319    { "name": "BlockdevOptions", "meta-type": "object",
1320      "members": [
1321          { "name": "driver", "type": "BlockdevDriver" },
1322          { "name": "read-only", "type": "bool", "default": null } ],
1323      "tag": "driver",
1324      "variants": [
1325          { "case": "file", "type": "BlockdevOptionsFile" },
1326          { "case": "qcow2", "type": "BlockdevOptionsQcow2" } ] }
1327
1328Note that base types are "flattened": its members are included in the
1329"members" array.
1330
1331The SchemaInfo for an alternate type has meta-type "alternate", and
1332variant member "members".  "members" is a JSON array.  Each element is
1333a JSON object with member "type", which names a type.  Values of the
1334alternate type conform to exactly one of its member types.  There is
1335no guarantee on the order in which "members" will be listed.
1336
1337Example: the SchemaInfo for BlockdevRef from section `Alternate types`_ ::
1338
1339    { "name": "BlockdevRef", "meta-type": "alternate",
1340      "members": [
1341          { "type": "BlockdevOptions" },
1342          { "type": "str" } ] }
1343
1344The SchemaInfo for an array type has meta-type "array", and variant
1345member "element-type", which names the array's element type.  Array
1346types are implicitly defined.  For convenience, the array's name may
1347resemble the element type; however, clients should examine member
1348"element-type" instead of making assumptions based on parsing member
1349"name".
1350
1351Example: the SchemaInfo for ['str'] ::
1352
1353    { "name": "[str]", "meta-type": "array",
1354      "element-type": "str" }
1355
1356The SchemaInfo for an enumeration type has meta-type "enum" and
1357variant member "members".
1358
1359"members" is a JSON array describing the enumeration values.  Each
1360element is a JSON object with member "name" (the member's name), and
1361optionally "features" (a JSON array of feature strings).  The
1362"members" array is in no particular order; clients must search the
1363entire array when learning whether a particular value is supported.
1364
1365Example: the SchemaInfo for MyEnum from section `Enumeration types`_ ::
1366
1367    { "name": "MyEnum", "meta-type": "enum",
1368      "members": [
1369        { "name": "value1" },
1370        { "name": "value2" },
1371        { "name": "value3" }
1372      ] }
1373
1374The SchemaInfo for a built-in type has the same name as the type in
1375the QAPI schema (see section `Built-in Types`_), with one exception
1376detailed below.  It has variant member "json-type" that shows how
1377values of this type are encoded on the wire.
1378
1379Example: the SchemaInfo for str ::
1380
1381    { "name": "str", "meta-type": "builtin", "json-type": "string" }
1382
1383The QAPI schema supports a number of integer types that only differ in
1384how they map to C.  They are identical as far as SchemaInfo is
1385concerned.  Therefore, they get all mapped to a single type "int" in
1386SchemaInfo.
1387
1388As explained above, type names are not part of the wire ABI.  Not even
1389the names of built-in types.  Clients should examine member
1390"json-type" instead of hard-coding names of built-in types.
1391
1392
1393Compatibility considerations
1394============================
1395
1396Maintaining backward compatibility at the Client JSON Protocol level
1397while evolving the schema requires some care.  This section is about
1398syntactic compatibility, which is necessary, but not sufficient, for
1399actual compatibility.
1400
1401Clients send commands with argument data, and receive command
1402responses with return data and events with event data.
1403
1404Adding opt-in functionality to the send direction is backwards
1405compatible: adding commands, optional arguments, enumeration values,
1406union and alternate branches; turning an argument type into an
1407alternate of that type; making mandatory arguments optional.  Clients
1408oblivious of the new functionality continue to work.
1409
1410Incompatible changes include removing commands, command arguments,
1411enumeration values, union and alternate branches, adding mandatory
1412command arguments, and making optional arguments mandatory.
1413
1414The specified behavior of an absent optional argument should remain
1415the same.  With proper documentation, this policy still allows some
1416flexibility; for example, when an optional 'buffer-size' argument is
1417specified to default to a sensible buffer size, the actual default
1418value can still be changed.  The specified default behavior is not the
1419exact size of the buffer, only that the default size is sensible.
1420
1421Adding functionality to the receive direction is generally backwards
1422compatible: adding events, adding return and event data members.
1423Clients are expected to ignore the ones they don't know.
1424
1425Removing "unreachable" stuff like events that can't be triggered
1426anymore, optional return or event data members that can't be sent
1427anymore, and return or event data member (enumeration) values that
1428can't be sent anymore makes no difference to clients, except for
1429introspection.  The latter can conceivably confuse clients, so tread
1430carefully.
1431
1432Incompatible changes include removing return and event data members.
1433
1434Any change to a command definition's 'data' or one of the types used
1435there (recursively) needs to consider send direction compatibility.
1436
1437Any change to a command definition's 'return', an event definition's
1438'data', or one of the types used there (recursively) needs to consider
1439receive direction compatibility.
1440
1441Any change to types used in both contexts need to consider both.
1442
1443Enumeration type values and complex and alternate type members may be
1444reordered freely.  For enumerations and alternate types, this doesn't
1445affect the wire encoding.  For complex types, this might make the
1446implementation emit JSON object members in a different order, which
1447the Client JSON Protocol permits.
1448
1449Since type names are not visible in the Client JSON Protocol, types
1450may be freely renamed.  Even certain refactorings are invisible, such
1451as splitting members from one type into a common base type.
1452
1453
1454Code generation
1455===============
1456
1457The QAPI code generator qapi-gen.py generates code and documentation
1458from the schema.  Together with the core QAPI libraries, this code
1459provides everything required to take JSON commands read in by a Client
1460JSON Protocol server, unmarshal the arguments into the underlying C
1461types, call into the corresponding C function, map the response back
1462to a Client JSON Protocol response to be returned to the user, and
1463introspect the commands.
1464
1465As an example, we'll use the following schema, which describes a
1466single complex user-defined type, along with command which takes a
1467list of that type as a parameter, and returns a single element of that
1468type.  The user is responsible for writing the implementation of
1469qmp_my_command(); everything else is produced by the generator. ::
1470
1471    $ cat example-schema.json
1472    { 'struct': 'UserDefOne',
1473      'data': { 'integer': 'int', '*string': 'str', '*flag': 'bool' } }
1474
1475    { 'command': 'my-command',
1476      'data': { 'arg1': ['UserDefOne'] },
1477      'returns': 'UserDefOne' }
1478
1479    { 'event': 'MY_EVENT' }
1480
1481We run qapi-gen.py like this::
1482
1483    $ python scripts/qapi-gen.py --output-dir="qapi-generated" \
1484    --prefix="example-" example-schema.json
1485
1486For a more thorough look at generated code, the testsuite includes
1487tests/qapi-schema/qapi-schema-tests.json that covers more examples of
1488what the generator will accept, and compiles the resulting C code as
1489part of 'make check-unit'.
1490
1491
1492Code generated for QAPI types
1493-----------------------------
1494
1495The following files are created:
1496
1497 ``$(prefix)qapi-types.h``
1498     C types corresponding to types defined in the schema
1499
1500 ``$(prefix)qapi-types.c``
1501     Cleanup functions for the above C types
1502
1503The $(prefix) is an optional parameter used as a namespace to keep the
1504generated code from one schema/code-generation separated from others so code
1505can be generated/used from multiple schemas without clobbering previously
1506created code.
1507
1508Example::
1509
1510    $ cat qapi-generated/example-qapi-types.h
1511    [Uninteresting stuff omitted...]
1512
1513    #ifndef EXAMPLE_QAPI_TYPES_H
1514    #define EXAMPLE_QAPI_TYPES_H
1515
1516    #include "qapi/qapi-builtin-types.h"
1517
1518    typedef struct UserDefOne UserDefOne;
1519
1520    typedef struct UserDefOneList UserDefOneList;
1521
1522    typedef struct q_obj_my_command_arg q_obj_my_command_arg;
1523
1524    struct UserDefOne {
1525        int64_t integer;
1526        char *string;
1527        bool has_flag;
1528        bool flag;
1529    };
1530
1531    void qapi_free_UserDefOne(UserDefOne *obj);
1532    G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOne, qapi_free_UserDefOne)
1533
1534    struct UserDefOneList {
1535        UserDefOneList *next;
1536        UserDefOne *value;
1537    };
1538
1539    void qapi_free_UserDefOneList(UserDefOneList *obj);
1540    G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOneList, qapi_free_UserDefOneList)
1541
1542    struct q_obj_my_command_arg {
1543        UserDefOneList *arg1;
1544    };
1545
1546    #endif /* EXAMPLE_QAPI_TYPES_H */
1547    $ cat qapi-generated/example-qapi-types.c
1548    [Uninteresting stuff omitted...]
1549
1550    void qapi_free_UserDefOne(UserDefOne *obj)
1551    {
1552        Visitor *v;
1553
1554        if (!obj) {
1555            return;
1556        }
1557
1558        v = qapi_dealloc_visitor_new();
1559        visit_type_UserDefOne(v, NULL, &obj, NULL);
1560        visit_free(v);
1561    }
1562
1563    void qapi_free_UserDefOneList(UserDefOneList *obj)
1564    {
1565        Visitor *v;
1566
1567        if (!obj) {
1568            return;
1569        }
1570
1571        v = qapi_dealloc_visitor_new();
1572        visit_type_UserDefOneList(v, NULL, &obj, NULL);
1573        visit_free(v);
1574    }
1575
1576    [Uninteresting stuff omitted...]
1577
1578For a modular QAPI schema (see section `Include directives`_), code for
1579each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1580
1581 SUBDIR/$(prefix)qapi-types-SUBMODULE.h
1582 SUBDIR/$(prefix)qapi-types-SUBMODULE.c
1583
1584If qapi-gen.py is run with option --builtins, additional files are
1585created:
1586
1587 ``qapi-builtin-types.h``
1588     C types corresponding to built-in types
1589
1590 ``qapi-builtin-types.c``
1591     Cleanup functions for the above C types
1592
1593
1594Code generated for visiting QAPI types
1595--------------------------------------
1596
1597These are the visitor functions used to walk through and convert
1598between a native QAPI C data structure and some other format (such as
1599QObject); the generated functions are named visit_type_FOO() and
1600visit_type_FOO_members().
1601
1602The following files are generated:
1603
1604 ``$(prefix)qapi-visit.c``
1605     Visitor function for a particular C type, used to automagically
1606     convert QObjects into the corresponding C type and vice-versa, as
1607     well as for deallocating memory for an existing C type
1608
1609 ``$(prefix)qapi-visit.h``
1610     Declarations for previously mentioned visitor functions
1611
1612Example::
1613
1614    $ cat qapi-generated/example-qapi-visit.h
1615    [Uninteresting stuff omitted...]
1616
1617    #ifndef EXAMPLE_QAPI_VISIT_H
1618    #define EXAMPLE_QAPI_VISIT_H
1619
1620    #include "qapi/qapi-builtin-visit.h"
1621    #include "example-qapi-types.h"
1622
1623
1624    bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp);
1625
1626    bool visit_type_UserDefOne(Visitor *v, const char *name,
1627                     UserDefOne **obj, Error **errp);
1628
1629    bool visit_type_UserDefOneList(Visitor *v, const char *name,
1630                     UserDefOneList **obj, Error **errp);
1631
1632    bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp);
1633
1634    #endif /* EXAMPLE_QAPI_VISIT_H */
1635    $ cat qapi-generated/example-qapi-visit.c
1636    [Uninteresting stuff omitted...]
1637
1638    bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp)
1639    {
1640        bool has_string = !!obj->string;
1641
1642        if (!visit_type_int(v, "integer", &obj->integer, errp)) {
1643            return false;
1644        }
1645        if (visit_optional(v, "string", &has_string)) {
1646            if (!visit_type_str(v, "string", &obj->string, errp)) {
1647                return false;
1648            }
1649        }
1650        if (visit_optional(v, "flag", &obj->has_flag)) {
1651            if (!visit_type_bool(v, "flag", &obj->flag, errp)) {
1652                return false;
1653            }
1654        }
1655        return true;
1656    }
1657
1658    bool visit_type_UserDefOne(Visitor *v, const char *name,
1659                     UserDefOne **obj, Error **errp)
1660    {
1661        bool ok = false;
1662
1663        if (!visit_start_struct(v, name, (void **)obj, sizeof(UserDefOne), errp)) {
1664            return false;
1665        }
1666        if (!*obj) {
1667            /* incomplete */
1668            assert(visit_is_dealloc(v));
1669            ok = true;
1670            goto out_obj;
1671        }
1672        if (!visit_type_UserDefOne_members(v, *obj, errp)) {
1673            goto out_obj;
1674        }
1675        ok = visit_check_struct(v, errp);
1676    out_obj:
1677        visit_end_struct(v, (void **)obj);
1678        if (!ok && visit_is_input(v)) {
1679            qapi_free_UserDefOne(*obj);
1680            *obj = NULL;
1681        }
1682        return ok;
1683    }
1684
1685    bool visit_type_UserDefOneList(Visitor *v, const char *name,
1686                     UserDefOneList **obj, Error **errp)
1687    {
1688        bool ok = false;
1689        UserDefOneList *tail;
1690        size_t size = sizeof(**obj);
1691
1692        if (!visit_start_list(v, name, (GenericList **)obj, size, errp)) {
1693            return false;
1694        }
1695
1696        for (tail = *obj; tail;
1697             tail = (UserDefOneList *)visit_next_list(v, (GenericList *)tail, size)) {
1698            if (!visit_type_UserDefOne(v, NULL, &tail->value, errp)) {
1699                goto out_obj;
1700            }
1701        }
1702
1703        ok = visit_check_list(v, errp);
1704    out_obj:
1705        visit_end_list(v, (void **)obj);
1706        if (!ok && visit_is_input(v)) {
1707            qapi_free_UserDefOneList(*obj);
1708            *obj = NULL;
1709        }
1710        return ok;
1711    }
1712
1713    bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp)
1714    {
1715        if (!visit_type_UserDefOneList(v, "arg1", &obj->arg1, errp)) {
1716            return false;
1717        }
1718        return true;
1719    }
1720
1721    [Uninteresting stuff omitted...]
1722
1723For a modular QAPI schema (see section `Include directives`_), code for
1724each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1725
1726 SUBDIR/$(prefix)qapi-visit-SUBMODULE.h
1727 SUBDIR/$(prefix)qapi-visit-SUBMODULE.c
1728
1729If qapi-gen.py is run with option --builtins, additional files are
1730created:
1731
1732 ``qapi-builtin-visit.h``
1733     Visitor functions for built-in types
1734
1735 ``qapi-builtin-visit.c``
1736     Declarations for these visitor functions
1737
1738
1739Code generated for commands
1740---------------------------
1741
1742These are the marshaling/dispatch functions for the commands defined
1743in the schema.  The generated code provides qmp_marshal_COMMAND(), and
1744declares qmp_COMMAND() that the user must implement.
1745
1746The following files are generated:
1747
1748 ``$(prefix)qapi-commands.c``
1749     Command marshal/dispatch functions for each QMP command defined in
1750     the schema
1751
1752 ``$(prefix)qapi-commands.h``
1753     Function prototypes for the QMP commands specified in the schema
1754
1755 ``$(prefix)qapi-commands.trace-events``
1756     Trace event declarations, see :ref:`tracing`.
1757
1758 ``$(prefix)qapi-init-commands.h``
1759     Command initialization prototype
1760
1761 ``$(prefix)qapi-init-commands.c``
1762     Command initialization code
1763
1764Example::
1765
1766    $ cat qapi-generated/example-qapi-commands.h
1767    [Uninteresting stuff omitted...]
1768
1769    #ifndef EXAMPLE_QAPI_COMMANDS_H
1770    #define EXAMPLE_QAPI_COMMANDS_H
1771
1772    #include "example-qapi-types.h"
1773
1774    UserDefOne *qmp_my_command(UserDefOneList *arg1, Error **errp);
1775    void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp);
1776
1777    #endif /* EXAMPLE_QAPI_COMMANDS_H */
1778
1779    $ cat qapi-generated/example-qapi-commands.trace-events
1780    # AUTOMATICALLY GENERATED, DO NOT MODIFY
1781
1782    qmp_enter_my_command(const char *json) "%s"
1783    qmp_exit_my_command(const char *result, bool succeeded) "%s %d"
1784
1785    $ cat qapi-generated/example-qapi-commands.c
1786    [Uninteresting stuff omitted...]
1787
1788    static void qmp_marshal_output_UserDefOne(UserDefOne *ret_in,
1789                                    QObject **ret_out, Error **errp)
1790    {
1791        Visitor *v;
1792
1793        v = qobject_output_visitor_new_qmp(ret_out);
1794        if (visit_type_UserDefOne(v, "unused", &ret_in, errp)) {
1795            visit_complete(v, ret_out);
1796        }
1797        visit_free(v);
1798        v = qapi_dealloc_visitor_new();
1799        visit_type_UserDefOne(v, "unused", &ret_in, NULL);
1800        visit_free(v);
1801    }
1802
1803    void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp)
1804    {
1805        Error *err = NULL;
1806        bool ok = false;
1807        Visitor *v;
1808        UserDefOne *retval;
1809        q_obj_my_command_arg arg = {0};
1810
1811        v = qobject_input_visitor_new_qmp(QOBJECT(args));
1812        if (!visit_start_struct(v, NULL, NULL, 0, errp)) {
1813            goto out;
1814        }
1815        if (visit_type_q_obj_my_command_arg_members(v, &arg, errp)) {
1816            ok = visit_check_struct(v, errp);
1817        }
1818        visit_end_struct(v, NULL);
1819        if (!ok) {
1820            goto out;
1821        }
1822
1823        if (trace_event_get_state_backends(TRACE_QMP_ENTER_MY_COMMAND)) {
1824            g_autoptr(GString) req_json = qobject_to_json(QOBJECT(args));
1825
1826            trace_qmp_enter_my_command(req_json->str);
1827        }
1828
1829        retval = qmp_my_command(arg.arg1, &err);
1830        if (err) {
1831            trace_qmp_exit_my_command(error_get_pretty(err), false);
1832            error_propagate(errp, err);
1833            goto out;
1834        }
1835
1836        qmp_marshal_output_UserDefOne(retval, ret, errp);
1837
1838        if (trace_event_get_state_backends(TRACE_QMP_EXIT_MY_COMMAND)) {
1839            g_autoptr(GString) ret_json = qobject_to_json(*ret);
1840
1841            trace_qmp_exit_my_command(ret_json->str, true);
1842        }
1843
1844    out:
1845        visit_free(v);
1846        v = qapi_dealloc_visitor_new();
1847        visit_start_struct(v, NULL, NULL, 0, NULL);
1848        visit_type_q_obj_my_command_arg_members(v, &arg, NULL);
1849        visit_end_struct(v, NULL);
1850        visit_free(v);
1851    }
1852
1853    [Uninteresting stuff omitted...]
1854    $ cat qapi-generated/example-qapi-init-commands.h
1855    [Uninteresting stuff omitted...]
1856    #ifndef EXAMPLE_QAPI_INIT_COMMANDS_H
1857    #define EXAMPLE_QAPI_INIT_COMMANDS_H
1858
1859    #include "qapi/qmp-registry.h"
1860
1861    void example_qmp_init_marshal(QmpCommandList *cmds);
1862
1863    #endif /* EXAMPLE_QAPI_INIT_COMMANDS_H */
1864    $ cat qapi-generated/example-qapi-init-commands.c
1865    [Uninteresting stuff omitted...]
1866    void example_qmp_init_marshal(QmpCommandList *cmds)
1867    {
1868        QTAILQ_INIT(cmds);
1869
1870        qmp_register_command(cmds, "my-command",
1871                             qmp_marshal_my_command, 0, 0);
1872    }
1873    [Uninteresting stuff omitted...]
1874
1875For a modular QAPI schema (see section `Include directives`_), code for
1876each sub-module SUBDIR/SUBMODULE.json is actually generated into::
1877
1878 SUBDIR/$(prefix)qapi-commands-SUBMODULE.h
1879 SUBDIR/$(prefix)qapi-commands-SUBMODULE.c
1880
1881
1882Code generated for events
1883-------------------------
1884
1885This is the code related to events defined in the schema, providing
1886qapi_event_send_EVENT().
1887
1888The following files are created:
1889
1890 ``$(prefix)qapi-events.h``
1891     Function prototypes for each event type
1892
1893 ``$(prefix)qapi-events.c``
1894     Implementation of functions to send an event
1895
1896 ``$(prefix)qapi-emit-events.h``
1897     Enumeration of all event names, and common event code declarations
1898
1899 ``$(prefix)qapi-emit-events.c``
1900     Common event code definitions
1901
1902Example::
1903
1904    $ cat qapi-generated/example-qapi-events.h
1905    [Uninteresting stuff omitted...]
1906
1907    #ifndef EXAMPLE_QAPI_EVENTS_H
1908    #define EXAMPLE_QAPI_EVENTS_H
1909
1910    #include "qapi/util.h"
1911    #include "example-qapi-types.h"
1912
1913    void qapi_event_send_my_event(void);
1914
1915    #endif /* EXAMPLE_QAPI_EVENTS_H */
1916    $ cat qapi-generated/example-qapi-events.c
1917    [Uninteresting stuff omitted...]
1918
1919    void qapi_event_send_my_event(void)
1920    {
1921        QDict *qmp;
1922
1923        qmp = qmp_event_build_dict("MY_EVENT");
1924
1925        example_qapi_event_emit(EXAMPLE_QAPI_EVENT_MY_EVENT, qmp);
1926
1927        qobject_unref(qmp);
1928    }
1929
1930    [Uninteresting stuff omitted...]
1931    $ cat qapi-generated/example-qapi-emit-events.h
1932    [Uninteresting stuff omitted...]
1933
1934    #ifndef EXAMPLE_QAPI_EMIT_EVENTS_H
1935    #define EXAMPLE_QAPI_EMIT_EVENTS_H
1936
1937    #include "qapi/util.h"
1938
1939    typedef enum example_QAPIEvent {
1940        EXAMPLE_QAPI_EVENT_MY_EVENT,
1941        EXAMPLE_QAPI_EVENT__MAX,
1942    } example_QAPIEvent;
1943
1944    #define example_QAPIEvent_str(val) \
1945        qapi_enum_lookup(&example_QAPIEvent_lookup, (val))
1946
1947    extern const QEnumLookup example_QAPIEvent_lookup;
1948
1949    void example_qapi_event_emit(example_QAPIEvent event, QDict *qdict);
1950
1951    #endif /* EXAMPLE_QAPI_EMIT_EVENTS_H */
1952    $ cat qapi-generated/example-qapi-emit-events.c
1953    [Uninteresting stuff omitted...]
1954
1955    const QEnumLookup example_QAPIEvent_lookup = {
1956        .array = (const char *const[]) {
1957            [EXAMPLE_QAPI_EVENT_MY_EVENT] = "MY_EVENT",
1958        },
1959        .size = EXAMPLE_QAPI_EVENT__MAX
1960    };
1961
1962    [Uninteresting stuff omitted...]
1963
1964For a modular QAPI schema (see section `Include directives`_), code for
1965each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1966
1967 SUBDIR/$(prefix)qapi-events-SUBMODULE.h
1968 SUBDIR/$(prefix)qapi-events-SUBMODULE.c
1969
1970
1971Code generated for introspection
1972--------------------------------
1973
1974The following files are created:
1975
1976 ``$(prefix)qapi-introspect.c``
1977     Defines a string holding a JSON description of the schema
1978
1979 ``$(prefix)qapi-introspect.h``
1980     Declares the above string
1981
1982Example::
1983
1984    $ cat qapi-generated/example-qapi-introspect.h
1985    [Uninteresting stuff omitted...]
1986
1987    #ifndef EXAMPLE_QAPI_INTROSPECT_H
1988    #define EXAMPLE_QAPI_INTROSPECT_H
1989
1990    #include "qobject/qlit.h"
1991
1992    extern const QLitObject example_qmp_schema_qlit;
1993
1994    #endif /* EXAMPLE_QAPI_INTROSPECT_H */
1995    $ cat qapi-generated/example-qapi-introspect.c
1996    [Uninteresting stuff omitted...]
1997
1998    const QLitObject example_qmp_schema_qlit = QLIT_QLIST(((QLitObject[]) {
1999        QLIT_QDICT(((QLitDictEntry[]) {
2000            { "arg-type", QLIT_QSTR("0"), },
2001            { "meta-type", QLIT_QSTR("command"), },
2002            { "name", QLIT_QSTR("my-command"), },
2003            { "ret-type", QLIT_QSTR("1"), },
2004            {}
2005        })),
2006        QLIT_QDICT(((QLitDictEntry[]) {
2007            { "arg-type", QLIT_QSTR("2"), },
2008            { "meta-type", QLIT_QSTR("event"), },
2009            { "name", QLIT_QSTR("MY_EVENT"), },
2010            {}
2011        })),
2012        /* "0" = q_obj_my-command-arg */
2013        QLIT_QDICT(((QLitDictEntry[]) {
2014            { "members", QLIT_QLIST(((QLitObject[]) {
2015                QLIT_QDICT(((QLitDictEntry[]) {
2016                    { "name", QLIT_QSTR("arg1"), },
2017                    { "type", QLIT_QSTR("[1]"), },
2018                    {}
2019                })),
2020                {}
2021            })), },
2022            { "meta-type", QLIT_QSTR("object"), },
2023            { "name", QLIT_QSTR("0"), },
2024            {}
2025        })),
2026        /* "1" = UserDefOne */
2027        QLIT_QDICT(((QLitDictEntry[]) {
2028            { "members", QLIT_QLIST(((QLitObject[]) {
2029                QLIT_QDICT(((QLitDictEntry[]) {
2030                    { "name", QLIT_QSTR("integer"), },
2031                    { "type", QLIT_QSTR("int"), },
2032                    {}
2033                })),
2034                QLIT_QDICT(((QLitDictEntry[]) {
2035                    { "default", QLIT_QNULL, },
2036                    { "name", QLIT_QSTR("string"), },
2037                    { "type", QLIT_QSTR("str"), },
2038                    {}
2039                })),
2040                QLIT_QDICT(((QLitDictEntry[]) {
2041                    { "default", QLIT_QNULL, },
2042                    { "name", QLIT_QSTR("flag"), },
2043                    { "type", QLIT_QSTR("bool"), },
2044                    {}
2045                })),
2046                {}
2047            })), },
2048            { "meta-type", QLIT_QSTR("object"), },
2049            { "name", QLIT_QSTR("1"), },
2050            {}
2051        })),
2052        /* "2" = q_empty */
2053        QLIT_QDICT(((QLitDictEntry[]) {
2054            { "members", QLIT_QLIST(((QLitObject[]) {
2055                {}
2056            })), },
2057            { "meta-type", QLIT_QSTR("object"), },
2058            { "name", QLIT_QSTR("2"), },
2059            {}
2060        })),
2061        QLIT_QDICT(((QLitDictEntry[]) {
2062            { "element-type", QLIT_QSTR("1"), },
2063            { "meta-type", QLIT_QSTR("array"), },
2064            { "name", QLIT_QSTR("[1]"), },
2065            {}
2066        })),
2067        QLIT_QDICT(((QLitDictEntry[]) {
2068            { "json-type", QLIT_QSTR("int"), },
2069            { "meta-type", QLIT_QSTR("builtin"), },
2070            { "name", QLIT_QSTR("int"), },
2071            {}
2072        })),
2073        QLIT_QDICT(((QLitDictEntry[]) {
2074            { "json-type", QLIT_QSTR("string"), },
2075            { "meta-type", QLIT_QSTR("builtin"), },
2076            { "name", QLIT_QSTR("str"), },
2077            {}
2078        })),
2079        QLIT_QDICT(((QLitDictEntry[]) {
2080            { "json-type", QLIT_QSTR("boolean"), },
2081            { "meta-type", QLIT_QSTR("builtin"), },
2082            { "name", QLIT_QSTR("bool"), },
2083            {}
2084        })),
2085        {}
2086    }));
2087
2088    [Uninteresting stuff omitted...]
2089