mirror of
https://github.com/torvalds/linux.git
synced 2024-11-22 12:11:40 +00:00
7594bb08fb
Hannes reported a problem with setting up dma transfers on a mcb device. The problem boiled down to the use of a wrong 'device' for the dma functions. Document how to setup dma transfers for a IP core on a mcb carrier. Reported-by: Hannes Duerr <Hannes.Duerr@duagon.com> Signed-off-by: Johannes Thumshirn <johannes.thumshirn@wdc.com> Link: https://lore.kernel.org/r/3bdc8f76b30c2b0e2a2bfab06c2e73797ddc9384.1608305690.git.johannes.thumshirn@wdc.com Signed-off-by: Jonathan Corbet <corbet@lwn.net>
188 lines
6.1 KiB
ReStructuredText
188 lines
6.1 KiB
ReStructuredText
=================
|
|
MEN Chameleon Bus
|
|
=================
|
|
|
|
.. Table of Contents
|
|
=================
|
|
1 Introduction
|
|
1.1 Scope of this Document
|
|
1.2 Limitations of the current implementation
|
|
2 Architecture
|
|
2.1 MEN Chameleon Bus
|
|
2.2 Carrier Devices
|
|
2.3 Parser
|
|
3 Resource handling
|
|
3.1 Memory Resources
|
|
3.2 IRQs
|
|
4 Writing an MCB driver
|
|
4.1 The driver structure
|
|
4.2 Probing and attaching
|
|
4.3 Initializing the driver
|
|
4.4 Using DMA
|
|
|
|
|
|
Introduction
|
|
============
|
|
|
|
This document describes the architecture and implementation of the MEN
|
|
Chameleon Bus (called MCB throughout this document).
|
|
|
|
Scope of this Document
|
|
----------------------
|
|
|
|
This document is intended to be a short overview of the current
|
|
implementation and does by no means describe the complete possibilities of MCB
|
|
based devices.
|
|
|
|
Limitations of the current implementation
|
|
-----------------------------------------
|
|
|
|
The current implementation is limited to PCI and PCIe based carrier devices
|
|
that only use a single memory resource and share the PCI legacy IRQ. Not
|
|
implemented are:
|
|
|
|
- Multi-resource MCB devices like the VME Controller or M-Module carrier.
|
|
- MCB devices that need another MCB device, like SRAM for a DMA Controller's
|
|
buffer descriptors or a video controller's video memory.
|
|
- A per-carrier IRQ domain for carrier devices that have one (or more) IRQs
|
|
per MCB device like PCIe based carriers with MSI or MSI-X support.
|
|
|
|
Architecture
|
|
============
|
|
|
|
MCB is divided into 3 functional blocks:
|
|
|
|
- The MEN Chameleon Bus itself,
|
|
- drivers for MCB Carrier Devices and
|
|
- the parser for the Chameleon table.
|
|
|
|
MEN Chameleon Bus
|
|
-----------------
|
|
|
|
The MEN Chameleon Bus is an artificial bus system that attaches to a so
|
|
called Chameleon FPGA device found on some hardware produced my MEN Mikro
|
|
Elektronik GmbH. These devices are multi-function devices implemented in a
|
|
single FPGA and usually attached via some sort of PCI or PCIe link. Each
|
|
FPGA contains a header section describing the content of the FPGA. The
|
|
header lists the device id, PCI BAR, offset from the beginning of the PCI
|
|
BAR, size in the FPGA, interrupt number and some other properties currently
|
|
not handled by the MCB implementation.
|
|
|
|
Carrier Devices
|
|
---------------
|
|
|
|
A carrier device is just an abstraction for the real world physical bus the
|
|
Chameleon FPGA is attached to. Some IP Core drivers may need to interact with
|
|
properties of the carrier device (like querying the IRQ number of a PCI
|
|
device). To provide abstraction from the real hardware bus, an MCB carrier
|
|
device provides callback methods to translate the driver's MCB function calls
|
|
to hardware related function calls. For example a carrier device may
|
|
implement the get_irq() method which can be translated into a hardware bus
|
|
query for the IRQ number the device should use.
|
|
|
|
Parser
|
|
------
|
|
|
|
The parser reads the first 512 bytes of a Chameleon device and parses the
|
|
Chameleon table. Currently the parser only supports the Chameleon v2 variant
|
|
of the Chameleon table but can easily be adopted to support an older or
|
|
possible future variant. While parsing the table's entries new MCB devices
|
|
are allocated and their resources are assigned according to the resource
|
|
assignment in the Chameleon table. After resource assignment is finished, the
|
|
MCB devices are registered at the MCB and thus at the driver core of the
|
|
Linux kernel.
|
|
|
|
Resource handling
|
|
=================
|
|
|
|
The current implementation assigns exactly one memory and one IRQ resource
|
|
per MCB device. But this is likely going to change in the future.
|
|
|
|
Memory Resources
|
|
----------------
|
|
|
|
Each MCB device has exactly one memory resource, which can be requested from
|
|
the MCB bus. This memory resource is the physical address of the MCB device
|
|
inside the carrier and is intended to be passed to ioremap() and friends. It
|
|
is already requested from the kernel by calling request_mem_region().
|
|
|
|
IRQs
|
|
----
|
|
|
|
Each MCB device has exactly one IRQ resource, which can be requested from the
|
|
MCB bus. If a carrier device driver implements the ->get_irq() callback
|
|
method, the IRQ number assigned by the carrier device will be returned,
|
|
otherwise the IRQ number inside the Chameleon table will be returned. This
|
|
number is suitable to be passed to request_irq().
|
|
|
|
Writing an MCB driver
|
|
=====================
|
|
|
|
The driver structure
|
|
--------------------
|
|
|
|
Each MCB driver has a structure to identify the device driver as well as
|
|
device ids which identify the IP Core inside the FPGA. The driver structure
|
|
also contains callback methods which get executed on driver probe and
|
|
removal from the system::
|
|
|
|
static const struct mcb_device_id foo_ids[] = {
|
|
{ .device = 0x123 },
|
|
{ }
|
|
};
|
|
MODULE_DEVICE_TABLE(mcb, foo_ids);
|
|
|
|
static struct mcb_driver foo_driver = {
|
|
driver = {
|
|
.name = "foo-bar",
|
|
.owner = THIS_MODULE,
|
|
},
|
|
.probe = foo_probe,
|
|
.remove = foo_remove,
|
|
.id_table = foo_ids,
|
|
};
|
|
|
|
Probing and attaching
|
|
---------------------
|
|
|
|
When a driver is loaded and the MCB devices it services are found, the MCB
|
|
core will call the driver's probe callback method. When the driver is removed
|
|
from the system, the MCB core will call the driver's remove callback method::
|
|
|
|
static init foo_probe(struct mcb_device *mdev, const struct mcb_device_id *id);
|
|
static void foo_remove(struct mcb_device *mdev);
|
|
|
|
Initializing the driver
|
|
-----------------------
|
|
|
|
When the kernel is booted or your foo driver module is inserted, you have to
|
|
perform driver initialization. Usually it is enough to register your driver
|
|
module at the MCB core::
|
|
|
|
static int __init foo_init(void)
|
|
{
|
|
return mcb_register_driver(&foo_driver);
|
|
}
|
|
module_init(foo_init);
|
|
|
|
static void __exit foo_exit(void)
|
|
{
|
|
mcb_unregister_driver(&foo_driver);
|
|
}
|
|
module_exit(foo_exit);
|
|
|
|
The module_mcb_driver() macro can be used to reduce the above code::
|
|
|
|
module_mcb_driver(foo_driver);
|
|
|
|
Using DMA
|
|
---------
|
|
|
|
To make use of the kernel's DMA-API's function, you will need to use the
|
|
carrier device's 'struct device'. Fortunately 'struct mcb_device' embeds a
|
|
pointer (->dma_dev) to the carrier's device for DMA purposes::
|
|
|
|
ret = dma_set_mask_and_coherent(&mdev->dma_dev, DMA_BIT_MASK(dma_bits));
|
|
if (rc)
|
|
/* Handle errors */
|