Implement AI on Any Hardware With AIfES

Machine Learning for Embedded Systems with AIfES®

With the open source AI software framework AIfES (Artificial Intelligence for Embedded Systems) you can run and even train artificial neural networks (ANN) on virtually any hardware. Tiny embedded systems plus artificial intelligence (AI) - the topic of our time. 

 

Open Source AI Framework

The first open source AI framework "Made in Germany", developed as a Maker project at the Fraunhofer Institute for Microelectronic Circuits and Systems IMS. AIfES® is comparable and compatible with well-known Python ML frameworks like TensorFlow, Keras or PyTorch. In the current version, Feedforward Neural Networks (FNN) are supported, which can be configured completely freely. Common activation functions such as ReLU, Sigmoid or Softmax are also already integrated. A full implementation of Convolutional Neural Networks (ConvNet) will follow in the near future.

 

Tiny ML

AIfES® can be used on almost any system, be it a microcontroller, IoT device, Raspberry PI, PC or smartphone, making the purchase of new hardware redundant. However, the focus is particularly on running AI on simple microcontrollers and small IoT devices, so-called »tinyML«. Tiny, self-learning, battery-powered devices can process sensor data where it occurs, independent of a cloud or other devices. The data is stored on the device and processing takes place without transmission delay, with significantly lower energy consumption compared to a PC.

Artificial Intelligence for Embedded Systems
© Fraunhofer IMS
Logo AIfES
© Wokwi
Arduino Mega Demonstrator über Wokwi

AIfES® for Arduino®

A version compatible with the Arduino® IDE of AIfES® has been realized, which can be run on almost any Arduino board.


Benchmark

AIfES was specifically designed to overcome the challenges of traditional Edge AI. The AI software framework from Fraunhofer IMS enables the integration of machine learning into the smallest embedded devices. This allows the highest flexibility in hardware selection and the integration of customized hardware accelerators.

In the paper  »AIfES: A Next-Generation Edge AI Framework«, we present the Artificial Intelligence for Embedded Systems (AIfES) framework and compare it with conventional Edge AI. The results were compared with TensorFlow Lite for Microcontrollers (TFLM) on an ARM Cortex-M4-based system-on-chip (SoC) and show the following:

  • AIfES scores in execution time and memory consumption for fully connected neural networks (FNNs). 
  • AIfES reduces memory consumption by up to 54% when using convolutional neural networks (CNNs). 
  • AIfES can efficiently train CNNs even on resource-constrained devices with just over 100 kB of RAM. 

Climate protection

The project supports the UN sustainability goal of climate action in industry. Through efficient algorithms and energy saving hardware, AIfES enables to drastically reduce CO2 emissions compared to Deep Learning on high-performance computers.

Decentralized AI

AIfES enables decentralization of computing power, for example, by allowing small intelligent embedded systems to take over the data before processing it without transmission delay and provide the results to a higher-level system. This significantly reduces the amount of data to be transmitted. In addition, a network of small adaptive systems that divide tasks among themselves is also possible. A decentralized architecture allows for increased reliability and personalization.

Privacy

Since processing can take place offline on the device, no sensitive data needs to be transferred.

 

News are regularly communicated on the AIfES LinkedIn channel. New demonstrators and AIfES at trade fairs and events are also presented on Youtube.

Privacy warning

With the click on the play button an external video from www.youtube.com is loaded and started. Your data is possible transferred and stored to third party. Do not start the video if you disagree. Find more about the youtube privacy statement under the following link: https://policies.google.com/privacy

Embedded World 2020 – Gesture Recognition Demonstrator

 

Frequently Asked Questions to AIfES:

Questions and Answers

What devices does AIfES run on?

AIfES® can be used on almost any system, whether it's a microcontroller, IoT device, Raspberry PI, PC or smartphone. So you do not need to invest in new hardware and instead you can get started right away.

How can I install AIfES?

AIfES® can be downloaded and installed by searching for "aifes" in the Arduino® Library Manager. Alternatively, a manual download is also possible. Download the AIfES repository as a ZIP archive and follow the instructions. All information can be found on our GitHub.

For which ML problems is AIfES suitable?

Generally, for any machine learning problem that can be solved with complex neural networks.

Still need inspiration? Our demonstrators can help: gesture recognition, recognition of colors and objects, or an interactive tic-tac-toe-game.

To what extent can the architecture be adapted?

AIfES® was developed as a flexible and extensible toolbox for the operation and training of artificial neural networks on microcontrollers. All layer, loss and optimization functions are modular and can be optimized for different data types and hardware platforms.Currently complex neural network types for inference and training are supported.

Why is TinyML so exciting?

According to the TinyML Foundation's definition, Tiny Machine Learning (TinyML) is a rapidly growing field of machine learning technologies and applications. It encompasses hardware, algorithms, and software capable of analyzing sensor data on the sensor node at extremely low power (typically in the mW range and below), enabling a variety of applications even on battery-powered devices. Rapid progress is being made. For example, significant advances have been achieved in algorithms, networks, and models with a size of 100 kB and less, and the first low-power applications have been developed in the areas of image processing and audio. AIFES® is a pioneer and enables data processing on embedded systems. This allows data to be stored on microcontrollers and small IoT devices and processing to be performed without transmission delay. For more on TinyML, see the TinyML Foundation website.

Flyers & Demonstrators

To show what is possible with AIfES®, we at Fraunhofer IMS develop demonstrators at regular intervals with which we try to realize and present our ideas to you.

 
 

Cooperation & contact

Get in contact with the AIfES® team

Federated learning for resource-constrained systems

SEC-Learn

Recognition of humans by means of embedded AI

NoKat

Personalizable AI

Individually trainable gesture recognition

Our fields of application - Our expertise for you

Sustainable Production

  • Optimization of raw material and energy use
  • Use of alternative energy sources and energy-autonomous sensors
  • Green ICT

Mobile autonomous Manufacturing

  • Sensors / Control for Robots / Cobots
  • Industrial transport systems (AGV)
  • Human-Machine Interaction

Industrial-AI

  •  Decentralized AI systems and platforms
  • Sensor/actuator optimization and cost efficiency through local AI.
  • Pattern recognition methods

Trustworthy Electronics

  • Protection against product piracy / Counterfeit-proof labeling
  • Tamper-proof and fail-safe electronics
  • Trustworthy supply chains
 

Industry (Home)

Click here to return to the overview page of the Industry business unit.