We are happy to announce that our Head of Business Development Peter Kristiansen will speak at InCabin Brussels Thursday 22nd June at 10:05am!

 

Bringing the community together

InCabin is far more than a conference, it is a unique community of OEM, Tier 1 and supply chain engineers working on safety, comfort and productivity solutions for current and future in-cabin applications.

InCabin in an environment like no other, enabling engineers and experts in the automotive interior industry to connect, share, and take strides in developing the latest technology.

Get your tickets here 

We look forward to seeing you in Brussels!

 

IMG_5108

Peter Kristiansen is Head of Business Development at Embedl and has the privilege of working with finding business opportunities in a deep-tech environment. He has experience from the Automotive software industry from his work in introducing 2nd gen. Driver Monitoring Systems to Tier1s and OEMs in Europe, Americas, and Asia as well as autonomous systems, neural networks, and robotics from his studies. Apart from work Peter likes snowboarding and hiking.

 

Abstract:

Agile DL development - How often can you iterate on a DL model design?

The automotive industry comes with a history of long development cycles. There is a large difference in the time from sourcing and SoD, to SoP compared with product development cycles in other industries. As an example, the smartphone industry just stretched their commitment to 4 years of SW updates for phones and that is for SoCs that are brand new when the phone is launched.

In a young and rapidly moving field such as Machine Learning where there are more than 100 new papers published every day1 there is little room for legacy “solutions”. Models and architectures get outdated fast and new breakthroughs can be found every 6 months. When ML applications were introduced in cars these two worlds collided. To allow AI engineers to be able to build state-of-the-art products they cannot be stuck with a toolchain that was decided when the project was sourced or a model architecture that takes months to update and deploy on the target HW.

To be able to stay in the forefront of development you will need to be agile and open to new architectures, methods and follow the development of the tools and compilers. Data may be the raw material that make up DL applications, but that material needs to be shaped and handled in the right way to shape a competitive product.

To find an optimal model architecture for a particular task such as segmentation or object classification, requires that multiple parameters are considered. Except for the more obvious requirement on performance and the size of the input, there are other parameters to consider such as amount of data available for training and what is supported by the toolchain you are using. But most important, the HW you are going to deploy the model on. There is a huge difference between how well different processors and accelerators handle certain operations. 

With state-of-the-art models increasing in size so does the cost of training the models. To find the correct architecture in a traditional way a lot of trial and error is required. Typically, a DL engineer uses a known model architecture as a starting point and then tries to modify it to only contain operators that are supported by the hardware. The model also needs to be modified in order to fit the available compute on the SoC. To know the true outcome of each experiment with the architecture there is a need to train and then evaluate the model. Training the complex models used today takes time and is expensive. Hence there is a lot to gain by replacing the trial-and-error approach.

To get a more agile workflow:

  • Reduce the deployment effort for your model.
    • Training and deployment loop < 24h
  • Approximate and simulate accuracy and latency.
    • Experiment without running the full loop.
  • The HW toolchain should be updated throughout the project.
    • Adding support for new operators.
  • Minimise effort required to update the model architecture.
    • It should be possible to adjust the architecture biweekly.


 “A New Golden Age in Computer Architecture: Empowering the Machine-Learning Revolution”
Jeff Dean, David Patterson, and Cliff Young

 

 

You may also like

THE TECH ARENA 2024
THE TECH ARENA 2024
12 February, 2024

We are thrilled to announce that Embedl has been selected as a finalist for the prestigious Pitch40 competition at The T...

tinyML EMEA Innovation Forum
tinyML EMEA Innovation Forum
19 April, 2023

The tinyML EMEA Innovation Forum is accelerating the adoption of tiny machine learning across the region by connecting t...

ICA Summit 2023
ICA Summit 2023
20 March, 2023

ICA Summit will take place May 15th–16th in Frankfurt, Germany and Embedl will be a part of the Startup hour May 16th at...