Hi Ruchika,
as an addition to the previous answers, there is also the SecureMark-TLS benchmark from EEMBC that "Analyzes the costs associated with implementing TLS on an edge device using a common IoT cyphersuite comprised of ECC & ECDSA on the NIST secp256r1 curve, SHA256, and AES128-CCM/ECB", see: https://www.eembc.org/securemark/ It provides profiles to run benchmarks against Mbed TLS API, PSA Crypto API, and wolfSSL, see sources here: https://github.com/eembc/securemark-tls/tree/main/examples/selfhosted/profil... The chosen cipher-suite is similar to the TF-M medium profile and it allows estimates of speed and power consumption for TLS on microcontrollers. It also allows to add - manually - footprint data.
Best Stephan
From: Ruchika Gupta via psa-crypto psa-crypto@lists.trustedfirmware.org Reply to: Ruchika Gupta ruchika.gupta_1@nxp.com Date: Tuesday, 16 May 2023 at 13:40 To: "mbed-tls@lists.trustedfirmware.org" mbed-tls@lists.trustedfirmware.org, "psa-crypto@lists.trustedfirmware.org" psa-crypto@lists.trustedfirmware.org Subject: [psa-crypto] Benchmark application for PSA crypto API's
Hi,
For mbedtls API’s, there is a benchmark application available. Are there any plans to implement benchmark application for PSA crypto APIs ?
Regards, Ruchika
Hello,
The source code is distributed under "EEMBC Benchmark License Agreements"
EEMBC Benchmark License Agreements are contracts that allow qualified college and university faculty members and their research teams to use the EEMBC benchmarks for processor/compiler and system research under an academically-oriented fee structure(eembc.org). EEMBC stands for Embedded Microprocessor Benchmark Consortium, a nonprofit organization that develops industry-standard benchmarks for the hardware and software used in various applications(eembc.org). EEMBC Benchmark License Agreements require the licensees to maintain the confidentiality and applicability of the EEMBC code and to provide feedback and contributions to the consortium(eembc.org)(github.com).
It is not clear if we may port and distribute this benchmark project independently to everybody as part of our SDK. Any clarification?
Thank you,
Andrej Butok
From: Stephan Koch via mbed-tls mbed-tls@lists.trustedfirmware.org Sent: Tuesday, May 16, 2023 5:46 PM To: Ruchika Gupta ruchika.gupta_1@nxp.com; psa-crypto@lists.trustedfirmware.org; mbed-tls@lists.trustedfirmware.org Subject: [mbed-tls] Re: [psa-crypto] Benchmark application for PSA crypto API's
Hi Ruchika,
as an addition to the previous answers, there is also the SecureMark-TLS benchmark from EEMBC that "Analyzes the costs associated with implementing TLS on an edge device using a common IoT cyphersuite comprised of ECC & ECDSA on the NIST secp256r1 curve, SHA256, and AES128-CCM/ECB", see: https://www.eembc.org/securemark/ https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.eembc .org%2Fsecuremark%2F&data=05%7C01%7Candrey.butok%40nxp.com%7C8555015851cb4c6 9178208db5624b42d%7C686ea1d3bc2b4c6fa92cd99c5c301635%7C0%7C0%7C6381984878626 91396%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik 1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=e%2B25vB1CBB5PCVnUaeeH4vH5IJ73zyy 8TyKv%2B9Joxck%3D&reserved=0
It provides profiles to run benchmarks against Mbed TLS API, PSA Crypto API, and wolfSSL, see sources here: https://github.com/eembc/securemark-tls/tree/main/examples/selfhosted/profil e https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.co m%2Feembc%2Fsecuremark-tls%2Ftree%2Fmain%2Fexamples%2Fselfhosted%2Fprofile&d ata=05%7C01%7Candrey.butok%40nxp.com%7C8555015851cb4c69178208db5624b42d%7C68 6ea1d3bc2b4c6fa92cd99c5c301635%7C0%7C0%7C638198487862691396%7CUnknown%7CTWFp bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7 C3000%7C%7C%7C&sdata=dn%2FQk7M6D4wpqbtSSr8KHC%2FFWereDbRBvKV9bkdKR1Q%3D&rese rved=0
The chosen cipher-suite is similar to the TF-M medium profile and it allows estimates of speed and power consumption for TLS on microcontrollers. It also allows to add - manually - footprint data.
Best
Stephan
From: Ruchika Gupta via psa-crypto <psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org > Reply to: Ruchika Gupta <ruchika.gupta_1@nxp.com mailto:ruchika.gupta_1@nxp.com > Date: Tuesday, 16 May 2023 at 13:40 To: "mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org " <mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org >, "psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org " <psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org > Subject: [psa-crypto] Benchmark application for PSA crypto API's
Hi,
For mbedtls API's, there is a benchmark application available. Are there any plans to implement benchmark application for PSA crypto APIs ?
Regards,
Ruchika
Hi Andrej,
While we contributed code to run SecureMark-TLS against the PSA Crypto API, we are not affiliated with EEMBC. EEMBC attached an Apache-2.0 license with an extension called "Acceptable Use Agreement", see their README at https://github.com/eembc/securemark-tls/tree/main#licensing and their license at: https://github.com/eembc/securemark-tls/blob/main/LICENSE.md Maybe this helps.
Best Stephan
From: Andrej Butok andrey.butok@nxp.com Date: Wednesday, 17 May 2023 at 12:12 To: Stephan Koch koch@oberon.ch, Ruchika Gupta ruchika.gupta_1@nxp.com, psa-crypto@lists.trustedfirmware.org psa-crypto@lists.trustedfirmware.org, mbed-tls@lists.trustedfirmware.org mbed-tls@lists.trustedfirmware.org Subject: RE: [psa-crypto] Benchmark application for PSA crypto API's Hello,
The source code is distributed under “EEMBC Benchmark License Agreements” EEMBC Benchmark License Agreements are contracts that allow qualified college and university faculty members and their research teams to use the EEMBC benchmarks for processor/compiler and system research under an academically-oriented fee structure(eembc.org). EEMBC stands for Embedded Microprocessor Benchmark Consortium, a nonprofit organization that develops industry-standard benchmarks for the hardware and software used in various applications(eembc.org). EEMBC Benchmark License Agreements require the licensees to maintain the confidentiality and applicability of the EEMBC code and to provide feedback and contributions to the consortium(eembc.org)(github.com).
It is not clear if we may port and distribute this benchmark project independently to everybody as part of our SDK. Any clarification?
Thank you, Andrej Butok
From: Stephan Koch via mbed-tls mbed-tls@lists.trustedfirmware.org Sent: Tuesday, May 16, 2023 5:46 PM To: Ruchika Gupta ruchika.gupta_1@nxp.com; psa-crypto@lists.trustedfirmware.org; mbed-tls@lists.trustedfirmware.org Subject: [mbed-tls] Re: [psa-crypto] Benchmark application for PSA crypto API's
Hi Ruchika,
as an addition to the previous answers, there is also the SecureMark-TLS benchmark from EEMBC that "Analyzes the costs associated with implementing TLS on an edge device using a common IoT cyphersuite comprised of ECC & ECDSA on the NIST secp256r1 curve, SHA256, and AES128-CCM/ECB", see: https://www.eembc.org/securemark/ It provides profiles to run benchmarks against Mbed TLS API, PSA Crypto API, and wolfSSL, see sources here: https://github.com/eembc/securemark-tls/tree/main/examples/selfhosted/profil... The chosen cipher-suite is similar to the TF-M medium profile and it allows estimates of speed and power consumption for TLS on microcontrollers. It also allows to add - manually - footprint data.
Best Stephan
From: Ruchika Gupta via psa-crypto <psa-crypto@lists.trustedfirmware.orgmailto:psa-crypto@lists.trustedfirmware.org> Reply to: Ruchika Gupta <ruchika.gupta_1@nxp.commailto:ruchika.gupta_1@nxp.com> Date: Tuesday, 16 May 2023 at 13:40 To: "mbed-tls@lists.trustedfirmware.orgmailto:mbed-tls@lists.trustedfirmware.org" <mbed-tls@lists.trustedfirmware.orgmailto:mbed-tls@lists.trustedfirmware.org>, "psa-crypto@lists.trustedfirmware.orgmailto:psa-crypto@lists.trustedfirmware.org" <psa-crypto@lists.trustedfirmware.orgmailto:psa-crypto@lists.trustedfirmware.org> Subject: [psa-crypto] Benchmark application for PSA crypto API's
Hi,
For mbedtls API’s, there is a benchmark application available. Are there any plans to implement benchmark application for PSA crypto APIs ?
Regards, Ruchika
AI answer:
"No, you cannot distribute the EEMBC source code. According to the CoreMarkR ACCEPTABLE USE AGREEMENT, you must not disclose, distribute, transfer, sublicense, rent, lease or otherwise make available the CoreMarkR software or any portion thereof to any third party(eembc.org). The same applies to other EEMBC benchmarks, such as CoreMarkR-PRO, AudioMarkT, SecureMarkT-TLS, etc(github.com). You must also comply with the EEMBC regulations and policies regarding the use of its benchmarks(github.com)."
From: Stephan Koch koch@oberon.ch Sent: Wednesday, May 17, 2023 2:19 PM To: Andrej Butok andrey.butok@nxp.com; Ruchika Gupta ruchika.gupta_1@nxp.com; psa-crypto@lists.trustedfirmware.org; mbed-tls@lists.trustedfirmware.org Subject: Re: [psa-crypto] Benchmark application for PSA crypto API's
Hi Andrej,
While we contributed code to run SecureMark-TLS against the PSA Crypto API, we are not affiliated with EEMBC.
EEMBC attached an Apache-2.0 license with an extension called "Acceptable Use Agreement", see their README at
https://github.com/eembc/securemark-tls/tree/main#licensing https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.co m%2Feembc%2Fsecuremark-tls%2Ftree%2Fmain%23licensing&data=05%7C01%7Candrey.b utok%40nxp.com%7C2c86e3e2950e45fdb3de08db56d0ef92%7C686ea1d3bc2b4c6fa92cd99c 5c301635%7C0%7C0%7C638199227601910957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLj AwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=C I4JijnvthpRKPW2qjE62o7xdvcqOg4cULunB6zUO4w%3D&reserved=0
and their license at:
https://github.com/eembc/securemark-tls/blob/main/LICENSE.md https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.co m%2Feembc%2Fsecuremark-tls%2Fblob%2Fmain%2FLICENSE.md&data=05%7C01%7Candrey. butok%40nxp.com%7C2c86e3e2950e45fdb3de08db56d0ef92%7C686ea1d3bc2b4c6fa92cd99 c5c301635%7C0%7C0%7C638199227601910957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wL jAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata= %2F2rqJLvy4HIkuDEEWefFnkmsgvdXFvd%2FAspYWoFQG08%3D&reserved=0
Maybe this helps.
Best
Stephan
From: Andrej Butok <andrey.butok@nxp.com mailto:andrey.butok@nxp.com > Date: Wednesday, 17 May 2023 at 12:12 To: Stephan Koch <koch@oberon.ch mailto:koch@oberon.ch >, Ruchika Gupta <ruchika.gupta_1@nxp.com mailto:ruchika.gupta_1@nxp.com >, psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org <psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org >, mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org <mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org > Subject: RE: [psa-crypto] Benchmark application for PSA crypto API's
Hello,
The source code is distributed under "EEMBC Benchmark License Agreements"
EEMBC Benchmark License Agreements are contracts that allow qualified college and university faculty members and their research teams to use the EEMBC benchmarks for processor/compiler and system research under an academically-oriented fee structure(eembc.org). EEMBC stands for Embedded Microprocessor Benchmark Consortium, a nonprofit organization that develops industry-standard benchmarks for the hardware and software used in various applications(eembc.org). EEMBC Benchmark License Agreements require the licensees to maintain the confidentiality and applicability of the EEMBC code and to provide feedback and contributions to the consortium(eembc.org)(github.com).
It is not clear if we may port and distribute this benchmark project independently to everybody as part of our SDK. Any clarification?
Thank you,
Andrej Butok
From: Stephan Koch via mbed-tls <mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org > Sent: Tuesday, May 16, 2023 5:46 PM To: Ruchika Gupta <ruchika.gupta_1@nxp.com mailto:ruchika.gupta_1@nxp.com
; psa-crypto@lists.trustedfirmware.org
mailto:psa-crypto@lists.trustedfirmware.org ; mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org Subject: [mbed-tls] Re: [psa-crypto] Benchmark application for PSA crypto API's
Hi Ruchika,
as an addition to the previous answers, there is also the SecureMark-TLS benchmark from EEMBC that "Analyzes the costs associated with implementing TLS on an edge device using a common IoT cyphersuite comprised of ECC & ECDSA on the NIST secp256r1 curve, SHA256, and AES128-CCM/ECB", see: https://www.eembc.org/securemark/ https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.eembc .org%2Fsecuremark%2F&data=05%7C01%7Candrey.butok%40nxp.com%7C2c86e3e2950e45f db3de08db56d0ef92%7C686ea1d3bc2b4c6fa92cd99c5c301635%7C0%7C0%7C6381992276019 10957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik 1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=a4755%2FR7S3l%2B304USKE0Qgw7tpG57 VRzhzEBeceYdKo%3D&reserved=0
It provides profiles to run benchmarks against Mbed TLS API, PSA Crypto API, and wolfSSL, see sources here: https://github.com/eembc/securemark-tls/tree/main/examples/selfhosted/profil e https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.co m%2Feembc%2Fsecuremark-tls%2Ftree%2Fmain%2Fexamples%2Fselfhosted%2Fprofile&d ata=05%7C01%7Candrey.butok%40nxp.com%7C2c86e3e2950e45fdb3de08db56d0ef92%7C68 6ea1d3bc2b4c6fa92cd99c5c301635%7C0%7C0%7C638199227601910957%7CUnknown%7CTWFp bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7 C3000%7C%7C%7C&sdata=S3IO%2FtnVcK4h8a4x5NqV8G%2FrE9hYkQTXp6CaoNsd4hA%3D&rese rved=0
The chosen cipher-suite is similar to the TF-M medium profile and it allows estimates of speed and power consumption for TLS on microcontrollers. It also allows to add - manually - footprint data.
Best
Stephan
From: Ruchika Gupta via psa-crypto <psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org > Reply to: Ruchika Gupta <ruchika.gupta_1@nxp.com mailto:ruchika.gupta_1@nxp.com > Date: Tuesday, 16 May 2023 at 13:40 To: "mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org " <mbed-tls@lists.trustedfirmware.org mailto:mbed-tls@lists.trustedfirmware.org >, "psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org " <psa-crypto@lists.trustedfirmware.org mailto:psa-crypto@lists.trustedfirmware.org > Subject: [psa-crypto] Benchmark application for PSA crypto API's
Hi,
For mbedtls API's, there is a benchmark application available. Are there any plans to implement benchmark application for PSA crypto APIs ?
Regards,
Ruchika
psa-crypto@lists.trustedfirmware.org
-
Andrej Butok -
Stephan Koch