Skip to content

Commit 94cd186

Browse files
cjyabrahamkyliewd
andauthored
Added blog post "Learn how to develop Android applications with ExecuTorch and Llama models" (#1669)
* Added blog post "Learn how to develop Android applications with ExecuTorch and Llama models" Signed-off-by: Chris Abraham <[email protected]> * Update and rename 2024-07-09-develop-android-applications.md to 2024-07-10-develop-android-applications.md Signed-off-by: Kylie Wagar-Dirks <[email protected]> --------- Signed-off-by: Chris Abraham <[email protected]> Signed-off-by: Kylie Wagar-Dirks <[email protected]> Co-authored-by: Kylie Wagar-Dirks <[email protected]>
1 parent ed7b2df commit 94cd186

File tree

1 file changed

+40
-0
lines changed

1 file changed

+40
-0
lines changed
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
---
2+
layout: blog_detail
3+
title: "Learn how to develop Android applications with ExecuTorch and Llama models"
4+
---
5+
_This blog is courtesy of the PyTorch team at Arm. More details can be found [here]([url](https://learn.arm.com/learning-paths/smartphones-and-mobile/build-llama3-chat-android-app-using-executorch-and-xnnpack/?utm_source=twitter&utm_medium=social-organic&utm_content=landingpage&utm_campaign=mk24_developer_na))._
6+
7+
Arm’s compute platform is delivering GenAI applications on phones, laptops, and servers. Cost, privacy, performance, security, and energy efficiency are just some of the reasons developers are investigating on-device AI.
8+
9+
A new Learning Path explaining how to leverage the capabilities of large language models (LLMs) on Android using ExecuTorch and XNNPACK is now available.
10+
11+
Here's a summary of what you'll learn:
12+
13+
* Development Environment setup
14+
15+
The Learning Path begins by guiding you through setting up your development environment, ensuring you have all the necessary tools installed, including Android Studio, the Android NDK, Java JDK, and Python.
16+
17+
* ExecuTorch and XNNPACK
18+
19+
You'll learn about the core technologies: ExecuTorch, a framework for deploying PyTorch models to edge devices, and XNNPACK, a high-performance library for executing neural networks on Arm-based platforms.
20+
21+
* Llama models
22+
23+
The Learning Path explores Llama, a family of powerful LLMs, focusing specifically on the 8B Llama 3 model. You'll learn about quantization techniques, which are essential for optimizing model size and performance on mobile devices.
24+
25+
* Prepare Llama models for ExecuTorch
26+
27+
You'll be guided through the process of downloading, exporting, and evaluating Llama models, ensuring they are ready for deployment using ExecuTorch.
28+
29+
* Check model performance on Android
30+
31+
The Learning Path walks you through cross-compiling the Llama runner binary for Android, allowing you to test your model's performance on your phone.
32+
33+
* Build and run an Android Chat App
34+
35+
Finally, you'll learn how to build a native Android chat app using the `LlamaDemo` application from the ExecuTorch repository. This hands-on experience allows you to put your knowledge into practice and create a real-world application.
36+
37+
38+
Explore this Learning Path if you want to learn how to leverage the power of LLMs on your Android phone, and gain expertise in tools for on-device machine learning.
39+
40+
Dig into the excitement of building Android chat apps and understand more about how they work on the [Arm Developer Hub]([url](https://learn.arm.com/learning-paths/smartphones-and-mobile/build-llama3-chat-android-app-using-executorch-and-xnnpack/?utm_source=twitter&utm_medium=social-organic&utm_content=landingpage&utm_campaign=mk24_developer_na)).

0 commit comments

Comments
 (0)