交叉編譯Python-3.6.0到aarch64/aarch32 —— 支持sqlite3

參考

https://datko.net/2013/05/10/cross-compiling-python-3-3-1-for-beaglebone-arm-angstrom/

 

平台

主機： ubuntu14.04 64bit

開發板： qemu + aarch64 （參考： http://www.cnblogs.com/pengdonglin137/p/6442583.html）

工具鏈： 

    aarch64-linux-gnu-gcc  (gcc version 4.9.1 20140529)  用於編譯aarch64上面運行的程序

    arm-none-linux-gnueabi-gcc  (gcc version 4.8.3 20140320) 用於編譯aarch32上面運行的程序

Python版本： Python-3.6.0

 

概述

前面幾篇博文介紹了Python2.7.13的交叉編譯，在編譯前需要給Python源碼打上用於交叉編譯的patch，從Python-3.3.1開始，就不需要再打什么patch了，只需要在configure的時候指定--build和--host參數即可。

下面我們以aarch64和aarch32為例說明。

 

正文

一、編譯PC上面用的Python

因為在交叉編譯的時候需要在PC上面運行對應版本的Python程序，所以我們需要先編譯和安裝PC上面用的Python，下面是命令：

#!/bin/bash

../Python-3.6.0/configure

make -j8
sudo make install 

默認，Python3.6.0會被安裝到/usr/local下面。

二、交叉編譯

1、配置 mk1_conf.sh

• aarch32

#!/bin/bash

export PATH=/home/pengdonglin/src/qemu/aarch32/arm-2014.05/bin:$PATH

../Python-3.6.0/configure \
    --host=arm-none-linux-gnueabi \
    --build=armv7 \
    --prefix=`pwd` \
    --enable-ipv6 \
    --enable-shared \
    ac_cv_file__dev_ptmx="yes" \
    ac_cv_file__dev_ptc="no" \
    LDFLAGS="-L/home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch32/lib" \
    CPPFLAGS="-I/home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch32/include"

其中--build表示編譯出來的程序運行的CPU架構，--host是交叉編譯工具鏈。這里我已經吧sqlite3的lib和include添加上了，所以生成的python3是支持sqlite3的。

• aarch64

#!/bin/bash

export PATH=/home/pengdonglin/src/qemu/aarch64/gcc-linaro-aarch64-linux-gnu-4.9-2014.07_linux/bin:$PATH

../Python-3.6.0/configure \
    --host=aarch64-linux-gnu \
    --build=aarch64 \
    --prefix=`pwd` \
    --enable-ipv6 \
    --enable-shared \
    ac_cv_file__dev_ptmx="yes" \
    ac_cv_file__dev_ptc="no" \
    LDFLAGS="-L/home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch64/lib" \
    CPPFLAGS="-I/home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch64/include"

只需要替換運行的CPU架構為aarch64，然后設置對應的工具鏈即可，別忘了還有sqlite3的相關路徑的修改。

2、編譯和安裝 mk2_make.sh

這里沒有什么好說的，下面是腳本內容：

• aarch32

#!/bin/bash

export PATH=/home/pengdonglin/src/qemu/aarch32/arm-2014.05/bin:$PATH

make -j4
make install

• aarch64

#!/bin/bash

export PATH=/home/pengdonglin/src/qemu/aarch64/gcc-linaro-aarch64-linux-gnu-4.9-2014.07_linux/bin:$PATH

make -j4
make install

3、制作ramdisk

為了便於在python2和python3之間的切換，適當修改mk_ramdisk.sh如下：

• aarch32

#!/bin/bash

sudo rm -rf rootfs
sudo rm -rf tmpfs
sudo rm -rf ramdisk*

sudo mkdir rootfs
sudo cp ../busybox-1.24.2/_install/*  rootfs/ -raf

sudo mkdir -p rootfs/proc/
sudo mkdir -p rootfs/sys/
sudo mkdir -p rootfs/tmp/
sudo mkdir -p rootfs/root/
sudo mkdir -p rootfs/var/
sudo mkdir -p rootfs/mnt/

sudo cp etc rootfs/ -arf

sudo cp -arf ../arm-2014.05/arm-none-linux-gnueabi/libc/lib rootfs/

ver=3
sudo mkdir -p rootfs/usr
pushd rootfs/usr
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${ver}/aarch32/lib .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${ver}/aarch32/include .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${ver}/aarch32/bin .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${ver}/aarch32/share .
sudo /home/pengdonglin/src/qemu/aarch32/arm-2014.05/bin/arm-none-linux-gnueabi-strip lib/python*
popd

#sqlite
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch32/bin/* rootfs/bin/
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch32/include/* rootfs/include/
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch32/lib/* rootfs/lib/
sudo strip rootfs/bin/sqlite3

sudo mkdir -p rootfs/dev/
sudo mknod rootfs/dev/tty1 c 4 1
sudo mknod rootfs/dev/tty2 c 4 2
sudo mknod rootfs/dev/tty3 c 4 3
sudo mknod rootfs/dev/tty4 c 4 4
sudo mknod rootfs/dev/console c 5 1
sudo mknod rootfs/dev/null c 1 3

sudo rm -rf rootfs/lib/*.a
sudo rm -rf rootfs/lib/*.la
sudo /home/pengdonglin/src/qemu/aarch32/arm-2014.05/bin/arm-none-linux-gnueabi-strip rootfs/lib/*

sudo mkdir -p rootfs/tools
sudo cp ./other_tools/* rootfs/tools

sudo mkdir -p rootfs/lib/modules/4\.10\.0\+

sudo dd if=/dev/zero of=ramdisk bs=1M count=150
sudo mkfs.ext4 -F ramdisk

sudo mkdir -p tmpfs
sudo mount -t ext4 ramdisk ./tmpfs/  -o loop
sudo cp -raf rootfs/*  tmpfs/
sudo umount tmpfs

sudo gzip --best -c ramdisk > ramdisk.gz
sudo mkimage -n "ramdisk" -A arm -O linux -T ramdisk -C gzip -d ramdisk.gz ramdisk.img

如果提示空間不足的話，可以將dd命令的count參數擴大，同時不要忘了將kernel配置里的ramdisk的大小也擴大：

Device Drivers  --->

    [*] Block devices  --->

        (153600) Default RAM disk size (kbytes)

這里將ramdisk的大小修改為了150MB，然后重新編譯kernel

• aarch64

#!/bin/bash

sudo rm -rf rootfs
sudo rm -rf tmpfs
sudo rm -rf ramdisk*

sudo mkdir rootfs
sudo cp ../busybox-1.24.2/_install/*  rootfs/ -raf

sudo mkdir -p rootfs/proc/
sudo mkdir -p rootfs/sys/
sudo mkdir -p rootfs/tmp/
sudo mkdir -p rootfs/root/
sudo mkdir -p rootfs/var/
sudo mkdir -p rootfs/mnt/

sudo cp etc rootfs/ -arf
sudo mkdir -p rootfs/lib

sudo cp -arf ../gcc-linaro-aarch64-linux-gnu-4.9-2014.07_linux/aarch64-linux-gnu/libc/lib/aarch64-linux-gnu/* rootfs/lib/

sudo rm rootfs/lib/*.a
sudo ../gcc-linaro-aarch64-linux-gnu-4.9-2014.07_linux/bin/aarch64-linux-gnu-strip rootfs/lib/*

version=3
sudo mkdir -p rootfs/usr
pushd rootfs/usr
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${version}/aarch64/lib .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${version}/aarch64/include .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${version}/aarch64/bin .
sudo cp  -raf /home/pengdonglin/src/qemu/python_cross_compile/Python${version}/aarch64/share .
sudo /home/pengdonglin/src/qemu/aarch64/gcc-linaro-aarch64-linux-gnu-4.9-2014.07_linux/bin/aarch64-linux-gnu-strip lib/python*
popd

#sqlite
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch64/bin/* rootfs/bin/
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch64/include/* rootfs/include/
sudo cp -raf /home/pengdonglin/src/qemu/python_cross_compile/SQlite/aarch64/lib/* rootfs/lib/
sudo strip rootfs/bin/sqlite3

sudo mkdir -p rootfs/dev/
sudo mknod rootfs/dev/tty1 c 4 1
sudo mknod rootfs/dev/tty2 c 4 2
sudo mknod rootfs/dev/tty3 c 4 3
sudo mknod rootfs/dev/tty4 c 4 4
sudo mknod rootfs/dev/console c 5 1
sudo mknod rootfs/dev/null c 1 3

sudo mkdir -p rootfs/lib/modules/4\.10\.0\+

pushd rootfs/lib
sudo ln -sf ld-2.19-2014.07.so ld-linux-aarch64.so.1
popd

sudo mkdir -p rootfs/tools
sudo cp ./other_tools/* rootfs/tools

sudo dd if=/dev/zero of=ramdisk bs=1M count=200
sudo mkfs.ext4 -F ramdisk

sudo mkdir -p tmpfs
sudo mount -t ext4 ramdisk ./tmpfs/  -o loop
sudo cp -raf rootfs/*  tmpfs/
sudo umount tmpfs

sudo gzip --best -c ramdisk > ramdisk.gz
sudo mkimage -n "ramdisk" -A arm -O linux -T ramdisk -C gzip -d ramdisk.gz ramdisk.img

這里將ramdisk的大小設置為了200MB，同時修改kernel配置：

Device Drivers  --->
    
    [*] Block devices  --->
        
        (204800) Default RAM disk size (kbytes)

然后重新編譯kernel。

4、測試

在板子起來后，運行：

 python3 /usr/lib/python3.6/test/test___all__.py 

• aarch32

[root@vexpress ]# python3 /usr/lib/python3.6/test/test___all__.py 
__phello__.foo
_bootlocale
_collections_abc
_compat_pickle
_compression
_dummy_thread
... ...
.
----------------------------------------------------------------------
Ran 1 test in 15.731s
OK

• aarch64

[root@aarch64 ]# python3 /usr/lib/python3.6/test/test___all__.py 
[   20.347974] random: python3: uninitialized urandom read (24 bytes read)
[   21.049645] random: fast init done
__phello__.foo
_bootlocale
_collections_abc
_compat_pickle
_compression
_dummy_thread
_markupbase
... ...
.
----------------------------------------------------------------------
Ran 1 test in 10.745s
OK

 

完