Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1 | #!/usr/bin/env python |
| 2 | # |
| 3 | # Copyright (C) 2008 The Android Open Source Project |
| 4 | # |
| 5 | # Licensed under the Apache License, Version 2.0 (the "License"); |
| 6 | # you may not use this file except in compliance with the License. |
| 7 | # You may obtain a copy of the License at |
| 8 | # |
| 9 | # http://www.apache.org/licenses/LICENSE-2.0 |
| 10 | # |
| 11 | # Unless required by applicable law or agreed to in writing, software |
| 12 | # distributed under the License is distributed on an "AS IS" BASIS, |
| 13 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 14 | # See the License for the specific language governing permissions and |
| 15 | # limitations under the License. |
| 16 | |
| 17 | """ |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 18 | Given a target-files zipfile, produces an OTA package that installs that build. |
| 19 | An incremental OTA is produced if -i is given, otherwise a full OTA is produced. |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 20 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 21 | Usage: ota_from_target_files [options] input_target_files output_ota_package |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 22 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 23 | Common options that apply to both of non-A/B and A/B OTAs |
| 24 | |
| 25 | --downgrade |
| 26 | Intentionally generate an incremental OTA that updates from a newer build |
Tao Bao | faa8e0b | 2018-04-12 14:31:43 -0700 | [diff] [blame] | 27 | to an older one (e.g. downgrading from P preview back to O MR1). |
| 28 | "ota-downgrade=yes" will be set in the package metadata file. A data wipe |
| 29 | will always be enforced when using this flag, so "ota-wipe=yes" will also |
| 30 | be included in the metadata file. The update-binary in the source build |
| 31 | will be used in the OTA package, unless --binary flag is specified. Please |
| 32 | also check the comment for --override_timestamp below. |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 33 | |
| 34 | -i (--incremental_from) <file> |
| 35 | Generate an incremental OTA using the given target-files zip as the |
| 36 | starting build. |
| 37 | |
| 38 | -k (--package_key) <key> |
| 39 | Key to use to sign the package (default is the value of |
| 40 | default_system_dev_certificate from the input target-files's |
Tao Bao | 59cf0c5 | 2019-06-25 10:04:24 -0700 | [diff] [blame] | 41 | META/misc_info.txt, or "build/make/target/product/security/testkey" if |
| 42 | that value is not specified). |
Doug Zongker | afb32ea | 2011-09-22 10:28:04 -0700 | [diff] [blame] | 43 | |
| 44 | For incremental OTAs, the default value is based on the source |
| 45 | target-file, not the target build. |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 46 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 47 | --override_timestamp |
| 48 | Intentionally generate an incremental OTA that updates from a newer build |
Tao Bao | faa8e0b | 2018-04-12 14:31:43 -0700 | [diff] [blame] | 49 | to an older one (based on timestamp comparison), by setting the downgrade |
| 50 | flag in the package metadata. This differs from --downgrade flag, as we |
| 51 | don't enforce a data wipe with this flag. Because we know for sure this is |
| 52 | NOT an actual downgrade case, but two builds happen to be cut in a reverse |
| 53 | order (e.g. from two branches). A legit use case is that we cut a new |
| 54 | build C (after having A and B), but want to enfore an update path of A -> |
| 55 | C -> B. Specifying --downgrade may not help since that would enforce a |
| 56 | data wipe for C -> B update. |
| 57 | |
| 58 | We used to set a fake timestamp in the package metadata for this flow. But |
| 59 | now we consolidate the two cases (i.e. an actual downgrade, or a downgrade |
| 60 | based on timestamp) with the same "ota-downgrade=yes" flag, with the |
| 61 | difference being whether "ota-wipe=yes" is set. |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 62 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 63 | --wipe_user_data |
| 64 | Generate an OTA package that will wipe the user data partition when |
| 65 | installed. |
| 66 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 67 | --retrofit_dynamic_partitions |
| 68 | Generates an OTA package that updates a device to support dynamic |
| 69 | partitions (default False). This flag is implied when generating |
| 70 | an incremental OTA where the base build does not support dynamic |
| 71 | partitions but the target build does. For A/B, when this flag is set, |
| 72 | --skip_postinstall is implied. |
| 73 | |
xunchang | abfa265 | 2019-02-19 16:27:10 -0800 | [diff] [blame] | 74 | --skip_compatibility_check |
Yifan Hong | 9276cf0 | 2019-08-21 16:37:04 -0700 | [diff] [blame] | 75 | Skip checking compatibility of the input target files package. |
xunchang | abfa265 | 2019-02-19 16:27:10 -0800 | [diff] [blame] | 76 | |
xunchang | 1cfe251 | 2019-02-19 14:14:48 -0800 | [diff] [blame] | 77 | --output_metadata_path |
| 78 | Write a copy of the metadata to a separate file. Therefore, users can |
| 79 | read the post build fingerprint without extracting the OTA package. |
| 80 | |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 81 | --force_non_ab |
| 82 | This flag can only be set on an A/B device that also supports non-A/B |
| 83 | updates. Implies --two_step. |
| 84 | If set, generate that non-A/B update package. |
| 85 | If not set, generates A/B package for A/B device and non-A/B package for |
| 86 | non-A/B device. |
| 87 | |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 88 | -o (--oem_settings) <main_file[,additional_files...]> |
| 89 | Comma separated list of files used to specify the expected OEM-specific |
| 90 | properties on the OEM partition of the intended device. Multiple expected |
| 91 | values can be used by providing multiple files. Only the first dict will |
| 92 | be used to compute fingerprint, while the rest will be used to assert |
| 93 | OEM-specific properties. |
| 94 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 95 | Non-A/B OTA specific options |
| 96 | |
| 97 | -b (--binary) <file> |
| 98 | Use the given binary as the update-binary in the output package, instead |
| 99 | of the binary in the build's target_files. Use for development only. |
| 100 | |
| 101 | --block |
| 102 | Generate a block-based OTA for non-A/B device. We have deprecated the |
| 103 | support for file-based OTA since O. Block-based OTA will be used by |
| 104 | default for all non-A/B devices. Keeping this flag here to not break |
| 105 | existing callers. |
| 106 | |
| 107 | -e (--extra_script) <file> |
| 108 | Insert the contents of file at the end of the update script. |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 109 | |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 110 | --full_bootloader |
| 111 | Similar to --full_radio. When generating an incremental OTA, always |
| 112 | include a full copy of bootloader image. |
| 113 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 114 | --full_radio |
| 115 | When generating an incremental OTA, always include a full copy of radio |
| 116 | image. This option is only meaningful when -i is specified, because a full |
| 117 | radio is always included in a full OTA if applicable. |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 118 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 119 | --log_diff <file> |
| 120 | Generate a log file that shows the differences in the source and target |
| 121 | builds for an incremental package. This option is only meaningful when -i |
| 122 | is specified. |
| 123 | |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 124 | --oem_no_mount |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 125 | For devices with OEM-specific properties but without an OEM partition, do |
| 126 | not mount the OEM partition in the updater-script. This should be very |
| 127 | rarely used, since it's expected to have a dedicated OEM partition for |
| 128 | OEM-specific properties. Only meaningful when -o is specified. |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 129 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 130 | --stash_threshold <float> |
| 131 | Specify the threshold that will be used to compute the maximum allowed |
| 132 | stash size (defaults to 0.8). |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 133 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 134 | -t (--worker_threads) <int> |
| 135 | Specify the number of worker-threads that will be used when generating |
| 136 | patches for incremental updates (defaults to 3). |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 137 | |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 138 | --verify |
| 139 | Verify the checksums of the updated system and vendor (if any) partitions. |
| 140 | Non-A/B incremental OTAs only. |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 141 | |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 142 | -2 (--two_step) |
Tao Bao | 30df8b4 | 2018-04-23 15:32:53 -0700 | [diff] [blame] | 143 | Generate a 'two-step' OTA package, where recovery is updated first, so |
| 144 | that any changes made to the system partition are done using the new |
| 145 | recovery (new kernel, etc.). |
| 146 | |
| 147 | A/B OTA specific options |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 148 | |
Tianjie Xu | 1b07983 | 2019-08-28 12:19:23 -0700 | [diff] [blame] | 149 | --disable_fec_computation |
| 150 | Disable the on device FEC data computation for incremental updates. |
| 151 | |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 152 | --include_secondary |
| 153 | Additionally include the payload for secondary slot images (default: |
| 154 | False). Only meaningful when generating A/B OTAs. |
| 155 | |
| 156 | By default, an A/B OTA package doesn't contain the images for the |
| 157 | secondary slot (e.g. system_other.img). Specifying this flag allows |
| 158 | generating a separate payload that will install secondary slot images. |
| 159 | |
| 160 | Such a package needs to be applied in a two-stage manner, with a reboot |
| 161 | in-between. During the first stage, the updater applies the primary |
| 162 | payload only. Upon finishing, it reboots the device into the newly updated |
| 163 | slot. It then continues to install the secondary payload to the inactive |
| 164 | slot, but without switching the active slot at the end (needs the matching |
| 165 | support in update_engine, i.e. SWITCH_SLOT_ON_REBOOT flag). |
| 166 | |
| 167 | Due to the special install procedure, the secondary payload will be always |
| 168 | generated as a full payload. |
| 169 | |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 170 | --payload_signer <signer> |
| 171 | Specify the signer when signing the payload and metadata for A/B OTAs. |
| 172 | By default (i.e. without this flag), it calls 'openssl pkeyutl' to sign |
| 173 | with the package private key. If the private key cannot be accessed |
| 174 | directly, a payload signer that knows how to do that should be specified. |
| 175 | The signer will be supplied with "-inkey <path_to_key>", |
| 176 | "-in <input_file>" and "-out <output_file>" parameters. |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 177 | |
| 178 | --payload_signer_args <args> |
| 179 | Specify the arguments needed for payload signer. |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 180 | |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 181 | --payload_signer_maximum_signature_size <signature_size> |
| 182 | The maximum signature size (in bytes) that would be generated by the given |
| 183 | payload signer. Only meaningful when custom payload signer is specified |
| 184 | via '--payload_signer'. |
| 185 | If the signer uses a RSA key, this should be the number of bytes to |
| 186 | represent the modulus. If it uses an EC key, this is the size of a |
| 187 | DER-encoded ECDSA signature. |
| 188 | |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 189 | --payload_signer_key_size <key_size> |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 190 | Deprecated. Use the '--payload_signer_maximum_signature_size' instead. |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 191 | |
Tianjie | d686716 | 2020-05-10 14:30:13 -0700 | [diff] [blame] | 192 | --boot_variable_file <path> |
| 193 | A file that contains the possible values of ro.boot.* properties. It's |
| 194 | used to calculate the possible runtime fingerprints when some |
| 195 | ro.product.* properties are overridden by the 'import' statement. |
| 196 | The file expects one property per line, and each line has the following |
| 197 | format: 'prop_name=value1,value2'. e.g. 'ro.boot.product.sku=std,pro' |
| 198 | |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 199 | --skip_postinstall |
| 200 | Skip the postinstall hooks when generating an A/B OTA package (default: |
| 201 | False). Note that this discards ALL the hooks, including non-optional |
| 202 | ones. Should only be used if caller knows it's safe to do so (e.g. all the |
| 203 | postinstall work is to dexopt apps and a data wipe will happen immediately |
| 204 | after). Only meaningful when generating A/B OTAs. |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 205 | |
| 206 | --partial "<PARTITION> [<PARTITION>[...]]" |
| 207 | Generate partial updates, overriding ab_partitions list with the given |
| 208 | list. |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 209 | |
| 210 | --custom_image <custom_partition=custom_image> |
| 211 | Use the specified custom_image to update custom_partition when generating |
| 212 | an A/B OTA package. e.g. "--custom_image oem=oem.img --custom_image |
| 213 | cus=cus_test.img" |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 214 | """ |
| 215 | |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 216 | from __future__ import print_function |
| 217 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 218 | import logging |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 219 | import multiprocessing |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 220 | import os.path |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 221 | import shlex |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 222 | import shutil |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 223 | import struct |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 224 | import sys |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 225 | import zipfile |
| 226 | |
| 227 | import common |
Kelvin Zhang | 2e41738 | 2020-08-20 11:33:11 -0400 | [diff] [blame] | 228 | import ota_utils |
Kelvin Zhang | 0876c41 | 2020-06-23 15:06:58 -0400 | [diff] [blame] | 229 | import target_files_diff |
Kelvin Zhang | cff4d76 | 2020-07-29 16:37:51 -0400 | [diff] [blame] | 230 | from check_target_files_vintf import CheckVintfIfTrebleEnabled |
| 231 | from non_ab_ota import GenerateNonAbOtaPackage |
| 232 | from ota_utils import (UNZIP_PATTERN, FinalizeMetadata, GetPackageMetadata, |
| 233 | PropertyFiles) |
Kelvin Zhang | 0876c41 | 2020-06-23 15:06:58 -0400 | [diff] [blame] | 234 | |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 235 | if sys.hexversion < 0x02070000: |
| 236 | print("Python 2.7 or newer is required.", file=sys.stderr) |
| 237 | sys.exit(1) |
| 238 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 239 | logger = logging.getLogger(__name__) |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 240 | |
Kelvin Zhang | 2e41738 | 2020-08-20 11:33:11 -0400 | [diff] [blame] | 241 | OPTIONS = ota_utils.OPTIONS |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 242 | OPTIONS.verify = False |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 243 | OPTIONS.patch_threshold = 0.95 |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 244 | OPTIONS.wipe_user_data = False |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 245 | OPTIONS.extra_script = None |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 246 | OPTIONS.worker_threads = multiprocessing.cpu_count() // 2 |
| 247 | if OPTIONS.worker_threads == 0: |
| 248 | OPTIONS.worker_threads = 1 |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 249 | OPTIONS.two_step = False |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 250 | OPTIONS.include_secondary = False |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 251 | OPTIONS.block_based = True |
Doug Zongker | 2556848 | 2014-03-03 10:21:27 -0800 | [diff] [blame] | 252 | OPTIONS.updater_binary = None |
Tianjie Xu | 9afb221 | 2020-05-10 21:48:15 +0000 | [diff] [blame] | 253 | OPTIONS.oem_dicts = None |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 254 | OPTIONS.oem_source = None |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 255 | OPTIONS.oem_no_mount = False |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 256 | OPTIONS.full_radio = False |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 257 | OPTIONS.full_bootloader = False |
Tao Bao | d47d8e1 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 258 | # Stash size cannot exceed cache_size * threshold. |
| 259 | OPTIONS.cache_size = None |
| 260 | OPTIONS.stash_threshold = 0.8 |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 261 | OPTIONS.log_diff = None |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 262 | OPTIONS.payload_signer = None |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 263 | OPTIONS.payload_signer_args = [] |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 264 | OPTIONS.payload_signer_maximum_signature_size = None |
Tao Bao | 5f8ff93 | 2017-03-21 22:35:00 -0700 | [diff] [blame] | 265 | OPTIONS.extracted_input = None |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 266 | OPTIONS.skip_postinstall = False |
xunchang | abfa265 | 2019-02-19 16:27:10 -0800 | [diff] [blame] | 267 | OPTIONS.skip_compatibility_check = False |
Tianjie Xu | 1b07983 | 2019-08-28 12:19:23 -0700 | [diff] [blame] | 268 | OPTIONS.disable_fec_computation = False |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 269 | OPTIONS.partial = None |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 270 | OPTIONS.custom_images = {} |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 271 | |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 272 | POSTINSTALL_CONFIG = 'META/postinstall_config.txt' |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 273 | DYNAMIC_PARTITION_INFO = 'META/dynamic_partitions_info.txt' |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 274 | AB_PARTITIONS = 'META/ab_partitions.txt' |
Kelvin Zhang | cff4d76 | 2020-07-29 16:37:51 -0400 | [diff] [blame] | 275 | |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 276 | # Files to be unzipped for target diffing purpose. |
| 277 | TARGET_DIFFING_UNZIP_PATTERN = ['BOOT', 'RECOVERY', 'SYSTEM/*', 'VENDOR/*', |
Yifan Hong | cfb917a | 2020-05-07 14:58:20 -0700 | [diff] [blame] | 278 | 'PRODUCT/*', 'SYSTEM_EXT/*', 'ODM/*', |
Yifan Hong | f496f1b | 2020-07-15 16:52:59 -0700 | [diff] [blame] | 279 | 'VENDOR_DLKM/*', 'ODM_DLKM/*'] |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 280 | RETROFIT_DAP_UNZIP_PATTERN = ['OTA/super_*.img', AB_PARTITIONS] |
Tao Bao | 3e75946 | 2019-09-17 22:43:11 -0700 | [diff] [blame] | 281 | |
| 282 | # Images to be excluded from secondary payload. We essentially only keep |
| 283 | # 'system_other' and bootloader partitions. |
| 284 | SECONDARY_PAYLOAD_SKIPPED_IMAGES = [ |
Yifan Hong | c08cbf0 | 2020-09-15 19:07:39 +0000 | [diff] [blame] | 285 | 'boot', 'dtbo', 'modem', 'odm', 'odm_dlkm', 'product', 'radio', 'recovery', |
Tianjie | c385064 | 2020-05-13 14:47:31 -0700 | [diff] [blame] | 286 | 'system_ext', 'vbmeta', 'vbmeta_system', 'vbmeta_vendor', 'vendor', |
Yifan Hong | f496f1b | 2020-07-15 16:52:59 -0700 | [diff] [blame] | 287 | 'vendor_boot'] |
Tao Bao | 6b0b2f9 | 2017-03-05 11:38:11 -0800 | [diff] [blame] | 288 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 289 | |
Tao Bao | fabe083 | 2018-01-17 15:52:28 -0800 | [diff] [blame] | 290 | class PayloadSigner(object): |
| 291 | """A class that wraps the payload signing works. |
| 292 | |
| 293 | When generating a Payload, hashes of the payload and metadata files will be |
| 294 | signed with the device key, either by calling an external payload signer or |
| 295 | by calling openssl with the package key. This class provides a unified |
| 296 | interface, so that callers can just call PayloadSigner.Sign(). |
| 297 | |
| 298 | If an external payload signer has been specified (OPTIONS.payload_signer), it |
| 299 | calls the signer with the provided args (OPTIONS.payload_signer_args). Note |
| 300 | that the signing key should be provided as part of the payload_signer_args. |
| 301 | Otherwise without an external signer, it uses the package key |
| 302 | (OPTIONS.package_key) and calls openssl for the signing works. |
| 303 | """ |
| 304 | |
| 305 | def __init__(self): |
| 306 | if OPTIONS.payload_signer is None: |
| 307 | # Prepare the payload signing key. |
| 308 | private_key = OPTIONS.package_key + OPTIONS.private_key_suffix |
| 309 | pw = OPTIONS.key_passwords[OPTIONS.package_key] |
| 310 | |
| 311 | cmd = ["openssl", "pkcs8", "-in", private_key, "-inform", "DER"] |
| 312 | cmd.extend(["-passin", "pass:" + pw] if pw else ["-nocrypt"]) |
| 313 | signing_key = common.MakeTempFile(prefix="key-", suffix=".key") |
| 314 | cmd.extend(["-out", signing_key]) |
Tao Bao | bec89c1 | 2018-10-15 11:53:28 -0700 | [diff] [blame] | 315 | common.RunAndCheckOutput(cmd, verbose=False) |
Tao Bao | fabe083 | 2018-01-17 15:52:28 -0800 | [diff] [blame] | 316 | |
| 317 | self.signer = "openssl" |
| 318 | self.signer_args = ["pkeyutl", "-sign", "-inkey", signing_key, |
| 319 | "-pkeyopt", "digest:sha256"] |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 320 | self.maximum_signature_size = self._GetMaximumSignatureSizeInBytes( |
| 321 | signing_key) |
Tao Bao | fabe083 | 2018-01-17 15:52:28 -0800 | [diff] [blame] | 322 | else: |
| 323 | self.signer = OPTIONS.payload_signer |
| 324 | self.signer_args = OPTIONS.payload_signer_args |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 325 | if OPTIONS.payload_signer_maximum_signature_size: |
| 326 | self.maximum_signature_size = int( |
| 327 | OPTIONS.payload_signer_maximum_signature_size) |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 328 | else: |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 329 | # The legacy config uses RSA2048 keys. |
| 330 | logger.warning("The maximum signature size for payload signer is not" |
| 331 | " set, default to 256 bytes.") |
| 332 | self.maximum_signature_size = 256 |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 333 | |
| 334 | @staticmethod |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 335 | def _GetMaximumSignatureSizeInBytes(signing_key): |
| 336 | out_signature_size_file = common.MakeTempFile("signature_size") |
| 337 | cmd = ["delta_generator", "--out_maximum_signature_size_file={}".format( |
| 338 | out_signature_size_file), "--private_key={}".format(signing_key)] |
| 339 | common.RunAndCheckOutput(cmd) |
| 340 | with open(out_signature_size_file) as f: |
| 341 | signature_size = f.read().rstrip() |
Luca Stefani | 88e1a14 | 2020-03-27 14:05:12 +0100 | [diff] [blame] | 342 | logger.info("%s outputs the maximum signature size: %s", cmd[0], |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 343 | signature_size) |
| 344 | return int(signature_size) |
Tao Bao | fabe083 | 2018-01-17 15:52:28 -0800 | [diff] [blame] | 345 | |
| 346 | def Sign(self, in_file): |
| 347 | """Signs the given input file. Returns the output filename.""" |
| 348 | out_file = common.MakeTempFile(prefix="signed-", suffix=".bin") |
| 349 | cmd = [self.signer] + self.signer_args + ['-in', in_file, '-out', out_file] |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 350 | common.RunAndCheckOutput(cmd) |
Tao Bao | fabe083 | 2018-01-17 15:52:28 -0800 | [diff] [blame] | 351 | return out_file |
| 352 | |
| 353 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 354 | class Payload(object): |
| 355 | """Manages the creation and the signing of an A/B OTA Payload.""" |
| 356 | |
| 357 | PAYLOAD_BIN = 'payload.bin' |
| 358 | PAYLOAD_PROPERTIES_TXT = 'payload_properties.txt' |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 359 | SECONDARY_PAYLOAD_BIN = 'secondary/payload.bin' |
| 360 | SECONDARY_PAYLOAD_PROPERTIES_TXT = 'secondary/payload_properties.txt' |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 361 | |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 362 | def __init__(self, secondary=False): |
| 363 | """Initializes a Payload instance. |
| 364 | |
| 365 | Args: |
| 366 | secondary: Whether it's generating a secondary payload (default: False). |
| 367 | """ |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 368 | self.payload_file = None |
| 369 | self.payload_properties = None |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 370 | self.secondary = secondary |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 371 | |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 372 | def _Run(self, cmd): # pylint: disable=no-self-use |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 373 | # Don't pipe (buffer) the output if verbose is set. Let |
| 374 | # brillo_update_payload write to stdout/stderr directly, so its progress can |
| 375 | # be monitored. |
| 376 | if OPTIONS.verbose: |
| 377 | common.RunAndCheckOutput(cmd, stdout=None, stderr=None) |
| 378 | else: |
| 379 | common.RunAndCheckOutput(cmd) |
| 380 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 381 | def Generate(self, target_file, source_file=None, additional_args=None): |
| 382 | """Generates a payload from the given target-files zip(s). |
| 383 | |
| 384 | Args: |
| 385 | target_file: The filename of the target build target-files zip. |
| 386 | source_file: The filename of the source build target-files zip; or None if |
| 387 | generating a full OTA. |
| 388 | additional_args: A list of additional args that should be passed to |
| 389 | brillo_update_payload script; or None. |
| 390 | """ |
| 391 | if additional_args is None: |
| 392 | additional_args = [] |
| 393 | |
| 394 | payload_file = common.MakeTempFile(prefix="payload-", suffix=".bin") |
| 395 | cmd = ["brillo_update_payload", "generate", |
| 396 | "--payload", payload_file, |
| 397 | "--target_image", target_file] |
| 398 | if source_file is not None: |
| 399 | cmd.extend(["--source_image", source_file]) |
Tianjie Xu | 1b07983 | 2019-08-28 12:19:23 -0700 | [diff] [blame] | 400 | if OPTIONS.disable_fec_computation: |
| 401 | cmd.extend(["--disable_fec_computation", "true"]) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 402 | cmd.extend(additional_args) |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 403 | self._Run(cmd) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 404 | |
| 405 | self.payload_file = payload_file |
| 406 | self.payload_properties = None |
| 407 | |
| 408 | def Sign(self, payload_signer): |
| 409 | """Generates and signs the hashes of the payload and metadata. |
| 410 | |
| 411 | Args: |
| 412 | payload_signer: A PayloadSigner() instance that serves the signing work. |
| 413 | |
| 414 | Raises: |
| 415 | AssertionError: On any failure when calling brillo_update_payload script. |
| 416 | """ |
| 417 | assert isinstance(payload_signer, PayloadSigner) |
| 418 | |
| 419 | # 1. Generate hashes of the payload and metadata files. |
| 420 | payload_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin") |
| 421 | metadata_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin") |
| 422 | cmd = ["brillo_update_payload", "hash", |
| 423 | "--unsigned_payload", self.payload_file, |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 424 | "--signature_size", str(payload_signer.maximum_signature_size), |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 425 | "--metadata_hash_file", metadata_sig_file, |
| 426 | "--payload_hash_file", payload_sig_file] |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 427 | self._Run(cmd) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 428 | |
| 429 | # 2. Sign the hashes. |
| 430 | signed_payload_sig_file = payload_signer.Sign(payload_sig_file) |
| 431 | signed_metadata_sig_file = payload_signer.Sign(metadata_sig_file) |
| 432 | |
| 433 | # 3. Insert the signatures back into the payload file. |
| 434 | signed_payload_file = common.MakeTempFile(prefix="signed-payload-", |
| 435 | suffix=".bin") |
| 436 | cmd = ["brillo_update_payload", "sign", |
| 437 | "--unsigned_payload", self.payload_file, |
| 438 | "--payload", signed_payload_file, |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 439 | "--signature_size", str(payload_signer.maximum_signature_size), |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 440 | "--metadata_signature_file", signed_metadata_sig_file, |
| 441 | "--payload_signature_file", signed_payload_sig_file] |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 442 | self._Run(cmd) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 443 | |
| 444 | # 4. Dump the signed payload properties. |
| 445 | properties_file = common.MakeTempFile(prefix="payload-properties-", |
| 446 | suffix=".txt") |
| 447 | cmd = ["brillo_update_payload", "properties", |
| 448 | "--payload", signed_payload_file, |
| 449 | "--properties_file", properties_file] |
Tao Bao | 718faed | 2019-08-02 13:24:19 -0700 | [diff] [blame] | 450 | self._Run(cmd) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 451 | |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 452 | if self.secondary: |
| 453 | with open(properties_file, "a") as f: |
| 454 | f.write("SWITCH_SLOT_ON_REBOOT=0\n") |
| 455 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 456 | if OPTIONS.wipe_user_data: |
| 457 | with open(properties_file, "a") as f: |
| 458 | f.write("POWERWASH=1\n") |
| 459 | |
| 460 | self.payload_file = signed_payload_file |
| 461 | self.payload_properties = properties_file |
| 462 | |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 463 | def WriteToZip(self, output_zip): |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 464 | """Writes the payload to the given zip. |
| 465 | |
| 466 | Args: |
| 467 | output_zip: The output ZipFile instance. |
| 468 | """ |
| 469 | assert self.payload_file is not None |
| 470 | assert self.payload_properties is not None |
| 471 | |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 472 | if self.secondary: |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 473 | payload_arcname = Payload.SECONDARY_PAYLOAD_BIN |
| 474 | payload_properties_arcname = Payload.SECONDARY_PAYLOAD_PROPERTIES_TXT |
| 475 | else: |
| 476 | payload_arcname = Payload.PAYLOAD_BIN |
| 477 | payload_properties_arcname = Payload.PAYLOAD_PROPERTIES_TXT |
| 478 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 479 | # Add the signed payload file and properties into the zip. In order to |
| 480 | # support streaming, we pack them as ZIP_STORED. So these entries can be |
| 481 | # read directly with the offset and length pairs. |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 482 | common.ZipWrite(output_zip, self.payload_file, arcname=payload_arcname, |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 483 | compress_type=zipfile.ZIP_STORED) |
| 484 | common.ZipWrite(output_zip, self.payload_properties, |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 485 | arcname=payload_properties_arcname, |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 486 | compress_type=zipfile.ZIP_STORED) |
| 487 | |
| 488 | |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 489 | def _LoadOemDicts(oem_source): |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 490 | """Returns the list of loaded OEM properties dict.""" |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 491 | if not oem_source: |
| 492 | return None |
| 493 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 494 | oem_dicts = [] |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 495 | for oem_file in oem_source: |
| 496 | with open(oem_file) as fp: |
| 497 | oem_dicts.append(common.LoadDictionaryFromLines(fp.readlines())) |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 498 | return oem_dicts |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 499 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 500 | |
Tao Bao | d3fc38a | 2018-03-08 16:09:01 -0800 | [diff] [blame] | 501 | class StreamingPropertyFiles(PropertyFiles): |
| 502 | """A subclass for computing the property-files for streaming A/B OTAs.""" |
| 503 | |
| 504 | def __init__(self): |
| 505 | super(StreamingPropertyFiles, self).__init__() |
| 506 | self.name = 'ota-streaming-property-files' |
| 507 | self.required = ( |
| 508 | # payload.bin and payload_properties.txt must exist. |
| 509 | 'payload.bin', |
| 510 | 'payload_properties.txt', |
| 511 | ) |
| 512 | self.optional = ( |
Tianjie Xu | 4c05f4a | 2018-09-14 16:24:41 -0700 | [diff] [blame] | 513 | # care_map is available only if dm-verity is enabled. |
| 514 | 'care_map.pb', |
Tao Bao | d3fc38a | 2018-03-08 16:09:01 -0800 | [diff] [blame] | 515 | 'care_map.txt', |
| 516 | # compatibility.zip is available only if target supports Treble. |
| 517 | 'compatibility.zip', |
| 518 | ) |
| 519 | |
| 520 | |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 521 | class AbOtaPropertyFiles(StreamingPropertyFiles): |
| 522 | """The property-files for A/B OTA that includes payload_metadata.bin info. |
| 523 | |
| 524 | Since P, we expose one more token (aka property-file), in addition to the ones |
| 525 | for streaming A/B OTA, for a virtual entry of 'payload_metadata.bin'. |
| 526 | 'payload_metadata.bin' is the header part of a payload ('payload.bin'), which |
| 527 | doesn't exist as a separate ZIP entry, but can be used to verify if the |
| 528 | payload can be applied on the given device. |
| 529 | |
| 530 | For backward compatibility, we keep both of the 'ota-streaming-property-files' |
| 531 | and the newly added 'ota-property-files' in P. The new token will only be |
| 532 | available in 'ota-property-files'. |
| 533 | """ |
| 534 | |
| 535 | def __init__(self): |
| 536 | super(AbOtaPropertyFiles, self).__init__() |
| 537 | self.name = 'ota-property-files' |
| 538 | |
| 539 | def _GetPrecomputed(self, input_zip): |
| 540 | offset, size = self._GetPayloadMetadataOffsetAndSize(input_zip) |
| 541 | return ['payload_metadata.bin:{}:{}'.format(offset, size)] |
| 542 | |
| 543 | @staticmethod |
| 544 | def _GetPayloadMetadataOffsetAndSize(input_zip): |
| 545 | """Computes the offset and size of the payload metadata for a given package. |
| 546 | |
| 547 | (From system/update_engine/update_metadata.proto) |
| 548 | A delta update file contains all the deltas needed to update a system from |
| 549 | one specific version to another specific version. The update format is |
| 550 | represented by this struct pseudocode: |
| 551 | |
| 552 | struct delta_update_file { |
| 553 | char magic[4] = "CrAU"; |
| 554 | uint64 file_format_version; |
| 555 | uint64 manifest_size; // Size of protobuf DeltaArchiveManifest |
| 556 | |
| 557 | // Only present if format_version > 1: |
| 558 | uint32 metadata_signature_size; |
| 559 | |
| 560 | // The Bzip2 compressed DeltaArchiveManifest |
| 561 | char manifest[metadata_signature_size]; |
| 562 | |
| 563 | // The signature of the metadata (from the beginning of the payload up to |
| 564 | // this location, not including the signature itself). This is a |
| 565 | // serialized Signatures message. |
| 566 | char medatada_signature_message[metadata_signature_size]; |
| 567 | |
| 568 | // Data blobs for files, no specific format. The specific offset |
| 569 | // and length of each data blob is recorded in the DeltaArchiveManifest. |
| 570 | struct { |
| 571 | char data[]; |
| 572 | } blobs[]; |
| 573 | |
| 574 | // These two are not signed: |
| 575 | uint64 payload_signatures_message_size; |
| 576 | char payload_signatures_message[]; |
| 577 | }; |
| 578 | |
| 579 | 'payload-metadata.bin' contains all the bytes from the beginning of the |
| 580 | payload, till the end of 'medatada_signature_message'. |
| 581 | """ |
| 582 | payload_info = input_zip.getinfo('payload.bin') |
Shashikant Baviskar | 338856f | 2018-04-12 12:11:22 +0900 | [diff] [blame] | 583 | payload_offset = payload_info.header_offset |
| 584 | payload_offset += zipfile.sizeFileHeader |
| 585 | payload_offset += len(payload_info.extra) + len(payload_info.filename) |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 586 | payload_size = payload_info.file_size |
| 587 | |
Tao Bao | 59cf0c5 | 2019-06-25 10:04:24 -0700 | [diff] [blame] | 588 | with input_zip.open('payload.bin') as payload_fp: |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 589 | header_bin = payload_fp.read(24) |
| 590 | |
| 591 | # network byte order (big-endian) |
| 592 | header = struct.unpack("!IQQL", header_bin) |
| 593 | |
| 594 | # 'CrAU' |
| 595 | magic = header[0] |
| 596 | assert magic == 0x43724155, "Invalid magic: {:x}".format(magic) |
| 597 | |
| 598 | manifest_size = header[2] |
| 599 | metadata_signature_size = header[3] |
| 600 | metadata_total = 24 + manifest_size + metadata_signature_size |
| 601 | assert metadata_total < payload_size |
| 602 | |
| 603 | return (payload_offset, metadata_total) |
| 604 | |
| 605 | |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 606 | def UpdatesInfoForSpecialUpdates(content, partitions_filter, |
| 607 | delete_keys=None): |
| 608 | """ Updates info file for secondary payload generation, partial update, etc. |
| 609 | |
| 610 | Scan each line in the info file, and remove the unwanted partitions from |
| 611 | the dynamic partition list in the related properties. e.g. |
| 612 | "super_google_dynamic_partitions_partition_list=system vendor product" |
| 613 | will become "super_google_dynamic_partitions_partition_list=system". |
| 614 | |
| 615 | Args: |
| 616 | content: The content of the input info file. e.g. misc_info.txt. |
| 617 | partitions_filter: A function to filter the desired partitions from a given |
| 618 | list |
| 619 | delete_keys: A list of keys to delete in the info file |
| 620 | |
| 621 | Returns: |
| 622 | A string of the updated info content. |
| 623 | """ |
| 624 | |
| 625 | output_list = [] |
| 626 | # The suffix in partition_list variables that follows the name of the |
| 627 | # partition group. |
| 628 | list_suffix = 'partition_list' |
| 629 | for line in content.splitlines(): |
| 630 | if line.startswith('#') or '=' not in line: |
| 631 | output_list.append(line) |
| 632 | continue |
| 633 | key, value = line.strip().split('=', 1) |
| 634 | |
| 635 | if delete_keys and key in delete_keys: |
| 636 | pass |
| 637 | elif key.endswith(list_suffix): |
| 638 | partitions = value.split() |
| 639 | # TODO for partial update, partitions in the same group must be all |
| 640 | # updated or all omitted |
| 641 | partitions = filter(partitions_filter, partitions) |
| 642 | output_list.append('{}={}'.format(key, ' '.join(partitions))) |
| 643 | else: |
| 644 | output_list.append(line) |
| 645 | return '\n'.join(output_list) |
| 646 | |
| 647 | |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 648 | def GetTargetFilesZipForSecondaryImages(input_file, skip_postinstall=False): |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 649 | """Returns a target-files.zip file for generating secondary payload. |
| 650 | |
| 651 | Although the original target-files.zip already contains secondary slot |
| 652 | images (i.e. IMAGES/system_other.img), we need to rename the files to the |
| 653 | ones without _other suffix. Note that we cannot instead modify the names in |
| 654 | META/ab_partitions.txt, because there are no matching partitions on device. |
| 655 | |
| 656 | For the partitions that don't have secondary images, the ones for primary |
| 657 | slot will be used. This is to ensure that we always have valid boot, vbmeta, |
| 658 | bootloader images in the inactive slot. |
| 659 | |
| 660 | Args: |
| 661 | input_file: The input target-files.zip file. |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 662 | skip_postinstall: Whether to skip copying the postinstall config file. |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 663 | |
| 664 | Returns: |
| 665 | The filename of the target-files.zip for generating secondary payload. |
| 666 | """ |
Tianjie Xu | 1c80800 | 2019-09-11 00:29:26 -0700 | [diff] [blame] | 667 | |
| 668 | def GetInfoForSecondaryImages(info_file): |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 669 | """Updates info file for secondary payload generation.""" |
Tianjie Xu | 1c80800 | 2019-09-11 00:29:26 -0700 | [diff] [blame] | 670 | with open(info_file) as f: |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 671 | content = f.read() |
| 672 | # Remove virtual_ab flag from secondary payload so that OTA client |
| 673 | # don't use snapshots for secondary update |
| 674 | delete_keys = ['virtual_ab', "virtual_ab_retrofit"] |
| 675 | return UpdatesInfoForSpecialUpdates( |
| 676 | content, lambda p: p not in SECONDARY_PAYLOAD_SKIPPED_IMAGES, |
| 677 | delete_keys) |
Tianjie Xu | 1c80800 | 2019-09-11 00:29:26 -0700 | [diff] [blame] | 678 | |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 679 | target_file = common.MakeTempFile(prefix="targetfiles-", suffix=".zip") |
| 680 | target_zip = zipfile.ZipFile(target_file, 'w', allowZip64=True) |
| 681 | |
Kelvin Zhang | 928c234 | 2020-09-22 16:15:57 -0400 | [diff] [blame] | 682 | with zipfile.ZipFile(input_file, 'r', allowZip64=True) as input_zip: |
Tao Bao | dba59ee | 2018-01-09 13:21:02 -0800 | [diff] [blame] | 683 | infolist = input_zip.infolist() |
Tao Bao | 1248980 | 2018-07-12 14:47:38 -0700 | [diff] [blame] | 684 | |
Tao Bao | 0ff15de | 2019-03-20 11:26:06 -0700 | [diff] [blame] | 685 | input_tmp = common.UnzipTemp(input_file, UNZIP_PATTERN) |
Tao Bao | dba59ee | 2018-01-09 13:21:02 -0800 | [diff] [blame] | 686 | for info in infolist: |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 687 | unzipped_file = os.path.join(input_tmp, *info.filename.split('/')) |
| 688 | if info.filename == 'IMAGES/system_other.img': |
| 689 | common.ZipWrite(target_zip, unzipped_file, arcname='IMAGES/system.img') |
| 690 | |
| 691 | # Primary images and friends need to be skipped explicitly. |
| 692 | elif info.filename in ('IMAGES/system.img', |
| 693 | 'IMAGES/system.map'): |
| 694 | pass |
Tao Bao | 3e75946 | 2019-09-17 22:43:11 -0700 | [diff] [blame] | 695 | |
| 696 | # Copy images that are not in SECONDARY_PAYLOAD_SKIPPED_IMAGES. |
| 697 | elif info.filename.startswith(('IMAGES/', 'RADIO/')): |
| 698 | image_name = os.path.basename(info.filename) |
| 699 | if image_name not in ['{}.img'.format(partition) for partition in |
| 700 | SECONDARY_PAYLOAD_SKIPPED_IMAGES]: |
| 701 | common.ZipWrite(target_zip, unzipped_file, arcname=info.filename) |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 702 | |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 703 | # Skip copying the postinstall config if requested. |
| 704 | elif skip_postinstall and info.filename == POSTINSTALL_CONFIG: |
| 705 | pass |
| 706 | |
Tianjie Xu | 1c80800 | 2019-09-11 00:29:26 -0700 | [diff] [blame] | 707 | elif info.filename.startswith('META/'): |
| 708 | # Remove the unnecessary partitions for secondary images from the |
| 709 | # ab_partitions file. |
| 710 | if info.filename == AB_PARTITIONS: |
| 711 | with open(unzipped_file) as f: |
| 712 | partition_list = f.read().splitlines() |
| 713 | partition_list = [partition for partition in partition_list if partition |
Tao Bao | 3e75946 | 2019-09-17 22:43:11 -0700 | [diff] [blame] | 714 | and partition not in SECONDARY_PAYLOAD_SKIPPED_IMAGES] |
Kelvin Zhang | 0876c41 | 2020-06-23 15:06:58 -0400 | [diff] [blame] | 715 | common.ZipWriteStr(target_zip, info.filename, |
| 716 | '\n'.join(partition_list)) |
Tianjie Xu | 1c80800 | 2019-09-11 00:29:26 -0700 | [diff] [blame] | 717 | # Remove the unnecessary partitions from the dynamic partitions list. |
| 718 | elif (info.filename == 'META/misc_info.txt' or |
| 719 | info.filename == DYNAMIC_PARTITION_INFO): |
| 720 | modified_info = GetInfoForSecondaryImages(unzipped_file) |
| 721 | common.ZipWriteStr(target_zip, info.filename, modified_info) |
| 722 | else: |
| 723 | common.ZipWrite(target_zip, unzipped_file, arcname=info.filename) |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 724 | |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 725 | common.ZipClose(target_zip) |
| 726 | |
| 727 | return target_file |
| 728 | |
| 729 | |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 730 | def GetTargetFilesZipWithoutPostinstallConfig(input_file): |
| 731 | """Returns a target-files.zip that's not containing postinstall_config.txt. |
| 732 | |
| 733 | This allows brillo_update_payload script to skip writing all the postinstall |
| 734 | hooks in the generated payload. The input target-files.zip file will be |
| 735 | duplicated, with 'META/postinstall_config.txt' skipped. If input_file doesn't |
| 736 | contain the postinstall_config.txt entry, the input file will be returned. |
| 737 | |
| 738 | Args: |
| 739 | input_file: The input target-files.zip filename. |
| 740 | |
| 741 | Returns: |
| 742 | The filename of target-files.zip that doesn't contain postinstall config. |
| 743 | """ |
| 744 | # We should only make a copy if postinstall_config entry exists. |
Kelvin Zhang | 928c234 | 2020-09-22 16:15:57 -0400 | [diff] [blame] | 745 | with zipfile.ZipFile(input_file, 'r', allowZip64=True) as input_zip: |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 746 | if POSTINSTALL_CONFIG not in input_zip.namelist(): |
| 747 | return input_file |
| 748 | |
| 749 | target_file = common.MakeTempFile(prefix="targetfiles-", suffix=".zip") |
| 750 | shutil.copyfile(input_file, target_file) |
| 751 | common.ZipDelete(target_file, POSTINSTALL_CONFIG) |
| 752 | return target_file |
| 753 | |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 754 | def ParseInfoDict(target_file_path): |
| 755 | with zipfile.ZipFile(target_file_path, 'r', allowZip64=True) as zfp: |
| 756 | return common.LoadInfoDict(zfp) |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 757 | |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 758 | def GetTargetFilesZipForPartialUpdates(input_file, ab_partitions): |
| 759 | """Returns a target-files.zip for partial ota update package generation. |
| 760 | |
| 761 | This function modifies ab_partitions list with the desired partitions before |
| 762 | calling the brillo_update_payload script. It also cleans up the reference to |
| 763 | the excluded partitions in the info file, e.g misc_info.txt. |
| 764 | |
| 765 | Args: |
| 766 | input_file: The input target-files.zip filename. |
| 767 | ab_partitions: A list of partitions to include in the partial update |
| 768 | |
| 769 | Returns: |
| 770 | The filename of target-files.zip used for partial ota update. |
| 771 | """ |
| 772 | |
| 773 | def AddImageForPartition(partition_name): |
| 774 | """Add the archive name for a given partition to the copy list.""" |
| 775 | for prefix in ['IMAGES', 'RADIO']: |
| 776 | image_path = '{}/{}.img'.format(prefix, partition_name) |
| 777 | if image_path in namelist: |
| 778 | copy_entries.append(image_path) |
| 779 | map_path = '{}/{}.map'.format(prefix, partition_name) |
| 780 | if map_path in namelist: |
| 781 | copy_entries.append(map_path) |
| 782 | return |
| 783 | |
| 784 | raise ValueError("Cannot find {} in input zipfile".format(partition_name)) |
| 785 | |
| 786 | with zipfile.ZipFile(input_file, allowZip64=True) as input_zip: |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 787 | original_ab_partitions = input_zip.read( |
| 788 | AB_PARTITIONS).decode().splitlines() |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 789 | namelist = input_zip.namelist() |
| 790 | |
| 791 | unrecognized_partitions = [partition for partition in ab_partitions if |
| 792 | partition not in original_ab_partitions] |
| 793 | if unrecognized_partitions: |
| 794 | raise ValueError("Unrecognized partitions when generating partial updates", |
| 795 | unrecognized_partitions) |
| 796 | |
| 797 | logger.info("Generating partial updates for %s", ab_partitions) |
| 798 | |
| 799 | copy_entries = ['META/update_engine_config.txt'] |
| 800 | for partition_name in ab_partitions: |
| 801 | AddImageForPartition(partition_name) |
| 802 | |
| 803 | # Use zip2zip to avoid extracting the zipfile. |
| 804 | partial_target_file = common.MakeTempFile(suffix='.zip') |
| 805 | cmd = ['zip2zip', '-i', input_file, '-o', partial_target_file] |
| 806 | cmd.extend(['{}:{}'.format(name, name) for name in copy_entries]) |
| 807 | common.RunAndCheckOutput(cmd) |
| 808 | |
| 809 | partial_target_zip = zipfile.ZipFile(partial_target_file, 'a', |
| 810 | allowZip64=True) |
| 811 | with zipfile.ZipFile(input_file, allowZip64=True) as input_zip: |
| 812 | common.ZipWriteStr(partial_target_zip, 'META/ab_partitions.txt', |
| 813 | '\n'.join(ab_partitions)) |
| 814 | for info_file in ['META/misc_info.txt', DYNAMIC_PARTITION_INFO]: |
| 815 | if info_file not in input_zip.namelist(): |
| 816 | logger.warning('Cannot find %s in input zipfile', info_file) |
| 817 | continue |
| 818 | content = input_zip.read(info_file).decode() |
| 819 | modified_info = UpdatesInfoForSpecialUpdates( |
| 820 | content, lambda p: p in ab_partitions) |
| 821 | common.ZipWriteStr(partial_target_zip, info_file, modified_info) |
| 822 | |
| 823 | # TODO(xunchang) handle 'META/care_map.pb', 'META/postinstall_config.txt' |
| 824 | common.ZipClose(partial_target_zip) |
| 825 | |
| 826 | return partial_target_file |
| 827 | |
| 828 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 829 | def GetTargetFilesZipForRetrofitDynamicPartitions(input_file, |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 830 | super_block_devices, |
| 831 | dynamic_partition_list): |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 832 | """Returns a target-files.zip for retrofitting dynamic partitions. |
| 833 | |
| 834 | This allows brillo_update_payload to generate an OTA based on the exact |
| 835 | bits on the block devices. Postinstall is disabled. |
| 836 | |
| 837 | Args: |
| 838 | input_file: The input target-files.zip filename. |
| 839 | super_block_devices: The list of super block devices |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 840 | dynamic_partition_list: The list of dynamic partitions |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 841 | |
| 842 | Returns: |
| 843 | The filename of target-files.zip with *.img replaced with super_*.img for |
| 844 | each block device in super_block_devices. |
| 845 | """ |
| 846 | assert super_block_devices, "No super_block_devices are specified." |
| 847 | |
| 848 | replace = {'OTA/super_{}.img'.format(dev): 'IMAGES/{}.img'.format(dev) |
Tao Bao | 03fecb6 | 2018-11-28 10:59:23 -0800 | [diff] [blame] | 849 | for dev in super_block_devices} |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 850 | |
| 851 | target_file = common.MakeTempFile(prefix="targetfiles-", suffix=".zip") |
| 852 | shutil.copyfile(input_file, target_file) |
| 853 | |
Kelvin Zhang | 928c234 | 2020-09-22 16:15:57 -0400 | [diff] [blame] | 854 | with zipfile.ZipFile(input_file, allowZip64=True) as input_zip: |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 855 | namelist = input_zip.namelist() |
| 856 | |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 857 | input_tmp = common.UnzipTemp(input_file, RETROFIT_DAP_UNZIP_PATTERN) |
| 858 | |
| 859 | # Remove partitions from META/ab_partitions.txt that is in |
| 860 | # dynamic_partition_list but not in super_block_devices so that |
| 861 | # brillo_update_payload won't generate update for those logical partitions. |
| 862 | ab_partitions_file = os.path.join(input_tmp, *AB_PARTITIONS.split('/')) |
| 863 | with open(ab_partitions_file) as f: |
| 864 | ab_partitions_lines = f.readlines() |
| 865 | ab_partitions = [line.strip() for line in ab_partitions_lines] |
| 866 | # Assert that all super_block_devices are in ab_partitions |
| 867 | super_device_not_updated = [partition for partition in super_block_devices |
| 868 | if partition not in ab_partitions] |
| 869 | assert not super_device_not_updated, \ |
| 870 | "{} is in super_block_devices but not in {}".format( |
| 871 | super_device_not_updated, AB_PARTITIONS) |
| 872 | # ab_partitions -= (dynamic_partition_list - super_block_devices) |
Kelvin Zhang | 0876c41 | 2020-06-23 15:06:58 -0400 | [diff] [blame] | 873 | new_ab_partitions = common.MakeTempFile( |
| 874 | prefix="ab_partitions", suffix=".txt") |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 875 | with open(new_ab_partitions, 'w') as f: |
| 876 | for partition in ab_partitions: |
| 877 | if (partition in dynamic_partition_list and |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 878 | partition not in super_block_devices): |
Tao Bao | 59cf0c5 | 2019-06-25 10:04:24 -0700 | [diff] [blame] | 879 | logger.info("Dropping %s from ab_partitions.txt", partition) |
| 880 | continue |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 881 | f.write(partition + "\n") |
| 882 | to_delete = [AB_PARTITIONS] |
| 883 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 884 | # Always skip postinstall for a retrofit update. |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 885 | to_delete += [POSTINSTALL_CONFIG] |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 886 | |
| 887 | # Delete dynamic_partitions_info.txt so that brillo_update_payload thinks this |
| 888 | # is a regular update on devices without dynamic partitions support. |
| 889 | to_delete += [DYNAMIC_PARTITION_INFO] |
| 890 | |
Tao Bao | 03fecb6 | 2018-11-28 10:59:23 -0800 | [diff] [blame] | 891 | # Remove the existing partition images as well as the map files. |
Tao Bao | 59cf0c5 | 2019-06-25 10:04:24 -0700 | [diff] [blame] | 892 | to_delete += list(replace.values()) |
Tao Bao | 03fecb6 | 2018-11-28 10:59:23 -0800 | [diff] [blame] | 893 | to_delete += ['IMAGES/{}.map'.format(dev) for dev in super_block_devices] |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 894 | |
| 895 | common.ZipDelete(target_file, to_delete) |
| 896 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 897 | target_zip = zipfile.ZipFile(target_file, 'a', allowZip64=True) |
| 898 | |
| 899 | # Write super_{foo}.img as {foo}.img. |
| 900 | for src, dst in replace.items(): |
| 901 | assert src in namelist, \ |
Tao Bao | 59cf0c5 | 2019-06-25 10:04:24 -0700 | [diff] [blame] | 902 | 'Missing {} in {}; {} cannot be written'.format(src, input_file, dst) |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 903 | unzipped_file = os.path.join(input_tmp, *src.split('/')) |
| 904 | common.ZipWrite(target_zip, unzipped_file, arcname=dst) |
| 905 | |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 906 | # Write new ab_partitions.txt file |
| 907 | common.ZipWrite(target_zip, new_ab_partitions, arcname=AB_PARTITIONS) |
| 908 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 909 | common.ZipClose(target_zip) |
| 910 | |
| 911 | return target_file |
| 912 | |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 913 | |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 914 | def GetTargetFilesZipForCustomImagesUpdates(input_file, custom_images): |
| 915 | """Returns a target-files.zip for custom partitions update. |
| 916 | |
| 917 | This function modifies ab_partitions list with the desired custom partitions |
| 918 | and puts the custom images into the target target-files.zip. |
| 919 | |
| 920 | Args: |
| 921 | input_file: The input target-files.zip filename. |
| 922 | custom_images: A map of custom partitions and custom images. |
| 923 | |
| 924 | Returns: |
| 925 | The filename of a target-files.zip which has renamed the custom images in |
| 926 | the IMAGS/ to their partition names. |
| 927 | """ |
| 928 | # Use zip2zip to avoid extracting the zipfile. |
| 929 | target_file = common.MakeTempFile(prefix="targetfiles-", suffix=".zip") |
| 930 | cmd = ['zip2zip', '-i', input_file, '-o', target_file] |
| 931 | |
| 932 | with zipfile.ZipFile(input_file, allowZip64=True) as input_zip: |
| 933 | namelist = input_zip.namelist() |
| 934 | |
| 935 | # Write {custom_image}.img as {custom_partition}.img. |
| 936 | for custom_partition, custom_image in custom_images.items(): |
| 937 | default_custom_image = '{}.img'.format(custom_partition) |
| 938 | if default_custom_image != custom_image: |
| 939 | logger.info("Update custom partition '%s' with '%s'", |
| 940 | custom_partition, custom_image) |
| 941 | # Default custom image need to be deleted first. |
| 942 | namelist.remove('IMAGES/{}'.format(default_custom_image)) |
| 943 | # IMAGES/{custom_image}.img:IMAGES/{custom_partition}.img. |
| 944 | cmd.extend(['IMAGES/{}:IMAGES/{}'.format(custom_image, |
| 945 | default_custom_image)]) |
| 946 | |
| 947 | cmd.extend(['{}:{}'.format(name, name) for name in namelist]) |
| 948 | common.RunAndCheckOutput(cmd) |
| 949 | |
| 950 | return target_file |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 951 | |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 952 | def GeneratePartitionTimestampFlags(partition_state): |
| 953 | partition_timestamps = [ |
| 954 | part.partition_name + ":" + part.version |
| 955 | for part in partition_state] |
| 956 | return ["--partition_timestamps", ",".join(partition_timestamps)] |
| 957 | |
Kelvin Zhang | 8019572 | 2020-11-04 14:38:34 -0500 | [diff] [blame^] | 958 | def GeneratePartitionTimestampFlagsDowngrade(pre_partition_state, post_partition_state): |
| 959 | assert pre_partition_state is not None |
| 960 | partition_timestamps = {} |
| 961 | for part in pre_partition_state: |
| 962 | partition_timestamps[part.partition_name] = part.version |
| 963 | for part in post_partition_state: |
| 964 | partition_timestamps[part.partition_name] = \ |
| 965 | max(part.version, partition_timestamps[part.partition_name]) |
| 966 | return [ |
| 967 | "--partition_timestamps", |
| 968 | ",".join([key + ":" + val for (key, val) in partition_timestamps.items()]) |
| 969 | ] |
| 970 | |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 971 | def GenerateAbOtaPackage(target_file, output_file, source_file=None): |
Tao Bao | fe5b69a | 2018-03-02 09:47:43 -0800 | [diff] [blame] | 972 | """Generates an Android OTA package that has A/B update payload.""" |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 973 | # Stage the output zip package for package signing. |
Tao Bao | 491d7e2 | 2018-02-21 13:17:22 -0800 | [diff] [blame] | 974 | if not OPTIONS.no_signing: |
| 975 | staging_file = common.MakeTempFile(suffix='.zip') |
| 976 | else: |
| 977 | staging_file = output_file |
Tao Bao | a652c00 | 2018-03-01 19:31:38 -0800 | [diff] [blame] | 978 | output_zip = zipfile.ZipFile(staging_file, "w", |
Kelvin Zhang | 928c234 | 2020-09-22 16:15:57 -0400 | [diff] [blame] | 979 | compression=zipfile.ZIP_DEFLATED, allowZip64=True) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 980 | |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 981 | if source_file is not None: |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 982 | assert "ab_partitions" in OPTIONS.source_info_dict, \ |
| 983 | "META/ab_partitions.txt is required for ab_update." |
| 984 | assert "ab_partitions" in OPTIONS.target_info_dict, \ |
| 985 | "META/ab_partitions.txt is required for ab_update." |
Tao Bao | 1c320f8 | 2019-10-04 23:25:12 -0700 | [diff] [blame] | 986 | target_info = common.BuildInfo(OPTIONS.target_info_dict, OPTIONS.oem_dicts) |
| 987 | source_info = common.BuildInfo(OPTIONS.source_info_dict, OPTIONS.oem_dicts) |
Kelvin Zhang | 31233e5 | 2020-11-03 13:42:46 -0500 | [diff] [blame] | 988 | vendor_prop = source_info.info_dict.get("vendor.build.prop") |
| 989 | if vendor_prop and \ |
| 990 | vendor_prop.GetProp("ro.virtual_ab.compression.enabled") == "true": |
| 991 | # TODO(zhangkelvin) Remove this once FEC on VABC is supported |
| 992 | logger.info("Virtual AB Compression enabled, disabling FEC") |
| 993 | OPTIONS.disable_fec_computation = True |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 994 | else: |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 995 | assert "ab_partitions" in OPTIONS.info_dict, \ |
| 996 | "META/ab_partitions.txt is required for ab_update." |
Tao Bao | 1c320f8 | 2019-10-04 23:25:12 -0700 | [diff] [blame] | 997 | target_info = common.BuildInfo(OPTIONS.info_dict, OPTIONS.oem_dicts) |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 998 | source_info = None |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 999 | |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 1000 | additional_args = [] |
| 1001 | |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 1002 | # Prepare custom images. |
| 1003 | if OPTIONS.custom_images: |
| 1004 | target_file = GetTargetFilesZipForCustomImagesUpdates( |
| 1005 | target_file, OPTIONS.custom_images) |
| 1006 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1007 | if OPTIONS.retrofit_dynamic_partitions: |
| 1008 | target_file = GetTargetFilesZipForRetrofitDynamicPartitions( |
Yifan Hong | b433eba | 2019-03-06 12:42:53 -0800 | [diff] [blame] | 1009 | target_file, target_info.get("super_block_devices").strip().split(), |
| 1010 | target_info.get("dynamic_partition_list").strip().split()) |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 1011 | elif OPTIONS.partial: |
| 1012 | target_file = GetTargetFilesZipForPartialUpdates(target_file, |
| 1013 | OPTIONS.partial) |
| 1014 | additional_args += ["--is_partial_update", "true"] |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1015 | elif OPTIONS.skip_postinstall: |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 1016 | target_file = GetTargetFilesZipWithoutPostinstallConfig(target_file) |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 1017 | # Target_file may have been modified, reparse ab_partitions |
| 1018 | with zipfile.ZipFile(target_file, allowZip64=True) as zfp: |
| 1019 | target_info.info_dict['ab_partitions'] = zfp.read( |
Kelvin Zhang | 31233e5 | 2020-11-03 13:42:46 -0500 | [diff] [blame] | 1020 | AB_PARTITIONS).decode().strip().split("\n") |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 1021 | |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 1022 | # Metadata to comply with Android OTA package format. |
| 1023 | metadata = GetPackageMetadata(target_info, source_info) |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 1024 | # Generate payload. |
| 1025 | payload = Payload() |
| 1026 | |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1027 | partition_timestamps_flags = [] |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 1028 | # Enforce a max timestamp this payload can be applied on top of. |
Tao Bao | ff1b86e | 2017-10-03 14:17:57 -0700 | [diff] [blame] | 1029 | if OPTIONS.downgrade: |
Tao Bao | 2a12ed7 | 2018-01-22 11:35:00 -0800 | [diff] [blame] | 1030 | max_timestamp = source_info.GetBuildProp("ro.build.date.utc") |
Kelvin Zhang | 8019572 | 2020-11-04 14:38:34 -0500 | [diff] [blame^] | 1031 | partition_timestamps_flags = GeneratePartitionTimestampFlagsDowngrade( |
| 1032 | metadata.precondition.partition_state, |
| 1033 | metadata.postcondition.partition_state |
| 1034 | ) |
Tao Bao | ff1b86e | 2017-10-03 14:17:57 -0700 | [diff] [blame] | 1035 | else: |
Tianjie | a207613 | 2020-08-19 17:25:32 -0700 | [diff] [blame] | 1036 | max_timestamp = str(metadata.postcondition.timestamp) |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1037 | partition_timestamps_flags = GeneratePartitionTimestampFlags( |
| 1038 | metadata.postcondition.partition_state) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1039 | |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1040 | additional_args += ["--max_timestamp", max_timestamp] |
| 1041 | |
| 1042 | payload.Generate( |
| 1043 | target_file, |
| 1044 | source_file, |
| 1045 | additional_args + partition_timestamps_flags |
| 1046 | ) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1047 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 1048 | # Sign the payload. |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1049 | payload_signer = PayloadSigner() |
| 1050 | payload.Sign(payload_signer) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1051 | |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 1052 | # Write the payload into output zip. |
| 1053 | payload.WriteToZip(output_zip) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1054 | |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1055 | # Generate and include the secondary payload that installs secondary images |
| 1056 | # (e.g. system_other.img). |
| 1057 | if OPTIONS.include_secondary: |
| 1058 | # We always include a full payload for the secondary slot, even when |
| 1059 | # building an incremental OTA. See the comments for "--include_secondary". |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 1060 | secondary_target_file = GetTargetFilesZipForSecondaryImages( |
| 1061 | target_file, OPTIONS.skip_postinstall) |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 1062 | secondary_payload = Payload(secondary=True) |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1063 | assert not OPTIONS.downgrade |
| 1064 | partition_timestamps_flags = GeneratePartitionTimestampFlags( |
| 1065 | [part |
| 1066 | for part in metadata.postcondition.partition_state |
| 1067 | if part.partition_name not in SECONDARY_PAYLOAD_SKIPPED_IMAGES] |
| 1068 | ) |
Tao Bao | db1fe41 | 2018-02-09 23:15:05 -0800 | [diff] [blame] | 1069 | secondary_payload.Generate(secondary_target_file, |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1070 | additional_args=["--max_timestamp", |
| 1071 | max_timestamp]+partition_timestamps_flags) |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1072 | secondary_payload.Sign(payload_signer) |
Tao Bao | 667ff57 | 2018-02-10 00:02:40 -0800 | [diff] [blame] | 1073 | secondary_payload.WriteToZip(output_zip) |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1074 | |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1075 | # If dm-verity is supported for the device, copy contents of care_map |
| 1076 | # into A/B OTA package. |
Kelvin Zhang | 928c234 | 2020-09-22 16:15:57 -0400 | [diff] [blame] | 1077 | target_zip = zipfile.ZipFile(target_file, "r", allowZip64=True) |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 1078 | if (target_info.get("verity") == "true" or |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 1079 | target_info.get("avb_enable") == "true"): |
Tianjie Xu | 4c05f4a | 2018-09-14 16:24:41 -0700 | [diff] [blame] | 1080 | care_map_list = [x for x in ["care_map.pb", "care_map.txt"] if |
| 1081 | "META/" + x in target_zip.namelist()] |
| 1082 | |
| 1083 | # Adds care_map if either the protobuf format or the plain text one exists. |
| 1084 | if care_map_list: |
| 1085 | care_map_name = care_map_list[0] |
| 1086 | care_map_data = target_zip.read("META/" + care_map_name) |
| 1087 | # In order to support streaming, care_map needs to be packed as |
Tao Bao | 40b1882 | 2018-01-30 18:19:04 -0800 | [diff] [blame] | 1088 | # ZIP_STORED. |
Tianjie Xu | 4c05f4a | 2018-09-14 16:24:41 -0700 | [diff] [blame] | 1089 | common.ZipWriteStr(output_zip, care_map_name, care_map_data, |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 1090 | compress_type=zipfile.ZIP_STORED) |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1091 | else: |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1092 | logger.warning("Cannot find care map file in target_file package") |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1093 | |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1094 | common.ZipClose(target_zip) |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1095 | |
Yifan Hong | 9276cf0 | 2019-08-21 16:37:04 -0700 | [diff] [blame] | 1096 | CheckVintfIfTrebleEnabled(target_file, target_info) |
| 1097 | |
Tao Bao | fe5b69a | 2018-03-02 09:47:43 -0800 | [diff] [blame] | 1098 | # We haven't written the metadata entry yet, which will be handled in |
| 1099 | # FinalizeMetadata(). |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1100 | common.ZipClose(output_zip) |
| 1101 | |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 1102 | # AbOtaPropertyFiles intends to replace StreamingPropertyFiles, as it covers |
| 1103 | # all the info of the latter. However, system updaters and OTA servers need to |
| 1104 | # take time to switch to the new flag. We keep both of the flags for |
| 1105 | # P-timeframe, and will remove StreamingPropertyFiles in later release. |
Tao Bao | d3fc38a | 2018-03-08 16:09:01 -0800 | [diff] [blame] | 1106 | needed_property_files = ( |
Tao Bao | 85f1698 | 2018-03-08 16:28:33 -0800 | [diff] [blame] | 1107 | AbOtaPropertyFiles(), |
Tao Bao | d3fc38a | 2018-03-08 16:09:01 -0800 | [diff] [blame] | 1108 | StreamingPropertyFiles(), |
| 1109 | ) |
| 1110 | FinalizeMetadata(metadata, staging_file, output_file, needed_property_files) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1111 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1112 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1113 | def main(argv): |
| 1114 | |
| 1115 | def option_handler(o, a): |
Tao Bao | 4b76a0e | 2017-10-31 12:13:33 -0700 | [diff] [blame] | 1116 | if o in ("-k", "--package_key"): |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1117 | OPTIONS.package_key = a |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1118 | elif o in ("-i", "--incremental_from"): |
| 1119 | OPTIONS.incremental_source = a |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 1120 | elif o == "--full_radio": |
| 1121 | OPTIONS.full_radio = True |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 1122 | elif o == "--full_bootloader": |
| 1123 | OPTIONS.full_bootloader = True |
Tao Bao | 337633f | 2017-12-06 15:20:19 -0800 | [diff] [blame] | 1124 | elif o == "--wipe_user_data": |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 1125 | OPTIONS.wipe_user_data = True |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1126 | elif o == "--downgrade": |
| 1127 | OPTIONS.downgrade = True |
| 1128 | OPTIONS.wipe_user_data = True |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 1129 | elif o == "--override_timestamp": |
Tao Bao | faa8e0b | 2018-04-12 14:31:43 -0700 | [diff] [blame] | 1130 | OPTIONS.downgrade = True |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 1131 | elif o in ("-o", "--oem_settings"): |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 1132 | OPTIONS.oem_source = a.split(',') |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 1133 | elif o == "--oem_no_mount": |
| 1134 | OPTIONS.oem_no_mount = True |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 1135 | elif o in ("-e", "--extra_script"): |
| 1136 | OPTIONS.extra_script = a |
Martin Blumenstingl | 374e114 | 2014-05-31 20:42:55 +0200 | [diff] [blame] | 1137 | elif o in ("-t", "--worker_threads"): |
| 1138 | if a.isdigit(): |
| 1139 | OPTIONS.worker_threads = int(a) |
| 1140 | else: |
| 1141 | raise ValueError("Cannot parse value %r for option %r - only " |
| 1142 | "integers are allowed." % (a, o)) |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 1143 | elif o in ("-2", "--two_step"): |
| 1144 | OPTIONS.two_step = True |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1145 | elif o == "--include_secondary": |
| 1146 | OPTIONS.include_secondary = True |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 1147 | elif o == "--no_signing": |
Takeshi Kanemoto | e153b34 | 2013-11-14 17:20:50 +0900 | [diff] [blame] | 1148 | OPTIONS.no_signing = True |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1149 | elif o == "--verify": |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 1150 | OPTIONS.verify = True |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 1151 | elif o == "--block": |
| 1152 | OPTIONS.block_based = True |
Doug Zongker | 2556848 | 2014-03-03 10:21:27 -0800 | [diff] [blame] | 1153 | elif o in ("-b", "--binary"): |
| 1154 | OPTIONS.updater_binary = a |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 1155 | elif o == "--stash_threshold": |
| 1156 | try: |
| 1157 | OPTIONS.stash_threshold = float(a) |
| 1158 | except ValueError: |
| 1159 | raise ValueError("Cannot parse value %r for option %r - expecting " |
| 1160 | "a float" % (a, o)) |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 1161 | elif o == "--log_diff": |
| 1162 | OPTIONS.log_diff = a |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1163 | elif o == "--payload_signer": |
| 1164 | OPTIONS.payload_signer = a |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1165 | elif o == "--payload_signer_args": |
| 1166 | OPTIONS.payload_signer_args = shlex.split(a) |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 1167 | elif o == "--payload_signer_maximum_signature_size": |
| 1168 | OPTIONS.payload_signer_maximum_signature_size = a |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 1169 | elif o == "--payload_signer_key_size": |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 1170 | # TODO(Xunchang) remove this option after cleaning up the callers. |
| 1171 | logger.warning("The option '--payload_signer_key_size' is deprecated." |
| 1172 | " Use '--payload_signer_maximum_signature_size' instead.") |
| 1173 | OPTIONS.payload_signer_maximum_signature_size = a |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1174 | elif o == "--extracted_input_target_files": |
| 1175 | OPTIONS.extracted_input = a |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 1176 | elif o == "--skip_postinstall": |
| 1177 | OPTIONS.skip_postinstall = True |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1178 | elif o == "--retrofit_dynamic_partitions": |
| 1179 | OPTIONS.retrofit_dynamic_partitions = True |
xunchang | abfa265 | 2019-02-19 16:27:10 -0800 | [diff] [blame] | 1180 | elif o == "--skip_compatibility_check": |
| 1181 | OPTIONS.skip_compatibility_check = True |
xunchang | 1cfe251 | 2019-02-19 14:14:48 -0800 | [diff] [blame] | 1182 | elif o == "--output_metadata_path": |
| 1183 | OPTIONS.output_metadata_path = a |
Tianjie Xu | 1b07983 | 2019-08-28 12:19:23 -0700 | [diff] [blame] | 1184 | elif o == "--disable_fec_computation": |
| 1185 | OPTIONS.disable_fec_computation = True |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 1186 | elif o == "--force_non_ab": |
| 1187 | OPTIONS.force_non_ab = True |
Tianjie | d686716 | 2020-05-10 14:30:13 -0700 | [diff] [blame] | 1188 | elif o == "--boot_variable_file": |
| 1189 | OPTIONS.boot_variable_file = a |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 1190 | elif o == "--partial": |
| 1191 | partitions = a.split() |
| 1192 | if not partitions: |
| 1193 | raise ValueError("Cannot parse partitions in {}".format(a)) |
| 1194 | OPTIONS.partial = partitions |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 1195 | elif o == "--custom_image": |
| 1196 | custom_partition, custom_image = a.split("=") |
| 1197 | OPTIONS.custom_images[custom_partition] = custom_image |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1198 | else: |
| 1199 | return False |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 1200 | return True |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1201 | |
| 1202 | args = common.ParseOptions(argv, __doc__, |
Tao Bao | 337633f | 2017-12-06 15:20:19 -0800 | [diff] [blame] | 1203 | extra_opts="b:k:i:d:e:t:2o:", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1204 | extra_long_opts=[ |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1205 | "package_key=", |
| 1206 | "incremental_from=", |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 1207 | "full_radio", |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 1208 | "full_bootloader", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1209 | "wipe_user_data", |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1210 | "downgrade", |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 1211 | "override_timestamp", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1212 | "extra_script=", |
| 1213 | "worker_threads=", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1214 | "two_step", |
Tao Bao | f7140c0 | 2018-01-30 17:09:24 -0800 | [diff] [blame] | 1215 | "include_secondary", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1216 | "no_signing", |
| 1217 | "block", |
| 1218 | "binary=", |
| 1219 | "oem_settings=", |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 1220 | "oem_no_mount", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1221 | "verify", |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 1222 | "stash_threshold=", |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 1223 | "log_diff=", |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1224 | "payload_signer=", |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1225 | "payload_signer_args=", |
Tianjie Xu | 21e6deb | 2019-10-07 18:01:00 -0700 | [diff] [blame] | 1226 | "payload_signer_maximum_signature_size=", |
xunchang | 376cc7c | 2019-04-08 23:04:58 -0700 | [diff] [blame] | 1227 | "payload_signer_key_size=", |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1228 | "extracted_input_target_files=", |
Tao Bao | 15a146a | 2018-02-21 16:06:59 -0800 | [diff] [blame] | 1229 | "skip_postinstall", |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1230 | "retrofit_dynamic_partitions", |
xunchang | abfa265 | 2019-02-19 16:27:10 -0800 | [diff] [blame] | 1231 | "skip_compatibility_check", |
xunchang | 1cfe251 | 2019-02-19 14:14:48 -0800 | [diff] [blame] | 1232 | "output_metadata_path=", |
Tianjie Xu | 1b07983 | 2019-08-28 12:19:23 -0700 | [diff] [blame] | 1233 | "disable_fec_computation", |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 1234 | "force_non_ab", |
Tianjie | d686716 | 2020-05-10 14:30:13 -0700 | [diff] [blame] | 1235 | "boot_variable_file=", |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 1236 | "partial=", |
Hongguang Chen | 49ab1b90 | 2020-10-19 14:15:43 -0700 | [diff] [blame] | 1237 | "custom_image=", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1238 | ], extra_option_handler=option_handler) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1239 | |
| 1240 | if len(args) != 2: |
| 1241 | common.Usage(__doc__) |
| 1242 | sys.exit(1) |
| 1243 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1244 | common.InitLogging() |
| 1245 | |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1246 | # Load the build info dicts from the zip directly or the extracted input |
| 1247 | # directory. We don't need to unzip the entire target-files zips, because they |
| 1248 | # won't be needed for A/B OTAs (brillo_update_payload does that on its own). |
| 1249 | # When loading the info dicts, we don't need to provide the second parameter |
| 1250 | # to common.LoadInfoDict(). Specifying the second parameter allows replacing |
| 1251 | # some properties with their actual paths, such as 'selinux_fc', |
| 1252 | # 'ramdisk_dir', which won't be used during OTA generation. |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1253 | if OPTIONS.extracted_input is not None: |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1254 | OPTIONS.info_dict = common.LoadInfoDict(OPTIONS.extracted_input) |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1255 | else: |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1256 | OPTIONS.info_dict = ParseInfoDict(args[0]) |
Kelvin Zhang | 8019572 | 2020-11-04 14:38:34 -0500 | [diff] [blame^] | 1257 | if OPTIONS.partial: |
| 1258 | OPTIONS.info_dict['ab_partitions'] = \ |
| 1259 | list( |
| 1260 | set(OPTIONS.info_dict['ab_partitions']) & set(OPTIONS.partial) |
| 1261 | ) |
| 1262 | |
| 1263 | if OPTIONS.downgrade: |
| 1264 | # We should only allow downgrading incrementals (as opposed to full). |
| 1265 | # Otherwise the device may go back from arbitrary build with this full |
| 1266 | # OTA package. |
| 1267 | if OPTIONS.incremental_source is None: |
| 1268 | raise ValueError("Cannot generate downgradable full OTAs") |
| 1269 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1270 | |
Yifan Hong | 38ab4d8 | 2020-06-18 15:19:56 -0700 | [diff] [blame] | 1271 | # TODO(xunchang) for retrofit and partial updates, maybe we should rebuild the |
| 1272 | # target-file and reload the info_dict. So the info will be consistent with |
| 1273 | # the modified target-file. |
| 1274 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1275 | logger.info("--- target info ---") |
| 1276 | common.DumpInfoDict(OPTIONS.info_dict) |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1277 | |
Kelvin Zhang | 8019572 | 2020-11-04 14:38:34 -0500 | [diff] [blame^] | 1278 | |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1279 | # Load the source build dict if applicable. |
| 1280 | if OPTIONS.incremental_source is not None: |
| 1281 | OPTIONS.target_info_dict = OPTIONS.info_dict |
Kelvin Zhang | a59bb27 | 2020-10-30 12:52:25 -0400 | [diff] [blame] | 1282 | OPTIONS.source_info_dict = ParseInfoDict(OPTIONS.incremental_source) |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1283 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1284 | logger.info("--- source info ---") |
| 1285 | common.DumpInfoDict(OPTIONS.source_info_dict) |
Tao Bao | 2db1385 | 2018-01-08 22:28:57 -0800 | [diff] [blame] | 1286 | |
| 1287 | # Load OEM dicts if provided. |
Tao Bao | 481bab8 | 2017-12-21 11:23:09 -0800 | [diff] [blame] | 1288 | OPTIONS.oem_dicts = _LoadOemDicts(OPTIONS.oem_source) |
| 1289 | |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1290 | # Assume retrofitting dynamic partitions when base build does not set |
Yifan Hong | 5061103 | 2018-11-20 14:27:38 -0800 | [diff] [blame] | 1291 | # use_dynamic_partitions but target build does. |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1292 | if (OPTIONS.source_info_dict and |
Yifan Hong | 5061103 | 2018-11-20 14:27:38 -0800 | [diff] [blame] | 1293 | OPTIONS.source_info_dict.get("use_dynamic_partitions") != "true" and |
Kelvin Zhang | 39aea44 | 2020-08-17 11:04:25 -0400 | [diff] [blame] | 1294 | OPTIONS.target_info_dict.get("use_dynamic_partitions") == "true"): |
Yifan Hong | 50e7954 | 2018-11-08 17:44:12 -0800 | [diff] [blame] | 1295 | if OPTIONS.target_info_dict.get("dynamic_partition_retrofit") != "true": |
| 1296 | raise common.ExternalError( |
| 1297 | "Expect to generate incremental OTA for retrofitting dynamic " |
| 1298 | "partitions, but dynamic_partition_retrofit is not set in target " |
| 1299 | "build.") |
| 1300 | logger.info("Implicitly generating retrofit incremental OTA.") |
| 1301 | OPTIONS.retrofit_dynamic_partitions = True |
| 1302 | |
| 1303 | # Skip postinstall for retrofitting dynamic partitions. |
| 1304 | if OPTIONS.retrofit_dynamic_partitions: |
| 1305 | OPTIONS.skip_postinstall = True |
| 1306 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1307 | ab_update = OPTIONS.info_dict.get("ab_update") == "true" |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 1308 | allow_non_ab = OPTIONS.info_dict.get("allow_non_ab") == "true" |
| 1309 | if OPTIONS.force_non_ab: |
| 1310 | assert allow_non_ab, "--force_non_ab only allowed on devices that supports non-A/B" |
| 1311 | assert ab_update, "--force_non_ab only allowed on A/B devices" |
| 1312 | |
| 1313 | generate_ab = not OPTIONS.force_non_ab and ab_update |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1314 | |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 1315 | # Use the default key to sign the package if not specified with package_key. |
| 1316 | # package_keys are needed on ab_updates, so always define them if an |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 1317 | # A/B update is getting created. |
| 1318 | if not OPTIONS.no_signing or generate_ab: |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 1319 | if OPTIONS.package_key is None: |
| 1320 | OPTIONS.package_key = OPTIONS.info_dict.get( |
| 1321 | "default_system_dev_certificate", |
Dan Willemsen | 0ab1be6 | 2019-04-09 21:35:37 -0700 | [diff] [blame] | 1322 | "build/make/target/product/security/testkey") |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 1323 | # Get signing keys |
| 1324 | OPTIONS.key_passwords = common.GetKeyPasswords([OPTIONS.package_key]) |
| 1325 | |
Yifan Hong | 65afc07 | 2020-04-17 10:08:10 -0700 | [diff] [blame] | 1326 | if generate_ab: |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 1327 | GenerateAbOtaPackage( |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1328 | target_file=args[0], |
| 1329 | output_file=args[1], |
| 1330 | source_file=OPTIONS.incremental_source) |
| 1331 | |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1332 | else: |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 1333 | GenerateNonAbOtaPackage( |
| 1334 | target_file=args[0], |
| 1335 | output_file=args[1], |
| 1336 | source_file=OPTIONS.incremental_source) |
Doug Zongker | fdd8e69 | 2009-08-03 17:27:48 -0700 | [diff] [blame] | 1337 | |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 1338 | # Post OTA generation works. |
| 1339 | if OPTIONS.incremental_source is not None and OPTIONS.log_diff: |
| 1340 | logger.info("Generating diff logs...") |
| 1341 | logger.info("Unzipping target-files for diffing...") |
| 1342 | target_dir = common.UnzipTemp(args[0], TARGET_DIFFING_UNZIP_PATTERN) |
| 1343 | source_dir = common.UnzipTemp( |
| 1344 | OPTIONS.incremental_source, TARGET_DIFFING_UNZIP_PATTERN) |
Doug Zongker | eb0a78a | 2014-01-27 10:01:06 -0800 | [diff] [blame] | 1345 | |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 1346 | with open(OPTIONS.log_diff, 'w') as out_file: |
Tao Bao | f0c4aa2 | 2018-04-30 20:29:30 -0700 | [diff] [blame] | 1347 | target_files_diff.recursiveDiff( |
| 1348 | '', source_dir, target_dir, out_file) |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 1349 | |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1350 | logger.info("done.") |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1351 | |
| 1352 | |
| 1353 | if __name__ == '__main__': |
| 1354 | try: |
Ying Wang | 7e6d4e4 | 2010-12-13 16:25:36 -0800 | [diff] [blame] | 1355 | common.CloseInheritedPipes() |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1356 | main(sys.argv[1:]) |
Tao Bao | 32fcdab | 2018-10-12 10:30:39 -0700 | [diff] [blame] | 1357 | except common.ExternalError: |
| 1358 | logger.exception("\n ERROR:\n") |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1359 | sys.exit(1) |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 1360 | finally: |
| 1361 | common.Cleanup() |