> ## Documentation Index
> Fetch the complete documentation index at: https://cloud-architect.ipoint-labs.com/llms.txt
> Use this file to discover all available pages before exploring further.
# S3 Batch Operation
> Hands-on lab · 45m
Launch this lab in the IP Lab Portal, then follow the steps below in the AWS console.
Open IP Lab Portal
## Overview
### Lab Details
* In this lab, you will configure and test Amazon S3 Batch Operations to update object access permissions. You'll create a manifest listing multiple JPG objects stored in an S3 bucket and define a batch job to replace their ACLs. The job will run using a dedicated IAM role with the required permissions, making the objects publicly accessible. Finally, you'll verify the completion report to ensure all target objects have been updated successfully.
* Duration: **45 minutes**
* AWS Region: **US East (N. Virginia) us-east-1**
### Introduction
###### Amazon S3 Batch Operations :
* Amazon S3 Batch Operations is a feature that allows you to perform large-scale actions on multiple S3 objects at the same time as long as the objects are in the same bucket.
* You can use it to update object permissions, copy objects, or invoke AWS Lambda functions across thousands or millions of objects.
* All objects in the manifest are processed uniformly, which means changes like making JPG files public are applied consistently.
* It is designed for bulk object management tasks, reducing manual effort and ensuring accurate, auditable operations.
#### Lab Feature :
* This lab shows how to configure Amazon S3 Batch Operations to perform bulk actions on multiple objects in a single bucket. You'll use a manifest to select specific files (e.g., JPGs) and update their permissions to make them public. It demonstrates proper use of CSV manifests and ACL replacement, ensuring consistent and auditable changes across all selected objects.
#### Benefits:
* Efficiently apply operations to thousands of objects in S3 without manual updates.
* Ensures consistency by using a manifest to target specific files, like JPGs.
* Reduces human error and saves time compared to individual object management.
* Provides auditability with completion reports for all performed actions.
### Architecture Diagram
### Task Details :
1. Sign in to the AWS Management Console.
2. Create S3 Bucket
3. Create Manifest file
4. Create Batch Operation
5. Run Batch Operation Job
### Launching Lab Environment
1. To launch the lab environment, click on the **Start Lab** button.
2. Please wait until the cloud environment is provisioned. It will take less than a minute to provision.
3. Once the Lab is started, you will be provided with **IAM username, Password, Access Key,** and **Secret Access Key.**
> **Note :** You can only start one lab at any given time
## Lab guide
### Lab Steps:
#### Task 1: Sign in to AWS Management Console
1. Click on the Open Console button, and you will get redirected to AWS Console in a new browser tab.
2. On the AWS sign-in page,
a. Leave the Account ID as default. Never edit/remove the 12 digit Account ID present in the AWS Console. otherwise, you cannot proceed with the lab.
b. Now copy your **User Name** and **Password** in the Lab Console to the **IAM Username and Password** in AWS Console and click on the **Sign in** button.
3. Once Signed In to the AWS Management Console, Make the default AWS Region as **US East (N. Virginia) us-east-1.**
#### Task 2 : Create S3 Bucket
1. Navigate to the Services menu at the top and click on **S3** in the **Storage** section.
2. In the left menu, choose Buckets, click Create Bucket and fill in the bucket details.
a. Bucket Type Select : **General purpose**
b. Bucket Name: Enter **whiz-batch-operation**
> **Note:** The Bucket Name must be Unique across all existing bucket names in Amazon S3
* Object ownership: Select **ACLs Enabled** option then Choose **Object writer**
* Bucket settings for Block Public Access: **Uncheck** the option, **Block** all **public access** and select the check box option of Acknowledgment.
* Leave other settings as default.
* Click on the **Create Bucket** button.
> **Note:** if you are getting any error please ignore and follow further steps.
#### Task 3 : Create Manifest file
1. Click on your bucket name.
2. Click to download the [ZIP](https://labresources.whizlabs.com/85ca05f72e2bf05429f28cb47f4cb545/sample_files.zip) file, then extract it and upload the files to the S3 bucket.
3. The uploaded files are now visible in the S3 bucket.
4. Click the **photo1.jpg** object to copy its **Object URL**, then paste the URL into a new browser tab.
5. Now we can’t see this because the object is not public.
> **Note :** S3 Batch Operations are typically used with inventory configurations to create a manifest file. However, once an inventory configuration is created, AWS delivers the file within 24 hours. To avoid waiting, this time we create the manifest file manually using Python.
6. Open Cloud Shell present in the top right corner.
7. Paste the following in the cloudshell
```
nano main.py
```
* Replace the bucket name
import boto3
import csv
# Replace the bucket name
bucket\_name = 'my-batch-test-bucket'
output\_file = 'jpg\_manifest.csv'
prefix = ''
s3 = boto3.client('s3')
response = s3.list\_objects\_v2(Bucket=bucket\_name, Prefix=prefix)
with open(output\_file, 'w', newline='') as csvfile:
writer = csv.writer(csvfile)
for obj in response.get('Contents', \[]):
key = obj\['Key']
if key.endswith('.jpg'):
writer.writerow(\[bucket\_name, key])
print(" Manifest created.")
# Upload to S3
s3.upload\_file(output\_file, bucket\_name, 'manifests/jpg\_manifest.csv')
print("Uploaded manifest to S3.")
* Click Ctrl+X, Y and then Click **Enter**
```
python main.py
```
7. Now you can see: 'Manifest created. Uploaded manifest to S3.'
8. Go to the S3 bucket **manifests/** to see the manifest file created: **jpg\_manifest.csv.**
#### Task 4 : Create Batch Operation
1. Go to **Batch Operation.** Click to **Create Job**
2. Scroll down in the Manifest field, choose **CSV**, and in the **Manifest object**, select the S3 bucket where the **manifest file** is located. Then, click Next.
3. In the **'Choose Operation'** field, select **'Replace access control list (ACL)'**.
4. Under 'Everyone (public access)', check the **'Read'** checkbox.
* Also, check the box acknowledging.
* Click Next
5. In the Configure Additional Options section, set the priority to 10.
* Check the box for **Generate completion report** and select **All tasks.**
* In the **Completion Report Destination**, choose your bucket and add **/batch-reports/jpg-acl-job/.**
6. The **Permissions** field, choose **batch\_operation\_role-\,** then click Next
7. Click **Create Job**.
### Task 5 : Run Batch Operation Job
1. Wait for 2 minutes, then the created job will show **'Awaiting your confirmation to run'.** Click to run the job.
2. Now you can see that the job has been successfully completed.
3. Now go to the bucket, copy the **photo1.jpg** object URL, and paste it into a new browser tab.
* Now You can see this Image!
> **Do You Know ?**
> S3 Batch Operations can process millions of objects in a single job, letting you perform tasks like copying, tagging, or updating ACLs efficiently. Completion reports help track success and failure for each object. It can also integrate with AWS Lambda for custom processing of your objects.
### Completion and Conclusion
* You have successfully created a manifest file listing the target JPG files in S3.
* You have configured an S3 Batch Operations job to update the ACL of those objects.
* You have run the Batch Operations job, making the JPG files publicly accessible.
* You have verified that the completion report confirms all objects were processed successfully.
### End Lab
1. Sign out of AWS Account.
2. You have successfully completed the lab.
3. Once you completed the steps, click on **End Lab** from your IP Lab Portal and wait till the process gets completed.
## What gets checked
When you press **Check my work**, the platform verifies each of these:
* **Create acl enabled S3 bucket** — Check whether an S3 Bucket is created with acl enabled or not
* **check s3 object** — Check whether an object is uploaded to the S3 bucket.
## Related help
* [FAQs and Troubleshooting](/aws-saa/support/faqs-and-troubleshooting)
This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.