DynamoDb-Lab 3 Solved

Exercise: Adding multiple items to     
Amazon DynamoDB using the AWS Software Development Kit (AWS SDK)
 
In this exercise, you will learn how to develop with Amazon DynamoDB by using the AWS Software Development Kit (AWS SDK). Following the scenario provided, you will add multiple items into multiple DynamoDB tables using the AWS SDK. This exercise gives you hands-on experience with both Amazon DynamoDB and AWS Cloud9.
Objectives     
 
After completing this exercise, you will be able to use the AWS SDKs to do the following:
         Uploading multiple items to multiple DynamoDB tables.
Story continued     
 
So you now have a proof of concept website that on page load will display dragon cards (albeit 2) using data stored in DynamoDB.
Your website communicates with your API Gateway backend, and currently returns everything in the database.
This is fine for a proof of concept, and when you call Mary and show her the website she is very happy with what you are doing. She tells you that she already has come up with an idea for a card template and asks if you can integrate that too?
You say no problem, and ask her to email it to you along with the JSON files for all the dragon data that she has been promising you all week.
She apologizes about the delay and tells you, you will have it in the next 5 minutes via email.
38 minutes later, you get the email. Your head sinks into your hands, as you see that she has a much more complex data requirement than the one you envisioned.
It is basically a relational data structure with dragons of different types, having different skills and modifiers. Essentially she has given you all the data that would be required for an actual game engine.
You are not building the game engine. She has other people lined up for that, thank goodness. However she still wants you to use DynamoDB to store this data for her, and leverage that to display card data on the website.
You already know how to upload one item at a time with code, but that isn't feasible with the amount of data she has given you.
You need to come up with a script that can upload multiple items to multiple tables (using batch processing).
The 4 JSON files she sent you have the following structure:
DragonStatsTableOne [ 25 items]     
 
DragonStatsTableTwo [25 items]     
(as above) - she just broke them into manageable files, rather than use one big file.
DragonCurrentPowerTable [1 item] - sample item only (table is dynamic)     
 
DragonBonusAttackTable [5 items]     
 
DragonFamilyTable [4 items]     
 
You decide to create a table for each JSON file, and structure it a bit like this:
Dragon Stats Table     
Using dragon name as the Primary Key (PK) as you will want to search for a dragon by name.
dragon_name
(PK)    damage    description    protection    family    location_country    location_city    location_state    Location_neighborhood
cassidiuma    9    Amazing dragon    3    red    usa    las vegas    nevada    spring valley
Dragon current power table [ 1 per game]     
 
Mary tells you that these entries will be created dynamically per game, and she has given you an example.
Although you won't be referring this data in your card viewing website, she gave it to you anyway for context.
You decide that the string game_id (String) should be the primary key (PK). They will want to search on game_id and get a list of all the dragons in play.
game_id (PK)    dragon_name    current_will_not_fight_credits    current_endurance (dynamic)
56syjdh8756    cassidiuma    2    8
Dragon Bonus Attack Table    
As you think that they might want to search for details on a type of breath_attack you choose that as your primary key for this table.
Also you think it would be nice to see if an attack is "in range", so you add a sort key on range to find out if say "a water attack is in range to do damage".
breath_attack(PK)    description    extra_damage    range (SK)
acid    spews acid    3    5
electricty    bolts fly from mouth    3    5
water    high pressure jet over a large area    1    10
fear    Prevent all attacks next round    0    4
fire    Short blast of fire    8    4
Dragon Family Table     
Later on in the game engine, the developers will likely need to be able to bring up information about modifiers relating to the dragon type (family). You decide to use family as the Primary Key (PK).
You feel that this table should probably be merged with the bonus attack table, but you keep it the way it is for now. [You might optimize this later on].
breath_attack    damage_modifer    description    family (PK)    protection_modifier
acid    -2    Better defense    green    2
fire    2    Attacks faster    red    -2
water    1    Happy in water    blue    -1
fear    0    Prefers to bite    black    0
Time to load data     
 
You remember reading about different ways to get data into DynamoDB, and you figure that using the SDK and the batchWriteItem method would be the best option here.
Prepare the exercise     
 
Before you can start this exercise, you need to import some files and install some modules in the AWS Cloud9 environment that has been prepared for you.
1.    Head over to Cloud9.
2.    As you have been working with Cloud9 for the previous exercises we need to make sure you are in the right path in the thermal.
 
You should probably close any AWS Cloud9 tabs you have open, and collapse any inactive folders, as it can get messy with too many code tabs open.
3.    You will need to seed your AWS Cloud9 filesystem with the lab3 content, so go to the AWS Cloud9  bash terminal (at the bottom of the page) and run the following wget command:
4.    To unzip the workdir.zip file, run the following command:
 
5.    To keep things clean, run the following commands to remove the zip file:
6.    Select the black arrow next to the lab3 folder to expand it (collapsing lab 2 and 1 if they are still open). Notice that there is a solution folder in lab3 along with a resources folder. Throughout this exercise, don't peek at the solution unless you really get stuck. Always TRY to code first. We will come back to the resources folder shortly. For now let's set the terminal path to the correct folder.
 
As this course is self-paced, often people will start the lab then come back to it later. In the interim period, we may have made adjustments to the code.
Ensure that inside your lab3 folder that the name of the version markdown file is matching the version number at the top of this document.
If they are out of sync, you will run into problems. To get them synced, simply remove the old folder, ensure you are in the right path in the terminal, and run through the wget steps above one more time.
This lab and future labs are especially prone to getting out of sync, because all the website iterations have alredy been loaded into lab2.
So, if your website is not working as expected for the lab, please double check that lab2 (that contains the website) has not had any updates recently. If your lab2 code versions don't match the version on the lab2 document, you will need to re-upload the website by following the steps one more time from lab2.
 
You are now ready to do the exercise tasks.
Step 1A): Create multiple DynamoDB tables using the SDK     
You already know how to create tables using the AWS-SDK, so creating a few more should be a breeze. Follow these steps, to create the following tables with respective Primary Keys (see tables above).
You have done this before so replace the <FMI>'s in the following script.
1.    Open up lab3/create_multiple_tables.js and edit as needed.
2.    Once you are done choose File and Save .
3.    Run the following:
 
You should see output like the following:
 
 
Note: the only change in terms of code vs what you did last time in lab 1, is that we are using the Async Await feature of Node to allow us to use Promises. Don't get hung up on this stuff, it's just a way to carry out multiple calls to the DB in one script.
Also you may have to wait up to five minutes before all your tables show as ACTIVE.
 
Make sure your tables say Active before moving on.
Step 1B): Add Dragon data to multiple DynamoDB tables using the     BatchWriteItem method (SDK)
1. Open the SDK docs for the language you want to code in, and find the method for creating new items as a batch inside an existing DynamoDB table. Find out the correct method name and establish what parameters you need to pass in.
Language    AWS documentation deep link
NODE.JS
(8.16.0)    https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB.html# batchWriteItem-property
Time to write some code that adds a a batch of items to each of the DynamoDB tables.
1.    Open up the seed_dragons file inside the code folder you are working from, by double clicking on it.
2.    Have the SDK docs open (as above) to help you.
3.    Replace the <FMI> sections of the code in that file, so that the code uploads all the dragon data into new tables. You table should have been called dragons and will be in us-east-1.
4.    You have the dragon data in the JSON files.
5.    Save the file.
6.    Double check your code is correct by looking at the solution file.
7.    Go to the terminal and run your file
8.    node seed_dragons.js
     
 
You should see the following out after running:
 
We can also verify in the DynamoDB console refresh the page, and look at the items tab of one of the tables. In this case let's look at the dragon_bonus_attack table.
 
Step 1C): Delete the old table     
We are no longer going to use the mock dragon database you created in lab1. So this would be a great time to clean it up.
Run this command from the Cloud 9 terminal to remove the old dragon table. Out with the old in with the new.
 
You should see something like this:
 
 
Now our website will break because the API is pointing to a Lambda function that references the table you just removed.
Fear not. All we need to do is edit our Lambda function to point to the right table.
The other day you updated your website to allow a user to search for a specific dragon and bring up just that dragon. They can still select "show all dragons", but you thought it was a nice feature so you added it.
So while we are in there updating the Lambda function, we will have you update the code a little more, to allow for more functionality.
The website needs to show a single dragon card If the website passes a dragon name in the request. If they don't choose a dragon, we just give them a table dump ;)
Step 2: Adjust the lambda function to work with the new database, and filter for just a specific dragon (if asked)
 
So your current API function takes in an empty POST request and spits out everything in the dragon data table.
You will need to modify lab3/scan_dragons.js to allow a user to search for a dragon by name or search for all dragons!
CODE STEPS:     
The solution can be found in the solution folder if you get stuck.
You "could" edit the code directly in the Lambda function, but you would like to test it in AWS Cloud9 first. Then you can copy and paste it into Lambda.
You want to be able to test a "scan all" and a show a specific dragon.
Open the SDK docs and find the method for scanning and filtering with DynamoDB. Find the correct method name and establish what parameters you need to pass in.
Language    AWS documentation deep link
NODE.JS
(8.16.0)    https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB.html #scan-property
Time to write some code that adds a a batch of items to each of the DynamoDB tables.
1.    Open up the scan_dragons file double clicking on it. (note use the scan_dragons.js file inside the lab3 folder not the old lab2 folder)
2.    Collapse and close any files you are not using and have the SDK docs open (as above) to help you.
3.    Replace the <FMI> sections of the code in that file, so that the code scans all the dragon data from the dragon_scan table.
4.    Run the following:
 
5.    You should see the following:
 
6.    Run the following:
 
It should return ALL the dragons in the table.
Step 3: Copy and paste new code into the lambda     console (updating only Lambda and test steps)
 
1.    Pivot back to the console by choosing AWS Cloud9 in the upper left.
2.    Choose Go To Your Dashboard and choose Services and search for Lambda.
3.    Open the DragonSearch function.
4.    Replace the contents of index.js with the new code from scan_dragons .
5.    Choose Save.
6.    Choose Test (using the DragonScan test event).
7.    It should show you a list of dragons in the Details section under Execution results.
8.    Now try searching for a dragon by name.
9.    Click the drop down area next to Test and choose Configure test events.
10.    Select the radio button next to Create new test event.
11.    Under Event name enter JustOneDragon .
12.    Replace the existing content with:
 
13.    Choose Create and then choose Test.
14.    In the Execution results you should see the following:
 
 
Step 4: Test the existing REST API endpoint and     connect it to your website
 
Good news the API you set up in lab2 is pointing to the ARN (Amazon Resource Name) of that Lambda function you just edited.
This means you do not need to re-deploy your API gateway. However, a quick test before checking the website is best practice. So, follow these steps.
1.    Choose Services and search for API Gateway.
2.    Choose the DragonSearchAPI.
3.    Choose POST and select TEST.
You can leave the "request body" blank or use "All" shown below:
 
4.    Choose Test.
You will see all the dragon information returned at the right.
Now let's test for a specific dragon.
5.    In the Request Body paste the following:
 
6.    Choose Test.
7.    You should see the following in the Response Body