Open source news and updates #135

{"value":"### **November 14th, 2022 - Instalment #135**\n### **Welcome**\n\nWelcome to the Amazon Web Services open source newsletter, edition #135.\n\nWhat do we have in store for you in this weeks instalment? I am happy to report that we have yet more great new projects this week. These include \"sovereign-keys\" and \"nitrogen\" are new projects to help you secure and get started working with enclaves, \"Amazon Web Services-serverless-scheduler\" helps you schedule your events, \"Amazon Web Services-resource-explorer-cli\" provides a command line tool for this new capability, \"workload-discovery-on-Amazon Web Services\" helps you stay on top of your Amazon Web Services workloads, \"\"image-content-moderation\" provide a sample project for image moderation you can integrate into your workflows, \"cloudenv\" is a proof of concept that explores managing secrets and prameters, \"cdk-schema-watcher\" is a tool to help you stay notified of schema changes in your event driven applications, and several other projects to check out.\n\nWe also feature content on Redis, [Amazon EMR](https://aws.amazon.com/cn/emr/?trk=cndc-detail), Amazon Web Services Copilot, Ansible, O3DE, Dagger, Apache Hudi, Apache Flink, Amazon Web Services Amplify, Amazon Web Services AppSync, PostgreSQL, Spring Boot, Amazon Web Services SAM, Micronaut, Apache Iceberg and more. Finally, don't forget the quick updates, video round up and events section. We have the seventh episode of Build on Open Source this Friday, 18th and we are super excited to have as a special guest, Vinoth Chandar, creator of the Apache Hudi project.\n\n### **Feedback**\n\nPlease let me know how we can improve this newsletter as well as how Amazon Web Services can better work with open source projects and technologies by completing ++[this very short survey](https://eventbox.dev/survey/NUSZ91Z)++ that will take you probably less than 30 seconds to complete. Thank you so much!\n\n### **Celebrating open source contributors**\n\nThe articles and projects shared in this newsletter are only possible thanks to the many contributors in open source. I would like to shout out and thank those folks who really do power open source and enable us all to learn and build on top of what they have created.\n\nSo thank you to the following open source heroes: Lars Jacobsson, David Boyne, Agus Marchi, Hardik Singh Behl, Allan Chua, Diego Gomes, Bill Pereira, Lee Hung Nguyen, Jérémie Rondon, Kyle Lee, Mark Sailes, Heather Jeong, Jimmy Kang, Jimmy Tam, Aidan Steele, Shaun Scovil, and Samrose Ahmed.\n\n### **Latest open source projects**\nThe great thing about open source projects is that you can review the source code. If you like the look of these projects, make sure you that take a look at the code, and if it is useful to you, get in touch with the maintainer to provide feedback, suggestions or even submit a contribution.\n\n### **Tools**\n### **workload-discovery-on-Amazon Web Services**\n\n++[workload-discovery-on-Amazon Web Services](https://aws-oss.beachgeek.co.uk/292)++ is a solution to visualize Amazon Web Services Cloud workloads. With it you can build, customize, and share architecture diagrams of your workloads based on live data from Amazon Web Services. The solution maintains an inventory of the Amazon Web Services resources across your accounts and regions, mapping their relationships and displaying them in the user interface.\n\n\n\nYou can view more details by checking out the implementation guide over at, ++[Workload Discovery on Amazon Web Services](https://aws-oss.beachgeek.co.uk/293)++\n\n### **Amazon Web Services-resource-explorer-cli**\n\n++[Amazon Web Services-resource-explorer-cli](https://aws-oss.beachgeek.co.uk/290)++ is the latest project from Amazon Web Services Community Builder Lars Jacobsson, and provide a cli for the recently announced Resource Explorer feature (read more about that in the blog post, ++[Introducing Amazon Web Services Resource Explorer – Quickly Find Resources in Your Amazon Web Services Account](https://aws-oss.beachgeek.co.uk/291)++ from my colleague Danilo Poccia). The cli tool allows you to quickly find what you are looking for in the console before launching the web browser in the right place.\n\n\n\n\n### **cdk-schema-watcher**\n\n++[cdk-schema-watcher](https://aws-oss.beachgeek.co.uk/28y)++ Serverless Developer Advocate and all round open source good guy David Boyne has been hard at the open source forge again, this time with his latest creation, SchemaWatcher. SchemaWatcher is a CDK construct that can help you scale your event-driven architecture by allowing event consumers to subscribe to schema changes. SchemaWatcher was designed to help developers manage their event-driven architecture. Notifying consumers of any changes to event structures can help catch issues before you see them in production. In David's words:\n\nOver time our Event Driven Architectures (EDA) grow and it can become difficult to understand the impact of changes to downstream consumers. Producers can easily change their event schemas without consumers being aware. SchemaWatcher was built to help you setup notifications for your downstream consumers when using EventBridge. Never let a breaking schema scare you again!\n\nDavid's projects have one common trait - amazing documentation, and SchemaWatcher is no different. You can view the documentation at ++[cdk-schema-watcher.vercel.app](https://aws-oss.beachgeek.co.uk/28z)++\n\n### **Amazon Web Services-serverless-scheduler**\n\n++[Amazon Web Services-serverless-scheduler](https://github.com/agusmdev/aws-serverless-scheduler)++ this repo from Agus Marchi is a fork of a similar project (Amazon Web Services-scheduler) but with a narrower focus, scheduling webhook-related tasks. How does it work? The docs have you covered, but to schedule a trigger you have to publish an event (format spec is provided in the docs). There are some limitations to check out, but if you are looking for a way to schedule large amounts of point in time events with a great time precision, and they are webhook related, then this is a project for you my friend.\n\n\n\n### **cloudenv**\n\n++[cloudenv](https://aws-oss.beachgeek.co.uk/28o)++ is an open source proof of concept from Aidan Steele that allows your Amazon Web Services Lambda functions to be configured to use secrets stored in Amazon Web Services Parameter Store and Amazon Web Services Secrets Manager in the same way that Amazon Web Services ECS task definitions can be. Aidan has put together a detailed blog post, ++[Configuration in the cloud](https://aws-oss.beachgeek.co.uk/28p)++, that goes into more details. Take a look and get back to Aidan with your feedback.\n\n\n\n\n\n### **nitrogen**\n\n++[nitrogen](https://aws-oss.beachgeek.co.uk/28v)++ is my vote for coolest project name this week, and is an open source tool for deploying web services to Amazon Web Services Nitro Enclaves. Given a dockerfile and an ssh key, Nitrogen will spin up an EC2, configure the network, and build and deploy your web service. You get back a hostname that’s ready to go. Nitrogen is fully open source and it comes with pre-built scripts for deploying popular services like Nginx, Redis, and MongoDB. This sounds pretty amazing to me, so this is going straight to the top of the todo list.\n\nMake sure you check out the documentation, which really does help explain and show how you might use enclave technology, as well as seeing the other demos from Cape Privacy, which you can find here ++[demos.capeprivacy.com](https://aws-oss.beachgeek.co.uk/28w)++\n\n### **sovereign-keys**\n\n++[sovereign-keys](https://aws-oss.beachgeek.co.uk/289)++ Sovereignty has become a concern for some companies as they plan and move to Cloud computing. This project is designed around the hypothesis that your Cloud provider is not actively seeking to steal your data for its own gain, but rather that it can be forced by the law to surrender your data to a (foreign) government. Sovereign Keys gives you additional data protection guarantees and also provides an excuse that Cloud providers can use to argue they cannot comply with legally issued requests to access your data (e.g. requests issued under the CLOUD Act).\n\n\n\nThere is a lot of stuff to go through in this project, and the examples and documentation is very detailed. Jérémie Rondon has also put together this video to walk you through it too. Grab your favourite beverage and strap yourself in, this is a great deep dive session into how this works.\n\n<video src=\\"https://dev-media.amazoncloud.cn/14ec28c1fb104fd8b3e3e15556bde55b_Sovereign%20Keys%20%EF%BC%9A%20Our%20open%20source%20project%2C%20advancing%20sovereignty%20on%20AWS%20for%20everyone..mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n## **Demos, Samples, Solutions and Workshops**\n### **soap-to-serverless-modern-infrastructure-for-mature-apis**\n\n\n++[soap-to-serverless-modern-infrastructure-for-mature-apis](https://aws-oss.beachgeek.co.uk/28s)++ this project provides a SOAP Service written in NodeJS that communicates with API Gateway which transforms the information payload using VTL to Lambda. Lambda responds back to API Gateway to maintain backward to SOAP and in JSON to REST calls. The repo provides a sample use case as to why this project might be helpful. A company has a legacy application communicating between layers using SOAP Services. The team that is in charge of the business logic wants to start migrating part of the code to Serverless but have backward compatibility with the front-end layer. So communication between the front-end and backend has to remain in SOAP contract but with business logic in serverless solution. This example show how to do that.\n\n\n\n\n### **react_Amazon Web Services_static_hosting**\n\n++[react_Amazon Web Services_static_hosting](https://aws-oss.beachgeek.co.uk/28t)++ is a demo repository from Allan Chua for hosting static React websites using Amazon Web Services, CloudFront, WAF & CloudFront Origin Policies.\n\n\n\n\n### **image-content-moderation**\n\n++[image-content-moderation](https://aws-oss.beachgeek.co.uk/28u)++ is a proof of concept from Hardik Singh Behl, that exposes a single REST API endpoint to set/update user's current profile picture. [Amazon Rekognition](https://aws.amazon.com/cn/rekognition/?trk=cndc-detail) has been integrated in the service layer to detect any inappropriate, suggestive, unwanted or offensive content in the image being uploaded, If any ModerationLabels are detected the API returns HttpStatus.NOT_ACCEPTABLE. On successful content moderation evaluation, HttpStatus.OK is returned by the endpoint. Check the README for a short video of how this works.\n\n### **sagemaker-datawrangler**\n\n++[sagemaker-datawrangler](https://aws-oss.beachgeek.co.uk/286)++ this repo contains example flows that demonstrate how to aggregate and prepare data for Machine Learning using [Amazon SageMaker](https://aws.amazon.com/cn/sagemaker/?trk=cndc-detail) Data Wrangler. Isha Dua has put together a blog post, ++[Use Github Samples with Amazon SageMaker Data Wrangler](https://aws-oss.beachgeek.co.uk/287)++ to help get you started.\n\n\n\n\n## **Amazon Web Services and Community blog posts**\n### **Terraform CDK**\n\n\nShaun Scovil has put together this post, ++[Using Terraform CDK with LocalStack (Python)](https://aws-oss.beachgeek.co.uk/28q)++ (with a nice illustration courtesy of Midjourney) that is intended for anyone who is trying to get Terraform CDK to work with LocalStack. For those who may be unfamiliar, LocalStack is an open source tool that enables you to run cloud service emulator in a single container on your laptop or in your CI environment. Very nice idea and post, so well worth five minutes of your time this week. [hands on]\n\n### **Apache Iceberg**\n\nMatano is an open source security lake platform for Amazon Web Services, which I have featured in previous editions of this newsletter. Samrose Ahmed peeks under the covers as he writes, ++[Automated Iceberg table maintenance](https://aws-oss.beachgeek.co.uk/28r)++ and how table maintenance works and how they are able to run completely serverless Iceberg table maintenance on Amazon Web Services.\n\n\n\n### **Micronaut**\n\nIn a collaboration between Mark Sailes, Heather Jeong, Jimmy Kang, and Jimmy Tam, they have got together to write ++[Improving Developer Productivity at Disney with Serverless and Open Source](https://aws-oss.beachgeek.co.uk/28k)++ where they share how they are combining serverless and open source technologies to improve their ability to deliver business value safely and reliably.\n\n\n\n### **Apache Flink**\n\nApache Flink is an open-source framework and engine for stateful processing of data streams. It’s highly available and scalable, delivering high throughput and low latency for the most demanding stream-processing applications. In ++[Learn more about Apache Flink and Amazon Kinesis Data Analytics with three new videos](https://aws-oss.beachgeek.co.uk/28i)++, there are three new videos for you to learn more about Apache Flink and Kinesis Data Analytics, including open-source contributions to Apache Flink, our learnings from running thousands of Flink jobs on a managed service, and how we use Kinesis Data Analytics and Apache Flink to enable machine learning (ML) in Alexa.\n\n<video src=\\"https://dev-media.amazoncloud.cn/ba9f83f3227848088a4e593bc0740e0c_Practical%20learnings%20from%20running%20thousands%20of%20Flink%20jobs%20%EF%BD%9C%20Amazon%20Web%20Services.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **Amazon Web Services Amplify**\n\nThis week we had a number of great posts for Web and Mobile developers.\n\nIn this first of a two part post, ++[Building Offline first applications with Amazon Web Services Amplify DataStore – Part 1](https://aws-oss.beachgeek.co.uk/28g)++, Diego Gomes shows how ++[Amazon Web Services Amplify DataStore](https://aws-oss.beachgeek.co.uk/28f)++ addresses some of the challenges of building Offline first applications. [hands on]\n\n\n\nFollowing that we had Kyle Lee write, ++[Getting Started with Amazon Web Services Amplify on macOS](https://aws-oss.beachgeek.co.uk/28h)++ who shows you how to use Amplify Auth sign in with web UI to authenticate a user across both macOS and iOS. Get into XCode and off you go...! [hands on]\n\n### **Other posts and quick reads**\n\n- ++[Using Async/Await with Amazon Web Services Amplify Libraries for Swift](https://aws-oss.beachgeek.co.uk/28n)++ shows you how to use async/await with the Amplify Libraries for Swift and demonstrates how efficiently you can write asynchronous code with this new release [hands on]\n- ++[Transfer learning for TensorFlow text classification models in Amazon SageMaker](https://aws-oss.beachgeek.co.uk/288)++ looks at the announcement last week that SageMaker provides a new built-in algorithm for text classification using TensorFlow [hands on]\n- ++[Secure Amazon Web Services AppSync with Amazon Cognito using the Amazon Web Services CDK](https://aws-oss.beachgeek.co.uk/28j)++ provides an overview of Amazon Web Services IAM permissions as they relate to Cognito identity pools, showing how to configure IAM permissions in the CDK [hands on]\n- ++[Secure Amazon Web Services AppSync with API Keys using the Amazon Web Services CDK](https://aws-oss.beachgeek.co.uk/28m)++ is a walkthrough on how access can be enabled for guest users–that is, users that need access to our data, but do not have a mechanism for logging in [hands on]\n- ++[Support JSON data using Amazon RDS for PostgreSQL or Amazon Aurora PostgreSQL and Java Spring Boot on Amazon Web Services](https://aws-oss.beachgeek.co.uk/28l)++ shows you how to support business data captured in JSON format in microservices developed in the Spring Boot Java framework, [Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail) for PostgreSQL, or Aurora PostgreSQL [hands on]\n\n### **Case Studies**\n\n- ++[How Hudl built a cost-optimized Amazon Web Services Glue pipeline with Apache Hudi datasets](https://aws-oss.beachgeek.co.uk/28e)++ in this case study, Hudl (Hudl Agile Sports Technologies, a company that provides tools for coaches and athletes to review game footage and improve individual and team play) share how Apache Hudi enabled them to dramatically improve performance of their data pipeline.\n\n\n\n## **Quick updates**\n### **Redis**\n\n[Amazon ElastiCache](https://aws.amazon.com/cn/elasticache/?trk=cndc-detail) for Redis now supports Redis 7. This release brings several new features to [Amazon ElastiCache](https://aws.amazon.com/cn/elasticache/?trk=cndc-detail) for Redis:\n\n- Redis Functions: ElastiCache for Redis 7 adds support for Redis Functions, and provides a managed experience enabling developers to execute LUA scripts with application logic stored on the ElastiCache cluster, without requiring clients to re-send the scripts to the server with every connection.\n- ACL improvements: ElastiCache for Redis 7 adds support for the next version of Redis Access Control Lists (ACLs). With ElastiCache for Redis 7, clients can now specify multiple sets of permissions on specific keys or keyspaces in Redis.\n- Sharded Pub/Sub: [Amazon ElastiCache](https://aws.amazon.com/cn/elasticache/?trk=cndc-detail) for Redis 7 now gives you the ability to run Redis’ Pub/Sub functionality in a sharded way when running ElastiCache in Cluster Mode Enabled (CME). Redis’ Pub/Sub capabilities enable publishers to issue messages to any number of subscribers on a channel. With [Amazon ElastiCache](https://aws.amazon.com/cn/elasticache/?trk=cndc-detail) for Redis 7, channels are bound to a shard in the ElastiCache cluster, eliminating the need to propagate channel information across shards resulting in improved scalability.\n\n### **[Amazon EMR](https://aws.amazon.com/cn/emr/?trk=cndc-detail)**\n\nAnnounced earlier this week was the general availability of job templates in [Amazon EMR](https://aws.amazon.com/cn/emr/?trk=cndc-detail) on EKS. Job templates allow you to create and store templates to configure Spark applications parameters. This helps you ensure consistent settings across applications by reusing and enforcing configuration overrides in data pipelines.\n\nEMR on EKS applies default Spark settings to optimise an application’s performance when customers use the StartJobRun API to run Spark-based applications and data pipelines. With job templates, data engineers can now define reusable templates to apply additional customisations, configuring executor and driver compute capacity, setting security and governance properties such as IAM roles, and customised docker image to use across multiple applications and data pipelines. Additionally, customers can also enforce specific configuration values, preventing overrides when calling the StartJobRun API using the template. Job templates can be optionally encrypted with customer-managed master keys stored in Amazon Web Services Key Management Service.\n\n### **Amazon Web Services Copilot**\n\nAmazon Web Services announced the general availability of Amazon Web Services Copilot version 1.23 with support for Amazon Web Services App Runner private services. App Runner makes it easier for developers to quickly deploy containerised web applications and APIs to the cloud, at scale, and without having to manage infrastructure. By default, App Runner services are accessible publicly over the internet. Now, with private services you can restrict network access to your internal websites, APIs, and applications to originate from within your [Amazon VPC](https://aws.amazon.com/cn/vpc/?trk=cndc-detail).\n\nWith Amazon Web Services Copilot, you can quickly get started and deploy to [Amazon ECS](https://aws.amazon.com/cn/ecs/?trk=cndc-detail) or Amazon Web Services App Runner with a single command and a Dockerfile. Copilot provides a developer-focused interface and workflows, where users can focus on application architecture by choosing common application and services patterns. Copilot provisions and keeps up to date the necessary Amazon Web Services infrastructure in your account, using the best-practices and infrastructure-as-code artefacts. Now, you have the option of toggling the request-driven Copilot services, powered by App Runner, to be private. Simply specify http.private: true in the Copilot service manifest and run copilot deploy command. Copilot will take care of configuring Amazon Web Services App Runner services to accept traffic only from within [Amazon VPC](https://aws.amazon.com/cn/vpc/?trk=cndc-detail) provisioned for your Copilot environment.\n\n### Videos of the week\n### Ansible\n\nBill Pereira shows you how you can use Ansible to transfer data. between #zOS and #Amazon Web Services, using the #ibm_zos_core modules to backup and restore, and the #AMAZON #Amazon Web Services modules to put and get data from the #S3 buckets.\n\n<video src=\\"https://dev-media.amazoncloud.cn/bc32a5d53d4341fcb40164ba4b5fd3a7_Ansible%20-%20Open%20source%20integrating%20zOS%20and%20AWS.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **O3DE**\n\nIn 2022, there are so many 3D engines that exist that you can barely keep a count on it. With multiple experiences, comes complex design problems to solve on a day to day basis. This is where design systems come in. There's no need to reinvent the wheel; when we can all just align on the most expected and common design patterns for users to experience. The BlueJay Design System is the official design system for Open 3D Engine. Lee Hung Nguyen is your speaker as he outlines what is involved in planning and building the best open source design system for the 3D engine.\n\n<video src=\\"https://dev-media.amazoncloud.cn/3a581307797946109932d6f5e1c707d2_Building%20the%20Best%20Open%20Source%20Design%20System%20for%203D%20Engines%20-%20Lee%20Hung%20Nguyen%2C%20Amazon.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **Dagger**\n\n++[Dagger](https://aws-oss.beachgeek.co.uk/28c)++ is an open source programmable CI/CD engine that runs your pipelines in containers. You can follow along with the Containers on the Couch crew via ++[Twitch](https://aws-oss.beachgeek.co.uk/28b)++ or ++[LinkedIn](https://aws-oss.beachgeek.co.uk/28a)++ as they introduce this project and then walk you through a demo.\n\n### **Amazon Web Services Container Day**\n\nIf you missed the Amazon Web Services sessions at KubeCon NA a few weeks back, the team has your back. They have put together a ++[play list on YouTube](https://aws-oss.beachgeek.co.uk/28d)++ with all the sessions.\n\n\n### **Build on Open Source**\n\nFor those unfamiliar with this show, Build on Open Source is where we go over this newsletter and then invite special guests to dive deep into their open source project. Expect plenty of code, demos and hopefully laughs.\n\nWe have put together a playlist so that you can easily access all the other episodes of the Build on Open Source show. ++[Build on Open Source playlist](https://aws-oss.beachgeek.co.uk/24u)++\n\n## **Events for your diary**\n### **OpenSearch - Development Backlog & Triage Meeting Security**\n### **14th November - 12pm PT**\n\nThe OpenSearch engineering team working on the Security repo have opened up their Backlog & Triage meetings to the public. This is a great opportunity to find out more about the inner workings of open source projects such as OpenSearch. Don't worry if you cannot make this meeting as they are currently scheduled from the 7th of November out through Dec 19th.\n\nCheck out the entire list here.\n\n## **Running Open Source Transcoding Server on [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail)**\n### **Friday, 18th, 19:00 WIB**\n\nJoin Beny Ibrani and the Amazon Web Services User Group Indonesia for this session (local language I believe) where Beny will show you how you can use open source transcoding software running on [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail).\n\nThis session will be streamed on YouTube, so ++[check it out here](https://aws-oss.beachgeek.co.uk/27j)++\n\n### **Build on Amazon Web Services Open Source**\n### **November 18th, 9am BST**\n\n\nJoin us for the sixth episode of the Build on Amazon Web Services series, featuring a live round up of the latest projects and news as well as a special guest speaker. We have another special guest lined up, and we are super happy to speak with Vinoth Chandar, Onehouse CEO/Founder and creator of the Apache Hudi project. Follow the show on @buildonopen for more details. Check it out on ++[https://twitch.tv/aws](https://twitch.tv/aws)++\n\n\n### **Amazon Web Services Elastic Kubernetes Service (EKS) Workshop**\n### **November 10th, London 5pm**\n\nJoin us for an interactive workshop on containers, Docker, Fargate and [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail), hosted by ClearScale and Amazon Web Services. This live, virtual workshop includes three hours of interactive presentation and hands-on lab work. You will take part in the setup and deployment of containers using EKS. Follow along and work directly with Amazon Web Services professionals and ClearScale (an Amazon Web Services Premier Tier Services Partner) in this Level 200 training session.\n\nYou can find out more about this event by ++[checking out the event page and signing up.](https://aws-oss.beachgeek.co.uk/22y)++\n\n### **re:Invent**\n### **November 28th - December 3rd, Las Vegas**\n\nre:Invent is only a few weeks away so I want to share a few things that will hopefully be of interest.\n\nFirst up, we will be running the Build On Live stream throughout re:Invent and we would love to feature you! If either yourself, or perhaps you know a community member going to re:Invent and think they will absolutely love to attend the livestream, we want to hear from you. Please nominate a community member you want to hear from during Build On Live ++[using this survey](https://eventbox.dev/survey/6B0ED1J)++.\n\nSecond, check out this handy way to look at all the amazing open source sessions, then check out this ++[dashboard](https://aws-oss.beachgeek.co.uk/252)++ [sign up required]. I would love to hear which ones you are excited about so please let me know in the comments or via Twitter. If you want to hear what my top three, must watch sessions, then this is what I would attend (sadly, as an Amazon Web Services employee I am not allowed to attend sessions)\n\n\n1. OPN306 Amazon Web Services Lambda Powertools: Lessons from the road to 10 million downloads - Heitor Lessa is going to deliver an amazing session on the journey from idea to one of the most loved and used open source tools for Amazon Web Services Lambda users\n2. BOA204 When security, safety, and urgency all matter: Handling Log4Shell - Cannot wait for this session from Abbey Fuller who will walk us through how we managed this incident\n3. OPN202 Maintaining the Amazon Web Services Amplify Framework in the open - Matt Auerbach and Ashish Nanda are going to share details on how Amplify engineering managers work with the OSS community to build open-source software\n\nThere are many other great open source sessions, and hopefully I will try and put together a more comprehensive list as approach re:Invent.\n\n### **OpenSearch**\n### **Every other Tuesday, 3pm GMT**\n\nThis regular meet-up is for anyone interested in OpenSearch & Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.\n\nSign up to the next session, ++[OpenSearch Community Meeting](https://aws-oss.beachgeek.co.uk/1az)++\n\n## **Stay in touch with open source at Amazon Web Services**\nI hope this summary has been useful. Remember to check out the ++[Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc)++ to keep up to date with all our activity in open source by following us on ++[@AWSOpen](https://twitter.com/AWSOpen)++\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n","render":"<h3><a id=\\"November_14th_2022__Instalment_135_0\\"></a><strong>November 14th, 2022 - Instalment #135</strong></h3>\\n<h3><a id=\\"Welcome_1\\"></a><strong>Welcome</strong></h3>\\n<p>Welcome to the Amazon Web Services open source newsletter, edition #135.</p>\n<p>What do we have in store for you in this weeks instalment? I am happy to report that we have yet more great new projects this week. These include “sovereign-keys” and “nitrogen” are new projects to help you secure and get started working with enclaves, “Amazon Web Services-serverless-scheduler” helps you schedule your events, “Amazon Web Services-resource-explorer-cli” provides a command line tool for this new capability, “workload-discovery-on-Amazon Web Services” helps you stay on top of your Amazon Web Services workloads, &quot;“image-content-moderation” provide a sample project for image moderation you can integrate into your workflows, “cloudenv” is a proof of concept that explores managing secrets and prameters, “cdk-schema-watcher” is a tool to help you stay notified of schema changes in your event driven applications, and several other projects to check out.</p>\n<p>We also feature content on Redis, Amazon EMR, Amazon Web Services Copilot, Ansible, O3DE, Dagger, Apache Hudi, Apache Flink, Amazon Web Services Amplify, Amazon Web Services AppSync, PostgreSQL, Spring Boot, Amazon Web Services SAM, Micronaut, Apache Iceberg and more. Finally, don’t forget the quick updates, video round up and events section. We have the seventh episode of Build on Open Source this Friday, 18th and we are super excited to have as a special guest, Vinoth Chandar, creator of the Apache Hudi project.</p>\n<h3><a id=\\"Feedback_9\\"></a><strong>Feedback</strong></h3>\\n<p>Please let me know how we can improve this newsletter as well as how Amazon Web Services can better work with open source projects and technologies by completing <ins><a href=\\"https://eventbox.dev/survey/NUSZ91Z\\" target=\\"_blank\\">this very short survey</a></ins> that will take you probably less than 30 seconds to complete. Thank you so much!</p>\n<h3><a id=\\"Celebrating_open_source_contributors_13\\"></a><strong>Celebrating open source contributors</strong></h3>\\n<p>The articles and projects shared in this newsletter are only possible thanks to the many contributors in open source. I would like to shout out and thank those folks who really do power open source and enable us all to learn and build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Lars Jacobsson, David Boyne, Agus Marchi, Hardik Singh Behl, Allan Chua, Diego Gomes, Bill Pereira, Lee Hung Nguyen, Jérémie Rondon, Kyle Lee, Mark Sailes, Heather Jeong, Jimmy Kang, Jimmy Tam, Aidan Steele, Shaun Scovil, and Samrose Ahmed.</p>\n<h3><a id=\\"Latest_open_source_projects_19\\"></a><strong>Latest open source projects</strong></h3>\\n<p>The great thing about open source projects is that you can review the source code. If you like the look of these projects, make sure you that take a look at the code, and if it is useful to you, get in touch with the maintainer to provide feedback, suggestions or even submit a contribution.</p>\n<h3><a id=\\"Tools_22\\"></a><strong>Tools</strong></h3>\\n<h3><a id=\\"workloaddiscoveryonAmazon_Web_Services_23\\"></a><strong>workload-discovery-on-Amazon Web Services</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/292\\" target=\\"_blank\\">workload-discovery-on-Amazon Web Services</a></ins> is a solution to visualize Amazon Web Services Cloud workloads. With it you can build, customize, and share architecture diagrams of your workloads based on live data from Amazon Web Services. The solution maintains an inventory of the Amazon Web Services resources across your accounts and regions, mapping their relationships and displaying them in the user interface.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/2e0cbb124e1640e683f81dd18d86b68b_image.png\\" alt=\\"image.png\\" /></p>\n<p>You can view more details by checking out the implementation guide over at, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/293\\" target=\\"_blank\\">Workload Discovery on Amazon Web Services</a></ins></p>\n<h3><a id=\\"Amazon_Web_Servicesresourceexplorercli_31\\"></a><strong>Amazon Web Services-resource-explorer-cli</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/290\\" target=\\"_blank\\">Amazon Web Services-resource-explorer-cli</a></ins> is the latest project from Amazon Web Services Community Builder Lars Jacobsson, and provide a cli for the recently announced Resource Explorer feature (read more about that in the blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/291\\" target=\\"_blank\\">Introducing Amazon Web Services Resource Explorer – Quickly Find Resources in Your Amazon Web Services Account</a></ins> from my colleague Danilo Poccia). The cli tool allows you to quickly find what you are looking for in the console before launching the web browser in the right place.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/588aa48241f84001ba98475ca3884943_demo.gif\\" alt=\\"demo.gif\\" /></p>\n<h3><a id=\\"cdkschemawatcher_38\\"></a><strong>cdk-schema-watcher</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28y\\" target=\\"_blank\\">cdk-schema-watcher</a></ins> Serverless Developer Advocate and all round open source good guy David Boyne has been hard at the open source forge again, this time with his latest creation, SchemaWatcher. SchemaWatcher is a CDK construct that can help you scale your event-driven architecture by allowing event consumers to subscribe to schema changes. SchemaWatcher was designed to help developers manage their event-driven architecture. Notifying consumers of any changes to event structures can help catch issues before you see them in production. In David’s words:</p>\n<p>Over time our Event Driven Architectures (EDA) grow and it can become difficult to understand the impact of changes to downstream consumers. Producers can easily change their event schemas without consumers being aware. SchemaWatcher was built to help you setup notifications for your downstream consumers when using EventBridge. Never let a breaking schema scare you again!</p>\n<p>David’s projects have one common trait - amazing documentation, and SchemaWatcher is no different. You can view the documentation at <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28z\\" target=\\"_blank\\">cdk-schema-watcher.vercel.app</a></ins></p>\n<h3><a id=\\"Amazon_Web_Servicesserverlessscheduler_46\\"></a><strong>Amazon Web Services-serverless-scheduler</strong></h3>\\n<p><ins><a href=\\"https://github.com/agusmdev/aws-serverless-scheduler\\" target=\\"_blank\\">Amazon Web Services-serverless-scheduler</a></ins> this repo from Agus Marchi is a fork of a similar project (Amazon Web Services-scheduler) but with a narrower focus, scheduling webhook-related tasks. How does it work? The docs have you covered, but to schedule a trigger you have to publish an event (format spec is provided in the docs). There are some limitations to check out, but if you are looking for a way to schedule large amounts of point in time events with a great time precision, and they are webhook related, then this is a project for you my friend.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/a84aba62354148d286170eb8c2e174c5_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"cloudenv_52\\"></a><strong>cloudenv</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28o\\" target=\\"_blank\\">cloudenv</a></ins> is an open source proof of concept from Aidan Steele that allows your Amazon Web Services Lambda functions to be configured to use secrets stored in Amazon Web Services Parameter Store and Amazon Web Services Secrets Manager in the same way that Amazon Web Services ECS task definitions can be. Aidan has put together a detailed blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28p\\" target=\\"_blank\\">Configuration in the cloud</a></ins>, that goes into more details. Take a look and get back to Aidan with your feedback.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/fe630d0da3c04b9fbff634ff9b979427_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"nitrogen_60\\"></a><strong>nitrogen</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28v\\" target=\\"_blank\\">nitrogen</a></ins> is my vote for coolest project name this week, and is an open source tool for deploying web services to Amazon Web Services Nitro Enclaves. Given a dockerfile and an ssh key, Nitrogen will spin up an EC2, configure the network, and build and deploy your web service. You get back a hostname that’s ready to go. Nitrogen is fully open source and it comes with pre-built scripts for deploying popular services like Nginx, Redis, and MongoDB. This sounds pretty amazing to me, so this is going straight to the top of the todo list.</p>\n<p>Make sure you check out the documentation, which really does help explain and show how you might use enclave technology, as well as seeing the other demos from Cape Privacy, which you can find here <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28w\\" target=\\"_blank\\">demos.capeprivacy.com</a></ins></p>\n<h3><a id=\\"sovereignkeys_66\\"></a><strong>sovereign-keys</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/289\\" target=\\"_blank\\">sovereign-keys</a></ins> Sovereignty has become a concern for some companies as they plan and move to Cloud computing. This project is designed around the hypothesis that your Cloud provider is not actively seeking to steal your data for its own gain, but rather that it can be forced by the law to surrender your data to a (foreign) government. Sovereign Keys gives you additional data protection guarantees and also provides an excuse that Cloud providers can use to argue they cannot comply with legally issued requests to access your data (e.g. requests issued under the CLOUD Act).</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/da6ab186a9554dae99ced78faae73315_image.png\\" alt=\\"image.png\\" /></p>\n<p>There is a lot of stuff to go through in this project, and the examples and documentation is very detailed. Jérémie Rondon has also put together this video to walk you through it too. Grab your favourite beverage and strap yourself in, this is a great deep dive session into how this works.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/14ec28c1fb104fd8b3e3e15556bde55b_Sovereign%20Keys%20%EF%BC%9A%20Our%20open%20source%20project%2C%20advancing%20sovereignty%20on%20AWS%20for%20everyone..mp4\\" controls=\\"controls\\"></video></p>\\n<h2><a id=\\"Demos_Samples_Solutions_and_Workshops_76\\"></a><strong>Demos, Samples, Solutions and Workshops</strong></h2>\\n<h3><a id=\\"soaptoserverlessmoderninfrastructureformatureapis_77\\"></a><strong>soap-to-serverless-modern-infrastructure-for-mature-apis</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28s\\" target=\\"_blank\\">soap-to-serverless-modern-infrastructure-for-mature-apis</a></ins> this project provides a SOAP Service written in NodeJS that communicates with API Gateway which transforms the information payload using VTL to Lambda. Lambda responds back to API Gateway to maintain backward to SOAP and in JSON to REST calls. The repo provides a sample use case as to why this project might be helpful. A company has a legacy application communicating between layers using SOAP Services. The team that is in charge of the business logic wants to start migrating part of the code to Serverless but have backward compatibility with the front-end layer. So communication between the front-end and backend has to remain in SOAP contract but with business logic in serverless solution. This example show how to do that.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/1bac4114f186499887e913b4dddc67a9_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"react_Amazon_Web_Services_static_hosting_85\\"></a><strong>react_Amazon Web Services_static_hosting</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28t\\" target=\\"_blank\\">react_Amazon Web Services_static_hosting</a></ins> is a demo repository from Allan Chua for hosting static React websites using Amazon Web Services, CloudFront, WAF &amp; CloudFront Origin Policies.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/391323ac1ff44f21ab5eba8966138570_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"imagecontentmoderation_92\\"></a><strong>image-content-moderation</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28u\\" target=\\"_blank\\">image-content-moderation</a></ins> is a proof of concept from Hardik Singh Behl, that exposes a single REST API endpoint to set/update user’s current profile picture. Amazon Rekognition has been integrated in the service layer to detect any inappropriate, suggestive, unwanted or offensive content in the image being uploaded, If any ModerationLabels are detected the API returns HttpStatus.NOT_ACCEPTABLE. On successful content moderation evaluation, HttpStatus.OK is returned by the endpoint. Check the README for a short video of how this works.</p>\n<h3><a id=\\"sagemakerdatawrangler_96\\"></a><strong>sagemaker-datawrangler</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/286\\" target=\\"_blank\\">sagemaker-datawrangler</a></ins> this repo contains example flows that demonstrate how to aggregate and prepare data for Machine Learning using Amazon SageMaker Data Wrangler. Isha Dua has put together a blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/287\\" target=\\"_blank\\">Use Github Samples with Amazon SageMaker Data Wrangler</a></ins> to help get you started.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/8380d803e4e54134b8b1d3bef4fdc9fc_image.png\\" alt=\\"image.png\\" /></p>\n<h2><a id=\\"Amazon_Web_Services_and_Community_blog_posts_103\\"></a><strong>Amazon Web Services and Community blog posts</strong></h2>\\n<h3><a id=\\"Terraform_CDK_104\\"></a><strong>Terraform CDK</strong></h3>\\n<p>Shaun Scovil has put together this post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28q\\" target=\\"_blank\\">Using Terraform CDK with LocalStack (Python)</a></ins> (with a nice illustration courtesy of Midjourney) that is intended for anyone who is trying to get Terraform CDK to work with LocalStack. For those who may be unfamiliar, LocalStack is an open source tool that enables you to run cloud service emulator in a single container on your laptop or in your CI environment. Very nice idea and post, so well worth five minutes of your time this week. [hands on]</p>\n<h3><a id=\\"Apache_Iceberg_109\\"></a><strong>Apache Iceberg</strong></h3>\\n<p>Matano is an open source security lake platform for Amazon Web Services, which I have featured in previous editions of this newsletter. Samrose Ahmed peeks under the covers as he writes, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28r\\" target=\\"_blank\\">Automated Iceberg table maintenance</a></ins> and how table maintenance works and how they are able to run completely serverless Iceberg table maintenance on Amazon Web Services.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/c577b28c47d54bac81174970de047627_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Micronaut_115\\"></a><strong>Micronaut</strong></h3>\\n<p>In a collaboration between Mark Sailes, Heather Jeong, Jimmy Kang, and Jimmy Tam, they have got together to write <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28k\\" target=\\"_blank\\">Improving Developer Productivity at Disney with Serverless and Open Source</a></ins> where they share how they are combining serverless and open source technologies to improve their ability to deliver business value safely and reliably.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/6c2b2e8be1c949e8afcef6f7e8fead44_image.png\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Apache_Flink_121\\"></a><strong>Apache Flink</strong></h3>\\n<p>Apache Flink is an open-source framework and engine for stateful processing of data streams. It’s highly available and scalable, delivering high throughput and low latency for the most demanding stream-processing applications. In <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28i\\" target=\\"_blank\\">Learn more about Apache Flink and Amazon Kinesis Data Analytics with three new videos</a></ins>, there are three new videos for you to learn more about Apache Flink and Kinesis Data Analytics, including open-source contributions to Apache Flink, our learnings from running thousands of Flink jobs on a managed service, and how we use Kinesis Data Analytics and Apache Flink to enable machine learning (ML) in Alexa.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/ba9f83f3227848088a4e593bc0740e0c_Practical%20learnings%20from%20running%20thousands%20of%20Flink%20jobs%20%EF%BD%9C%20Amazon%20Web%20Services.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Amazon_Web_Services_Amplify_127\\"></a><strong>Amazon Web Services Amplify</strong></h3>\\n<p>This week we had a number of great posts for Web and Mobile developers.</p>\n<p>In this first of a two part post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28g\\" target=\\"_blank\\">Building Offline first applications with Amazon Web Services Amplify DataStore – Part 1</a></ins>, Diego Gomes shows how <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28f\\" target=\\"_blank\\">Amazon Web Services Amplify DataStore</a></ins> addresses some of the challenges of building Offline first applications. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/7cf41921296541d48066533a82081896_image.png\\" alt=\\"image.png\\" /></p>\n<p>Following that we had Kyle Lee write, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28h\\" target=\\"_blank\\">Getting Started with Amazon Web Services Amplify on macOS</a></ins> who shows you how to use Amplify Auth sign in with web UI to authenticate a user across both macOS and iOS. Get into XCode and off you go…! [hands on]</p>\n<h3><a id=\\"Other_posts_and_quick_reads_137\\"></a><strong>Other posts and quick reads</strong></h3>\\n<ul>\\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28n\\" target=\\"_blank\\">Using Async/Await with Amazon Web Services Amplify Libraries for Swift</a></ins> shows you how to use async/await with the Amplify Libraries for Swift and demonstrates how efficiently you can write asynchronous code with this new release [hands on]</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/288\\" target=\\"_blank\\">Transfer learning for TensorFlow text classification models in Amazon SageMaker</a></ins> looks at the announcement last week that SageMaker provides a new built-in algorithm for text classification using TensorFlow [hands on]</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28j\\" target=\\"_blank\\">Secure Amazon Web Services AppSync with Amazon Cognito using the Amazon Web Services CDK</a></ins> provides an overview of Amazon Web Services IAM permissions as they relate to Cognito identity pools, showing how to configure IAM permissions in the CDK [hands on]</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28m\\" target=\\"_blank\\">Secure Amazon Web Services AppSync with API Keys using the Amazon Web Services CDK</a></ins> is a walkthrough on how access can be enabled for guest users–that is, users that need access to our data, but do not have a mechanism for logging in [hands on]</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28l\\" target=\\"_blank\\">Support JSON data using Amazon RDS for PostgreSQL or Amazon Aurora PostgreSQL and Java Spring Boot on Amazon Web Services</a></ins> shows you how to support business data captured in JSON format in microservices developed in the Spring Boot Java framework, Amazon RDS for PostgreSQL, or Aurora PostgreSQL [hands on]</li>\n</ul>\\n<h3><a id=\\"Case_Studies_145\\"></a><strong>Case Studies</strong></h3>\\n<ul>\\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28e\\" target=\\"_blank\\">How Hudl built a cost-optimized Amazon Web Services Glue pipeline with Apache Hudi datasets</a></ins> in this case study, Hudl (Hudl Agile Sports Technologies, a company that provides tools for coaches and athletes to review game footage and improve individual and team play) share how Apache Hudi enabled them to dramatically improve performance of their data pipeline.</li>\n</ul>\\n<p><img src=\\"https://dev-media.amazoncloud.cn/80ba6e871f534bb789eedd4f35aea085_image.png\\" alt=\\"image.png\\" /></p>\n<h2><a id=\\"Quick_updates_151\\"></a><strong>Quick updates</strong></h2>\\n<h3><a id=\\"Redis_152\\"></a><strong>Redis</strong></h3>\\n<p>Amazon ElastiCache for Redis now supports Redis 7. This release brings several new features to Amazon ElastiCache for Redis:</p>\n<ul>\\n<li>Redis Functions: ElastiCache for Redis 7 adds support for Redis Functions, and provides a managed experience enabling developers to execute LUA scripts with application logic stored on the ElastiCache cluster, without requiring clients to re-send the scripts to the server with every connection.</li>\n<li>ACL improvements: ElastiCache for Redis 7 adds support for the next version of Redis Access Control Lists (ACLs). With ElastiCache for Redis 7, clients can now specify multiple sets of permissions on specific keys or keyspaces in Redis.</li>\n<li>Sharded Pub/Sub: Amazon ElastiCache for Redis 7 now gives you the ability to run Redis’ Pub/Sub functionality in a sharded way when running ElastiCache in Cluster Mode Enabled (CME). Redis’ Pub/Sub capabilities enable publishers to issue messages to any number of subscribers on a channel. With Amazon ElastiCache for Redis 7, channels are bound to a shard in the ElastiCache cluster, eliminating the need to propagate channel information across shards resulting in improved scalability.</li>\n</ul>\\n<h3><a id=\\"Amazon_EMR_160\\"></a><strong>Amazon EMR</strong></h3>\\n<p>Announced earlier this week was the general availability of job templates in Amazon EMR on EKS. Job templates allow you to create and store templates to configure Spark applications parameters. This helps you ensure consistent settings across applications by reusing and enforcing configuration overrides in data pipelines.</p>\n<p>EMR on EKS applies default Spark settings to optimise an application’s performance when customers use the StartJobRun API to run Spark-based applications and data pipelines. With job templates, data engineers can now define reusable templates to apply additional customisations, configuring executor and driver compute capacity, setting security and governance properties such as IAM roles, and customised docker image to use across multiple applications and data pipelines. Additionally, customers can also enforce specific configuration values, preventing overrides when calling the StartJobRun API using the template. Job templates can be optionally encrypted with customer-managed master keys stored in Amazon Web Services Key Management Service.</p>\n<h3><a id=\\"Amazon_Web_Services_Copilot_166\\"></a><strong>Amazon Web Services Copilot</strong></h3>\\n<p>Amazon Web Services announced the general availability of Amazon Web Services Copilot version 1.23 with support for Amazon Web Services App Runner private services. App Runner makes it easier for developers to quickly deploy containerised web applications and APIs to the cloud, at scale, and without having to manage infrastructure. By default, App Runner services are accessible publicly over the internet. Now, with private services you can restrict network access to your internal websites, APIs, and applications to originate from within your Amazon VPC.</p>\n<p>With Amazon Web Services Copilot, you can quickly get started and deploy to Amazon ECS or Amazon Web Services App Runner with a single command and a Dockerfile. Copilot provides a developer-focused interface and workflows, where users can focus on application architecture by choosing common application and services patterns. Copilot provisions and keeps up to date the necessary Amazon Web Services infrastructure in your account, using the best-practices and infrastructure-as-code artefacts. Now, you have the option of toggling the request-driven Copilot services, powered by App Runner, to be private. Simply specify http.private: true in the Copilot service manifest and run copilot deploy command. Copilot will take care of configuring Amazon Web Services App Runner services to accept traffic only from within Amazon VPC provisioned for your Copilot environment.</p>\n<h3><a id=\\"Videos_of_the_week_172\\"></a>Videos of the week</h3>\\n<h3><a id=\\"Ansible_173\\"></a>Ansible</h3>\\n<p>Bill Pereira shows you how you can use Ansible to transfer data. between #zOS and #Amazon Web Services, using the #ibm_zos_core modules to backup and restore, and the #AMAZON #Amazon Web Services modules to put and get data from the #S3 buckets.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/bc32a5d53d4341fcb40164ba4b5fd3a7_Ansible%20-%20Open%20source%20integrating%20zOS%20and%20AWS.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"O3DE_179\\"></a><strong>O3DE</strong></h3>\\n<p>In 2022, there are so many 3D engines that exist that you can barely keep a count on it. With multiple experiences, comes complex design problems to solve on a day to day basis. This is where design systems come in. There’s no need to reinvent the wheel; when we can all just align on the most expected and common design patterns for users to experience. The BlueJay Design System is the official design system for Open 3D Engine. Lee Hung Nguyen is your speaker as he outlines what is involved in planning and building the best open source design system for the 3D engine.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/3a581307797946109932d6f5e1c707d2_Building%20the%20Best%20Open%20Source%20Design%20System%20for%203D%20Engines%20-%20Lee%20Hung%20Nguyen%2C%20Amazon.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Dagger_185\\"></a><strong>Dagger</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/28c\\" target=\\"_blank\\">Dagger</a></ins> is an open source programmable CI/CD engine that runs your pipelines in containers. You can follow along with the Containers on the Couch crew via <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28b\\" target=\\"_blank\\">Twitch</a></ins> or <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28a\\" target=\\"_blank\\">LinkedIn</a></ins> as they introduce this project and then walk you through a demo.</p>\n<h3><a id=\\"Amazon_Web_Services_Container_Day_189\\"></a><strong>Amazon Web Services Container Day</strong></h3>\\n<p>If you missed the Amazon Web Services sessions at KubeCon NA a few weeks back, the team has your back. They have put together a <ins><a href=\\"https://aws-oss.beachgeek.co.uk/28d\\" target=\\"_blank\\">play list on YouTube</a></ins> with all the sessions.</p>\n<h3><a id=\\"Build_on_Open_Source_194\\"></a><strong>Build on Open Source</strong></h3>\\n<p>For those unfamiliar with this show, Build on Open Source is where we go over this newsletter and then invite special guests to dive deep into their open source project. Expect plenty of code, demos and hopefully laughs.</p>\n<p>We have put together a playlist so that you can easily access all the other episodes of the Build on Open Source show. <ins><a href=\\"https://aws-oss.beachgeek.co.uk/24u\\" target=\\"_blank\\">Build on Open Source playlist</a></ins></p>\n<h2><a id=\\"Events_for_your_diary_200\\"></a><strong>Events for your diary</strong></h2>\\n<h3><a id=\\"OpenSearch__Development_Backlog__Triage_Meeting_Security_201\\"></a><strong>OpenSearch - Development Backlog &amp; Triage Meeting Security</strong></h3>\\n<h3><a id=\\"14th_November__12pm_PT_202\\"></a><strong>14th November - 12pm PT</strong></h3>\\n<p>The OpenSearch engineering team working on the Security repo have opened up their Backlog &amp; Triage meetings to the public. This is a great opportunity to find out more about the inner workings of open source projects such as OpenSearch. Don’t worry if you cannot make this meeting as they are currently scheduled from the 7th of November out through Dec 19th.</p>\n<p>Check out the entire list here.</p>\n<h2><a id=\\"Running_Open_Source_Transcoding_Server_on_Amazon_EKS_208\\"></a><strong>Running Open Source Transcoding Server on Amazon EKS</strong></h2>\\n<h3><a id=\\"Friday_18th_1900_WIB_209\\"></a><strong>Friday, 18th, 19:00 WIB</strong></h3>\\n<p>Join Beny Ibrani and the Amazon Web Services User Group Indonesia for this session (local language I believe) where Beny will show you how you can use open source transcoding software running on Amazon EKS.</p>\n<p>This session will be streamed on YouTube, so <ins><a href=\\"https://aws-oss.beachgeek.co.uk/27j\\" target=\\"_blank\\">check it out here</a></ins></p>\n<h3><a id=\\"Build_on_Amazon_Web_Services_Open_Source_215\\"></a><strong>Build on Amazon Web Services Open Source</strong></h3>\\n<h3><a id=\\"November_18th_9am_BST_216\\"></a><strong>November 18th, 9am BST</strong></h3>\\n<p>Join us for the sixth episode of the Build on Amazon Web Services series, featuring a live round up of the latest projects and news as well as a special guest speaker. We have another special guest lined up, and we are super happy to speak with Vinoth Chandar, Onehouse CEO/Founder and creator of the Apache Hudi project. Follow the show on @buildonopen for more details. Check it out on <ins><a href=\\"https://twitch.tv/aws\\" target=\\"_blank\\">https://twitch.tv/aws</a></ins></p>\n<h3><a id=\\"Amazon_Web_Services_Elastic_Kubernetes_Service_EKS_Workshop_222\\"></a><strong>Amazon Web Services Elastic Kubernetes Service (EKS) Workshop</strong></h3>\\n<h3><a id=\\"November_10th_London_5pm_223\\"></a><strong>November 10th, London 5pm</strong></h3>\\n<p>Join us for an interactive workshop on containers, Docker, Fargate and Amazon EKS, hosted by ClearScale and Amazon Web Services. This live, virtual workshop includes three hours of interactive presentation and hands-on lab work. You will take part in the setup and deployment of containers using EKS. Follow along and work directly with Amazon Web Services professionals and ClearScale (an Amazon Web Services Premier Tier Services Partner) in this Level 200 training session.</p>\n<p>You can find out more about this event by <ins><a href=\\"https://aws-oss.beachgeek.co.uk/22y\\" target=\\"_blank\\">checking out the event page and signing up.</a></ins></p>\n<h3><a id=\\"reInvent_229\\"></a><strong>re:Invent</strong></h3>\\n<h3><a id=\\"November_28th__December_3rd_Las_Vegas_230\\"></a><strong>November 28th - December 3rd, Las Vegas</strong></h3>\\n<p>re:Invent is only a few weeks away so I want to share a few things that will hopefully be of interest.</p>\n<p>First up, we will be running the Build On Live stream throughout re:Invent and we would love to feature you! If either yourself, or perhaps you know a community member going to re:Invent and think they will absolutely love to attend the livestream, we want to hear from you. Please nominate a community member you want to hear from during Build On Live <ins><a href=\\"https://eventbox.dev/survey/6B0ED1J\\" target=\\"_blank\\">using this survey</a></ins>.</p>\n<p>Second, check out this handy way to look at all the amazing open source sessions, then check out this <ins><a href=\\"https://aws-oss.beachgeek.co.uk/252\\" target=\\"_blank\\">dashboard</a></ins> [sign up required]. I would love to hear which ones you are excited about so please let me know in the comments or via Twitter. If you want to hear what my top three, must watch sessions, then this is what I would attend (sadly, as an Amazon Web Services employee I am not allowed to attend sessions)</p>\n<ol>\\n<li>OPN306 Amazon Web Services Lambda Powertools: Lessons from the road to 10 million downloads - Heitor Lessa is going to deliver an amazing session on the journey from idea to one of the most loved and used open source tools for Amazon Web Services Lambda users</li>\n<li>BOA204 When security, safety, and urgency all matter: Handling Log4Shell - Cannot wait for this session from Abbey Fuller who will walk us through how we managed this incident</li>\n<li>OPN202 Maintaining the Amazon Web Services Amplify Framework in the open - Matt Auerbach and Ashish Nanda are going to share details on how Amplify engineering managers work with the OSS community to build open-source software</li>\n</ol>\\n<p>There are many other great open source sessions, and hopefully I will try and put together a more comprehensive list as approach re:Invent.</p>\n<h3><a id=\\"OpenSearch_245\\"></a><strong>OpenSearch</strong></h3>\\n<h3><a id=\\"Every_other_Tuesday_3pm_GMT_246\\"></a><strong>Every other Tuesday, 3pm GMT</strong></h3>\\n<p>This regular meet-up is for anyone interested in OpenSearch &amp; Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.</p>\n<p>Sign up to the next session, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/1az\\" target=\\"_blank\\">OpenSearch Community Meeting</a></ins></p>\n<h2><a id=\\"Stay_in_touch_with_open_source_at_Amazon_Web_Services_252\\"></a><strong>Stay in touch with open source at Amazon Web Services</strong></h2>\\n<p>I hope this summary has been useful. Remember to check out the <ins><a href=\\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\\" target=\\"_blank\\">Open Source homepage</a></ins> to keep up to date with all our activity in open source by following us on <ins><a href=\\"https://twitter.com/AWSOpen\\" target=\\"_blank\\">@AWSOpen</a></ins></p>\n"}