Open source news and updates #131

{"value":"## **October 17th, 2022 - Instalment #131**\n\nWelcome to the Amazon Web Services open source newsletter, edition #131. This week's new projects include \"metahub\", a command line way to interact with Amazon Web Services Security Hub, \"somod\" a framework for creating micro applications in serverless, \"terraform-Amazon Web Services-guardduty-multiaccount\" a Terraform module to help you automate your Amazon Web Services Guard Duty configuration, \"Amazon Web Services-glue-cdk-cicd\" a sample project to automate the creation data pipelines using Amazon Web Services Glue, \"go-kafka-event-source\" an Apache Kafka client in Go, \"project-tools\" a tool to help you get insights from your GitHub repo, \"eks-event-watcher\" a command line tool to tail your [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail) logs, \"listmonk-based-edm-solution\" an example of how to deploy this open source mailing list tool, and many more.\n\nFrom projects to blog posts, we have another broad selection of great Amazon Web Services and Community posts covered that include content that features PostgreSQL, Amazon Web Services SAM, Apache Iceberg, Apache Kafka, Karpenter, Amazon Web Services CDK, kubectl, Open Telemetry, Hive Tez, Apache Spark, zstd, and more.\n\nFinally, make sure you check out this weeks videos and review the event listings. Speaking of which, there are a couple of big events around that I want to cover off fist.\n\n\n### **KubeCon**\n\nWith KubeCon happening next week, find out what you can expect to see from Amazon Web Services by checking out this post from Avichal Chum and Phil Estes. In ++[Top Amazon Web Services Open Source Talks at KubeCon + CloudNativeCon 2022](https://aws-oss.beachgeek.co.uk/259)++ they share what is happening on the Amazon Web Services booth and the main conference breakout sessions. Also, if you are going, make sure you check out the Event section below - the Open Source After Dark party is running again. We held this at KubeCon Valencia and it was superb, so it is something you do not want to miss. The party is invite only so reserve your spot (link in the Events section below)\n\n### **re:Invent**\n\nIf you are going to re:Invent, you can now log in and reserve sessions. If you want a handy way to look at all the amazing open source sessions, then check out this ++[dashboard](https://aws-oss.beachgeek.co.uk/252)++ [sign up required]. Would love to hear which ones you are excited about so please let me know in the comments or via Twitter.\n\n### **Feedback**\n\nPlease let me know how we can improve this newsletter as well as how Amazon Web Services can better work with open source projects and technologies by completing ++[this very short survey](https://eventbox.dev/survey/NUSZ91Z)++ that will take you probably less than 30 seconds to complete. Thank you so much!\n\n### **Celebrating open source contributors**\n\nThe articles and projects shared in this newsletter are only possible thanks to the many contributors in open source. I would like to shout out and thank those folks who really do power open source and enable us all to learn and build on top of what they have created.\n\nSo thank you to the following open source heroes: Olly Pomeroy, Praseeda Sathaye, Valentin Widmer, Shardul Srivastava, Deniz Parmaksız, Allan Chua, Michele Mancioppi, Yvo van Zee, Saravanan Gnanaguru, Ali Alemi, Kurt Tometich, Phil Estes, Avichal Chum, Kurt Tometich, Stewart Smith, Murali Krishna, Jeff Marcinko, Brian Zambrano, Eric Johnson, and Gabriel Soltz.\n\n### **Latest open source projects**\n\n*The great thing about open source projects is that you can review the source code. If you like the look of these projects, make sure you that take a look at the code, and if it is useful to you, get in touch with the maintainer to provide feedback, suggestions or even submit a contribution.*\n\n### **Tools**\n\n### **go-kafka-event-source**\n\n++[go-kafka-event-source](https://aws-oss.beachgeek.co.uk/25p)++ is a Go/Kafka client library for developing event sourcing applications. GKES (Go Kafka Event Source) attempts to fill the gaps ub the Go/Kafka library ecosystem. It supplies EOS (Exactly Once Semantics), local state stores and incremental consumer rebalancing to Go Kafka consumer applications, making it a viable alternative to a traditional Kafka Streams application written in Java.\n\n### **somod**\n\n++[somod](https://aws-oss.beachgeek.co.uk/25d)++ this project gets its name from Serverless Optimized MODule. SOMOD is a framework to create reusable micro applications using serverless technologies. The framework helps to develop, build and merge multiple micro applications to create a complete solution. The ++[documentation](https://aws-oss.beachgeek.co.uk/25e)++ and examples resources provide a selection for you to get started.\n\n### **metahub**\n\n++[metahub](https://aws-oss.beachgeek.co.uk/25c)++ is a new open source project from Gabriel Soltz, a command-line utility for Amazon Web Services Security Hub. MetaHub is a command line utility for Amazon Web Services Security Hub that lets you work with multiple standards, multiple checks, and thousands of findings in a very simple and advanced way by sorting, aggregating, filtering, and updating your data. In addition, MetaHub adds MetaChecks, an effortless and flexible way to do any tests on top of your resources to improve the level of confidence in your findings.\n\n### **terraform-Amazon Web Services-guardduty-multiaccount**\n\n++[terraform-Amazon Web Services-guardduty-multiaccount](https://aws-oss.beachgeek.co.uk/25f)++ is a Terraform module can be used to implement Amazon Web Services GuardDuty in a multi-account setup. That is designating a GuardDuty delegated admin account and then configuring the rest of GuardDuty in such account.\n\n### **project-tools**\n\n++[project-tools](https://aws-oss.beachgeek.co.uk/25o)++ is a neat tool fro the OpenSearch project that helps you create metrics reports on a bunch of things such as Pull Request stats, Contributor Lists, Contributor Stats, Issues and more. If you are looking to automate the reporting of your repo, check this tool out.\n\n### **eks-event-watcher**\n\n++[eks-event-watcher](https://aws-oss.beachgeek.co.uk/25q)++ Currently in [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail), the event TTL is set to 60m. Some customers have shown interest to increase the TTL. (aws/containers-roadmap#785). It will be an additional burden if EKS control plane provided the option to increase TTL as this will add load to ETCD and storage. This solution here tries to bridge the gap to capture events beyond 60 minutes to CloudWatch, if the customers still achieve the same. That way control plane event TTL is not modified but at the sametime, if customer wanted to capture the events beyond 60m, they could achieve the same.\n\n\n\n## **Demos, Samples, Solutions and Workshops**\n\n### **listmonk-based-edm-solution**\n\n++[listmonk-based-edm-solution](https://aws-oss.beachgeek.co.uk/25k)++ helps you deploy listmonk on Amazon Web Services. ++[listmonk](https://aws-oss.beachgeek.co.uk/25l)++ is a standalone, self-hosted, newsletter and mailing list manager. It looks pretty nice, and this solution uses [Amazon Simple Email Service](https://aws.amazon.com/cn/ses/?trk=cndc-detail) ([Amazon SES](https://aws.amazon.com/cn/ses/?trk=cndc-detail)) as an email sending platform and integrates a simple and clear operation interface. Users do not need to know about functions of Amazon Web Services. All deployments and installations can be completed with one click, and they can enjoy 62,000 free emails per month on [Amazon SES](https://aws.amazon.com/cn/ses/?trk=cndc-detail). The solution can easily manage mailing lists, subscribers, email templates, campaigns, and features statistics and multilingual support to help users achieve business success.\n\n\n\n\n### **land-rdbms-to-data-lake-at-scale**\n\n++[land-rdbms-to-data-lake-at-scale](https://aws-oss.beachgeek.co.uk/25g)++ provide some sample code to help you build your data lake on Amazon Web Services. When you look to build a data lake on Amazon Web Services, a common data ingestion pattern is to use Amazon Web Services Glue to perform extract, transform, and load (ETL) jobs from relational databases to [Amazon Simple Storage Service](https://aws.amazon.com/cn/s3/?trk=cndc-detail) ([Amazon S3](https://aws.amazon.com/cn/s3/?trk=cndc-detail)). A project often involves extracting hundreds of tables from source databases to the data lake raw layer. To walk you through the code, check out the accompanying blog post,++[ Land data from databases to a data lake at scale using Amazon Web Services Glue blueprints](https://aws-oss.beachgeek.co.uk/25h)++\n\n\n\n### **Amazon Web Services-glue-cdk-cicd**\n\n++[Amazon Web Services-glue-cdk-cicd](https://aws-oss.beachgeek.co.uk/25i)++ this repository demonstrates building a Continuous Integration and Continuous Delivery (CI/CD) pipeline using Amazon Web Services CodeCommit, Amazon Web Services CodeBuild and Amazon Web Services CodePipeline to provision Amazon Web Services Glue based data pipelines using Amazon Web Services Cloud Development Kit (CDK).\n\nThe Amazon Web Services CDK based solution deploys a CI/CD pipeline using Amazon Web Services CodeCommit, Amazon Web Services CodeBuild and Amazon Web Services CodePipeline, executes docker based PyTests and deploys a data pipeline using Amazon Web Services Glue. The data pipeline consists of Amazon Web Services Glue Workflow, Triggers, Jobs and Crawlers. The data pipeline uses COVID-19 Harmonized Data managed by Talend / Stitch to construct a data pipeline.\n\n\n\n## **Amazon Web Services and Community blog posts**\n\n### **zstd**\n\n++[Zstandard](https://aws-oss.beachgeek.co.uk/25n)++, or ++[zstd](https://aws-oss.beachgeek.co.uk/25n)++ as short version, is a fast lossless compression algorithm, targeting real-time compression scenarios at zlib-level and better compression ratios. In this post, ++[Reducing Amazon Web Services Fargate Startup Times with zstd Compressed Container Images](https://aws-oss.beachgeek.co.uk/25m)++ Olly Pomeroy how to use zstd-compressed container images to reduce the time taken to start containerised workloads running on Amazon Web Services Fargate. Very cool post indeed. [hands on]\n\n### **Apache Iceberg**\n\nApache Iceberg is an open source high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data. In this case study, ++[Apache Iceberg Reduced Our Amazon S3 Cost by 90%](https://aws-oss.beachgeek.co.uk/254)++, Deniz Parmaksız shares just why you should starting looking at open source technologies such as Apache Iceberg to enable more cost effective data analytics solutions (as well as providing other features too). This is a great primer post for those wanting to know more.\n\n\n\n### **Apache Kafka**\n\nIn the post, ++[Split your monolithic Apache Kafka clusters using Amazon MSK Serverless](https://aws-oss.beachgeek.co.uk/258)++ Ali Alemi looks at how splitting Apache Kafka clusters helps improve the security, performance, scalability, and reliability of your overall data streaming services and applications.\n\n\n\n\n### **Tekton**\n\nCanary deployment is a deployment strategy that releases a new software version in production by slowly rolling out the change to a small subset of users. Praseeda Sathaye and Valentin Widmer have collaborated on this post, ++[Canary Testing with Amazon Web Services App Mesh and Tekton](https://aws-oss.beachgeek.co.uk/25j)++ where they show you a preview of the talk they will be giving at KubeCon, and provide a hands on guide on how you can automate changes and use popular open source tools such as Tekton and Helm to create some abstractions. [hands on]\n\n\n\n### **Amazon Web Services SAM**\n\nWe have a couple of posts this week covering Amazon Web Services Serverless Application Model (SAM).\n\nFirst up we have Kurt Tometich who writes about Amazon Web Services SAM Connector in hist post, ++[Simplifying serverless permissions with Amazon Web Services SAM Connectors](https://aws-oss.beachgeek.co.uk/25a)++. Amazon Web Services SAW Connector simplifies permission management between serverless components and this post explores how you can speed up serverless development while maintaining secure best practices using Amazon Web Services SAM Connector. [hands on]\n\n\n\nFollowing that we have Allan Chua who writes, ++[An Opinionated View of Amazon Web Services SAM Connectors](https://aws-oss.beachgeek.co.uk/253)++ where he provides his take on Amazon Web Services SAM Connectors, constructs designed to reduce the complexity of authoring IAM permissions that adhere to the least privilege principles. He provides some in depth examples and wants to know if you are using Amazon Web Services SAM Connectors, for your feedback.\n\n\n### **Open Telemetry**\n\nNormally I feature blog posts, but in a break from tradition, I stumbled upon this excellent presentation, ++[Open Telemetry on Amazon Web Services](https://aws-oss.beachgeek.co.uk/250)++ from Michele Mancioppi from Lumigo after reading the always excellent weekly Observability newsletter, ++[o11y.news](https://aws-oss.beachgeek.co.uk/24z)++ from Michael Hausenblas (make sure you subscribe, the content is always excellent).\n\n### **Amazon Web Services Community Builder round-up**\n\nHere are some posts from rhe Amazon Web Services Heroes and Community Builders communities I though were well worth highlighting this week.\n\n\n- ++[Scaling in EKS with Karpenter - Part 1](https://aws-oss.beachgeek.co.uk/255)++ Shardul Srivastava walks you through an overview of what Karpenter is and how it is different to other things you might have used, and then shows you with a hands on example setting this up. If you are looking to test this out, why not take a look at this post [hands on]\n- ++[Securing CDK pipelines in an enterprise organization](https://aws-oss.beachgeek.co.uk/256)++ Yvo van Zee blogs about a presentation given at the Amazon Web Services Community Day in the Netherlands, so if you missed it, then make sure you read this post on what to look out for when using and deploying using Amazon Web Services CDK\n- ++[Introduction to Kubectl CLI Plugins ctx and ns](https://aws-oss.beachgeek.co.uk/257)++ Saravanan Gnanaguru provides his insights into what and how to use plugins when using the kubectl tool for managing Kubernetes. A quick read that summarises things nicely, and looks at two specific plugins [hands on]\n\n\n### **Other posts and quick reads**\n\n- ++[Developing a Remote Job Monitoring Application at the edge using Amazon Web Services IoT Greengrass](https://aws-oss.beachgeek.co.uk/25b)++ a two part, hands on post that shows a UI application at the edge, jointly developed by Amazon Web Services Professional Services and Amazon Web Services Partner, TensorIoT, for remote industrial job monitoring and processing [hands on]\n\n## **Quick updates**\n\n### **Bottlerocket**\n\n++[Bottlerocket v1.10.0](https://aws-oss.beachgeek.co.uk/25r)++ was released this week. Check out the release notes to review all the OS, Orchestrator, Build, Documentation and Platform changes.\n\n### **[Amazon EMR](https://aws.amazon.com/cn/emr/?trk=cndc-detail)**\n\nLast week it was announced that you can now monitor and debug jobs in EMR Serverless using native Apache Spark & Hive Tez UIs. The Apache Spark & Hive Tez UIs present visual interfaces with detailed information about your running and completed jobs. You can dive into job-specific metrics and information about event timelines, stages, tasks, and executors for each job.\n\nAfter you submit a job to an EMR Serverless application, you can view the real-time Spark UI or the Hive Tez UI for the running job from the EMR Studio console or request a secure URL using the GetDashboardForJobRun API. For completed jobs, you can view the Spark History Server or the Persistent Hive Tez UI from the EMR Studio Console.\n\n### **PostgreSQL**\n\nThe Amazon Web Services JDBC Driver for PostgreSQL is now generally available for use with your [Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail) or [Amazon Aurora](https://aws.amazon.com/cn/rds/aurora/?trk=cndc-detail) PostgreSQL-compatible edition database clusters. This wrapper driver is designed to work with the PostgreSQL community driver and provide improved failover handling for clustered databases such as Aurora PostgreSQL. The Amazon Web Services JDBC Driver for PostgreSQL is drop-in compatible with your existing applications because it adds failover functionality alongside the community driver, reducing the need for you to make application changes. This release replaces the standalone Amazon Web Services JDBC Driver for PostgreSQL previously released as a preview.\n\nThe wrapper driver minimizes failover time by monitoring database cluster status and caching the cluster’s topology. The cache is then used to improve DNS name resolution speed if a node fails, reducing failover time from minutes to seconds. It is an open-source project that uses the Apache License v2 and can be installed using Maven, Gradle, or by .jar file.\n\n### **Amazon Web Services Serverless Application Model (SAM)**\n\nServerless application developers can now use the new Amazon Web Services::Serverless::Connector resource available in Amazon Web Services Serverless Application Model (Amazon Web Services SAM) to simplify granting the appropriate level of access to the resources in their application’s infrastructure. With Amazon Web Services::Serverless::Connector resources, developers describe how data and events need to flow between two resources and the type of access required. Amazon Web Services SAM will compose purpose-built Amazon Web Services Identity and Access Management (Amazon Web Services IAM) policies in order to facilitate the interaction defined by the developer in the connector resource.\n\nBy using the Amazon Web Services::Serverless::Connector resource, serverless application developers can quickly compose or update well-scoped IAM policies to their application, speeding up application development while reducing the IAM expertise required. The Amazon Web Services::Serverless::Connector resource will transform into purpose-built IAM policies, using Read or Write permissions specified by the developer to compose the IAM policies from pre-defined sets of policy actions. Customers can use their existing policy review processes by reviewing a Amazon Web Services CloudFormation change set or processed CloudFormation template prior to deployment.\n\n### **Videos of the week**\n\n### **OpenSearch**\n\nFresh from the SDC (Storage Developer Conference) Murali Krishna presents this deep dive on the background of OpenSearch, the search engine storage structure, the need for remote storage, and also addresses design considerations and future-facing work.\n\n<video src=\\"https://dev-media.amazoncloud.cn/dcc68a16d52b48bc8cde3b769e58205f_AWS%20OpenSearch%EF%BC%9A%20Separating%20storage%20and%20compute%20for%20Search%20Engine%20-%20SNIA%20India%202022.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **Amazon Linux**\n\nStewart Smith from Amazon Web Services presents how Amazon is working with Fedora to develop the latest version of Amazon Linux.\n\n<video src=\\"https://dev-media.amazoncloud.cn/31be88ba371345809c92023d9b67bc3c_Amazon%20Linux%202022%20%2B%20Fedora.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **Amazon Web Services SAM**\n\nJeff Marcinko and Brian Zambrano join Eric Johnson to show how to use nested stacks to turbo charge your application lifecycle management when deploying complex serverless applications. See how Amazon Web Services SAM Accelerate speeds up deployment from your local system by bypassing Amazon Web Services CloudFormation to deploy code and resource updates when possible.\n\n<video src=\\"https://dev-media.amazoncloud.cn/1ad27fd6654945b1a3d500c3ecbf2713_AWS%20SAM%20Accelerate%20and%20nested%20stacks%20%EF%BD%9C%20Serverless%20Office%20Hours.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n### **Build on Open Source**\n\nWe have put together a playlist so that you can easily access all episodes of the Build on Open Source show. For those unfamiliar with this show, it is where we go over this newsletter and then invite special guests to dive deep into their open source project. Expect plenty of code, demos and hopefully laughs.\n\n++[Build on Open Source playlist](https://aws-oss.beachgeek.co.uk/24u)++\n\n## **Events for your diary**\n\n### **Hacktoberfest**\n\nOur friends at Steampipe are participating in Hacktoberfest this year, and have put together a page on how you can earn swag for contributions. Check it out for more details, ++[Hacktoberfest 2022: Steampipe](https://aws-oss.beachgeek.co.uk/24t)++\n### **Build on Amazon Web Services with Quarkus Workshop**\n### **Saturday, Oct 15th 3 - 9 pm CET**\n\n\"Build on Amazon Web Services with Quarkus Workshop\", with Julio Faerman, is a 100% practical, full-day workshop to get YOUR web application started and running on Amazon Web Services, using modern Java with Quarkus and other open-source technologies. We'll start from scratch and build a sample application, step by step, so do not worry if you're new to Java or Cloud Computing. All you'll need is a web browser, an Amazon Web Services account and your desire to build.\n\nCheck out more details and save your place, by heading over to the ++[Build on Amazon Web Services with Quarkus Workshop landing page.](https://aws-oss.beachgeek.co.uk/23z)++\n\n### **Build Flutter apps with Amazon Web Services Amplify for mobile, web, and desktop platforms**\n### **October 17th, 11am PT**\n\nBuilding cross-platform apps is becoming increasingly prominent when building products. This is due to the cost savings and operational efficiency builders get from building apps that target multiple platforms such as mobile (iOS/Android), web, and desktop (Windows, MacOS, Linux). The Amplify Libraries allow developers to connect their Flutter apps to an Amazon Web Services backend for building features such as Authentication, storage, and Data interchange operations. In this session, we'll show you can quickly build a feature-rich cross-platform apps that works across mobile, web, and desktop from a single codebase that delight your customers.\n\n++[You can register for this Webinar here](https://aws-oss.beachgeek.co.uk/22v)++.\n\n### **Amazon Web Services Community Day**\n### **Dresden, Germany 19th October**\n\nCheck out this all day Amazon Web Services Community driven and run event that features plenty of open source technologies. From open observability, Amazon Web Services CDK, GitOps using Argo, there are is something for everyone. If you are in Dresden Germany, one to check out.\n\nFind out the full schedule and sign up by checking out the ++[welcome page here](https://aws-oss.beachgeek.co.uk/240)++.\n\n### **Accelerating Adoption of Amazon Web Services Open-Source Observability Services**\n### October 20th, 9am PT\n\nJoin this online tech talk to learn how you can leverage Amazon Web Services managed open-source observability solutions to monitor your containerised or serverless workloads at scale. Unlock observability functionalities in [Amazon Managed Service for Prometheus](https://aws.amazon.com/cn/prometheus/?trk=cndc-detail), [Amazon Managed Grafana](https://aws.amazon.com/cn/grafana/?trk=cndc-detail), and Amazon Web Services Distro for OpenTelemetry and learn how our managed solutions can help you improve MTTD and reduce MTTR, saving you time and money. We’ll demo the [Amazon Elastic Kubernetes Service](https://aws.amazon.com/cn/eks/?trk=cndc-detail) Observability Accelerator and also share what’s new and upcoming in Amazon Web Services Open-Source Observability.\n\nFind out more and ++[register via this link](https://aws-oss.beachgeek.co.uk/22u)++.\n\n\n### **Build on Amazon Web Services Open Source**\n### **October 21st, 9am BST**\n\nJoin us for the fifth episode of the Build on Amazon Web Services series, featuring a live round up of the latest projects and news as well as a special guest speaker. We have another special guest lined up, more details to follow. Follow the show on @buildonopen for more details. Check it out on ++[https://twitch.tv/aws](https://twitch.tv/aws)++\n\n### **KubeCon and CloudNativeCon North America**\n### **October 24th-28th, Detroit USA**\n\nCheck out this blog post from Nathan Taber, ++[Amazon Web Services at KubeCon + CloudNativeCon North America 2022](https://aws-oss.beachgeek.co.uk/243)++ to hear more about what you can expect from Amazon Web Services at this event, including Container Day. If you are going check this post out to see how you can reserve a spot to speak with one of the Amazon Web Services specialists who will be at the booth.\n\n\n\nIf you are attending KubeCon, make sure you do not miss the legendary Open Source After Dark party. You can expect lots of fun activities, great food, music and lots more. Make sure you register to save your spot, as spaces will be limited. Register and relax in the comfort of having your place saved ++[by heading over to this page](https://aws-oss.beachgeek.co.uk/251)++.\n\n### **What's new in [Amazon Aurora](https://aws.amazon.com/cn/rds/aurora/?trk=cndc-detail) MySQL version 3October 25th, 9am PT**\n\n[Amazon Aurora](https://aws.amazon.com/cn/rds/aurora/?trk=cndc-detail) MySQL version 3 compatible with MySQL 8.0, is the latest version of Aurora MySQL. Come learn what makes this the best version of Aurora MySQL to run your relational database workloads. You will learn about the latest innovations in Aurora MySQL version 3 and MySQL 8.0. You will also be introduced to important and breaking behavioural changes in the new version. We will discuss the new version currency adopted with Aurora MySQL version 3 and ways to upgrade from older versions. There will also be a demo of new features like Aurora Serverless v2.\n\n++[Save your place on this online event by checking out the registration page here](https://aws-oss.beachgeek.co.uk/22x)++.\n\n### **Amazon Web Services Elastic Kubernetes Service (EKS) Workshop**\n### **November 10th, London 5pm**\n\nJoin us for an interactive workshop on containers, Docker, Fargate and [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail), hosted by ClearScale and Amazon Web Services. This live, virtual workshop includes three hours of interactive presentation and hands-on lab work. You will take part in the setup and deployment of containers using EKS. Follow along and work directly with Amazon Web Services professionals and ClearScale (an Amazon Web Services Premier Tier Services Partner) in this Level 200 training session.\n\nYou can find out more about this event by ++[checking out the event page and signing up](https://aws-oss.beachgeek.co.uk/22y)++.\n\n### **OpenSearch**\n### **Every other Tuesday, 3pm GMT**\n\nThis regular meet-up is for anyone interested in OpenSearch & Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.\n\nSign up to the next session, ++[OpenSearch Community Meeting](https://aws-oss.beachgeek.co.uk/1az)++\n\n### **Stay in touch with open source at Amazon Web Services**\n\nI hope this summary has been useful. Remember to check out the ++[Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc)++ to keep up to date with all our activity in open source by following us on ++[@AWSOpen](https://twitter.com/AWSOpen)++\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n","render":"<h2><a id=\\"October_17th_2022__Instalment_131_0\\"></a><strong>October 17th, 2022 - Instalment #131</strong></h2>\\n<p>Welcome to the Amazon Web Services open source newsletter, edition #131. This week’s new projects include “metahub”, a command line way to interact with Amazon Web Services Security Hub, “somod” a framework for creating micro applications in serverless, “terraform-Amazon Web Services-guardduty-multiaccount” a Terraform module to help you automate your Amazon Web Services Guard Duty configuration, “Amazon Web Services-glue-cdk-cicd” a sample project to automate the creation data pipelines using Amazon Web Services Glue, “go-kafka-event-source” an Apache Kafka client in Go, “project-tools” a tool to help you get insights from your GitHub repo, “eks-event-watcher” a command line tool to tail your Amazon EKS logs, “listmonk-based-edm-solution” an example of how to deploy this open source mailing list tool, and many more.</p>\n<p>From projects to blog posts, we have another broad selection of great Amazon Web Services and Community posts covered that include content that features PostgreSQL, Amazon Web Services SAM, Apache Iceberg, Apache Kafka, Karpenter, Amazon Web Services CDK, kubectl, Open Telemetry, Hive Tez, Apache Spark, zstd, and more.</p>\n<p>Finally, make sure you check out this weeks videos and review the event listings. Speaking of which, there are a couple of big events around that I want to cover off fist.</p>\n<h3><a id=\\"KubeCon_9\\"></a><strong>KubeCon</strong></h3>\\n<p>With KubeCon happening next week, find out what you can expect to see from Amazon Web Services by checking out this post from Avichal Chum and Phil Estes. In <ins><a href=\\"https://aws-oss.beachgeek.co.uk/259\\" target=\\"_blank\\">Top Amazon Web Services Open Source Talks at KubeCon + CloudNativeCon 2022</a></ins> they share what is happening on the Amazon Web Services booth and the main conference breakout sessions. Also, if you are going, make sure you check out the Event section below - the Open Source After Dark party is running again. We held this at KubeCon Valencia and it was superb, so it is something you do not want to miss. The party is invite only so reserve your spot (link in the Events section below)</p>\n<h3><a id=\\"reInvent_13\\"></a><strong>re:Invent</strong></h3>\\n<p>If you are going to re:Invent, you can now log in and reserve sessions. If you want a handy way to look at all the amazing open source sessions, then check out this <ins><a href=\\"https://aws-oss.beachgeek.co.uk/252\\" target=\\"_blank\\">dashboard</a></ins> [sign up required]. Would love to hear which ones you are excited about so please let me know in the comments or via Twitter.</p>\n<h3><a id=\\"Feedback_17\\"></a><strong>Feedback</strong></h3>\\n<p>Please let me know how we can improve this newsletter as well as how Amazon Web Services can better work with open source projects and technologies by completing <ins><a href=\\"https://eventbox.dev/survey/NUSZ91Z\\" target=\\"_blank\\">this very short survey</a></ins> that will take you probably less than 30 seconds to complete. Thank you so much!</p>\n<h3><a id=\\"Celebrating_open_source_contributors_21\\"></a><strong>Celebrating open source contributors</strong></h3>\\n<p>The articles and projects shared in this newsletter are only possible thanks to the many contributors in open source. I would like to shout out and thank those folks who really do power open source and enable us all to learn and build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Olly Pomeroy, Praseeda Sathaye, Valentin Widmer, Shardul Srivastava, Deniz Parmaksız, Allan Chua, Michele Mancioppi, Yvo van Zee, Saravanan Gnanaguru, Ali Alemi, Kurt Tometich, Phil Estes, Avichal Chum, Kurt Tometich, Stewart Smith, Murali Krishna, Jeff Marcinko, Brian Zambrano, Eric Johnson, and Gabriel Soltz.</p>\n<h3><a id=\\"Latest_open_source_projects_27\\"></a><strong>Latest open source projects</strong></h3>\\n<p><em>The great thing about open source projects is that you can review the source code. If you like the look of these projects, make sure you that take a look at the code, and if it is useful to you, get in touch with the maintainer to provide feedback, suggestions or even submit a contribution.</em></p>\\n<h3><a id=\\"Tools_31\\"></a><strong>Tools</strong></h3>\\n<h3><a id=\\"gokafkaeventsource_33\\"></a><strong>go-kafka-event-source</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25p\\" target=\\"_blank\\">go-kafka-event-source</a></ins> is a Go/Kafka client library for developing event sourcing applications. GKES (Go Kafka Event Source) attempts to fill the gaps ub the Go/Kafka library ecosystem. It supplies EOS (Exactly Once Semantics), local state stores and incremental consumer rebalancing to Go Kafka consumer applications, making it a viable alternative to a traditional Kafka Streams application written in Java.</p>\n<h3><a id=\\"somod_37\\"></a><strong>somod</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25d\\" target=\\"_blank\\">somod</a></ins> this project gets its name from Serverless Optimized MODule. SOMOD is a framework to create reusable micro applications using serverless technologies. The framework helps to develop, build and merge multiple micro applications to create a complete solution. The <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25e\\" target=\\"_blank\\">documentation</a></ins> and examples resources provide a selection for you to get started.</p>\n<h3><a id=\\"metahub_41\\"></a><strong>metahub</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25c\\" target=\\"_blank\\">metahub</a></ins> is a new open source project from Gabriel Soltz, a command-line utility for Amazon Web Services Security Hub. MetaHub is a command line utility for Amazon Web Services Security Hub that lets you work with multiple standards, multiple checks, and thousands of findings in a very simple and advanced way by sorting, aggregating, filtering, and updating your data. In addition, MetaHub adds MetaChecks, an effortless and flexible way to do any tests on top of your resources to improve the level of confidence in your findings.</p>\n<h3><a id=\\"terraformAmazon_Web_Servicesguarddutymultiaccount_45\\"></a><strong>terraform-Amazon Web Services-guardduty-multiaccount</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25f\\" target=\\"_blank\\">terraform-Amazon Web Services-guardduty-multiaccount</a></ins> is a Terraform module can be used to implement Amazon Web Services GuardDuty in a multi-account setup. That is designating a GuardDuty delegated admin account and then configuring the rest of GuardDuty in such account.</p>\n<h3><a id=\\"projecttools_49\\"></a><strong>project-tools</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25o\\" target=\\"_blank\\">project-tools</a></ins> is a neat tool fro the OpenSearch project that helps you create metrics reports on a bunch of things such as Pull Request stats, Contributor Lists, Contributor Stats, Issues and more. If you are looking to automate the reporting of your repo, check this tool out.</p>\n<h3><a id=\\"ekseventwatcher_53\\"></a><strong>eks-event-watcher</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25q\\" target=\\"_blank\\">eks-event-watcher</a></ins> Currently in Amazon EKS, the event TTL is set to 60m. Some customers have shown interest to increase the TTL. (aws/containers-roadmap#785). It will be an additional burden if EKS control plane provided the option to increase TTL as this will add load to ETCD and storage. This solution here tries to bridge the gap to capture events beyond 60 minutes to CloudWatch, if the customers still achieve the same. That way control plane event TTL is not modified but at the sametime, if customer wanted to capture the events beyond 60m, they could achieve the same.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/99e8657f4cd3424794a647bd82a26d0e_184262584-24302dee-2bf6-409e-9de5-c48a5578661c.jpg\\" alt=\\"18426258424302dee2bf6409e9de5c48a5578661c.jpg\\" /></p>\n<h2><a id=\\"Demos_Samples_Solutions_and_Workshops_59\\"></a><strong>Demos, Samples, Solutions and Workshops</strong></h2>\\n<h3><a id=\\"listmonkbasededmsolution_61\\"></a><strong>listmonk-based-edm-solution</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25k\\" target=\\"_blank\\">listmonk-based-edm-solution</a></ins> helps you deploy listmonk on Amazon Web Services. <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25l\\" target=\\"_blank\\">listmonk</a></ins> is a standalone, self-hosted, newsletter and mailing list manager. It looks pretty nice, and this solution uses Amazon Simple Email Service (Amazon SES) as an email sending platform and integrates a simple and clear operation interface. Users do not need to know about functions of Amazon Web Services. All deployments and installations can be completed with one click, and they can enjoy 62,000 free emails per month on Amazon SES. The solution can easily manage mailing lists, subscribers, email templates, campaigns, and features statistics and multilingual support to help users achieve business success.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/15c0575cea964bbdb6998222c0f10707_Architecture.png\\" alt=\\"Architecture.png\\" /></p>\n<h3><a id=\\"landrdbmstodatalakeatscale_68\\"></a><strong>land-rdbms-to-data-lake-at-scale</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25g\\" target=\\"_blank\\">land-rdbms-to-data-lake-at-scale</a></ins> provide some sample code to help you build your data lake on Amazon Web Services. When you look to build a data lake on Amazon Web Services, a common data ingestion pattern is to use Amazon Web Services Glue to perform extract, transform, and load (ETL) jobs from relational databases to Amazon Simple Storage Service (Amazon S3). A project often involves extracting hundreds of tables from source databases to the data lake raw layer. To walk you through the code, check out the accompanying blog post,<ins><a href=\\"https://aws-oss.beachgeek.co.uk/25h\\" target=\\"_blank\\"> Land data from databases to a data lake at scale using Amazon Web Services Glue blueprints</a></ins></p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/acd114908fdd4861a5038ebe9344f958_BDB1902.jpg\\" alt=\\"BDB1902.jpg\\" /></p>\n<h3><a id=\\"Amazon_Web_Servicesgluecdkcicd_74\\"></a><strong>Amazon Web Services-glue-cdk-cicd</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25i\\" target=\\"_blank\\">Amazon Web Services-glue-cdk-cicd</a></ins> this repository demonstrates building a Continuous Integration and Continuous Delivery (CI/CD) pipeline using Amazon Web Services CodeCommit, Amazon Web Services CodeBuild and Amazon Web Services CodePipeline to provision Amazon Web Services Glue based data pipelines using Amazon Web Services Cloud Development Kit (CDK).</p>\n<p>The Amazon Web Services CDK based solution deploys a CI/CD pipeline using Amazon Web Services CodeCommit, Amazon Web Services CodeBuild and Amazon Web Services CodePipeline, executes docker based PyTests and deploys a data pipeline using Amazon Web Services Glue. The data pipeline consists of Amazon Web Services Glue Workflow, Triggers, Jobs and Crawlers. The data pipeline uses COVID-19 Harmonized Data managed by Talend / Stitch to construct a data pipeline.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/57b61663cb384f43aac9627cfa9abf30_architecture-diagram.png\\" alt=\\"architecturediagram.png\\" /></p>\n<h2><a id=\\"Amazon_Web_Services_and_Community_blog_posts_82\\"></a><strong>Amazon Web Services and Community blog posts</strong></h2>\\n<h3><a id=\\"zstd_84\\"></a><strong>zstd</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25n\\" target=\\"_blank\\">Zstandard</a></ins>, or <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25n\\" target=\\"_blank\\">zstd</a></ins> as short version, is a fast lossless compression algorithm, targeting real-time compression scenarios at zlib-level and better compression ratios. In this post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25m\\" target=\\"_blank\\">Reducing Amazon Web Services Fargate Startup Times with zstd Compressed Container Images</a></ins> Olly Pomeroy how to use zstd-compressed container images to reduce the time taken to start containerised workloads running on Amazon Web Services Fargate. Very cool post indeed. [hands on]</p>\n<h3><a id=\\"Apache_Iceberg_88\\"></a><strong>Apache Iceberg</strong></h3>\\n<p>Apache Iceberg is an open source high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data. In this case study, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/254\\" target=\\"_blank\\">Apache Iceberg Reduced Our Amazon S3 Cost by 90%</a></ins>, Deniz Parmaksız shares just why you should starting looking at open source technologies such as Apache Iceberg to enable more cost effective data analytics solutions (as well as providing other features too). This is a great primer post for those wanting to know more.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/5675bb1449444f7198d6891733ab2d9b_1%20QP0D_ZRv_B0HmnIXt7PMeA.png\\" alt=\\"1 QP0D_ZRv_B0HmnIXt7PMeA.png\\" /></p>\n<h3><a id=\\"Apache_Kafka_94\\"></a><strong>Apache Kafka</strong></h3>\\n<p>In the post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/258\\" target=\\"_blank\\">Split your monolithic Apache Kafka clusters using Amazon MSK Serverless</a></ins> Ali Alemi looks at how splitting Apache Kafka clusters helps improve the security, performance, scalability, and reliability of your overall data streaming services and applications.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/46d37489c7114614a8f12fedd6faf929_bdb-2557-write-read-clusters.png\\" alt=\\"bdb2557writereadclusters.png\\" /></p>\n<h3><a id=\\"Tekton_101\\"></a><strong>Tekton</strong></h3>\\n<p>Canary deployment is a deployment strategy that releases a new software version in production by slowly rolling out the change to a small subset of users. Praseeda Sathaye and Valentin Widmer have collaborated on this post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25j\\" target=\\"_blank\\">Canary Testing with Amazon Web Services App Mesh and Tekton</a></ins> where they show you a preview of the talk they will be giving at KubeCon, and provide a hands on guide on how you can automate changes and use popular open source tools such as Tekton and Helm to create some abstractions. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/d32c883a786241988dd79d8316d88237_app-mesh-solution-design-1024x628.jpg\\" alt=\\"appmeshsolutiondesign1024x628.jpg\\" /></p>\n<h3><a id=\\"Amazon_Web_Services_SAM_107\\"></a><strong>Amazon Web Services SAM</strong></h3>\\n<p>We have a couple of posts this week covering Amazon Web Services Serverless Application Model (SAM).</p>\n<p>First up we have Kurt Tometich who writes about Amazon Web Services SAM Connector in hist post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/25a\\" target=\\"_blank\\">Simplifying serverless permissions with Amazon Web Services SAM Connectors</a></ins>. Amazon Web Services SAW Connector simplifies permission management between serverless components and this post explores how you can speed up serverless development while maintaining secure best practices using Amazon Web Services SAM Connector. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/dbc8ee8247394ebbbdd1edce99959ce4_Screen-Shot-2022-10-12-at-10.26.26-AM.jpg\\" alt=\\"ScreenShot20221012at10.26.26AM.jpg\\" /></p>\n<p>Following that we have Allan Chua who writes, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/253\\" target=\\"_blank\\">An Opinionated View of Amazon Web Services SAM Connectors</a></ins> where he provides his take on Amazon Web Services SAM Connectors, constructs designed to reduce the complexity of authoring IAM permissions that adhere to the least privilege principles. He provides some in depth examples and wants to know if you are using Amazon Web Services SAM Connectors, for your feedback.</p>\n<h3><a id=\\"Open_Telemetry_118\\"></a><strong>Open Telemetry</strong></h3>\\n<p>Normally I feature blog posts, but in a break from tradition, I stumbled upon this excellent presentation, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/250\\" target=\\"_blank\\">Open Telemetry on Amazon Web Services</a></ins> from Michele Mancioppi from Lumigo after reading the always excellent weekly Observability newsletter, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/24z\\" target=\\"_blank\\">o11y.news</a></ins> from Michael Hausenblas (make sure you subscribe, the content is always excellent).</p>\n<h3><a id=\\"Amazon_Web_Services_Community_Builder_roundup_122\\"></a><strong>Amazon Web Services Community Builder round-up</strong></h3>\\n<p>Here are some posts from rhe Amazon Web Services Heroes and Community Builders communities I though were well worth highlighting this week.</p>\n<ul>\\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/255\\" target=\\"_blank\\">Scaling in EKS with Karpenter - Part 1</a></ins> Shardul Srivastava walks you through an overview of what Karpenter is and how it is different to other things you might have used, and then shows you with a hands on example setting this up. If you are looking to test this out, why not take a look at this post [hands on]</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/256\\" target=\\"_blank\\">Securing CDK pipelines in an enterprise organization</a></ins> Yvo van Zee blogs about a presentation given at the Amazon Web Services Community Day in the Netherlands, so if you missed it, then make sure you read this post on what to look out for when using and deploying using Amazon Web Services CDK</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/257\\" target=\\"_blank\\">Introduction to Kubectl CLI Plugins ctx and ns</a></ins> Saravanan Gnanaguru provides his insights into what and how to use plugins when using the kubectl tool for managing Kubernetes. A quick read that summarises things nicely, and looks at two specific plugins [hands on]</li>\n</ul>\\n<h3><a id=\\"Other_posts_and_quick_reads_132\\"></a><strong>Other posts and quick reads</strong></h3>\\n<ul>\\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25b\\" target=\\"_blank\\">Developing a Remote Job Monitoring Application at the edge using Amazon Web Services IoT Greengrass</a></ins> a two part, hands on post that shows a UI application at the edge, jointly developed by Amazon Web Services Professional Services and Amazon Web Services Partner, TensorIoT, for remote industrial job monitoring and processing [hands on]</li>\n</ul>\\n<h2><a id=\\"Quick_updates_136\\"></a><strong>Quick updates</strong></h2>\\n<h3><a id=\\"Bottlerocket_138\\"></a><strong>Bottlerocket</strong></h3>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/25r\\" target=\\"_blank\\">Bottlerocket v1.10.0</a></ins> was released this week. Check out the release notes to review all the OS, Orchestrator, Build, Documentation and Platform changes.</p>\n<h3><a id=\\"Amazon_EMR_142\\"></a><strong>Amazon EMR</strong></h3>\\n<p>Last week it was announced that you can now monitor and debug jobs in EMR Serverless using native Apache Spark &amp; Hive Tez UIs. The Apache Spark &amp; Hive Tez UIs present visual interfaces with detailed information about your running and completed jobs. You can dive into job-specific metrics and information about event timelines, stages, tasks, and executors for each job.</p>\n<p>After you submit a job to an EMR Serverless application, you can view the real-time Spark UI or the Hive Tez UI for the running job from the EMR Studio console or request a secure URL using the GetDashboardForJobRun API. For completed jobs, you can view the Spark History Server or the Persistent Hive Tez UI from the EMR Studio Console.</p>\n<h3><a id=\\"PostgreSQL_148\\"></a><strong>PostgreSQL</strong></h3>\\n<p>The Amazon Web Services JDBC Driver for PostgreSQL is now generally available for use with your Amazon RDS or Amazon Aurora PostgreSQL-compatible edition database clusters. This wrapper driver is designed to work with the PostgreSQL community driver and provide improved failover handling for clustered databases such as Aurora PostgreSQL. The Amazon Web Services JDBC Driver for PostgreSQL is drop-in compatible with your existing applications because it adds failover functionality alongside the community driver, reducing the need for you to make application changes. This release replaces the standalone Amazon Web Services JDBC Driver for PostgreSQL previously released as a preview.</p>\n<p>The wrapper driver minimizes failover time by monitoring database cluster status and caching the cluster’s topology. The cache is then used to improve DNS name resolution speed if a node fails, reducing failover time from minutes to seconds. It is an open-source project that uses the Apache License v2 and can be installed using Maven, Gradle, or by .jar file.</p>\n<h3><a id=\\"Amazon_Web_Services_Serverless_Application_Model_SAM_154\\"></a><strong>Amazon Web Services Serverless Application Model (SAM)</strong></h3>\\n<p>Serverless application developers can now use the new Amazon Web Services::Serverless::Connector resource available in Amazon Web Services Serverless Application Model (Amazon Web Services SAM) to simplify granting the appropriate level of access to the resources in their application’s infrastructure. With Amazon Web Services::Serverless::Connector resources, developers describe how data and events need to flow between two resources and the type of access required. Amazon Web Services SAM will compose purpose-built Amazon Web Services Identity and Access Management (Amazon Web Services IAM) policies in order to facilitate the interaction defined by the developer in the connector resource.</p>\n<p>By using the Amazon Web Services::Serverless::Connector resource, serverless application developers can quickly compose or update well-scoped IAM policies to their application, speeding up application development while reducing the IAM expertise required. The Amazon Web Services::Serverless::Connector resource will transform into purpose-built IAM policies, using Read or Write permissions specified by the developer to compose the IAM policies from pre-defined sets of policy actions. Customers can use their existing policy review processes by reviewing a Amazon Web Services CloudFormation change set or processed CloudFormation template prior to deployment.</p>\n<h3><a id=\\"Videos_of_the_week_160\\"></a><strong>Videos of the week</strong></h3>\\n<h3><a id=\\"OpenSearch_162\\"></a><strong>OpenSearch</strong></h3>\\n<p>Fresh from the SDC (Storage Developer Conference) Murali Krishna presents this deep dive on the background of OpenSearch, the search engine storage structure, the need for remote storage, and also addresses design considerations and future-facing work.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/dcc68a16d52b48bc8cde3b769e58205f_AWS%20OpenSearch%EF%BC%9A%20Separating%20storage%20and%20compute%20for%20Search%20Engine%20-%20SNIA%20India%202022.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Amazon_Linux_168\\"></a><strong>Amazon Linux</strong></h3>\\n<p>Stewart Smith from Amazon Web Services presents how Amazon is working with Fedora to develop the latest version of Amazon Linux.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/31be88ba371345809c92023d9b67bc3c_Amazon%20Linux%202022%20%2B%20Fedora.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Amazon_Web_Services_SAM_174\\"></a><strong>Amazon Web Services SAM</strong></h3>\\n<p>Jeff Marcinko and Brian Zambrano join Eric Johnson to show how to use nested stacks to turbo charge your application lifecycle management when deploying complex serverless applications. See how Amazon Web Services SAM Accelerate speeds up deployment from your local system by bypassing Amazon Web Services CloudFormation to deploy code and resource updates when possible.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/1ad27fd6654945b1a3d500c3ecbf2713_AWS%20SAM%20Accelerate%20and%20nested%20stacks%20%EF%BD%9C%20Serverless%20Office%20Hours.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Build_on_Open_Source_180\\"></a><strong>Build on Open Source</strong></h3>\\n<p>We have put together a playlist so that you can easily access all episodes of the Build on Open Source show. For those unfamiliar with this show, it is where we go over this newsletter and then invite special guests to dive deep into their open source project. Expect plenty of code, demos and hopefully laughs.</p>\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/24u\\" target=\\"_blank\\">Build on Open Source playlist</a></ins></p>\n<h2><a id=\\"Events_for_your_diary_186\\"></a><strong>Events for your diary</strong></h2>\\n<h3><a id=\\"Hacktoberfest_188\\"></a><strong>Hacktoberfest</strong></h3>\\n<p>Our friends at Steampipe are participating in Hacktoberfest this year, and have put together a page on how you can earn swag for contributions. Check it out for more details, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/24t\\" target=\\"_blank\\">Hacktoberfest 2022: Steampipe</a></ins></p>\n<h3><a id=\\"Build_on_Amazon_Web_Services_with_Quarkus_Workshop_191\\"></a><strong>Build on Amazon Web Services with Quarkus Workshop</strong></h3>\\n<h3><a id=\\"Saturday_Oct_15th_3__9_pm_CET_192\\"></a><strong>Saturday, Oct 15th 3 - 9 pm CET</strong></h3>\\n<p>“Build on Amazon Web Services with Quarkus Workshop”, with Julio Faerman, is a 100% practical, full-day workshop to get YOUR web application started and running on Amazon Web Services, using modern Java with Quarkus and other open-source technologies. We’ll start from scratch and build a sample application, step by step, so do not worry if you’re new to Java or Cloud Computing. All you’ll need is a web browser, an Amazon Web Services account and your desire to build.</p>\n<p>Check out more details and save your place, by heading over to the <ins><a href=\\"https://aws-oss.beachgeek.co.uk/23z\\" target=\\"_blank\\">Build on Amazon Web Services with Quarkus Workshop landing page.</a></ins></p>\n<h3><a id=\\"Build_Flutter_apps_with_Amazon_Web_Services_Amplify_for_mobile_web_and_desktop_platforms_198\\"></a><strong>Build Flutter apps with Amazon Web Services Amplify for mobile, web, and desktop platforms</strong></h3>\\n<h3><a id=\\"October_17th_11am_PT_199\\"></a><strong>October 17th, 11am PT</strong></h3>\\n<p>Building cross-platform apps is becoming increasingly prominent when building products. This is due to the cost savings and operational efficiency builders get from building apps that target multiple platforms such as mobile (iOS/Android), web, and desktop (Windows, MacOS, Linux). The Amplify Libraries allow developers to connect their Flutter apps to an Amazon Web Services backend for building features such as Authentication, storage, and Data interchange operations. In this session, we’ll show you can quickly build a feature-rich cross-platform apps that works across mobile, web, and desktop from a single codebase that delight your customers.</p>\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/22v\\" target=\\"_blank\\">You can register for this Webinar here</a></ins>.</p>\n<h3><a id=\\"Amazon_Web_Services_Community_Day_205\\"></a><strong>Amazon Web Services Community Day</strong></h3>\\n<h3><a id=\\"Dresden_Germany_19th_October_206\\"></a><strong>Dresden, Germany 19th October</strong></h3>\\n<p>Check out this all day Amazon Web Services Community driven and run event that features plenty of open source technologies. From open observability, Amazon Web Services CDK, GitOps using Argo, there are is something for everyone. If you are in Dresden Germany, one to check out.</p>\n<p>Find out the full schedule and sign up by checking out the <ins><a href=\\"https://aws-oss.beachgeek.co.uk/240\\" target=\\"_blank\\">welcome page here</a></ins>.</p>\n<h3><a id=\\"Accelerating_Adoption_of_Amazon_Web_Services_OpenSource_Observability_Services_212\\"></a><strong>Accelerating Adoption of Amazon Web Services Open-Source Observability Services</strong></h3>\\n<h3><a id=\\"October_20th_9am_PT_213\\"></a>October 20th, 9am PT</h3>\\n<p>Join this online tech talk to learn how you can leverage Amazon Web Services managed open-source observability solutions to monitor your containerised or serverless workloads at scale. Unlock observability functionalities in Amazon Managed Service for Prometheus, Amazon Managed Grafana, and Amazon Web Services Distro for OpenTelemetry and learn how our managed solutions can help you improve MTTD and reduce MTTR, saving you time and money. We’ll demo the Amazon Elastic Kubernetes Service Observability Accelerator and also share what’s new and upcoming in Amazon Web Services Open-Source Observability.</p>\n<p>Find out more and <ins><a href=\\"https://aws-oss.beachgeek.co.uk/22u\\" target=\\"_blank\\">register via this link</a></ins>.</p>\n<h3><a id=\\"Build_on_Amazon_Web_Services_Open_Source_220\\"></a><strong>Build on Amazon Web Services Open Source</strong></h3>\\n<h3><a id=\\"October_21st_9am_BST_221\\"></a><strong>October 21st, 9am BST</strong></h3>\\n<p>Join us for the fifth episode of the Build on Amazon Web Services series, featuring a live round up of the latest projects and news as well as a special guest speaker. We have another special guest lined up, more details to follow. Follow the show on @buildonopen for more details. Check it out on <ins><a href=\\"https://twitch.tv/aws\\" target=\\"_blank\\">https://twitch.tv/aws</a></ins></p>\n<h3><a id=\\"KubeCon_and_CloudNativeCon_North_America_225\\"></a><strong>KubeCon and CloudNativeCon North America</strong></h3>\\n<h3><a id=\\"October_24th28th_Detroit_USA_226\\"></a><strong>October 24th-28th, Detroit USA</strong></h3>\\n<p>Check out this blog post from Nathan Taber, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/243\\" target=\\"_blank\\">Amazon Web Services at KubeCon + CloudNativeCon North America 2022</a></ins> to hear more about what you can expect from Amazon Web Services at this event, including Container Day. If you are going check this post out to see how you can reserve a spot to speak with one of the Amazon Web Services specialists who will be at the booth.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/e31be801ad6e404cb6d308354be74b40_Fe4LAcZWYAEtoMh%20format%3Djpg%26name%3Dsmall.jpg\\" alt=\\"Fe4LAcZWYAEtoMh format=jpgname=small.jpg\\" /></p>\n<p>If you are attending KubeCon, make sure you do not miss the legendary Open Source After Dark party. You can expect lots of fun activities, great food, music and lots more. Make sure you register to save your spot, as spaces will be limited. Register and relax in the comfort of having your place saved <ins><a href=\\"https://aws-oss.beachgeek.co.uk/251\\" target=\\"_blank\\">by heading over to this page</a></ins>.</p>\n<h3><a id=\\"Whats_new_in_Amazon_Aurora_MySQL_version_3October_25th_9am_PT_234\\"></a><strong>What’s new in Amazon Aurora MySQL version 3October 25th, 9am PT</strong></h3>\\n<p>Amazon Aurora MySQL version 3 compatible with MySQL 8.0, is the latest version of Aurora MySQL. Come learn what makes this the best version of Aurora MySQL to run your relational database workloads. You will learn about the latest innovations in Aurora MySQL version 3 and MySQL 8.0. You will also be introduced to important and breaking behavioural changes in the new version. We will discuss the new version currency adopted with Aurora MySQL version 3 and ways to upgrade from older versions. There will also be a demo of new features like Aurora Serverless v2.</p>\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/22x\\" target=\\"_blank\\">Save your place on this online event by checking out the registration page here</a></ins>.</p>\n<h3><a id=\\"Amazon_Web_Services_Elastic_Kubernetes_Service_EKS_Workshop_240\\"></a><strong>Amazon Web Services Elastic Kubernetes Service (EKS) Workshop</strong></h3>\\n<h3><a id=\\"November_10th_London_5pm_241\\"></a><strong>November 10th, London 5pm</strong></h3>\\n<p>Join us for an interactive workshop on containers, Docker, Fargate and Amazon EKS, hosted by ClearScale and Amazon Web Services. This live, virtual workshop includes three hours of interactive presentation and hands-on lab work. You will take part in the setup and deployment of containers using EKS. Follow along and work directly with Amazon Web Services professionals and ClearScale (an Amazon Web Services Premier Tier Services Partner) in this Level 200 training session.</p>\n<p>You can find out more about this event by <ins><a href=\\"https://aws-oss.beachgeek.co.uk/22y\\" target=\\"_blank\\">checking out the event page and signing up</a></ins>.</p>\n<h3><a id=\\"OpenSearch_247\\"></a><strong>OpenSearch</strong></h3>\\n<h3><a id=\\"Every_other_Tuesday_3pm_GMT_248\\"></a><strong>Every other Tuesday, 3pm GMT</strong></h3>\\n<p>This regular meet-up is for anyone interested in OpenSearch &amp; Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.</p>\n<p>Sign up to the next session, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/1az\\" target=\\"_blank\\">OpenSearch Community Meeting</a></ins></p>\n<h3><a id=\\"Stay_in_touch_with_open_source_at_Amazon_Web_Services_254\\"></a><strong>Stay in touch with open source at Amazon Web Services</strong></h3>\\n<p>I hope this summary has been useful. Remember to check out the <ins><a href=\\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\\" target=\\"_blank\\">Open Source homepage</a></ins> to keep up to date with all our activity in open source by following us on <ins><a href=\\"https://twitter.com/AWSOpen\\" target=\\"_blank\\">@AWSOpen</a></ins></p>\n"}